AC
What kind of model and what kind of microcontroller?
Size: a a a
2020 November 05
EN
Hi All , Can you help me in Automatic short answer grading please ?
EN
i think to use a transformer model that based on attention but i dont know how ?
2020 November 06
SP
Всем привет! А есть ли у кого удачные примеры/опыт квантизации sqad от DeepPavlov? И вообще уменьшения веса deep pavlov моделей?
E
Всем привет!
Поделитесь, пожалуйста, вариантами решения задачи insult detection на русском языке. Есть ли готовые инструменты/библиотеки? Если нет, может, есть на примете подходящий датасет?
Более общий вопрос: насколько хорошо будет работать сеть, если обучить её на *переводном* датасете (взять датасет с kaggle'а на английском, перевести на русский и обучить)? Или перевод будет недостаточно адекватным для данной задачи?
Поделитесь, пожалуйста, вариантами решения задачи insult detection на русском языке. Есть ли готовые инструменты/библиотеки? Если нет, может, есть на примете подходящий датасет?
Более общий вопрос: насколько хорошо будет работать сеть, если обучить её на *переводном* датасете (взять датасет с kaggle'а на английском, перевести на русский и обучить)? Или перевод будет недостаточно адекватным для данной задачи?
DK
Добрый день, как называется профессия. Когда есть задача от бизнеса, нужно добыть и исследовать данные, почистить, посчитать, придумать и обучить нейросеть, протестировать, запустить в прод?
NS
Dmitri Kapustin
Добрый день, как называется профессия. Когда есть задача от бизнеса, нужно добыть и исследовать данные, почистить, посчитать, придумать и обучить нейросеть, протестировать, запустить в прод?
Ml engineer вроде как
DK
🙏 Спасибо!
YB
Dmitri Kapustin
Добрый день, как называется профессия. Когда есть задача от бизнеса, нужно добыть и исследовать данные, почистить, посчитать, придумать и обучить нейросеть, протестировать, запустить в прод?
Я бы data scientist назвал наверное тоже.
What is a Data Scientist
Data scientists are big data wranglers, gathering and analyzing large sets of structured and unstructured data. A data scientist’s role combines computer science, statistics, and mathematics. They analyze, process, and model data then interpret the results to create actionable plans for companies and other organizations.
Data scientists are analytical experts who utilize their skills in both technology and social science to find trends and manage data. They use industry knowledge, contextual understanding, skepticism of existing assumptions – to uncover solutions to business challenges.
A data scientist’s work typically involves making sense of messy, unstructured data, from sources such as smart devices, social media feeds, and emails that don’t neatly fit into a database.
What is a Data Scientist
Data scientists are big data wranglers, gathering and analyzing large sets of structured and unstructured data. A data scientist’s role combines computer science, statistics, and mathematics. They analyze, process, and model data then interpret the results to create actionable plans for companies and other organizations.
Data scientists are analytical experts who utilize their skills in both technology and social science to find trends and manage data. They use industry knowledge, contextual understanding, skepticism of existing assumptions – to uncover solutions to business challenges.
A data scientist’s work typically involves making sense of messy, unstructured data, from sources such as smart devices, social media feeds, and emails that don’t neatly fit into a database.
DK
Я бы data scientist назвал наверное тоже.
What is a Data Scientist
Data scientists are big data wranglers, gathering and analyzing large sets of structured and unstructured data. A data scientist’s role combines computer science, statistics, and mathematics. They analyze, process, and model data then interpret the results to create actionable plans for companies and other organizations.
Data scientists are analytical experts who utilize their skills in both technology and social science to find trends and manage data. They use industry knowledge, contextual understanding, skepticism of existing assumptions – to uncover solutions to business challenges.
A data scientist’s work typically involves making sense of messy, unstructured data, from sources such as smart devices, social media feeds, and emails that don’t neatly fit into a database.
What is a Data Scientist
Data scientists are big data wranglers, gathering and analyzing large sets of structured and unstructured data. A data scientist’s role combines computer science, statistics, and mathematics. They analyze, process, and model data then interpret the results to create actionable plans for companies and other organizations.
Data scientists are analytical experts who utilize their skills in both technology and social science to find trends and manage data. They use industry knowledge, contextual understanding, skepticism of existing assumptions – to uncover solutions to business challenges.
A data scientist’s work typically involves making sense of messy, unstructured data, from sources such as smart devices, social media feeds, and emails that don’t neatly fit into a database.
Full stack data scientist :)
NS
Ни каждый ds может настроить веб сервис на поток выгрузки данных или же даже просто поднять тот же flask.
Тут рассказывает кто такой ml engineer
https://youtu.be/7bUYEMZVMCE
Тут рассказывает кто такой ml engineer
https://youtu.be/7bUYEMZVMCE
OA
What kind of model and what kind of microcontroller?
Its a QA model, I'm building a virtual assistant like Siri
I dont know the type of microcontroller I can use for it
I dont know the type of microcontroller I can use for it
SL
Its a QA model, I'm building a virtual assistant like Siri
I dont know the type of microcontroller I can use for it
I dont know the type of microcontroller I can use for it
may be you need smth with more power, like raspberry PI or dunno intel Nuke? or new stuff from nvidia with specific hardware for nn (basically there were some alternatives for that)
SL
Its a QA model, I'm building a virtual assistant like Siri
I dont know the type of microcontroller I can use for it
I dont know the type of microcontroller I can use for it
speaking about a microcontrollers only. If you have smth really simple it goes ok, because almost chip micros has very small resources and has implementation limits. the next lvl is a kind of small portable pc (or processor), as raspberry or may be mobile phones processors for example (because they are powerful and chip enougth even for launching deep networks like CNN).
If your question is about hardware. The exception from the rule are processors in mobile phones for example, because they are powerfull enough for now.
hope it helps)
If your question is about hardware. The exception from the rule are processors in mobile phones for example, because they are powerfull enough for now.
hope it helps)
IJ
@iRioxe do you think STM32 would not be enough for self-wrote nn? i saw them on TensorFlow support list https://www.tensorflow.org/lite/microcontrollers
SL
@iRioxe do you think STM32 would not be enough for self-wrote nn? i saw them on TensorFlow support list https://www.tensorflow.org/lite/microcontrollers
hm.. dunno, have never played with that before. may be its better to ask tf-community for more broad details if it's important.
but for some tasks it works, because there is smth like this:
https://www.digikey.com/en/maker/projects/tinyml-getting-started-with-tensorflow-lite-for-microcontrollers/c0cdd850f5004b098d263400aa294023
so seems like even smth simple shall work if they have good support
but for some tasks it works, because there is smth like this:
https://www.digikey.com/en/maker/projects/tinyml-getting-started-with-tensorflow-lite-for-microcontrollers/c0cdd850f5004b098d263400aa294023
so seems like even smth simple shall work if they have good support
M
Добрый день!
Я использую NER для английского языка из SpaCy из коробки - en_core_web_lg. Мне хотелось бы выделять организации и имена из текста, но мне важнее recall, чем precision. На тестовом корпусе у меня Recall=86. Есть ли возможность в spacy поменять порог уверенности, чтобы получить больше 90? В Гугле нашел только вариант с beam_search, но как я понял это не совсем то и замедляет работу.
Я использую NER для английского языка из SpaCy из коробки - en_core_web_lg. Мне хотелось бы выделять организации и имена из текста, но мне важнее recall, чем precision. На тестовом корпусе у меня Recall=86. Есть ли возможность в spacy поменять порог уверенности, чтобы получить больше 90? В Гугле нашел только вариант с beam_search, но как я понял это не совсем то и замедляет работу.
OA
speaking about a microcontrollers only. If you have smth really simple it goes ok, because almost chip micros has very small resources and has implementation limits. the next lvl is a kind of small portable pc (or processor), as raspberry or may be mobile phones processors for example (because they are powerful and chip enougth even for launching deep networks like CNN).
If your question is about hardware. The exception from the rule are processors in mobile phones for example, because they are powerfull enough for now.
hope it helps)
If your question is about hardware. The exception from the rule are processors in mobile phones for example, because they are powerfull enough for now.
hope it helps)
Oh
I get, thanks so much for this
I get, thanks so much for this
SL
Oh
I get, thanks so much for this
I get, thanks so much for this
welcome)
SD
Oh
I get, thanks so much for this
I get, thanks so much for this
You may want to read about Knowledge Distillation, it is often used to transfer models to small devices.