Job Description

Job Description Key Responsibilities: Develop and maintain data processing pipelines, data lakes, and data warehouses. Implement ETL workflows using Spark and Python. Handle large-scale data loads, feature extraction, and data processing in near real-time, batch, and real-time modes. Ensure data quality and accuracy through robust practices. Build and deploy machine learning models in a production environment. Perform data preprocessing, feature engineering, and model engineering as needed. Work with Python deep learning libraries such as PyTorch, TensorFlow, and Keras. Integrate with various data stores, including SQL/NoSQL databases, in-memory stores like Redis, and data lakes (e.g., Delta Lake). Utilize Databricks or similar data lake/data platform technologies. Collaborate with cross-functional teams to understand and implement architectural patterns and best practices. Stay updated with the latest technologies and approaches, and adapt quickly to new tools and method We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form ( . The EEOC "Know Your Rights" Poster is available here ( . To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: . Skills and Requirements Required Skills & Experience: 5+ years of experience in heavy volume data processing, data platforms, data lakes, big data, data warehouses, or equivalent. 5+ years of strong proficiency in Python, Scala, and Spark 3+ years of hands-on experience in ETL workflows using Spark and Python. 3+ years of experience with large-scale data loads, feature extraction, and data processing pipelines in different modes near real-time, batch, real-time. Solid understanding of data quality and accuracy concepts and practices. 2+ years of experience in building and deploying ML models in a production setup. 2+ years of experience with Python deep learning libraries like PyTorch, TensorFlow, Keras. Prior experience working with LLMs and transformers. Experience integrating with various data stores, including SQL/NoSQL databases, in-memory stores like Redis, and data lakes (e.g., Delta Lake). Experience with Databricks or similar data lake/data platform. Familiarity with notebook-based environments such as Jupyter Notebook. Adaptability and willingness to learn new technologies and approaches. Initiative and ability to take ownership of tasks, learn independently, and innovate. Preferred Skills: Ability to pivot from conventional approaches and develop creative solutions. Experience with Java and Spring Boot. null We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to HR@insightglobal.com.

Job Tags

Similar Jobs