Data Engineer
Cluj, RO Iasi, RO Brasov, RO Bucuresti, RO Sibiu, RO Remote, RO Timisoara, RO
Who we are
Our client is a leading payment system company specializing in designing and building real-time, account-based payment infrastructures, applications, and services. They are committed to innovation and excellence, constantly driving the evolution of payment solutions in a dynamic and growing industry.
We are seeking a highly skilled Data Engineer to enhance our data and analytics environments. The successful candidate will play a pivotal role in designing, developing, and managing data solutions that leverage cloud technologies and big data frameworks. This role will involve creating efficient data pipelines, optimizing data storage solutions, and implementing robust data processing workflows to ensure high-quality data availability for analytics and business intelligence.
What you'll be doing
- Create and manage ETL processes using Azure Data Factory to automate data flow between various systems and services
- Implement data storage solutions using Azure Data Lake and Cosmos DB, ensuring high availability and scalability
- Design and optimize data processes in Databricks, implementing Spark jobs that utilize Delta Lake for efficient data handling and versioning
- Build and maintain analytics models that can harness the capabilities of Delta Lake for better data quality and performance
- Develop scripts in Python and PowerShell to automate operational tasks, deployments, and monitoring of data workflows
- Collaborate with development teams to integrate CI/CD practices using Azure DevOps and Git for version control
- Manage and optimize MS SQL Server databases, writing efficient T-SQL queries for data manipulation and reporting
- Ensure data integrity and security through proper database management practices
- Implement logging and monitoring solutions to proactively address any issues impacting data applications and workflows
- Conduct root cause analysis on data-related problems and develop solutions to mitigate future occurrences
- Collaborate with business intelligence teams to create and share reports using Power BI
- Provide insights and recommendations based on data analysis to guide business decisions
What you'll bring along
- Minimum of 3-5 years of experience in a similar role
- Proficiency in Python for data processing and automation
- Experience with PowerShell scripting and Azure Data Factory
- Strong understanding of MS SQL Server and T-SQL for database scripting
- Familiarity with Databricks, Delta Lake, Azure Data Lake, and Cosmos DB
- Experience with version control using Git and CI/CD frameworks in Azure DevOps
- Solid problem-solving skills and ability to troubleshoot complex data issues
- Familiarity with DevOps methodologies including Scrum and Agile practices for software development
- Preferred Skills: Experience creating dashboards and reports using Power BI and Knowledge of data governance and data security best practices.
- Bachelor’s degree in Computer Science, Information Technology, or a related field is preferred
What’s in it for you
✔ New beginnings can be a challenge. We promise a smooth integration and a supportive mentor
✔ Pick your working style: choose from Remote, Hybrid or Office work opportunities
✔ Early bird or night owl? Our projects have different working hours to suit your needs
✔ Nobody is born an expert. Sharpen your tech skills with our sponsored certifications, trainings and top e-learning platforms
✔ We want you to stay healthy! Enjoy our Private Health Insurance – it’s custom-made for you
✔ A clear mind is a healthy mind. Attend individual coaching sessions or go one step further by joining our accredited Coaching School
✔ Make the most of our epic parties or themed events – they’re lovingly designed for our people and their families
NTT DATA Romania is an equal opportunity employer and considers all applicants regardless to race, color, religion, citizenship, national origin, ancestry, age, sex, sexual orientation, gender identity, genetic information, physical or mental disability, veteran or marital status, or any other characteristic protected by law. We are committed to creating a diverse and inclusive environment for all employees.
Not the job for you? Perhaps you have a friend who would be a perfect fit. Send them this link!
Job Segment:
Database, SQL, Business Intelligence, Data Analyst, Cloud, Technology, Data