Data Engineer (Azure Databricks)

Other Jobs To Apply

No other job posts for this day.

Miratech helps visionaries change the world. We are a global IT services and consulting company that brings together enterprise and start-up innovation. Today, we support digital transformation for some of the world's largest enterprises.

By partnering with both large and small players, we stay at the leading edge of technology, remain nimble even as a global leader, and create technology that helps our clients further enhance their business. We are a values-driven organization and our culture of Relentless Performance has enabled over 99% of Miratech's engagements to succeed by meeting or exceeding our scope, schedule, and/or budget objectives since our inception in 1989.

Miratech has coverage across 5 continents and operates in over 25 countries around the world. Miratech retains nearly 1000 full-time professionals, and our annual growth rate exceeds 25%.

Job Description

We are looking for a  Mid-Senior Data Engineer specialized in Azure Databricks  to join our data platform team.

The candidate will design and develop modern data pipelines and Lakehouse architectures, leveraging Azure Databricks, Spark, and Azure Data Factory, while integrating with existing SQL Server-based data warehouse environments, also evolving our data platform towards scalable, cloud-based data architectures, enabling advanced analytics and business intelligence.

Key responsibilities:

  • Design, develop, and maintain data pipelines using Azure Databricks
  • Build and optimize data transformations using PySpark and SQL in Databricks
  • Implement and maintain Lakehouse architectures using Delta Lake
  • Develop ETL/ELT pipelines orchestrated through Azure Data Factory
  • Integrate data from multiple sources into the data platform and analytical layers
  • Design and maintain data models and data warehouse structures for analytics
  • Ensure data quality, scalability, and performance of large-scale data processing pipelines
  • Collaborate with BI teams to support Power BI and reporting platforms
  • Support and evolve existing SQL Server data platforms and ETL solutions (SSIS) when required
  • Contribute to the design of modern cloud-based data architectures

Qualifications

  • 3+ years of experience  in Data Engineering or Data Warehouse development
  • Strong experience with  Azure Databricks
  • Experience developing  data pipelines using PySpark and Spark SQL
  • Solid understanding of distributed data processing and big data concepts
  • Experience working with  Delta Lake and Lakehouse architectures
  • Strong SQL skills and experience with  SQL Server  relational databases
  • Experience building data pipelines using  Azure Data Factory
  • Experience handling large datasets and performance optimization
Nice to have
  • Experience with Spark optimization techniques (partitioning, caching, cluster tuning)
  • Experience with structured streaming in Databricks
  • Knowledge of CI/CD pipelines for data platforms (Azure Devops)
  • Familiarity with Power BI
  • Experience in migrating from traditional ETL process to cloud architectures 
Soft Skills
  • Strong analytical and problem-solving skills.
  • Ability to work in collaborative environments and to adapt
  • Committed to continuous learning and professional development, with a keen focus on advancing cloud computing expertise
  • Team player
  • Good communication skills with technical and non-technical roles
  • Is proactive rather than reactive, actively identifying improvements and proposing solutions
  • Is comfortable working in dynamic environments where priorities and technologies evolve

Additional Information

We offer:

  • Culture of Relentless Performance:  join an unstoppable technology development team with a 99% project success rate and more than 30% year-over-year revenue growth.
  • Competitive Pay and Benefits:  enjoy a comprehensive compensation and benefits package, including health insurance, and a relocation program.
  • Work From Anywhere Culture:  make the most of the flexibility that comes with remote work.
  • Growth Mindset : reap the benefits of a range of professional development opportunities, including certification programs, mentorship and talent investment programs, internal mobility and internship opportunities.
  • Global Impact:  collaborate on impactful projects for top global clients and shape the future of industries.
  • Welcoming Multicultura
Back to blog

Common Interview Questions And Answers

1. HOW DO YOU PLAN YOUR DAY?

This is what this question poses: When do you focus and start working seriously? What are the hours you work optimally? Are you a night owl? A morning bird? Remote teams can be made up of people working on different shifts and around the world, so you won't necessarily be stuck in the 9-5 schedule if it's not for you...

2. HOW DO YOU USE THE DIFFERENT COMMUNICATION TOOLS IN DIFFERENT SITUATIONS?

When you're working on a remote team, there's no way to chat in the hallway between meetings or catch up on the latest project during an office carpool. Therefore, virtual communication will be absolutely essential to get your work done...

3. WHAT IS "WORKING REMOTE" REALLY FOR YOU?

Many people want to work remotely because of the flexibility it allows. You can work anywhere and at any time of the day...

4. WHAT DO YOU NEED IN YOUR PHYSICAL WORKSPACE TO SUCCEED IN YOUR WORK?

With this question, companies are looking to see what equipment they may need to provide you with and to verify how aware you are of what remote working could mean for you physically and logistically...

5. HOW DO YOU PROCESS INFORMATION?

Several years ago, I was working in a team to plan a big event. My supervisor made us all work as a team before the big day. One of our activities has been to find out how each of us processes information...

6. HOW DO YOU MANAGE THE CALENDAR AND THE PROGRAM? WHICH APPLICATIONS / SYSTEM DO YOU USE?

Or you may receive even more specific questions, such as: What's on your calendar? Do you plan blocks of time to do certain types of work? Do you have an open calendar that everyone can see?...

7. HOW DO YOU ORGANIZE FILES, LINKS, AND TABS ON YOUR COMPUTER?

Just like your schedule, how you track files and other information is very important. After all, everything is digital!...

8. HOW TO PRIORITIZE WORK?

The day I watched Marie Forleo's film separating the important from the urgent, my life changed. Not all remote jobs start fast, but most of them are...

9. HOW DO YOU PREPARE FOR A MEETING AND PREPARE A MEETING? WHAT DO YOU SEE HAPPENING DURING THE MEETING?

Just as communication is essential when working remotely, so is organization. Because you won't have those opportunities in the elevator or a casual conversation in the lunchroom, you should take advantage of the little time you have in a video or phone conference...

10. HOW DO YOU USE TECHNOLOGY ON A DAILY BASIS, IN YOUR WORK AND FOR YOUR PLEASURE?

This is a great question because it shows your comfort level with technology, which is very important for a remote worker because you will be working with technology over time...