Data Engineer with Azure

<p><strong>Job Description</strong> </p>
<p><strong>Must Have</strong> </p>
<ul><li>Python programming (Advance) </li></ul>
<ul><li>Various Data Matching Algorithms (String Similarity based, distance-based, phonetics algorithm) </li></ul>
<ul><li>Basic Graph DB / Vector DB knowledge </li></ul>
<ul><li>ML-based solution approach to define/ refine data matching criteria </li></ul>
<ul><li>Azure platform ( Databricks / Fabric / OpenAI etc.) </li></ul>
<p><strong>Good To Have</strong> </p>
<ul><li>API programming (FastAPI or Flask) </li></ul>
<ul><li>We have a need for two Azure data engineers for a master data project. One person should be a senior lead engineer almost at architect level and second could be mid to senior engineer. </li></ul>
<ul><li>The project requires data acquisition into Azure, creating data pipelines, normalize JSON data into relational format. </li></ul>
<ul><li>Model and design table structures </li></ul>
<ul><li>Analyze data and identify relationships, </li></ul>
<ul><li>Match the data with another dataset to find patterns and relationship </li></ul>
<ul><li>Create combined datasets by using various matching and merging techniques and logics </li></ul>
<ul><li>Build APIs to search the data </li></ul>
<ul><li>Build lightweight UI to enable search functionality for users </li></ul>
<ul><li>Main idea is we need self starter who can work independently and figure out the solution on their own, work with client team, discuss and modify accordingly. </li></ul>