Robotic Process Automation and AI Technology

Robotic process automation (or RPA) is a form of business process automation technology based on metaphorical software robots (bots) or artificial intelligence (AI) workers.

Introduction to Robotic Process Automation (RPA) and AI :

Robotic Process Automation:

Robotic Process Automation is the technology that allows anyone today to configure computer software, or a “robot” to emulate and integrate the actions of a human interacting within digital systems to execute a business process. RPA robots utilize the user interface to capture data and manipulate applications just like humans do. They interpret, trigger responses and communicate with other systems in order to perform on a vast variety of repetitive tasks. Only substantially better: an RPA software robot never sleeps and makes zero mistakes.

Artificial Intelligence (AI):

Artificial Intelligence (AI) is combination of technology and cognitive intelligence for simulation, processing of information and knowledge to build capability in a machine to imitate human behaviour. It is a transformative technology that has tremendous applications in the social, economic and military fields. Till some time back we had robots operated by a human or through a set of programming to perform repetitive task. The technology is already present in many sectors of economy, such as mapping technologies, hand writing recognition for mail delivery, financial trading, surveillance, target acquisition, smart vehicles, ammunition, and robots performing numerous industrial, medical and military tasks.

List of Contents :

  1. AI-based sensor data processing for decision support
  2. AI-RPA Test Jigs
  3. AI-RPA Based Autonomous_Mobile_Platform
  4. AI-RPA Engineered Solutions

AI-based sensor data processing for decision support

1.1. Localization sensors- Integrated GNSS/INS

Highly integrated GNSS/INS high-precision navigation system that adopts the absolute accuracy of GNSS positioning and the stability of Inertial Measurement Unit (IMU) gyro and accelerometer measurements are tightly coupled to provide real-time navigation results such as centimeter position, velocity, and 3D attitude etc.

Features:

  • Tightly coupled GNSS+INS navigation engine
  • Built-in high precision positioning and heading board
  • Built-in IMU module
  • Enhanced connection options including serial, CAN and Ethernet
  • Multi-vector RTK positioning engine
  • All-constellation, multi-frequency RTK positioning solution
  • Support modern signal systems such as BD-3 and Galileo
  • Support GNSS/IMU raw Measurements and post processing
  • Low latency

1.2. Perception sensors

A. 2D/3D LiDAR

TF-Luna is a single-point ranging LiDAR, based on the TOF principle. With unique optical and electrical design, it can achieve stable, accurate and highly sensitive range measurement. Solid State 3D LIDAR Wide FOV LiDAR Sensor is a solid-state infrared LiDAR which is developed based on the ToF principle. Equipped with its special hardware design, it could complete the measurement of wide horizontal FOV and output the grey and depth information at the same time.

2D LiDAR Features :

  • Operating Range is up to 8m
  • Distance Resolution = 1cm
  • Power Consumption≤0.35W
  • Frame Rate: 1-250Hz(Default 100Hz)
  • FOV: 2°
  • Weight: <=5g

3D LiDAR Features:

  • Model: CE30-A
  • Detecting Range:0.1~4m
  • Pixel Resolution:320 x 24
  • Ranging Resolution:1cm
  • Repeatability:≤3cm
  • Accuracy:≤5cm

B. RADAR

The Universal Medium Range Radar (UMRR) sensor family measures positions and speed of multiple targets simultaneously with high accuracy and short measurement cycles. The sensor platform is flexible and works under adverse weather or light conditions. The sensors operate in the 24 GHz ISM band and have been certified worldwide. Software parameters, bandwidths, or antenna patterns can be optimized for use in multiple sensor applications.

Features

  • Transmit Frequency 24.000 GHz to 24.250 GHz; ISM band
  • Power Adjust Range 16.0 dB
  • Sensor Communication CAN Bus, RS485, 10/100M Ethernet, or 802.11b,g
  • Sensors per sub-network up to 9 (without central unit)
  • Objects Tracked (per sensor) up to 32
  • Measurement Cycle Time 30 to 120 msec
  • Range Measurement Accuracy < 2.5%
  • Angle Measurement Accuracy < 0.5 deg
  • Speed Measurement Accuracy < 0.16 mph
  • Power Supply < 3.5 W @ 7 to 32 V
  • Operating Temperature -40 to +95°C

C. EO/IR/Thermal/Depth cameras

The Basler scout family is based on a selection of the best Sony CCD sensors and offers a wide variety of resolutions and speeds. The family also includes a high-performance CMOS sensor from Micron. With their new Gigabit Ethernet (GigE) and FireWire-b™ (IEEE 1394b) interface technologies, the cameras in this family are defined by state of the art technology that lets you get the maximum performance from each sensor.

Features

  • Resolutions from VGA to 2 megapixels with either a FireWire-b or a Gigabit Ethernet interface
  • 100-meter cable lengths provided by Gigabit Ethernet to give you the highest flexibility
  • Up to 12-bit depths and no bandwidth limitation on 8 bit data flow inside the camera
  • Free drivers for FireWire and Gigabit Ethernet (GigE Vision™)
  • Small, rugged housing for easy integration
  • Compatible with the newest vision industry standards including GenICam, GigE Vision, and EMVA 1288
  • 100% quality checked and calibrated to give you consistent performance and reliability

D. Laser Measurement System

Our non-contact Laser Measurement System (LMS) can be used for standard applications involving measurement of objects and position determination, monitoring areas, vehicle guidance and collision control. The fundamental ability of LMS is to offer accurate distance measurement throughout the 180° scanning field. Within this field, the LMS can be programmed to monitor multiple zones. These zones can then be assigned to solid state outputs of the LMS. Beyond this simple mode of operation the LMS will transmit all 180 measurements via a high speed RS 422 serial port. The Host system can then use this data for specific applications.

LMS measurements are based on time of- flight measurement. The LMS calculates the distance to the object using the time of flight of pulsed light; i.e. the length of time between sending and receiving the beam of light.

Features

  • 180° coverage
  • Indoor applications
  • High measurement resolution (10 mm resolution)
  • Contact-free measurement
  • Target objects require no reflectors or markings
  • High scanning frequency (up to 75 Hz)
  • Transfer of measurement data in real time
  • Active system, no illumination of target objects necessary
  • Measurements possible over long distance (up to 80 m)
  • Compact device construction
  • Three internally programmable monitoring fields assigned to three switching outputs

E. SWIR Situational Sensor system

Fuzor enhances situational awareness for pilots in darkness, smoke, haze, rain, fog and other hazardous situations. It is a multi-band fusion system consisting of two line replaceable units mounted on ground or aerial vehicles. Extended dynamic range and depth of field enhance the clarity and precision of the image while highlighting details that would typically not be visible to the naked eye. The sensor package consists of a Long Wave IR camera and a combination of Electro Optical (EO)/Short Wave IR SWIR (optional) imagers. The LWIR senses radiation in the 7.5–14 µm bands. It can image background scenery, terrain features and obstacles at night and in other low visibility conditions. The processing unit is a ruggedized platform equipped with intelligent software that fuses imagery from the multi-band sensors into one common easy to interpret video feed.

AI-RPA Test Jigs

We design & manufacture customized laboratory & production testing systems -

2.1. Mechanical Testing

  • Durability / Endurance Testing Machines - Static & Dynamic Loading of structures & components (Single Actuator / Multiple Actuators to simulate all loads acting on a component)
  • Fatigue Testing Systems - Upto 25KN Servo Hydraulic / Servo-Electric / Pneumatic Systems for Static & Dynamic Testing
  • Tension & Compression Testing for materials upto 25KN
  • Torsion Testing Systems - Upto 500Nm
  • Axial-Torsional / Multiple Actuator Testing Systems
  • Automated Testing Systems - Robots / X-Y Stages / Customized Mechanical Fixtures used for Automated Testing of products & components

2.2. Electrical & Electronics Testing

  • Durability Testing Systems for Electrical & Electronic Products (Measurement & Simulation of various electrical parameters)
  • Laboratory electrical testing machines customized as per the component to validate the product life cycle
  • High Voltage Testing Systems (Online Measurement & Analysis of High Voltage Waveforms / High Voltage Breakdown Testing Systems)
  • Automated Testing Systems - Robotic Testing / Customized Automated Design & Production Level Testing for Electrical & Electronic Products
  • End of Production Line Functionality Testing Systems - Power Circuit Parameters & Component Load Testing , Simulate Presence of Peripheral devices, Communication Protocol Testing (CAN, UART, RS485, RS232, Ethernet, Wireless), Electronic Circuit Functionality Simulation

2.3. Assembly Line Automation & Testing

  • Customized Assembly & Testing machines designed as per the component (Automatic Fitment, Torqueing, Greasing, Load / Torque Application & Measurement)
  • Automated End of Line Testing & Inspection Fixtures for Mechanical Assemblies

Durability Test Rigs

These are extremely robust testing machines developed in house by Task for a variety of applications as demanded by the industry. They can range from fatigue testing to structural testing to robotic testing for Electro-mechanical components such as automotive switches, electronic testing machines with a completely automated computerized interface which generates reports and readings as per the requirement of the user.

I. Some of the different testing machine applications are mentioned below:-

  • Mechanical Testing machines for Durability, Structural and Fatigue testing
  • Testing Machines for Electronics
  • Automated Robotic Testing Machines for Electro-mechanical Components such as Automotive Switches
  • Automated Testing machines to inspect fixtures
  • Quality Control Machines at the end of line
  • Lifecycle Testing Machines

II. Some of the different processes involved in the development of these machines are:-

1. Manufacturing and Assembly of Different components

  • Detailed mechanical design depending upon the nature of testing and the component
  • Design and manufacturing of Adjustable, removable fixture for mounting of mechanical component on testbed
  • Design of Automated mounting of component
  • Pneumatic and Hydraulic Actuators
  • Selection of Electrical motors (Servo / Induction)

2. Instrumentation Design

  • Selection of Displacement Sensors (LVDT, Cable Pull Encoder, Rotary Encoder)
  • Selection of Fatigue Rated Load Cells (Pancake, Rod End, Beam Type)
  • Selection of Torque Sensors
  • Selection of Pressure Measurement Sensors
  • Implementation of Vision Inspection & Measurement Systems

3. Machine Control / Automation Control

  • Implementation of Programmable Control System (PLC) on unit
  • Control of Pneumatic & Hydraulic Actuators
  • Control of Induction Motors / Servo Motors
  • Control of Multi Axis Robotic Arms & Grippers

4. Testing & Measurement Software

  • Customized Measurement & Control Screens according to customer
  • Programmable Setup Screen (Test Plan, Cycle Setup)
  • Customer oriented Data Analysis Screens / Statistical Process Control
  • Instrument Calibration Screens for calibration

AI-RPA Based Autonomous_Mobile_Platform

Autonomous navigation system it provides an autonomous ‘natural feature navigation’ system for compact vehicles, calculating its position, driving the vehicle, interfacing with the vehicle’s safety sensors and handling mission management (i.e. start here, go there, wait for the door to be opened etc.).

The product provides the most standard and reliable interfaces combined with a set of I/Os to enable the automation of typical forklifts and AGVs.

Features:

  • Complete navigation solution
  • Simple and robust localization
  • Optimal control of the vehicle
  • No inductive wires, magnets, triangulation reflectors
  • Use of safety laser scanners
  • Embedded management of missions
  • Compatible with hybrid manual/automatic use
  • Compatible with servers

Applications:

  • Unmanned Aircraft and Vehicle system in Defenses
  • Autonomous monitoring units for Power and process industries
  • Autonomous vehicles for Packing and shipping services
  • Autonomous Health monitoring robots for pandemic health monitoring i.e. COVID 19
  • Autonomous sensing, modeling, decision-making, and control in uncertain, dynamic environments.

AI-RPA Engineered Solutions

4.1. Rugged embedded computers

Nuvo-7164GC is a rugged edge AI inference platform designed for advanced inference acceleration applications such as voice, video, image and recommendation services. It supports NVIDIA Tesla P4 GPU, featuring 5.5 TFLOPS in FP32 and Tesla T4 GPU, featuring 8.1 TFLOPS in FP32 and 130 TOPs in INT8 for real-time inference based on trained neural network model. In addition, it supports Intel 9th/ 8th-Gen Coffee Lake Core 8/ 6-core CPU and 32 GB DDR4-2666, offering great balance between CPU, GPU and memory performance.

Features:

  • Supports NVIDIA Tesla P4/ T4 GPU
  • Dedicated heat dissipation for -25°C to 60°C wide-temperature range operation
  • Intel 9th/ 8th-Gen Core hexa-core 35W/ 65W LGA1151 CPU
  • 6x GigE ports, 802.3at PoE+ option available (ports 3~6)
  • M.2 2280 M key NVMe (Gen3 x4) socket for fast storage access
  • 4x USB 3.1 Gen2 ports and 4x USB 3.1 Gen1 ports
  • Accommodates two 2.5" SATA HDD/SSD with RAID 0/1 support
  • MezIO interface for easy function expansion

2. Rugged embedded computers-Without Integrated GPU’s

Nuvo-7000 series includes Neousys' track-proven technologies for superior ruggedness and versatility, such as effective fanless design, patented expansion Cassette and proprietary MezIO interface. It also incorporates cutting-edge computer I/O like USB 3.1 Gen2 with up to 10 Gbps throughput and M.2 2280 M key socket for NVMe SSD or Intel Optane memory for ultimate system performance. The plethora of on-board I/O ports (GbE, USB and COM) feature sophisticated protection circuits to endure stress from ESD and power surge. This makes Nuvo-7000 series by far the most rugged embedded computer we've ever created.

Features:

  • Intel 9th/ 8th-Gen Core i 35W/ 65W LGA1151 CPU
  • Patented Cassette for PCI/PCIe add-on card accommodation
  • MezIO interface for easy function expansion
  • Rugged, wide temperature range from -25°C to 70°C fanless operation
  • Up to 6x GigE ports, supporting 9.5 KB jumbo frame
  • M.2 2280 M key socket (Gen3 x4) supporting NVMe SSD or Intel® Optane memory
  • 4x USB 3.1 Gen2 ports and 4x USB 3.1 Gen1 ports
  • VGA/ DVI/ DP triple independent display, supporting 4K2K resolution

4.2. Electromechanical actuators, gearboxes and feedback elements for mobile robots and manipulator arms

In many robotic systems, actuators are often required to operate in distinctively different torque-speed load conditions. Machine tools, for instance, are usually either moving at high speed unloaded during reaching phases, or moving slowly applying large forces during manufacturing operations. Also, a legged robot, for example, has to move its leg forward quickly through the air and, once touching the ground, it has to bear a large load, or a gripper needs to reach the part quickly and then has to apply large holding forces.

To meet the power requirement of all operating points with small actuators, it is proposed to use electric motors coupled to a gearbox where the reduction ratio can be drastically changed online. Using such Variable Gear-ratio Actuator (VGA) on the many joint of robotic systems, leads to offering a wide range of properties in terms of speed, force and impedance.

An actuation technology, consisting of a mechanical architecture called DSDM (dual-motor dual-speed) used in conjunction with novel gear shifting control algorithms, that make possible fast and seamless transitions between two radically different gear-ratios. The below figure illustrates a DSDM actuator prototype.

4.3. Motor Driver Units

A motor controller is a device or group of devices that can coordinate in a predetermined manner the performance of an electric motor. A motor controller might include a manual or automatic means for starting and stopping the motor, selecting forward or reverse rotation, selecting and regulating the speed, regulating or limiting the torque, and protecting against overloads and electrical faults.

Features:

  • 4-quadrant
  • Protection with self recovering fuse, Settable current limit
  • Settable acceleration/brake ramp
  • Load compensation, Supply voltage compensation
  • Special braking options
  • Continuous / 2-step speed controlling
  • Positive driving logic
  • Mounting with DIN-rail or screws
  • High efficiency

4.4. Motus MEMS IMU

Description:

Motus is a miniature ultra-high accuracy MEMS IMU. It features some of the highest accuracy MEMS accelerometers and gyroscopes currently available combined with magnetometers. Motus is fully calibrated for all sensor errors over a wide temperature range and can be software upgraded to AHRS or INS functionality. It is available in both OEM and enclosed packages.

The Motus Manager software is downloadable from the software tab of the Motus page on the Advanced Navigation website. It allows Motus to be easily configured and tested. Motus can provide amazing results but it does need to be set up properly and operated with an awareness of its limitations. Please read through this manual carefully to ensure success within your application.

Features:

  • Ultra-High accuracy MEMS sensors
  • Miniature Package
  • AHRS or INS upgradeable
  • Advanced Signal Processing
  • 0.03° Roll and Pitch
  • 0.4°/hr MEMS gyroscope
  • 2000g Shock Limit
  • 0.08° Heading
  • 1000 Hz update rate

4.5. Openimu330bi (IMU)

Description:

The OpenIMU330BI module integrates highly-reliable MEMS inertial sensors (acceleration, angular rate/gyro) in a miniature factory-calibrated package to provide consistent performance through the extreme operating environments.

It is easy to synchronize and interface with external GPS, as well as other sensors. The main feature of OpenIMU300BI is triple redundancy for each inertial sensor.

Features:

  • Integrated triple redundant 3-Axis Angular Rate Sensors
  • Integrated triple redundant 3-Axis Accelerometer
  • 80MHz STM32 M4 CPU with FPU
  • SPI / UART Interfaces
  • Sensors highest ODR is 200Hz
  • Synchronization Input
  • In-System upgrade
  • Ultra-Small Size: 11x15x3 mm
  • Wide Temp Range -40 to 85 °C
  • High Reliability > 50,000 hr MTBF
  • Low power

4.6. U-Blox M8U (GNSS receiver)

Description:

The NEO-M8U module introduces u-blox’s untethered dead reckoning (UDR) technology, which provides continuous navigation without requiring speed information from the vehicle. This innovative technology brings the benefits of dead reckoning to installations previously restricted to using GNSS alone, and significantly reduces the cost of installation for after-market dead reckoning applications.

The strength of UDR is particularly apparent under poor signal conditions, where it brings continuous positioning in urban environments, even to devices with antennas installed within the vehicle. Useful positioning performance is also available during complete signal loss, for example in parking garages and short tunnels. With UDR, positioning starts as soon as power is applied to the module, before the first GNSS fix is available.

Features:

Uninterrupted positioning under all signal conditions using a built-in sensor without need for an electrical connection to the car.

  • World’s first untethered dead reckoning GNSS solution
  • Independent of any electrical connection to the car
  • Positioning accuracy in dense cities and covered areas
  • Complete positioning solution with integrated 3D sensors
  • Compatible with all modules of the NEO family
  • Real-time positioning update rate of up to 30 Hz

4.7. Skytraq S1216F8 (GNSS receiver with IRNSS)

Description:

The S1216F8‐GI3 is a satellite navigation receiver capable of using L5 NavIC and L1 GPS / GAGAN / GLONASS signal to provide 3D navigation in a single compact SMD module. The S1216F8‐GI3 has 56 tracking channels and could track all in‐view satellites. It is fully autonomous such that once power is applied, the receiver automatically searches, acquires and tracks satellite signals. When a sufficient number of satellites are tracked with valid measurements, the receiver produces 3D position and velocity outputs.

NavIC + GPS + GLONASS triple‐satellite capability enables using greater number of satellite signal than GPS‐only receivers. The increased satellite number offers superior performance in challenging urban canyon and multipath environments.

The S1216F8‐GI3 module contains SkyTraq Venus 8 positioning engine inside, featuring high sensitivity, low power consumption, and fast TTFF. The superior cold start sensitivity allows it to acquire, track, and get position fix autonomously in difficult weak signal environment. The receiver’s superior tracking sensitivity allows continuous position coverage in nearly all outdoor application environments.

Features:

  • Support NavIC, GPS, GAGAN, GLONASS
  • Better than ‐154dBm hot start sensitivity
  • Better than ‐160dBm tracking sensitivity
  • Less than 30 second cold start TTFF
  • ~ 1 second hot start
  • ~2.5m CEP accuracy
  • Multipath detection and suppression
  • Complete receiver in 12mm x 16mm size
  • Operating temperature ‐40 ~ +85oC
  • Pb‐free RoHS compliant

4.8. Magnetometer

Description:

AK09940 is ultrahigh precision 3-axis electronic magnetometer IC with ultrahigh sensitive TMR sensor technology. Small package of AK09940 incorporates magnetic sensors for detecting magnetic field in the X-axis, Y-axis, and Z-axis, a sensor driving circuit, signal amplifier chain, and an arithmetic circuit for processing the signal from each sensor. Self-test function is also incorporated.

Features:

  • 3-axis magnetometer device
  • Built-in A to D Converter for magnetometer data out
  • 18-bit data out for each 3-axis magnetic component
  • Sensitivity: 10 nT/LSB (typ.)
  • Range: ±1200 μT (typ.)
  • Serial interface
  • I2C bus interface
  • Standard and Fast modes compliant with Philips I2C specification Ver.2.1
  • 4-wire SPI
  • Operation mode
  • Power-down, Single measurement, Continuous measurement and Self-test
  • DRDY function for measurement data ready
  • Magnetic sensor overflow monitor function
  • Built-in oscillator for internal clock source
  • Power on Reset circuit
  • Self-test function with internal magnetic source
  • Built-in temperature sensor
  • Built-in magnetic sensitivity adjustment circuit
  • 8 FIFO data buffer
  • Selectable sensor drive
  • Low power drive / Low noise drive

4.9. ROHM BM1386GLV-ZTR (Barometer)

Description:

BM1386GLV is piezo-resistive pressure sensor. BM1386GLV performs temperature compensation for MEMS inside chip internally, so it’s very easy to get pressure information.

Features:

  • Piezo-resistive pressure sensor
  • Pressure range is from 300hPa to 1300hPa
  • Built-in temperature compensation function.
  • I2C bus interface (f/s mode support)
  • Built-in FIFO
  • Small package

4.10. Image Sensor Monochromatic

Description:

This 1/3-inch format, 1.2 MP imaging device has been designed to address the challenging requirements of automotive in-cabin cameras. The new global shutter sensor allows the camera to “freeze” fast moving scene data, and ensures effective synchronization with pulsed light sources. The AR0135 sensor incorporates a new innovative global shutter pixel design, with 10X lower dark current and 4X higher shutter efficiency vs. previous generation products. These improvements allow the sensor to produce clear, low-noise images, in both low-light and bright scenes, and in high temperature environments. This performance enables the required eye tracking and gesture detection functionality in next generation automotive in-cabin systems.

Features:

  • ON Semiconductor's Next Generation Global Shutter Technology
  • Superior Low-light Performance
  • HD Video (720p60)
  • Video/Single Frame Mode
  • Flexible Row-skip Modes
  • On-chip AE and Statistics Engine
  • Parallel and Serial Output
  • Support for External LED or Flash
  • Auto Black Level Calibration

4.11. Multi-Channels High Speed Digitizers

Description:

The PicoDigitizer 125-Series and MI250 Series is a high channel density, phase coherent, FPGA-based table top DAQ solution. It incorporates up to 64 channels on a Virtex-6 FPGA, sampling at 125 MSPS, and offers an embedded version which includes an Intel Quad-Core i7 processor for standalone applications. Additionally, signal generator outputs (DACs) can be added to the system for combined multichannel acquisition & transmission processing.

Features:

  • Up to 64 channels coupled to a large Virtex-6 FPGA.
  • High Channel density yielding the lowest 125 MSPS cost per channel in the industry.
  • Optional Intel Quad-Core i7 (embedded version).
  • 125 MSPS ADCs, 14-bit resolution.
  • Phase aligned channels and phase coherent sampling.
  • GigE and PCIe 4x high speed interfaces.
  • AC-DC coupling options, single-ended or differential (on request).
  • Model-based design integration.
  • Optional DACs, 1000 MSPS (Int. Modes), 16-bit.

4.12. High Speed A/D Converter Evaluation Kit

Description:

Renesas offers two options for evaluating high-speed analog-to-digital converter products with LVDS and/or LVCMOS outputs. A complete, turnkey evaluation platform is available, which includes data capture hardware and software to process and display acquired data. This system provides the fastest and easiest path to evaluating an ADC since no additional software coding is required of the user.

The second option is an adapter board that facilitates connection of an ADC daughter card to an FMC-based FPGA development board. This solution offers greater flexibility since the user has full access to the FPGA functionality and can therefore perform signal processing operations and/or "hardware in the loop" simulations. No software is provided for this option since there are a wide variety of supported FGPA development boards.

Features:

  • Datasheet-style live-updated parameter display.
  • Integrated SPI controller for ADC configuration.
  • 18Mb FIFO captures 1M ADC output samples.
  • USB 2.0 interface for rapid data transfer.
  • Exports CSV formatted sample records for offline data processing.

Applications:

  • Power amplifier linearization
  • Radar and satellite antenna array processing
  • Broadband communications
  • High-performance data acquisition
  • Communications test equipment
  • WiMAX and microwave receivers

4.13. Board Software Development Kit (BSDK)

Nutaq’s software development tools are a comprehensive suite that includes:

  • IP cores
  • Frameworks
  • APIs
  • Easy-to-use GUIs
  • Application examples

that significantly reduce the time customers spend on low value-added tasks such as programming interfaces, adjusting FPGA constraints, debugging Host drivers, etc.

Nutaq’s development framework also features seamsless integration to model-based design tools (such as Simulink and GNU Radio), combining a graphical development environment and automatic code generation. These tools greatly accelerate the development of applications, shorten the development cycle and reduce project costs.

Nutaq’s software tools are designed to enable and facilitate migrating from our standard products to a modified, customized or even miniaturized versions of them (For Nutaq customized hardware services, please click here). Built for embedded applications, Nutaq provides complete support for Linux and Windows environments on x86 processor architecture.

Combined with Nutaq FPGA-based standard systems, Nutaq development software tools provide a complete Turnkey System for developing and deploying next generations embedded real-time computing and algorithms acceleration (HPC) systems, mainly targeted for the following applications:

  • SIGNIT
  • SDR
  • Multichannel DAQ
  • Medical Imaging (PET scanners, Ultrasounds)
  • Physics (Linear accelerator, synchrotrons)

Depending on Nutaq systems and options, software development tools are provided with three different levels of integration, as the following:

The Nutaq Board Software Development Kit (BSDK) is a complete set of tools that includes IP cores, Frameworks, APIs, easy-to-use GUIs and application examples that significantly reduce the time customers spend on low value-added tasks such as programming interfaces, adjusting FPGA constraints, debugging Host drivers, etc.

Petalinux small footprint embedded Linux distribution running on MicroBlaze

A MicroBlaze processor instantiated within the FPGA fabric, running a commercial, embedded Linux distribution. This fabric risk processor runs Nutaq CCE application and may also run user-defined task/application.

Nutaq Central Communication Engine (CCE) Linux application on MicroBlaze

The CCE handles the bootloader, the start-up sequence, the TCP-IP and PCIe communication and configuration commands, etc. This software component is the board interface with the host Command Line Interpreter, GUIs or any other software running on a remote PC intended to communicate with the Nutaq FPGA-based hardware. The CCE is an implementation of a RPC (Remote Procedure Call library). It exposes the function of the Nutaq Software Libraries to the network. The CCE receives and handles TCP (GigE) or PCIe commands, answers to request coming in real-time and supports multi-user connections. For high efficiency and easy cross-platform API supports, a simple protocol is used. Basically, requests contain a function id and a parameter list. Each function from the Nutaq Software Libraries possesses a unique id. When receiving a request, the CCE call the corresponding function using a function lookup table.

Nutaq Extended Application Programming Interface (EAPI)

The Extended Application Programming Interface (EAPI) can run on either a Windows or Linux operating system.

This EAPI enables host-based applications to remotely control Nutaq’s FPGA boards, via the Central Communication Engine, through an Ethernet connection with a TCP transport (Windows or Linux) or PCIe interface (Linux only).

Command Line Interface

The command-line interface (or CLI) is the basic client interface for Nutaq FPGA boards. It consists of a shell where one can type commands, interacting with the board’s FPGA. The CLI offers many useful features like programming an FPGA bitstream in the onboard flash memory, reading or writing specific addresses on the AXI bus, loading data at some specific address in DDR3 SDRAM, using RTDex, etc. The CLI is a Python script file, which means that it dynamically parses and runs commands. It is also possible to write series of commands in text files and have these run as if they were typed in directly at the command prompt.

Nutaq High speed Real-Time Data Exchange (RTDEx) link over GigE / PCIe

Nutaq RTDEx IP core main objective is to provide customer a framework to exchange data with a host device through the GbE or PCIe links with the highest bandwidth and lower latency possible. On both interfaces, Nutaq CCE is used to configure DMA engines and registers to initiate data transfer. In order to avoid any bottleneck in the data throughput, the MicroBlaze processor is bypassed during data packet transmission allowing the full data bandwidth and lower latency.

FPGA Recording & Playback

The FPGA SDRAM recording module enables storing bursts of data in the onboard SDRAM. These can then be transferred to a host device for storage and analysis. The FPGA SDRAM playback module enables transmission of large portions of data from a host device such as a computer to the FPGA SDRAM these can then be read by the FPGA at high speed. Nutaq recording and playback FPGA core is equipped with a four-port memory controller core to permit it to sequentially access the DDR3 SDRAM. The core makes it possible to store data in memory from an FPGA input, for example. Similarly, it makes it possible to read data from the memory, and then send it to an FPGA output channel. The core also has two ports that can be connected to the RTDEx core, allowing a host device to read data from or write data in the FPGA SDRAM memory concurrently.

FPGA QDR Read & Write

The FPGA QDR Read and Write core enables easy user access to such high speed and low latency memory.

Software Synchronization

In a multithread system, synchronization is extremely important in a memory system — the key hardware capability is an uninterruptible instruction or instruction sequence capable of atomically retrieving and changing a value.

Basic problem: If two concurrent threads are accessing a shared variable, and that variable is read/modified/written by those threads, then access to the variable must be controlled to avoid erroneous behavior. Once a hardware synchronization mechanism exists, software synchronization mechanisms are then constructed using the capability. “Locks” are used to create “mutual exclusion” and to implement more complex synchronization mechanisms.

Time Stamping

Timestamps are important for keeping records of when information is being exchanged or created or deleted online. In many cases, these records are simply useful for us to know about. But in some cases, a timestamp is more valuable.

This is where ‘trusted’ timestamping comes in. These types of timestamps are generated by a trusted third party using secure FIPS-compliant hardware, so they are not subject to manipulation by a local user. Trusted timestamping means that you can say with a high level of certainty that the date on the timestamp is accurate and hasn’t been tampered with.

Here is a high level summary of the steps involved:

  1. The client application creates a hashed value (as a unique identifier of the data or file that needs to be timestamped) and sends it to the TSA.
  2. From now on, any change (even by a single bit of information) in the original file will require communication of changes with the TSA server.
  3. The TSA combines the hash and other information, including the authoritative time. The result is digitally signed with the TSA’s private key, creating a timestamp token which is sent back to the client. The timestamp token contains the information the client application will need to verify the timestamp later.
  4. The timestamp token is received by the client application and recorded within the document or code signature.

Packetization software implementation

Multimedia streaming is becoming increasingly popular. The multimedia standard MPEG-4 was designed to support scenes of different levels of complexity and applications with low bandwidth up to very high bandwidth requirements. Scalable video encoding is supported as well. This allows MPEG-4 streaming software to adapt video quality dynamically in the network to currently given QoS conditions. We evaluate packetization modes designed to transport MPEG-4 elementary streams over RTP connections, based on an implementation of an MPEG-4 video server and a demo client. Suitability of the packetization modes for video stream adaptation in the network nodes is discussed.

The client-server pair uses appropriate protocols like RTP/ RTCP to measure network QoS parameters. Using these measurements, the server adjusts the transmission band- width. Consequently the perceived video quality on the client side varies over time, especially sudden or frequent video quality changes are possible. This method is called non-transparent video scaling as it involves both client and server. The second method shifts the video adaptation task from the server into the network because the network routers have timely knowledge about current QoS situations. This is called transparent video scaling because it does not involve the end nodes in the quality adaptation process.

4.14. Real-Time Operating System (RTOS)?

Real-time operating system (RTOS) is an operating system intended to serve real time application that process data as it comes in, mostly without buffer delay. The full form of RTOS is Real time operating system.

In a RTOS, Processing time requirement are calculated in tenths of second’s increments of time. It is time-bound system that can be defined as fixed time constraints. In this type of system, processing must be done inside the specified constraints. Otherwise, the system will fail.

Benefits of RTOS

  • It offers priority-based scheduling, which allows you to separate analytical processing from non-critical processing.
  • The Real time OS provides API functions that allow cleaner and smaller application code.
  • Abstracting timing dependencies and the task-based design results in fewer interdependencies between modules.
  • RTOS offers modular task-based development, which allows modular task-based testing.
  • The task-based API encourages modular development as a task, will typically have a clearly defined role. It allows designers/teams to work independently on their parts of the project.
  • An RTOS is event-driven with no time wastage on processing time for the event which is not occur

Component of RTOS

  1. The Scheduler: This component of RTOS tells that in which order, the tasks can be executed which is generally based on the priority.
  2. Symmetric Multiprocessing (SMP): It is a number of multiple different tasks that can be handled by the RTOS so that parallel processing can be done.
  3. Function Library: It is an important element of RTOS that acts as an interface that helps you to connect kernel and application code. This application allows you to send the requests to the Kernel using a function library so that the application can give the desired results.
  4. Memory Management: this element is needed in the system to allocate memory to every program, which is the most important element of the RTOS.
  5. Fast dispatch latency: It is an interval between the termination of the task that can be identified by the OS and the actual time taken by the thread, which is in the ready queue that has started processing.
  6. User-defined data objects and classes: RTOS system makes use of programming languages like C or C++, which should be organized according to their operation.