Despite the enormous potential of millimeter-wave (mmWave) imaging, the high cost of large-scale antenna arrays or stringent prerequisites of the synthetic aperture radar (SAR) principle impedes its widespread application. Here, we report a portable, affordable, and high-resolution 3D mmWave imaging system by overcoming the destructive motion error of handheld SAR imaging. This is achieved by revealing two important phenomenons: spatial asymmetry of motion errors in different directions, and local similarity of phase errors exhibited by different targets, based on which we formulate the challenging phase error estimation problem as a tractable point spread function optimization problem. Experiments demonstrate that our approach can recover high-fidelity 3D mmWave images from severely distorted signals and augment the aperture size by over 50 times. Since our system does not rely on costly massive antennas or bulky motion controllers, it can be applied for diverse applications including security inspection, autonomous driving, and medical monitoring.
Recent years have witnessed an increasing adoption of millimeter-wave (mmWave) imaging across various critical applications, including security scanning 1,2 , non-destructive testing 3,4 , and structural health monitoring 5,6,7 , among others. The impetus for this growth can be attributed to several advantages that render mmWave a more appealing imaging modality. In contrast to optical cameras, mmWave is more privacy-preserving, robust to illumination changes, and capable of penetrating various materials 8,9 . Furthermore, the non-ionizing nature of mmWave radiation allows for safer and broader usage compared to X-rays. To date, plenty of mmWave imaging systems have been deployed at major airports worldwide, where they play a pivotal role in detecting concealed threats. Additionally, promising breakthroughs have also showcased the ability of mmWave imaging to provide non-invasive diagnostic information pertaining to skin cancer 10,11 and breast cancer 12,13 .
The fundamental capability that empowers various applications of mmWave imaging lies in its spatial resolution, which is intrinsically constrained by the aperture size (the number of antennas with a spacing of half of the wavelength) 14 . Existing high-resolution mmWave imaging systems are mainly built on the principles of either massive multiple-input multiple-output (MIMO) 15,16,17,18,19,20 or synthetic aperture radar (SAR) 21 . With MIMO technology, a N × N antenna array can be formulated by 2N transceivers, thus achieving the desired spatial resolution with fewer antennas 22 . However, to produce high-resolution 3D mmWave images, hundreds of transceivers are still required, which greatly increases the hardware complexity and system cost. On the other hand, SAR synthesizes a virtual aperture by maneuvering the radar to transmit signals from different locations 23,24,25 . Nevertheless, bulky mechanical scanners or expensive tracking devices are indispensable to ensure that received signals from different locations can be combined coherently.
Recent advancements in mmWave radar technology have fostered the development of compact and affordable mmWave imaging systems by introducing SAR imaging to handheld settings 26 . However, the major challenge in handheld SAR imaging is that the fluidity of hand movements introduces non-linearity and non-uniformity in the virtual apertures, resulting in phase errors in received signals and severe distortion in the resultant images. Previous studies 26,27 have resorted to expensive motion capture systems to achieve accurate device tracking during handheld scanning, which is not feasible for practical applications. To reduce system costs, some researchers have incorporated mobile localization methods for handheld mmWave SAR imaging. However, since the tracking precision fails to meet the stringent requirements (less than half a millimeter), they either necessitate an extended scanning time to accumulate recognizable images 28 or time-consuming registration processes to obtain more precise positions 29 . Additionally, all aforementioned systems are based on time-domain imaging methods, which are suitable for non-linear motion but impose high computational burdens. To leverage efficient frequency-domain imaging techniques, which require linear and uniform sampling, several motion compensation methods 30,31,32 have been proposed to compensate for the phase errors due to irregular scanning. Nonetheless, these approaches still depend on the premise of accurate device tracking, which is a non-trivial problem. In addition to signal processing-based methods, recent studies 29,33,34 have directly input the amplitude image into deep neural networks to alleviate distortions caused by motion errors. However, they ignore the signal phase critical for phase error compensation and simplify it as an image super-resolution problem. Moreover, these approaches require substantial training data to ensure the robustness of the deep learning models, leading to increased deployment costs. Consequently, a low-cost and efficient phase error correction solution is essential for practical handheld SAR imaging systems.
Here, we report a handheld mmWave imaging system that combines the advantages of MIMO technology and SAR principle, thus augmenting the aperture size of commercial-off-the-shelf mmWave devices by over 50x on average. Different from conventional approaches that focus on obtaining more precise device locations, our objective is to acquire the optimal point spread function (PSF) of the handheld synthetic array to effectively combat motion errors. Specifically, we first make a deep investigation into the root cause of phase errors, uncovering its spatial asymmetry which means that motion errors along different directions exert different influences on image quality. Moreover, we observe that the phase errors of different targets exhibit a local similarity, making it possible to approximate the phase error of the imaging target with another reference target. Based on these findings, we focus on the direction most susceptible to motion errors and estimate the optimal PSF based on the quadratic feature of the ideal phase history. Once obtaining the estimated PSF, we can derive and compensate for the phase errors caused by manual scanning and reconstruct the target with the efficient frequency-domain imaging method. Extensive experimental validations demonstrate the efficacy of our proposed imaging system in restoring targets from heavily distorted initial measurements, showcasing remarkable enhancements in both Peak Signal-to-Noise Ratio (PSNR, 4.54 dB) and Structure Similarity Index Measure (SSIM, 31.19%). As a result, our study can be deployed in mmWave applications that necessitate high mobility, cost-effectiveness as well as high-resolution imaging.
To achieve 3D mmWave imaging, a 2D planar aperture is required to obtain angle resolution along the azimuth and elevation directions. Combining MIMO technology with SAR principle makes it possible to synthesize a virtual planar array more efficiently. Figure 1a illustrates the synthesis of an ideal planar aperture by horizontally moving a linear MIMO array using a mechanical scanner. After a multistatic-to-monostatic transformation 35 , the instantaneous position of one arbitrary antenna can be denoted as \((^ <<\prime>>,^ <<\prime>>,0)\) and a single point on the imaging target can be represented by (x, y, z) with a reflectivity function σ(x, y, z). Under the Born approximation for the scattering field and an isotropic antenna assumption 36 , the received signal can be expressed as:
$$s(where \(k=\frac<2\pi f>\) , and f, c, and k represent the frequency, speed of propagation, and wavenumber, respectively. R is the slant range between the antenna and the imaging points, which can be denoted as:
Now let’s consider the handheld SAR imaging scenario where the motion trajectory of the antenna deviates from the ideal trajectory. In this case, the actual position of the antenna is given by \((^ <<\prime>>+>x,^ <<\prime>>+>y,>z)\) , and the ideal instantaneous range R changes to Re as:
$$As a result, the received signal with motion error becomes:
$$s(Analyzing the influence of motion errors on different axes reveals that the resultant phase error distribution exhibits a spatial asymmetry. Specifically, Fig. 1b shows the ideal imaging result when there is no motion error. However, if we add the same motion error along different axes, we can find that the z-axis motion errors have a considerably more significant impact than the x and y-axis errors, as demonstrated in Fig. 1c, d. This is because SAR imaging is highly sensitive to localization errors along the z-axis due to the resultant significant phase errors. For example, consider a target located 1 m away from a 77 GHz mmWave device, as depicted in Fig. 1a, a 1 mm shift in the x or y-axis would only introduce a signal propagation distance change of 0.0005 mm, resulting in a phase error of ΔΦx/y = 0.092°. However, a 1 mm deviation in the z-axis would lead to a phase error of ΔΦz = 184.8°, which is significantly larger and has a considerable impact on image quality, as demonstrated in Fig. 1f.
This observation makes it possible to relieve the burden of motion compensation in 3D space and focus only on the dominant direction (i.e., only considering the motion error in the z-axis Δz and approximating Δx and Δy as 0). Moreover, in near-field SAR imaging settings, Re−R can be well approximated by Δz 37 . Hence, if the actual positions of the handheld device can be precisely localized, the signal with a z-axis motion error Δz can be closely mapped to the ideal one by compensating for the phase error as 37 :
$$s(Existing mobile localization methods, however, fall short of the required tracking accuracy. The impact of localization errors can be observed in Fig. 1e, where the imaging result generated with the imprecise localization shows a severely defocused and distorted image compared to the ground-truth SAR image. The reflections of the target are spread throughout the entire image area, and the target’s shape is unrecognizable. Hence, the key to successful handheld SAR imaging lies in accurately estimating and compensating for phase errors caused by deviations in the z-axis.
Estimating z-axis phase error, however, is challenging for two reasons. First, the received signal phase is a superimposition of all scatters in the imaging scene, including the imaging target and other uninterested objects, which have different impacts on the phase of the final received signal. Hence, it is difficult to directly estimate phase errors from such a combination of diverse phase error components. Second, the distribution of motion errors caused by handheld scanning is complicated and unclear. Consequently, specific assumptions about phase error distribution which could reduce the difficulty of phase error estimation are also impractical.
To tackle these challenges, we propose combating the z-axis phase errors by leveraging the characteristic of ideal signal phase variations and the local similarity exhibited by different targets’ phase errors. We start with the analysis of the ideal phase history of an isolated point target. Suppose the radar moves along a linear path with a constant velocity v, as illustrated in Fig. 2a, and there is a single point target (the orange point) in front of the radar with a position of (x1, z1). For the i th transmitting location, the received signal of this point target can be expressed as:
$$s(where σ(x1, z1) is the reflection coefficient of target located at (x1, z1). \((_^ <<\prime>>,_^ <<\prime>>)\) is the ideal position of ith transmitting antenna. Hence, the unwrapped phase history H of the point target can be represented as:
$$H=<\left\>)>^+<(_-_^ <<\prime>>)>^>\right)\right\>>_^,$$where n is the number of total transmitting locations. U denotes the phase unwrap function. From Eq. (7), we observe that under near-field conditions, when the radar moves linearly and uniformly (xi increases linearly while zi remains unchanged), H follows a quadratic curve, as illustrated in Fig. 2b. This fundamental characteristic, actually, can be utilized as a strong prior to estimate the phase errors of the point target by measuring its difference with the ideal phase history.
However, obtaining the phase errors of a specific point target does not necessarily solve our problem because targets at different locations usually exhibit different reflected properties and phase variations. To exploit the correlation of phase errors between different targets, let’s consider two distinct point targets in the imaging scene located at (x1, z1) and (x2, z2), respectively, as depicted in Fig. 2a. For a single virtual antenna, the ideal antenna position is \((_^ <<\prime>>,_^ <<\prime>>)\) , while the actual antenna position contains a z-axis motion error of Δzi and is given by \((_^ <<\prime>>,_^ <<\prime>>+>_)\) . Hence, we can represent the difference in the round-trip propagation error between these two targets as follows:
$$\Deltawhere ΔR1 and ΔR2 denote the round-trip propagation error of target (x1, z1) and target (x2, z2), respectively. ΔR represents the difference between ∣ ΔR1 ∣ and ∣ ΔR2 ∣ . Obviously, the smaller the ΔR is, the closer these two targets’ phase errors will be. Figure 2c, d illustrates the spatial distribution of ΔR with ∣ z1 − z2 ∣ and ∣ x1 − x2 ∣ , respectively. We can observe that it is easy to find a region that minimizes ΔR, referred to as the local similarity of phase errors of different targets. Therefore, by setting a point target according to the distribution of ΔR, its estimated phase error can be quite close to the phase error of the imaging target.
PSF, the impulse response of an ideal point target, is usually utilized to characterize the capability of an imaging system. For SAR systems, the 1D PSF of a linear array or 2D PSF of a planar array reflects the angle resolution and focusing ability of the antenna array, and higher-quality PSFs correspond to improved imaging performance. In the context of this study, Fig. 3a–e visually demonstrates the notable contrast between the PSFs derived from mechanical scanning and the PSFs obtained through handheld scanning. Evidently, the PSFs resulting from handheld scanning experience considerable distortion due to motion errors.
To tackle the motion errors caused by manual scanning, we propose to optimize and restore a high-fidelity PSF to obtain a reliable estimation of phase errors. This is achieved based on previous findings, namely: (i) when the radar moves linearly and uniformly, the phase history of a single point target follows a quadratic curve, and (ii) in the x-z plane, targets located at different distances can exhibit similar phase errors. Accordingly, we first manually designate a point target within the imaging scene as a reference, ensuring both reference and imaging targets are observed by the radar. Subsequently, we attempt to obtain the optimized PSF by fitting the phase history of this point target with the corresponding ideal quadratic phase history. Through this process, we can measure the phase error of this point target by quantifying the discrepancy between its actual and ideal phase history. Finally, the estimation can be utilized to compensate for the phase history of the imaging target and generate the corrected SAR image. Figure 3c, f shows the PSF optimization results, which appear clear and well-focused (see the estimated deviation from a regular acquisition and phase error in Supplementary Fig. 2). It is noteworthy that our approach requires neither expensive tracking devices, nor iterative optimization processes, which reduces the system cost and imaging time. This enables a more affordable and efficient handheld SAR imaging system, which can be highly beneficial in various applications, such as security checks, SLAM, and industrial inspections.
Based on the above discussions, we build our handheld imaging system with three key components: signal resampling, PSF optimization, and SAR imaging, as depicted in Fig. 4. Specifically, Fig. 4a illustrates the data collection setup. The operational flow begins with resampling the collected signals to uniform spacing to apply the efficient FFT-based imaging methods, as shown in Fig. 4b. This is achieved by oversampling the radar frames and tracking the radar’s motion using a cost-effective visual tracking device. Subsequently, to address the non-linearity along the z-axis, we employ the previously described PSF optimization and obtain the compensated SAR echoes, as shown in Fig. 4c. Finally, the Range Migration Algorithm (RMA) 38,39 , a fast frequency-domain near-field imaging method, is utilized to reconstruct the SAR image, as depicted in Fig. 4d. Figure 4a also highlights its potential for application in security checks, where handheld scanning and high-quality imaging are essential. Traditional approaches rely on metal detectors which can only detect the presence of metal objects while we can reconstruct the exact shapes of hidden objects, enabling accurate identification of potential threats.
As depicted in Fig. 4a and Supplementary Fig. 6, we prototype our imaging system with the TI four-chip cascaded mmWave radar operating within the frequency range of 76-81 GHz. With the MIMO technique, the radar can formulate a virtual linear array consisting of 86 elements. This arrangement enables the creation of a 2D planar array by moving the radar along the orthogonal direction of its linear array dimension. As a result, the system can reconstruct specific objects through a single scanning process, thereby reducing the scanning time and improving users’ experience. The radar is co-located with the Intel RealSense T265 tracking camera, which captures the radar’s movement along the x-axis and is utilized to resample the collected data to uniform spacing. Since our focus lies solely on recording the x-axis movement, which exhibits a higher tolerance for tracking errors, alternative cost-effective mobile localization methods may also be suitable.
Suppose a monostatic antenna moves in a handheld configuration and transceives Frequency Modulated Continuous Wave (FMCW) signals. The imaging object and the reference target are situated at different distances from the center of the antenna’s trajectory. By leveraging the principles of FMCW, we can separate the two targets in the range domain by performing FFT (range-FFT) along each reflected pulse, assuming the distance between them is larger than the device’s range resolution. Based on the previous discussion that the phase history of a point target for an ideal trajectory follows a quadratic curve, we can proceed to estimate the ideal phase variation of the reference point target by optimizing the following function:
where \(\hat<<\phi >_>\) represents the estimated ideal phase variation of the reference point target from the received signal at ith location. ϕi is the corresponding disturbed phase variation extracted with range-FFT. n is the number of received pulses. α, β, and γ are the coefficients of the target curve. This function finds the optimal α, β, and γ values which can minimize the difference between the actual phase variations of the reference and its ideal phase variations. Once the estimated ideal phase history has been obtained, the phase error induced by handheld motion can be compensated as:
$$\hat<_>=_>>>>>>>>^>>>>>>>(\hat<<\phi >_>-<\phi >_)>,$$where \(\hat_>\) and si denote the compensated and the motion error corrupted ith received signal, respectively.
Notably, in this paper, a linear array is employed to facilitate MIMO SAR imaging. Hence, at each time step i, there will be multiple phase variations corresponding to multiple antennas. Although it is possible to estimate the phase error for each antenna, such an approach would increase computational costs and exacerbate the impact of incorrect estimations. To address this issue, we make the reasonable assumption that the primary phase error arises from translational motion error, considering that the device only needs to be moved along a single direction for a distance of approximately 20 cm to 30 cm. As a result, the antennas at the same timestep exhibit similar phase errors, which can be obtained by selecting the phase history of a single antenna to optimize in Eq. (11). Moreover, in the experiments, we find that if the x-axis position of the reference point target deviates from the x-axis center of the scanning trajectory, setting α as 0 would lead to better performance due to the incomplete quadratic feature of the ideal phase history.
Our imaging system is implemented with the TI four-chip cascaded mmWave radar, which consists of 12 transmitting antennas and 16 receiving antennas. We activate all the transceivers to achieve an 86-element virtual linear array. To collect the reflected signals in real-time, we attach a data capture board to the radar, which can transfer the collected data to a laptop through an Ethernet cable. The mmWave radar transmits FMCW signals which have the following parameters: start frequency, 77 GHz; ADC sampling rate, 8 Msps; chirp slope, 38.5 MHz/μs; chirp duration, 40 μs; the number of ADC samples, 256; frame periodicity, 10 ms for manual scanning and 50 ms for mechanical scanning, respectively. The mmWave radar is co-located with the Intel RealSense T265 camera, which has two fish eye cameras and one inertial motion unit to track the device’s motion. Since the camera’s pose updating rate (approximately 30 Hz) is lower than the radar’s frame rate, we employ cubic interpolation on the trajectory obtained by the camera, to get the radar’s position for each transmitted frame.
The mechanical scanning is achieved by moving the MIMO radar over a distance of 200 mm along the x-axis with a motion controller. The moving speed is 20 mm/s, resulting in 200 sampling pulses with a spacing of 1 mm.
The users are instructed to hold and move the MIMO radar over a distance of ~20 cm along the x-axis (see the experimental setup in Supplementary Fig. 6). The radar’s frame rate is set at 10 ms, while the user’s movement speed is restricted to no more than 0.2 m/s, in order to satisfy the Nyquist-Shannon sampling theorem. It is worth noting that by increasing the frame rate, we can achieve higher scanning speeds; however, this comes at the expense of heavier data processing.
To evaluate the ability to augment the aperture size of our handheld imaging system, we employ the 3 dB beamwidth of the 1D PSF as a measure and compare it to different lengths of apertures generated by mechanical scanning. In this evaluation, we position two corner reflectors in front of the imaging device: one serves as the imaging target, located at a range of 0.65 m, and the other as the reference target, positioned at a range of 1.8 m. A total of 100 manual scanning samples are collected from two different users, with each user having 50 samples (see how we calculate the estimated deviation from a regular acquisition in Supplementary Note 5 and the histogram of estimated deviation in Supplementary Fig. 4a). While the length of each manual scanning is ~200 mm, it does not necessarily mean that a 200 mm handheld scanning aperture is directly comparable to a 200 mm mechanical scanning aperture. This is because even after applying the proposed phase error compensation approach, residual phase errors may still be present. To determine the equivalent mechanical scanning imaging performance, we compute the normalized 3 dB beamwidth for different aperture lengths of mechanical scanning, as illustrated in the blue line of Fig. 5. Then we mark the average (plus/minus a standard deviation) 3 dB beamwidth of the PSFs associated with the 100 manual scanning samples as red to evaluate the imaging performance of handheld scanning. As a result, Fig. 5a shows that the average and best imaging performance of 200 mm handheld scanning is approximately equivalent to 100 mm and 175 mm mechanical scanning, respectively. Moreover, Fig. 5b–g depicts the 2D PSFs obtained from mechanical scanning and handheld scanning, respectively, which demonstrates that the proposed approach can effectively combat motion errors.
To evaluate the imaging performance of our system, we collect 200 samples from four different users imaging ten different metal letters, with each user having 50 samples (see the histogram of estimated deviation from a regular acquisition in Supplementary Fig. 4(b)). To demonstrate the superiority of our approach, we make a comparison with the method in ref. 32 . It is noteworthy that the core of ref. 32 lies in compensating the squiggle path to the uniform path in the x-y plane and assuming there is no z-axis motion error, which essentially functions the same as the signal resampling in our system. As demonstrated in Fig. 6a, even when compensating for the non-uniform motion error using the camera, the resulting SAR images still exhibit significant distortion due to z-axis motion error. Conversely, by mitigating phase errors through PSF optimization, the targets can be well-focused with high fidelity. The ECDF of PSNR and SSIM, presented in Fig. 6b, respectively, reveal a noteworthy improvement in image quality after applying phase correction. Furthermore, our PSF optimization does not necessitate iterative or computationally intensive processes. As a result, the average time required to estimate and compensate for the phase errors of a single image is approximately 60 ms using an Intel Core i7-11700K CPU (see Supplementary Note 4), demonstrating its superior efficiency and potential for real-time applications.
As described in Fig. 2c, it is straightforward to find a position for the reference to make the phase error of the two objects fairly close. Moreover, the difference in z-axis positions between the imaging object and the reference object does not significantly impact the imaging performance. Figure 7a exhibits the reconstruction results for various reference positions, demonstrating that the imaging object in each scenario can be successfully refocused (see quantitative analysis in Supplementary Fig. 5). Hence, our approach can be flexible and easy to be employed in practical scenarios.
Compared with optical imaging, mmWave can penetrate diverse non-metallic materials, making it suitable for Non-Line-of-Sight (NLoS) imaging to detect hidden objects. To illustrate the see-through ability of our imaging system, we cover the imaging object with various materials (i.e., paper, plastic, and cloth), then perform handheld scanning to reconstruct the concealed objects. Figure 7b illustrates the successful reconstruction of hidden objects using our handheld imaging system, despite the presence of different types of occlusions. This outcome demonstrates the system’s potential in non-destructive testing and security inspections, where it can facilitate the detection of concealed items.
Previous experiments have successfully demonstrated the ability of our imaging system to reconstruct certain objects through a single scanning process. However, the highly specular nature of mmWave signals causes them to exhibit mirror-like reflections from targets, particularly those with flat surfaces, such as the metal target used in our experiments. Consequently, for large targets, not all reflections from the target propagate back to the mmWave receiver, and some parts of the target are absent in the image. To address this, we propose to reconstruct different parts of the target individually and then combine these images to recover the whole target. Specifically, we employ a multi-scanning strategy. Firstly, the user performs a zig-zag scanning pattern to ensure complete coverage of the imaging target shown in Fig. 7c. Next, the entire scanning trajectory is divided into several sub-trajectories based on the x-axis motion. For instance, the trajectory in Fig. 7d is segmented into four sub-trajectories, each moving along the x-axis for about 40 cm. For each sub-trajectory, we conduct imaging and estimate the phase error of the collected signals, which yields a partial image of the target, as shown in Fig. 7e. Finally, we stitch together the partial images to reconstruct the entire target, as depicted in Fig. 7f.
In this paper, we utilize a point target with a known ideal phase history (a quadratic curve) for phase error estimation. However, when such a point-like target is not present or cannot be observed by the radar due to occlusion, we can utilize other detectable targets, such as the imaging targets themselves, to estimate phase error. The key insight is that while the ideal phase histories of these non-point targets may not precisely follow a quadratic curve, their overall trend still exhibits quadratic-like behavior, as shown in Fig. 8a. Therefore, it is feasible to approximate these non-point targets as point targets and fit their actual phase history with a standard quadratic curve to obtain the phase errors (see the results of phase correction for multiple nearby targets in Supplementary Fig. 7). Although this approximation introduces estimation errors, these errors are significantly smaller compared to the phase errors caused by handheld scanning. Consequently, employing this phase error estimation approach still yields better imaging results compared to not employing any phase error estimation at all, as demonstrated in Fig. 8b, c.
In this study, we focus on overcoming the fundamental limitation of spatial resolution of mmWave devices by realizing handheld SAR imaging. Our proposed handheld system is capable of turning commercial-off-the-shelf mmWave radars into portable, affordable, and high-resolution imaging systems that can see through things, which has great potential in mobile applications, emergency situations, and limited-cost scenarios.
Estimating motion errors from raw radar signal, referred to as the autofocus technique 40 , is a well-studied field in airborne SAR 41,42 . Generally, typical autofocus methods can be classified into three categories: MapDrift 43 , phase gradient autofocus 44 , and image optimization approaches 45,46,47,48 . The MapDrift-based autofocus divides the whole aperture into two or more sub-apertures and estimates motion parameters by cross-correlating the resulting sub-images. The phase gradient autofocus-based approaches extract phase gradient from dominant scatters in the imaging scene and apply phase corrections that simultaneously sharpen all scatters. The image optimization autofocus approach searches for the optimal compensated phase to improve the image quality based on specific metrics. While these methods have been proven effective in space-borne and air-borne SAR, they cannot be directly applied to near-field 3D mmWave SAR systems for various reasons. First, the MapDrift-based autofocus can only cope with second-order phase error caused by incorrect speed estimation for linear motion. Second, the phase gradient autofocus-based techniques are based on a far-field assumption that all row pixels of SAR images are at an effectively equivalent range from the radar, which is not valid for near-field 3D SAR. Finally, for 3D SAR that has considerably more optimized variables, the image optimization approaches are also not suitable due to the increasing optimization difficulty and computational burden.
While the reconstruction performance of our system is promising, it does exhibit certain limitations. Specifically, residual phase errors stemming from rotational motion error and imprecise phase error estimation may still degrade the resulting images. To further refine the image quality, one can employ well-established image enhancement techniques, including learning-based 49,50 and optimization-based approaches 51,52 , which have garnered advancements in the realm of image processing. Moreover, exceeding the maximum allowed motion errors may also lead to the failure of PSF optimization and image reconstruction. Despite this, we believe that this study represents a substantial stride forward in handheld 3D SAR imaging and will ignite further exploration within this promising field.
In our experiments, we anticipate users to move the radar in a near-straight line to emulate traditional strip-map SAR, which may not be a flexible operating pattern. In future work, we aim to explore techniques that enable handheld imaging with squiggle scanning paths, as well as investigate other SAR imaging techniques such as circular SAR or cylinder SAR. These advancements will further enhance the versatility and applicability of handheld mmWave SAR imaging.
In conclusion, this paper presented a practical handheld mmWave SAR imaging system. With the portability, affordability, and high-resolution 3D imaging ability, we believe that our design has the potential to become a standard component of subsequent handheld imaging systems, allowing more creative real-world applications in the future.
The data that support the findings of this study are available from the corresponding author upon reasonable request.