Please support exporting network logs via proxyman-cli

[ponienchen]

Description

In one of my automation suites, I would like the ability to export the network logs via proxyman-cli in order to check something.

Why this feature/change is important?

Some of my tests are making some api calls to report user interactions with the app, and it will be helpful to be able to test the payload of those calls as part of the automation.

Please support this use case.
Thank you so very much.

[NghiaTranUIT]

@ponienchen please use this Beta build https://download.proxyman.io/beta/Proxyman_5.10.0_Support_export-log_in_the_proxyman-cli.dmg

• Export all (ProxymanSession)

/Applications/Proxyman.app/Contents/MacOS/proxyman-cli export-log -m all -o "~/desktop/all"
Export certain domains (Only Host, no scheme, no port, no paths, and no Query)

• Export certain domains

/Applications/Proxyman.app/Contents/MacOS/proxyman-cli export-log -m domains -o "~/desktop/twitterlog" --domains 'api.twitter.com' --domains 'www.producthunt.com

You can find the example command line at https://docs.proxyman.io/command-line#export-proxyman-log

[ponienchen]

Thank you so much Noah! I will check it out! Peter

…

On Sat, Nov 2, 2024 at 7:36 AM Noah Tran ***@***.***> wrote: @ponienchen <https://github.com/ponienchen> please use this Beta build https://download.proxyman.io/beta/Proxyman_5.10.0_Support_export-log_in_the_proxyman-cli.dmg - Export all (ProxymanSession) /Applications/Proxyman.app/Contents/MacOS/proxyman-cli export-log -m all -o "~/desktop/all" Export certain domains (Only Host, no scheme, no port, no paths, and no Query) - Export certain domains /Applications/Proxyman.app/Contents/MacOS/proxyman-cli export-log -m domains -o "~/desktop/twitterlog" --domains 'api.twitter.com' --domains 'www.producthunt.com You can find the example command line at https://docs.proxyman.io/command-line#export-proxyman-log — Reply to this email directly, view it on GitHub <#2180 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ABFCSYG77L3BVZ5PDKBHUELZ6TPOZAVCNFSM6AAAAABQ4XLCV2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDINJTGAYTAMRUGU> . You are receiving this because you were mentioned.Message ID: ***@***.***>

[ponienchen]

hi, @NghiaTranUIT
I checked out the export.

The output is a binary file.
And I was wondering how I may view the contents.
Any way I can export the the network logs in json format ?

Also, is it possible to allow for specifying path ?
Or better yet, export network logs that contain certain queries ?
Like if I have
https://www.google.com/somePath?name=aaa&hobby=climbing
https://www.google.com/somePath?hobby=swimming&name=aaa

And can we be allowed to specify the query name=aaa such that it allows me to find all the network logs for
domain "www.google.com",
path "/somePath",
and query "name=aaa"
?

[NghiaTranUIT]

These files can be opened by Proxyman app.

If you want to open it as a JSON: -> Rename to zip -> Unzip -> Bunch of JSON

Also, is it possible to allow for specifying path ?

Not yet, this version only works with domain and all mode

[ponienchen]

Thank you, @NghiaTranUIT
I could see the json files now.

The bodyData is encrypted for both request and response, and so I am not able to use this data.

Can we by default show encrypted bodyData, but add a flag to optionally show decrypted bodyData for both request & response ?

[NghiaTranUIT]

The bodyData is encrypted for both request and response, and so I am not able to use this data.

It's not encrypted. It's encoded as a Base64 string. You should decode it to to JSON or binary data.

[ponienchen]

Thanks for the info on the base64 encoding, @NghiaTranUIT
I will check it out.
Have a nice long weekend.

[ponienchen]

Hi, @NghiaTranUIT
I am able to decode the bodyData and see the data.
Thanks for letting me know that it is encoded using base64.

[ponienchen]

I will play with this for a few days and if I see any issues, I will report it here.
Thanks again, @NghiaTranUIT

[ponienchen]

Hi, @NghiaTranUIT

Question.
Will this ability to export network logs be available to pro version or the free version ?

[NghiaTranUIT]

It's available in both versions. I will release this update on the next release 👍

[ponienchen]

Thank you, @NghiaTranUIT

[ponienchen]

Appreciated you working on this feature!