Skip to content

Conversation

Phillip9587
Copy link
Member

@Phillip9587 Phillip9587 commented Feb 15, 2025

This PR aims to improve the maintainability and readability of the internal read function. It also removes some weird parts of that code.

lib/read.js Outdated
stream.length = undefined
} catch (err) {
return next(err)
const charset = options.charset
Copy link
Member Author

@Phillip9587 Phillip9587 Feb 15, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I renamed the option to charset because it holds the content-type header charset (Content-Type: text/plain; charset=utf-8) or the default charset

Comment on lines -136 to -207
/**
* Get the content stream of the request.
*
* @param {object} req
* @param {function} debug
* @param {boolean} [inflate=true]
* @return {object}
* @api private
*/

function contentstream (req, debug, inflate) {
var encoding = (req.headers['content-encoding'] || 'identity').toLowerCase()
var length = req.headers['content-length']

debug('content-encoding "%s"', encoding)

if (inflate === false && encoding !== 'identity') {
throw createError(415, 'content encoding unsupported', {
encoding: encoding,
type: 'encoding.unsupported'
})
}

if (encoding === 'identity') {
req.length = length
return req
}

var stream = createDecompressionStream(encoding, debug)
req.pipe(stream)
return stream
}
Copy link
Member Author

@Phillip9587 Phillip9587 Feb 15, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This can be seen as follow-up to #564. I included the contentstream function in the main read function for multiple reasons:

  • to prevent the req object from being altered by setting length and resetting it in read.
  • This also improves code by only setting the raw-body length option and thus also only calling req.headers['content-length'] when the requests needs no inflation.

if (contentEncoding === 'identity') {
// set raw-body expected length
stream = req
options.length = req.headers['content-length']
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Improves the code by only accessing req.headers['content-length'] and setting the length option for raw-body when the stream needs no decompression

Copy link
Member Author

@Phillip9587 Phillip9587 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I’ve added comments to explain my changes. The diffs don’t fully capture the modifications clearly, so I’d recommend comparing the file from master with the version in this branch for better context.

Let me know if you have any questions or need further clarifications. Looking forward to your feedback! 😊

lib/read.js Outdated
Comment on lines 44 to 46
var encoding = opts.encoding !== null
? opts.encoding
: null
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we can remove that 😅

@Phillip9587 Phillip9587 marked this pull request as ready for review February 15, 2025 23:43
@Phillip9587 Phillip9587 force-pushed the perf-content-length branch 2 times, most recently from c0d4f4f to 9a2e3ca Compare March 27, 2025 00:08
@Phillip9587 Phillip9587 mentioned this pull request Mar 27, 2025
@Phillip9587 Phillip9587 force-pushed the perf-content-length branch from 9a2e3ca to 644df75 Compare April 25, 2025 07:26
@Phillip9587 Phillip9587 force-pushed the perf-content-length branch from 644df75 to 0d5f462 Compare May 5, 2025 20:20
@Phillip9587 Phillip9587 requested a review from Copilot May 5, 2025 20:21
Copilot

This comment was marked as outdated.

@Phillip9587
Copy link
Member Author

Hey @UlisesGascon @jonchurch, just circling back on this PR - it's been a little while, so I wanted to check in and see if you had a chance to take a look. Let me know if there's anything I should address or update to help move it forward. Thanks!

@Phillip9587
Copy link
Member Author

Hey @UlisesGascon @jonchurch 👋
Just revisited this PR and wanted to give it another gentle bump - it’s been a little while, and I’d love to get your feedback whenever you get a chance. Appreciate your time! 😊

Copy link

@Copilot Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR refactors the internal read function to improve maintainability and readability by inlining the contentstream helper function and renaming variables for clarity.

  • Renamed encoding variable to charset for better semantic clarity
  • Inlined the contentstream function directly into the main read function
  • Simplified variable declarations and moved content-encoding handling earlier in the flow

Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.

if (opts.encoding === null && encoding !== null && !iconv.encodingExists(encoding)) {
return next(createError(415, 'unsupported charset "' + encoding.toUpperCase() + '"', {
charset: encoding.toLowerCase(),
if (options.verify && charset !== null && !iconv.encodingExists(charset)) {
Copy link

Copilot AI Sep 8, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The charset validation logic has changed incorrectly. Previously, this check was performed when opts.encoding === null (which occurred when verify was truthy), but now it's only performed when options.verify is truthy AND charset is not null. This could skip charset validation when verify is falsy but charset needs to be validated for decoding.

Suggested change
if (options.verify && charset !== null && !iconv.encodingExists(charset)) {
if (charset !== null && !iconv.encodingExists(charset)) {

Copilot uses AI. Check for mistakes.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant