Jul 29 01:10:25.986864 ip-10-0-142-238 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 29 01:10:25.986876 ip-10-0-142-238 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 29 01:10:25.986884 ip-10-0-142-238 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 29 01:10:25.987231 ip-10-0-142-238 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 29 01:10:36.193834 ip-10-0-142-238 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 29 01:10:36.193852 ip-10-0-142-238 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 417e76a94b304390b4742ab33be11628 --
Jul 29 01:12:29.595247 ip-10-0-142-238 systemd[1]: Starting Kubernetes Kubelet...
Jul 29 01:12:29.896269 ip-10-0-142-238 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 01:12:29.896269 ip-10-0-142-238 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 29 01:12:29.896269 ip-10-0-142-238 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 01:12:29.896269 ip-10-0-142-238 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 29 01:12:29.896269 ip-10-0-142-238 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 01:12:29.897669 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.897596    2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 29 01:12:29.901452 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901437    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 01:12:29.901452 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901452    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 01:12:29.901515 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901456    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 01:12:29.901515 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901461    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 01:12:29.901515 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901464    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 01:12:29.901515 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901467    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 01:12:29.901515 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901469    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 01:12:29.901515 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901472    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 01:12:29.901515 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901474    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 01:12:29.901515 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901477    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 01:12:29.901515 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901480    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 01:12:29.901515 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901482    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 01:12:29.901515 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901485    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 01:12:29.901515 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901487    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 01:12:29.901515 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901491    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 01:12:29.901515 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901494    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 01:12:29.901515 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901496    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 01:12:29.901515 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901499    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 01:12:29.901515 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901501    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 01:12:29.901515 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901504    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 01:12:29.901515 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901507    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 01:12:29.901515 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901509    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 01:12:29.902002 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901512    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 01:12:29.902002 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901515    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 01:12:29.902002 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901518    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 01:12:29.902002 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901521    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 01:12:29.902002 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901530    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 01:12:29.902002 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901533    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 01:12:29.902002 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901535    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 01:12:29.902002 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901538    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 01:12:29.902002 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901540    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 01:12:29.902002 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901543    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 01:12:29.902002 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901545    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 01:12:29.902002 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901548    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 01:12:29.902002 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901551    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 01:12:29.902002 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901553    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 01:12:29.902002 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901556    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 01:12:29.902002 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901558    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 01:12:29.902002 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901561    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 01:12:29.902002 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901563    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 01:12:29.902002 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901566    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 01:12:29.902002 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901568    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 01:12:29.902002 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901571    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 01:12:29.902551 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901574    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 01:12:29.902551 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901576    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 01:12:29.902551 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901581    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 01:12:29.902551 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901586    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 01:12:29.902551 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901591    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 01:12:29.902551 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901594    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 01:12:29.902551 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901597    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 01:12:29.902551 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901600    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 01:12:29.902551 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901602    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 01:12:29.902551 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901605    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 01:12:29.902551 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901607    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 01:12:29.902551 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901610    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 01:12:29.902551 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901613    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 01:12:29.902551 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901616    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 01:12:29.902551 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901619    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 01:12:29.902551 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901621    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 01:12:29.902551 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901624    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 01:12:29.902551 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901626    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 01:12:29.902551 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901629    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 01:12:29.903028 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901632    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 01:12:29.903028 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901634    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 01:12:29.903028 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901637    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 01:12:29.903028 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901640    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 01:12:29.903028 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901642    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 01:12:29.903028 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901645    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 01:12:29.903028 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901647    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 01:12:29.903028 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901650    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 01:12:29.903028 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901652    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 01:12:29.903028 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901655    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 01:12:29.903028 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901657    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 01:12:29.903028 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901660    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 01:12:29.903028 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901664    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 01:12:29.903028 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901666    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 01:12:29.903028 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901669    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 01:12:29.903028 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901672    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 01:12:29.903028 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901674    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 01:12:29.903028 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901678    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 01:12:29.903028 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901680    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 01:12:29.903028 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901683    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 01:12:29.903502 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901685    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 01:12:29.903502 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901688    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 01:12:29.903502 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901692    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 01:12:29.903502 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901695    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 01:12:29.903502 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901698    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 01:12:29.903502 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901702    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 01:12:29.903502 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901704    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 01:12:29.903502 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901707    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 01:12:29.903502 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901710    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 01:12:29.903502 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901712    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 01:12:29.903502 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901715    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 01:12:29.903502 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901717    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 01:12:29.903502 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901720    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 01:12:29.903502 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901722    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 01:12:29.903502 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901725    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 01:12:29.903502 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901727    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 01:12:29.903502 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.901730    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 01:12:29.903502 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902463    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 01:12:29.903502 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902470    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 01:12:29.903968 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902473    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 01:12:29.903968 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902476    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 01:12:29.903968 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902480    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 01:12:29.903968 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902482    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 01:12:29.903968 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902485    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 01:12:29.903968 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902487    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 01:12:29.903968 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902490    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 01:12:29.903968 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902493    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 01:12:29.903968 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902495    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 01:12:29.903968 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902501    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 01:12:29.903968 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902505    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 01:12:29.903968 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902508    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 01:12:29.903968 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902511    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 01:12:29.903968 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902514    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 01:12:29.903968 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902517    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 01:12:29.903968 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902520    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 01:12:29.903968 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902523    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 01:12:29.903968 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902527    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 01:12:29.903968 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902530    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 01:12:29.904443 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902533    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 01:12:29.904443 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902536    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 01:12:29.904443 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902539    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 01:12:29.904443 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902542    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 01:12:29.904443 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902544    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 01:12:29.904443 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902547    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 01:12:29.904443 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902550    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 01:12:29.904443 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902552    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 01:12:29.904443 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902555    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 01:12:29.904443 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902558    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 01:12:29.904443 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902561    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 01:12:29.904443 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902564    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 01:12:29.904443 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902566    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 01:12:29.904443 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902569    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 01:12:29.904443 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902571    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 01:12:29.904443 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902574    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 01:12:29.904443 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902576    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 01:12:29.904443 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902579    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 01:12:29.904443 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902581    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 01:12:29.904443 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902584    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 01:12:29.904929 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902586    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 01:12:29.904929 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902590    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 01:12:29.904929 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902592    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 01:12:29.904929 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902596    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 01:12:29.904929 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902598    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 01:12:29.904929 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902601    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 01:12:29.904929 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902604    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 01:12:29.904929 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902606    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 01:12:29.904929 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902609    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 01:12:29.904929 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902612    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 01:12:29.904929 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902615    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 01:12:29.904929 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902617    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 01:12:29.904929 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902620    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 01:12:29.904929 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902622    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 01:12:29.904929 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902625    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 01:12:29.904929 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902628    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 01:12:29.904929 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902630    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 01:12:29.904929 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902633    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 01:12:29.904929 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902635    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 01:12:29.904929 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902638    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 01:12:29.905440 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902640    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 01:12:29.905440 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902643    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 01:12:29.905440 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902645    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 01:12:29.905440 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902648    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 01:12:29.905440 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902650    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 01:12:29.905440 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902653    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 01:12:29.905440 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902655    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 01:12:29.905440 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902658    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 01:12:29.905440 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902662    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 01:12:29.905440 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902666    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 01:12:29.905440 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902668    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 01:12:29.905440 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902671    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 01:12:29.905440 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902673    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 01:12:29.905440 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902676    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 01:12:29.905440 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902679    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 01:12:29.905440 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902681    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 01:12:29.905440 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902684    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 01:12:29.905440 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902687    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 01:12:29.905440 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902689    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 01:12:29.905930 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902692    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 01:12:29.905930 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902695    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 01:12:29.905930 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902697    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 01:12:29.905930 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902700    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 01:12:29.905930 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902702    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 01:12:29.905930 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902705    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 01:12:29.905930 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902708    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 01:12:29.905930 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902710    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 01:12:29.905930 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902714    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 01:12:29.905930 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902718    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 01:12:29.905930 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902720    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 01:12:29.905930 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902723    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 01:12:29.905930 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902727    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 01:12:29.905930 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902729    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 01:12:29.905930 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902732    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 01:12:29.905930 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902735    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 01:12:29.905930 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902738    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 01:12:29.905930 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902741    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 01:12:29.905930 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.902744    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 01:12:29.905930 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903106    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 01:12:29.906446 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903112    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 01:12:29.906446 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903114    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 01:12:29.906446 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903118    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 01:12:29.906446 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903121    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 01:12:29.906446 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903123    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 01:12:29.906446 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903126    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 01:12:29.906446 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903128    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 01:12:29.906446 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903133    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 01:12:29.906446 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903136    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 01:12:29.906446 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903140    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 01:12:29.906446 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903144    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 01:12:29.906446 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903148    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 01:12:29.906446 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903151    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 01:12:29.906446 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903154    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 01:12:29.906446 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903157    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 01:12:29.906446 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903160    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 01:12:29.906446 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903163    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 01:12:29.906446 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903165    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 01:12:29.906446 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903168    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 01:12:29.906902 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903171    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 01:12:29.906902 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903173    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 01:12:29.906902 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903176    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 01:12:29.906902 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903179    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 01:12:29.906902 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903182    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 01:12:29.906902 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903185    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 01:12:29.906902 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903189    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 01:12:29.906902 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903191    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 01:12:29.906902 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903194    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 01:12:29.906902 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903197    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 01:12:29.906902 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903199    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 01:12:29.906902 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903202    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 01:12:29.906902 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903204    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 01:12:29.906902 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903207    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 01:12:29.906902 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903209    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 01:12:29.906902 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903212    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 01:12:29.906902 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903215    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 01:12:29.906902 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903218    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 01:12:29.906902 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903221    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 01:12:29.907424 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903223    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 01:12:29.907424 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903227    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 01:12:29.907424 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903230    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 01:12:29.907424 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903233    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 01:12:29.907424 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903236    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 01:12:29.907424 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903238    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 01:12:29.907424 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903241    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 01:12:29.907424 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903244    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 01:12:29.907424 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903247    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 01:12:29.907424 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903250    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 01:12:29.907424 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903253    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 01:12:29.907424 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903255    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 01:12:29.907424 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903258    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 01:12:29.907424 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903260    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 01:12:29.907424 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903263    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 01:12:29.907424 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903265    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 01:12:29.907424 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903268    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 01:12:29.907424 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903270    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 01:12:29.907424 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903273    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 01:12:29.907424 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903275    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 01:12:29.907909 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903278    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 01:12:29.907909 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903280    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 01:12:29.907909 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903284    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 01:12:29.907909 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903286    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 01:12:29.907909 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903288    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 01:12:29.907909 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903291    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 01:12:29.907909 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903294    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 01:12:29.907909 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903296    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 01:12:29.907909 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903298    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 01:12:29.907909 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903301    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 01:12:29.907909 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903303    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 01:12:29.907909 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903306    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 01:12:29.907909 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903308    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 01:12:29.907909 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903312    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 01:12:29.907909 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903315    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 01:12:29.907909 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903317    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 01:12:29.907909 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903319    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 01:12:29.907909 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903323    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 01:12:29.907909 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903325    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 01:12:29.907909 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903328    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 01:12:29.908400 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903330    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 01:12:29.908400 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903333    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 01:12:29.908400 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903336    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 01:12:29.908400 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903338    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 01:12:29.908400 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903341    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 01:12:29.908400 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903343    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 01:12:29.908400 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903346    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 01:12:29.908400 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903348    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 01:12:29.908400 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903351    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 01:12:29.908400 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903353    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 01:12:29.908400 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903356    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 01:12:29.908400 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903358    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 01:12:29.908400 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903361    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 01:12:29.908400 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903365    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 01:12:29.908400 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903368    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 01:12:29.908400 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903371    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 01:12:29.908400 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903374    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 01:12:29.908400 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903376    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 01:12:29.908400 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903379    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 01:12:29.908878 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.903382    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 01:12:29.908878 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903449    2580 flags.go:64] FLAG: --address="0.0.0.0"
Jul 29 01:12:29.908878 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903456    2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 29 01:12:29.908878 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903461    2580 flags.go:64] FLAG: --anonymous-auth="true"
Jul 29 01:12:29.908878 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903466    2580 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 29 01:12:29.908878 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903470    2580 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 29 01:12:29.908878 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903475    2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 29 01:12:29.908878 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903479    2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 29 01:12:29.908878 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903483    2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 29 01:12:29.908878 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903486    2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 29 01:12:29.908878 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903489    2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 29 01:12:29.908878 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903493    2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 29 01:12:29.908878 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903496    2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 29 01:12:29.908878 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903499    2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 29 01:12:29.908878 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903502    2580 flags.go:64] FLAG: --cgroup-root=""
Jul 29 01:12:29.908878 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903505    2580 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 29 01:12:29.908878 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903509    2580 flags.go:64] FLAG: --client-ca-file=""
Jul 29 01:12:29.908878 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903512    2580 flags.go:64] FLAG: --cloud-provider="external"
Jul 29 01:12:29.908878 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903515    2580 flags.go:64] FLAG: --cluster-dns="[]"
Jul 29 01:12:29.908878 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903519    2580 flags.go:64] FLAG: --cluster-domain=""
Jul 29 01:12:29.908878 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903521    2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 29 01:12:29.908878 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903524    2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 29 01:12:29.908878 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903527    2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 29 01:12:29.908878 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903531    2580 flags.go:64] FLAG: --container-log-max-files="5"
Jul 29 01:12:29.909465 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903534    2580 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 29 01:12:29.909465 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903537    2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 29 01:12:29.909465 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903540    2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 29 01:12:29.909465 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903543    2580 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 29 01:12:29.909465 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903547    2580 flags.go:64] FLAG: --contention-profiling="false"
Jul 29 01:12:29.909465 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903549    2580 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 29 01:12:29.909465 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903552    2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 29 01:12:29.909465 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903555    2580 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 29 01:12:29.909465 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903558    2580 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 29 01:12:29.909465 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903563    2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 29 01:12:29.909465 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903566    2580 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 29 01:12:29.909465 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903569    2580 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 29 01:12:29.909465 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903571    2580 flags.go:64] FLAG: --enable-load-reader="false"
Jul 29 01:12:29.909465 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903574    2580 flags.go:64] FLAG: --enable-server="true"
Jul 29 01:12:29.909465 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903579    2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 29 01:12:29.909465 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903583    2580 flags.go:64] FLAG: --event-burst="100"
Jul 29 01:12:29.909465 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903586    2580 flags.go:64] FLAG: --event-qps="50"
Jul 29 01:12:29.909465 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903589    2580 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 29 01:12:29.909465 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903592    2580 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 29 01:12:29.909465 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903595    2580 flags.go:64] FLAG: --eviction-hard=""
Jul 29 01:12:29.909465 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903599    2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 29 01:12:29.909465 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903602    2580 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 29 01:12:29.909465 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903605    2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 29 01:12:29.909465 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903608    2580 flags.go:64] FLAG: --eviction-soft=""
Jul 29 01:12:29.909465 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903611    2580 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 29 01:12:29.910065 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903614    2580 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 29 01:12:29.910065 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903617    2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 29 01:12:29.910065 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903620    2580 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 29 01:12:29.910065 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903623    2580 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 29 01:12:29.910065 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903625    2580 flags.go:64] FLAG: --fail-swap-on="true"
Jul 29 01:12:29.910065 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903628    2580 flags.go:64] FLAG: --feature-gates=""
Jul 29 01:12:29.910065 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903631    2580 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 29 01:12:29.910065 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903634    2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 29 01:12:29.910065 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903638    2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 29 01:12:29.910065 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903641    2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 29 01:12:29.910065 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903644    2580 flags.go:64] FLAG: --healthz-port="10248"
Jul 29 01:12:29.910065 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903647    2580 flags.go:64] FLAG: --help="false"
Jul 29 01:12:29.910065 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903649    2580 flags.go:64] FLAG: --hostname-override="ip-10-0-142-238.ec2.internal"
Jul 29 01:12:29.910065 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903653    2580 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 29 01:12:29.910065 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903655    2580 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 29 01:12:29.910065 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903658    2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 29 01:12:29.910065 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903663    2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 29 01:12:29.910065 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903667    2580 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 29 01:12:29.910065 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903670    2580 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 29 01:12:29.910065 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903673    2580 flags.go:64] FLAG: --image-service-endpoint=""
Jul 29 01:12:29.910065 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903675    2580 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 29 01:12:29.910065 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903679    2580 flags.go:64] FLAG: --kube-api-burst="100"
Jul 29 01:12:29.910065 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903682    2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 29 01:12:29.910657 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903685    2580 flags.go:64] FLAG: --kube-api-qps="50"
Jul 29 01:12:29.910657 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903688    2580 flags.go:64] FLAG: --kube-reserved=""
Jul 29 01:12:29.910657 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903691    2580 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 29 01:12:29.910657 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903695    2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 29 01:12:29.910657 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903698    2580 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 29 01:12:29.910657 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903701    2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 29 01:12:29.910657 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903704    2580 flags.go:64] FLAG: --lock-file=""
Jul 29 01:12:29.910657 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903707    2580 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 29 01:12:29.910657 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903710    2580 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 29 01:12:29.910657 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903713    2580 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 29 01:12:29.910657 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903718    2580 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 29 01:12:29.910657 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903721    2580 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 29 01:12:29.910657 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903723    2580 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 29 01:12:29.910657 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903726    2580 flags.go:64] FLAG: --logging-format="text"
Jul 29 01:12:29.910657 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903729    2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 29 01:12:29.910657 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903732    2580 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 29 01:12:29.910657 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903735    2580 flags.go:64] FLAG: --manifest-url=""
Jul 29 01:12:29.910657 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903737    2580 flags.go:64] FLAG: --manifest-url-header=""
Jul 29 01:12:29.910657 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903742    2580 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 29 01:12:29.910657 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903744    2580 flags.go:64] FLAG: --max-open-files="1000000"
Jul 29 01:12:29.910657 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903748    2580 flags.go:64] FLAG: --max-pods="110"
Jul 29 01:12:29.910657 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903751    2580 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 29 01:12:29.910657 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903754    2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 29 01:12:29.910657 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903757    2580 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 29 01:12:29.910657 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903760    2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 29 01:12:29.911279 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903764    2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 29 01:12:29.911279 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903767    2580 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 29 01:12:29.911279 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903770    2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 29 01:12:29.911279 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903776    2580 flags.go:64] FLAG: --node-status-max-images="50"
Jul 29 01:12:29.911279 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903779    2580 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 29 01:12:29.911279 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903783    2580 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 29 01:12:29.911279 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903786    2580 flags.go:64] FLAG: --pod-cidr=""
Jul 29 01:12:29.911279 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903789    2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 29 01:12:29.911279 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903794    2580 flags.go:64] FLAG: --pod-manifest-path=""
Jul 29 01:12:29.911279 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903797    2580 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 29 01:12:29.911279 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903800    2580 flags.go:64] FLAG: --pods-per-core="0"
Jul 29 01:12:29.911279 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903803    2580 flags.go:64] FLAG: --port="10250"
Jul 29 01:12:29.911279 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903806    2580 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 29 01:12:29.911279 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903810    2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02f47b9fd29893639"
Jul 29 01:12:29.911279 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903813    2580 flags.go:64] FLAG: --qos-reserved=""
Jul 29 01:12:29.911279 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903816    2580 flags.go:64] FLAG: --read-only-port="10255"
Jul 29 01:12:29.911279 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903819    2580 flags.go:64] FLAG: --register-node="true"
Jul 29 01:12:29.911279 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903822    2580 flags.go:64] FLAG: --register-with-taints=""
Jul 29 01:12:29.911279 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903826    2580 flags.go:64] FLAG: --registry-burst="10"
Jul 29 01:12:29.911279 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903829    2580 flags.go:64] FLAG: --registry-qps="5"
Jul 29 01:12:29.911279 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903832    2580 flags.go:64] FLAG: --reserved-cpus=""
Jul 29 01:12:29.911279 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903834    2580 flags.go:64] FLAG: --reserved-memory=""
Jul 29 01:12:29.911279 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903841    2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 29 01:12:29.911279 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903844    2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 29 01:12:29.911279 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903846    2580 flags.go:64] FLAG: --rotate-certificates="false"
Jul 29 01:12:29.912016 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903849    2580 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 29 01:12:29.912016 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903852    2580 flags.go:64] FLAG: --runonce="false"
Jul 29 01:12:29.912016 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903855    2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 29 01:12:29.912016 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903858    2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 29 01:12:29.912016 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903861    2580 flags.go:64] FLAG: --seccomp-default="false"
Jul 29 01:12:29.912016 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903863    2580 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 29 01:12:29.912016 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903866    2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 29 01:12:29.912016 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903869    2580 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 29 01:12:29.912016 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903875    2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 29 01:12:29.912016 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903878    2580 flags.go:64] FLAG: --storage-driver-password="root"
Jul 29 01:12:29.912016 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903881    2580 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 29 01:12:29.912016 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903884    2580 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 29 01:12:29.912016 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903888    2580 flags.go:64] FLAG: --storage-driver-user="root"
Jul 29 01:12:29.912016 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903891    2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 29 01:12:29.912016 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903894    2580 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 29 01:12:29.912016 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903897    2580 flags.go:64] FLAG: --system-cgroups=""
Jul 29 01:12:29.912016 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903900    2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 29 01:12:29.912016 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903905    2580 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 29 01:12:29.912016 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903908    2580 flags.go:64] FLAG: --tls-cert-file=""
Jul 29 01:12:29.912016 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903910    2580 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 29 01:12:29.912016 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903914    2580 flags.go:64] FLAG: --tls-min-version=""
Jul 29 01:12:29.912016 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903917    2580 flags.go:64] FLAG: --tls-private-key-file=""
Jul 29 01:12:29.912016 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903920    2580 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 29 01:12:29.912016 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903924    2580 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 29 01:12:29.912016 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903926    2580 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 29 01:12:29.912656 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903929    2580 flags.go:64] FLAG: --v="2"
Jul 29 01:12:29.912656 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903933    2580 flags.go:64] FLAG: --version="false"
Jul 29 01:12:29.912656 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903937    2580 flags.go:64] FLAG: --vmodule=""
Jul 29 01:12:29.912656 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903940    2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 29 01:12:29.912656 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.903943    2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 29 01:12:29.912656 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904067    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 01:12:29.912656 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904070    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 01:12:29.912656 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904074    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 01:12:29.912656 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904077    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 01:12:29.912656 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904080    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 01:12:29.912656 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904083    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 01:12:29.912656 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904086    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 01:12:29.912656 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904089    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 01:12:29.912656 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904092    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 01:12:29.912656 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904095    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 01:12:29.912656 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904099    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 01:12:29.912656 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904102    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 01:12:29.912656 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904105    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 01:12:29.912656 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904108    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 01:12:29.912656 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904112    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 01:12:29.912656 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904114    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 01:12:29.913194 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904117    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 01:12:29.913194 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904121    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 01:12:29.913194 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904123    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 01:12:29.913194 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904126    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 01:12:29.913194 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904128    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 01:12:29.913194 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904131    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 01:12:29.913194 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904134    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 01:12:29.913194 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904137    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 01:12:29.913194 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904142    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 01:12:29.913194 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904145    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 01:12:29.913194 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904147    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 01:12:29.913194 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904150    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 01:12:29.913194 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904153    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 01:12:29.913194 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904155    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 01:12:29.913194 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904158    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 01:12:29.913194 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904160    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 01:12:29.913194 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904163    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 01:12:29.913194 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904165    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 01:12:29.913194 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904168    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 01:12:29.913194 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904170    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 01:12:29.913667 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904173    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 01:12:29.913667 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904175    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 01:12:29.913667 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904178    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 01:12:29.913667 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904180    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 01:12:29.913667 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904183    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 01:12:29.913667 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904186    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 01:12:29.913667 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904189    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 01:12:29.913667 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904192    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 01:12:29.913667 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904194    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 01:12:29.913667 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904197    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 01:12:29.913667 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904200    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 01:12:29.913667 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904203    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 01:12:29.913667 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904205    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 01:12:29.913667 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904208    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 01:12:29.913667 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904210    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 01:12:29.913667 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904213    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 01:12:29.913667 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904216    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 01:12:29.913667 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904218    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 01:12:29.913667 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904221    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 01:12:29.913667 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904223    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 01:12:29.914213 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904226    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 01:12:29.914213 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904229    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 01:12:29.914213 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904232    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 01:12:29.914213 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904234    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 01:12:29.914213 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904237    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 01:12:29.914213 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904239    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 01:12:29.914213 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904242    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 01:12:29.914213 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904244    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 01:12:29.914213 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904247    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 01:12:29.914213 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904249    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 01:12:29.914213 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904252    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 01:12:29.914213 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904254    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 01:12:29.914213 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904257    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 01:12:29.914213 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904259    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 01:12:29.914213 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904262    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 01:12:29.914213 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904264    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 01:12:29.914213 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904267    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 01:12:29.914213 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904270    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 01:12:29.914213 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904274    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 01:12:29.914213 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904276    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 01:12:29.914721 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904279    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 01:12:29.914721 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904282    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 01:12:29.914721 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904284    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 01:12:29.914721 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904287    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 01:12:29.914721 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904290    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 01:12:29.914721 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904292    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 01:12:29.914721 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904295    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 01:12:29.914721 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904297    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 01:12:29.914721 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904301    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 01:12:29.914721 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904305    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 01:12:29.914721 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904307    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 01:12:29.914721 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904310    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 01:12:29.914721 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904313    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 01:12:29.914721 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904316    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 01:12:29.914721 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904319    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 01:12:29.914721 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904322    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 01:12:29.914721 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904325    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 01:12:29.914721 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904329    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 01:12:29.914721 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904332    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 01:12:29.915197 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904335    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 01:12:29.915197 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904338    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 01:12:29.915197 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904340    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 01:12:29.915197 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.904343    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 01:12:29.915197 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.904349    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 01:12:29.915197 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.910977    2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 29 01:12:29.915197 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.910994    2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 29 01:12:29.915197 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.911552    2580 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 29 01:12:29.915197 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.911559    2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 29 01:12:29.915197 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911647    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 01:12:29.915197 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911652    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 01:12:29.915197 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911656    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 01:12:29.915197 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911659    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 01:12:29.915197 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911662    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 01:12:29.915197 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911665    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 01:12:29.915579 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911668    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 01:12:29.915579 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911671    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 01:12:29.915579 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911673    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 01:12:29.915579 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911677    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 01:12:29.915579 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911681    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 01:12:29.915579 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911684    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 01:12:29.915579 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911687    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 01:12:29.915579 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911690    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 01:12:29.915579 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911692    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 01:12:29.915579 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911696    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 01:12:29.915579 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911698    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 01:12:29.915579 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911701    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 01:12:29.915579 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911703    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 01:12:29.915579 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911706    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 01:12:29.915579 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911709    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 01:12:29.915579 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911711    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 01:12:29.915579 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911714    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 01:12:29.915579 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911716    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 01:12:29.915579 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911719    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 01:12:29.916047 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911721    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 01:12:29.916047 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911724    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 01:12:29.916047 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911726    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 01:12:29.916047 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911729    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 01:12:29.916047 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911740    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 01:12:29.916047 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911743    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 01:12:29.916047 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911745    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 01:12:29.916047 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911748    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 01:12:29.916047 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911750    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 01:12:29.916047 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911753    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 01:12:29.916047 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911755    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 01:12:29.916047 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911758    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 01:12:29.916047 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911761    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 01:12:29.916047 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911764    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 01:12:29.916047 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911766    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 01:12:29.916047 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911769    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 01:12:29.916047 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911772    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 01:12:29.916047 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911774    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 01:12:29.916047 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911777    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 01:12:29.916047 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911779    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 01:12:29.916534 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911782    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 01:12:29.916534 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911784    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 01:12:29.916534 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911787    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 01:12:29.916534 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911789    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 01:12:29.916534 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911792    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 01:12:29.916534 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911796    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 01:12:29.916534 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911799    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 01:12:29.916534 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911802    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 01:12:29.916534 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911805    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 01:12:29.916534 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911808    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 01:12:29.916534 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911810    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 01:12:29.916534 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911813    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 01:12:29.916534 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911815    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 01:12:29.916534 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911818    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 01:12:29.916534 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911820    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 01:12:29.916534 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911823    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 01:12:29.916534 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911826    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 01:12:29.916534 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911837    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 01:12:29.916534 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911840    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 01:12:29.917015 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911842    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 01:12:29.917015 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911845    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 01:12:29.917015 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911849    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 01:12:29.917015 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911853    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 01:12:29.917015 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911856    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 01:12:29.917015 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911858    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 01:12:29.917015 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911861    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 01:12:29.917015 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911863    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 01:12:29.917015 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911866    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 01:12:29.917015 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911868    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 01:12:29.917015 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911871    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 01:12:29.917015 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911873    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 01:12:29.917015 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911876    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 01:12:29.917015 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911878    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 01:12:29.917015 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911881    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 01:12:29.917015 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911883    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 01:12:29.917015 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911886    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 01:12:29.917015 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911888    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 01:12:29.917015 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911890    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 01:12:29.917015 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911893    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 01:12:29.917508 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911896    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 01:12:29.917508 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911898    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 01:12:29.917508 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911901    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 01:12:29.917508 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911903    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 01:12:29.917508 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911905    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 01:12:29.917508 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911908    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 01:12:29.917508 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911911    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 01:12:29.917508 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911913    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 01:12:29.917508 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911916    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 01:12:29.917508 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911919    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 01:12:29.917508 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911922    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 01:12:29.917508 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911930    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 01:12:29.917508 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911932    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 01:12:29.917508 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911935    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 01:12:29.917508 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.911937    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 01:12:29.918211 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.911942    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 01:12:29.918211 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912115    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 01:12:29.918211 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912120    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 01:12:29.918211 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912123    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 01:12:29.918211 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912126    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 01:12:29.918211 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912129    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 01:12:29.918211 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912132    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 01:12:29.918211 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912136    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 01:12:29.918211 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912140    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 01:12:29.918211 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912143    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 01:12:29.918211 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912145    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 01:12:29.918211 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912148    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 01:12:29.918211 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912151    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 01:12:29.918211 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912153    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 01:12:29.918698 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912156    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 01:12:29.918698 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912158    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 01:12:29.918698 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912161    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 01:12:29.918698 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912164    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 01:12:29.918698 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912166    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 01:12:29.918698 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912169    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 01:12:29.918698 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912171    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 01:12:29.918698 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912174    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 01:12:29.918698 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912176    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 01:12:29.918698 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912179    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 01:12:29.918698 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912181    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 01:12:29.918698 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912184    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 01:12:29.918698 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912186    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 01:12:29.918698 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912189    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 01:12:29.918698 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912192    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 01:12:29.918698 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912200    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 01:12:29.918698 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912203    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 01:12:29.918698 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912206    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 01:12:29.918698 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912208    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 01:12:29.918698 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912211    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 01:12:29.919206 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912213    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 01:12:29.919206 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912216    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 01:12:29.919206 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912218    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 01:12:29.919206 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912221    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 01:12:29.919206 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912223    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 01:12:29.919206 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912226    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 01:12:29.919206 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912228    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 01:12:29.919206 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912231    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 01:12:29.919206 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912233    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 01:12:29.919206 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912237    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 01:12:29.919206 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912239    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 01:12:29.919206 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912242    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 01:12:29.919206 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912244    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 01:12:29.919206 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912246    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 01:12:29.919206 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912249    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 01:12:29.919206 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912251    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 01:12:29.919206 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912254    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 01:12:29.919206 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912256    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 01:12:29.919206 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912259    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 01:12:29.919206 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912261    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 01:12:29.919700 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912264    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 01:12:29.919700 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912266    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 01:12:29.919700 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912269    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 01:12:29.919700 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912271    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 01:12:29.919700 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912273    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 01:12:29.919700 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912276    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 01:12:29.919700 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912279    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 01:12:29.919700 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912281    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 01:12:29.919700 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912290    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 01:12:29.919700 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912292    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 01:12:29.919700 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912295    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 01:12:29.919700 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912297    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 01:12:29.919700 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912300    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 01:12:29.919700 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912302    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 01:12:29.919700 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912306    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 01:12:29.919700 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912309    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 01:12:29.919700 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912312    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 01:12:29.919700 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912315    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 01:12:29.919700 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912317    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 01:12:29.919700 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912320    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 01:12:29.920191 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912323    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 01:12:29.920191 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912326    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 01:12:29.920191 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912328    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 01:12:29.920191 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912331    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 01:12:29.920191 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912333    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 01:12:29.920191 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912336    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 01:12:29.920191 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912338    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 01:12:29.920191 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912340    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 01:12:29.920191 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912343    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 01:12:29.920191 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912345    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 01:12:29.920191 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912349    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 01:12:29.920191 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912352    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 01:12:29.920191 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912355    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 01:12:29.920191 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912357    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 01:12:29.920191 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912360    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 01:12:29.920191 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912363    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 01:12:29.920191 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912365    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 01:12:29.920191 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912368    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 01:12:29.920191 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912370    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 01:12:29.920648 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912373    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 01:12:29.920648 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912375    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 01:12:29.920648 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912383    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 01:12:29.920648 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912386    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 01:12:29.920648 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912389    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 01:12:29.920648 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912391    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 01:12:29.920648 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:29.912394    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 01:12:29.920648 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.912399    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 01:12:29.920648 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.912525    2580 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 29 01:12:29.920648 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.914376    2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 29 01:12:29.920648 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.915436    2580 server.go:1019] "Starting client certificate rotation"
Jul 29 01:12:29.920648 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.915532    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 01:12:29.920648 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.915561    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 01:12:29.920648 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.917598    2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 01:12:29.923005 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.922981    2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 01:12:29.930063 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.930046    2580 log.go:25] "Validated CRI v1 runtime API"
Jul 29 01:12:29.932522 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.932506    2580 log.go:25] "Validated CRI v1 image API"
Jul 29 01:12:29.933394 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.933377    2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 29 01:12:29.936549 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.936528    2580 fs.go:135] Filesystem UUIDs: map[322b8228-b8b8-4978-b485-02c9e4e0ca26:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 e87857c3-9402-4c41-ae8a-1c12546ba991:/dev/nvme0n1p3]
Jul 29 01:12:29.936611 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.936548    2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 29 01:12:29.941343 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.941239    2580 manager.go:216] Machine: {Timestamp:2026-07-29 01:12:29.940237186 +0000 UTC m=+0.252629884 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3130133 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22634d8d6aabf5f5ef06c0368be6e4 SystemUUID:ec22634d-8d6a-abf5-f5ef-06c0368be6e4 BootID:417e76a9-4b30-4390-b474-2ab33be11628 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:17:19:bf:bf:39 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:17:19:bf:bf:39 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:d6:bb:39:61:ee Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 29 01:12:29.941343 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.941332    2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 29 01:12:29.941465 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.941424    2580 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 29 01:12:29.943319 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.943291    2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 29 01:12:29.943487 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.943323    2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-238.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 29 01:12:29.944146 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.944134    2580 topology_manager.go:138] "Creating topology manager with none policy"
Jul 29 01:12:29.944199 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.944151    2580 container_manager_linux.go:309] "Creating device plugin manager"
Jul 29 01:12:29.944199 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.944161    2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 01:12:29.944419 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.944405    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 01:12:29.944735 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.944722    2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 01:12:29.945488 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.945477    2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 29 01:12:29.948219 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.948206    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 01:12:29.948360 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.948349    2580 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 29 01:12:29.948415 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.948400    2580 kubelet.go:486] "Attempting to sync node with API server"
Jul 29 01:12:29.948461 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.948414    2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 29 01:12:29.948461 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.948434    2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 29 01:12:29.948461 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.948453    2580 kubelet.go:398] "Adding apiserver pod source"
Jul 29 01:12:29.948601 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.948466    2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 29 01:12:29.948829 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.948815    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 01:12:29.948894 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.948840    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 01:12:29.950780 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.950764    2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 29 01:12:29.952181 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.952162    2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 29 01:12:29.952246 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.952196    2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 29 01:12:29.953668 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.953655    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 29 01:12:29.953668 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.953670    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 29 01:12:29.953754 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.953677    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 29 01:12:29.953754 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.953683    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 29 01:12:29.953754 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.953692    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 29 01:12:29.953754 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.953697    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 29 01:12:29.953754 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.953705    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 29 01:12:29.953754 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.953710    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 29 01:12:29.953754 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.953717    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 29 01:12:29.953754 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.953722    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 29 01:12:29.953754 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.953731    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 29 01:12:29.953754 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.953736    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 29 01:12:29.954184 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.953769    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 29 01:12:29.954184 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.953774    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 29 01:12:29.957268 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.957254    2580 server.go:1268] "Started kubelet"
Jul 29 01:12:29.957348 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.957328    2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 29 01:12:29.957523 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.957443    2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 29 01:12:29.959811 ip-10-0-142-238 systemd[1]: Started Kubernetes Kubelet.
Jul 29 01:12:29.960604 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.960380    2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-238.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 29 01:12:29.960604 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:29.960547    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 29 01:12:29.960773 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:29.960672    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-238.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 29 01:12:29.960773 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.960743    2580 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 29 01:12:29.962018 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.961999    2580 server.go:310] "Adding debug handlers to kubelet server"
Jul 29 01:12:29.962669 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.962650    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4kl9m"
Jul 29 01:12:29.964226 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.964203    2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 29 01:12:29.964684 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:29.964657    2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 29 01:12:29.964870 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:29.964140    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-238.ec2.internal.18c69d915d1fb359  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-238.ec2.internal,UID:ip-10-0-142-238.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-238.ec2.internal,},FirstTimestamp:2026-07-29 01:12:29.957157721 +0000 UTC m=+0.269550420,LastTimestamp:2026-07-29 01:12:29.957157721 +0000 UTC m=+0.269550420,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-238.ec2.internal,}"
Jul 29 01:12:29.969336 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.969318    2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 29 01:12:29.969424 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.969337    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 29 01:12:29.969424 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:29.969385    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-238.ec2.internal\" not found"
Jul 29 01:12:29.969793 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.969777    2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 29 01:12:29.969882 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.969780    2580 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 29 01:12:29.969882 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.969814    2580 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 29 01:12:29.970039 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.969937    2580 reconstruct.go:97] "Volume reconstruction finished"
Jul 29 01:12:29.970039 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.969960    2580 reconciler.go:29] "Reconciler: start to sync state"
Jul 29 01:12:29.970184 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.970167    2580 factory.go:55] Registering systemd factory
Jul 29 01:12:29.970184 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.970186    2580 factory.go:223] Registration of the systemd container factory successfully
Jul 29 01:12:29.970403 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.970388    2580 factory.go:153] Registering CRI-O factory
Jul 29 01:12:29.970403 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.970404    2580 factory.go:223] Registration of the crio container factory successfully
Jul 29 01:12:29.970502 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.970451    2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 29 01:12:29.970502 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.970472    2580 factory.go:103] Registering Raw factory
Jul 29 01:12:29.970502 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.970487    2580 manager.go:1196] Started watching for new ooms in manager
Jul 29 01:12:29.970599 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.970555    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4kl9m"
Jul 29 01:12:29.970906 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.970894    2580 manager.go:349] Starting recovery of all containers
Jul 29 01:12:29.972316 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:29.972291    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 29 01:12:29.972426 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:29.972390    2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-238.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 29 01:12:29.979737 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.979716    2580 manager.go:354] Recovery completed
Jul 29 01:12:29.981049 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:29.980974    2580 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 29 01:12:29.984082 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.984071    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 01:12:29.985818 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.985803    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-238.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 01:12:29.985866 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.985838    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-238.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 01:12:29.985866 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.985851    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-238.ec2.internal" event="NodeHasSufficientPID"
Jul 29 01:12:29.986446 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.986416    2580 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 29 01:12:29.986446 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.986446    2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 29 01:12:29.986550 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.986460    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 01:12:29.986550 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.986434    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 01:12:29.987293 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.987279    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-238.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 01:12:29.987362 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.987308    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-238.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 01:12:29.987362 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.987323    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-238.ec2.internal" event="NodeHasSufficientPID"
Jul 29 01:12:29.988945 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.988933    2580 policy_none.go:49] "None policy: Start"
Jul 29 01:12:29.989347 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.989337    2580 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 29 01:12:29.989383 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.989355    2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 29 01:12:29.991325 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:29.991311    2580 policy_none.go:47] "Start"
Jul 29 01:12:30.028998 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.028977    2580 manager.go:337] "Starting Device Plugin manager"
Jul 29 01:12:30.029080 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:30.029020    2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 29 01:12:30.029080 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.029031    2580 server.go:87] "Starting device plugin registration server"
Jul 29 01:12:30.029248 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.029237    2580 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 29 01:12:30.029280 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.029249    2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 29 01:12:30.029377 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.029355    2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 29 01:12:30.029455 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.029447    2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 29 01:12:30.029551 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.029455    2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 29 01:12:30.029916 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:30.029897    2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 29 01:12:30.030079 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:30.030059    2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-238.ec2.internal\" not found"
Jul 29 01:12:30.130162 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.130132    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 01:12:30.132245 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.131071    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-238.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 01:12:30.132245 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.131099    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-238.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 01:12:30.132245 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.131110    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-238.ec2.internal" event="NodeHasSufficientPID"
Jul 29 01:12:30.132245 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.131138    2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-238.ec2.internal"
Jul 29 01:12:30.138586 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.138571    2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-238.ec2.internal"
Jul 29 01:12:30.138637 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:30.138593    2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-238.ec2.internal\": node \"ip-10-0-142-238.ec2.internal\" not found"
Jul 29 01:12:30.154822 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:30.154774    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-238.ec2.internal\" not found"
Jul 29 01:12:30.162438 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.162418    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 29 01:12:30.163606 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.163587    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 29 01:12:30.163671 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.163619    2580 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 29 01:12:30.163671 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.163636    2580 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 29 01:12:30.163671 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:30.163664    2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 29 01:12:30.165376 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.165361    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 01:12:30.255659 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:30.255642    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-238.ec2.internal\" not found"
Jul 29 01:12:30.263737 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.263705    2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-238.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-238.ec2.internal"]
Jul 29 01:12:30.263800 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.263784    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 01:12:30.266866 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.266851    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-238.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 01:12:30.266934 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.266876    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-238.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 01:12:30.266934 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.266885    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-238.ec2.internal" event="NodeHasSufficientPID"
Jul 29 01:12:30.269006 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.268994    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 01:12:30.269116 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.269101    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-238.ec2.internal"
Jul 29 01:12:30.269166 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.269134    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 01:12:30.269692 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.269679    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-238.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 01:12:30.269758 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.269706    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-238.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 01:12:30.269758 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.269729    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-238.ec2.internal" event="NodeHasSufficientPID"
Jul 29 01:12:30.269992 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.269975    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-238.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 01:12:30.270061 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.270005    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-238.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 01:12:30.270061 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.270018    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-238.ec2.internal" event="NodeHasSufficientPID"
Jul 29 01:12:30.270733 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.270716    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/058b030a4d40dd193c07301663f4e12e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-238.ec2.internal\" (UID: \"058b030a4d40dd193c07301663f4e12e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-238.ec2.internal"
Jul 29 01:12:30.270789 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.270742    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/058b030a4d40dd193c07301663f4e12e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-238.ec2.internal\" (UID: \"058b030a4d40dd193c07301663f4e12e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-238.ec2.internal"
Jul 29 01:12:30.270789 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.270758    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fc633d594ee9635d73371706219c2df2-config\") pod \"kube-apiserver-proxy-ip-10-0-142-238.ec2.internal\" (UID: \"fc633d594ee9635d73371706219c2df2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-238.ec2.internal"
Jul 29 01:12:30.271786 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.271771    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-238.ec2.internal"
Jul 29 01:12:30.271855 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.271797    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 01:12:30.272456 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.272443    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-238.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 01:12:30.272525 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.272468    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-238.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 01:12:30.272525 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.272480    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-238.ec2.internal" event="NodeHasSufficientPID"
Jul 29 01:12:30.291469 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:30.291447    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-238.ec2.internal\" not found" node="ip-10-0-142-238.ec2.internal"
Jul 29 01:12:30.295605 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:30.295589    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-238.ec2.internal\" not found" node="ip-10-0-142-238.ec2.internal"
Jul 29 01:12:30.356303 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:30.356282    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-238.ec2.internal\" not found"
Jul 29 01:12:30.371519 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.371491    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fc633d594ee9635d73371706219c2df2-config\") pod \"kube-apiserver-proxy-ip-10-0-142-238.ec2.internal\" (UID: \"fc633d594ee9635d73371706219c2df2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-238.ec2.internal"
Jul 29 01:12:30.371653 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.371529    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/058b030a4d40dd193c07301663f4e12e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-238.ec2.internal\" (UID: \"058b030a4d40dd193c07301663f4e12e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-238.ec2.internal"
Jul 29 01:12:30.371653 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.371552    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fc633d594ee9635d73371706219c2df2-config\") pod \"kube-apiserver-proxy-ip-10-0-142-238.ec2.internal\" (UID: \"fc633d594ee9635d73371706219c2df2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-238.ec2.internal"
Jul 29 01:12:30.371653 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.371594    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/058b030a4d40dd193c07301663f4e12e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-238.ec2.internal\" (UID: \"058b030a4d40dd193c07301663f4e12e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-238.ec2.internal"
Jul 29 01:12:30.371653 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.371598    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/058b030a4d40dd193c07301663f4e12e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-238.ec2.internal\" (UID: \"058b030a4d40dd193c07301663f4e12e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-238.ec2.internal"
Jul 29 01:12:30.371653 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.371553    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/058b030a4d40dd193c07301663f4e12e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-238.ec2.internal\" (UID: \"058b030a4d40dd193c07301663f4e12e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-238.ec2.internal"
Jul 29 01:12:30.456888 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:30.456834    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-238.ec2.internal\" not found"
Jul 29 01:12:30.557223 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:30.557187    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-238.ec2.internal\" not found"
Jul 29 01:12:30.593576 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.593550    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-238.ec2.internal"
Jul 29 01:12:30.598099 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.597987    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-238.ec2.internal"
Jul 29 01:12:30.657642 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:30.657616    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-238.ec2.internal\" not found"
Jul 29 01:12:30.758089 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:30.758046    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-238.ec2.internal\" not found"
Jul 29 01:12:30.791958 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.791932    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 01:12:30.858219 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:30.858200    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-238.ec2.internal\" not found"
Jul 29 01:12:30.915587 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.915565    2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 29 01:12:30.915942 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.915686    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 29 01:12:30.915942 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.915705    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 29 01:12:30.959003 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:30.958979    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-238.ec2.internal\" not found"
Jul 29 01:12:30.980830 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.980801    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 01:07:29 +0000 UTC" deadline="2028-04-09 12:27:15.589251224 +0000 UTC"
Jul 29 01:12:30.980830 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:30.980828    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14891h14m44.608426283s"
Jul 29 01:12:31.045852 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.045801    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 01:12:31.054604 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:31.054578    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod058b030a4d40dd193c07301663f4e12e.slice/crio-0d31b4bc55cd6adea35a71efaa63e4ea7d06dd236aff645c0f7c59029ccaad35 WatchSource:0}: Error finding container 0d31b4bc55cd6adea35a71efaa63e4ea7d06dd236aff645c0f7c59029ccaad35: Status 404 returned error can't find the container with id 0d31b4bc55cd6adea35a71efaa63e4ea7d06dd236aff645c0f7c59029ccaad35
Jul 29 01:12:31.054816 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:31.054791    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc633d594ee9635d73371706219c2df2.slice/crio-30c324508e63cf6e291a556e47c4db2002d9198d67c3476608dc43dff0deffa3 WatchSource:0}: Error finding container 30c324508e63cf6e291a556e47c4db2002d9198d67c3476608dc43dff0deffa3: Status 404 returned error can't find the container with id 30c324508e63cf6e291a556e47c4db2002d9198d67c3476608dc43dff0deffa3
Jul 29 01:12:31.059039 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:31.059020    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-238.ec2.internal\" not found"
Jul 29 01:12:31.059580 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.059568    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 01:12:31.160136 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:31.160110    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-238.ec2.internal\" not found"
Jul 29 01:12:31.167064 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.167020    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-238.ec2.internal" event={"ID":"058b030a4d40dd193c07301663f4e12e","Type":"ContainerStarted","Data":"0d31b4bc55cd6adea35a71efaa63e4ea7d06dd236aff645c0f7c59029ccaad35"}
Jul 29 01:12:31.167888 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.167866    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-238.ec2.internal" event={"ID":"fc633d594ee9635d73371706219c2df2","Type":"ContainerStarted","Data":"30c324508e63cf6e291a556e47c4db2002d9198d67c3476608dc43dff0deffa3"}
Jul 29 01:12:31.217575 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.217548    2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 01:12:31.269847 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.269825    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-238.ec2.internal"
Jul 29 01:12:31.279051 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.279031    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 01:12:31.279722 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.279711    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-238.ec2.internal"
Jul 29 01:12:31.287144 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.287127    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 01:12:31.949060 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.949022    2580 apiserver.go:52] "Watching apiserver"
Jul 29 01:12:31.957154 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.957100    2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 29 01:12:31.957605 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.957561    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-7k5r4","openshift-network-operator/iptables-alerter-tqlp2","kube-system/konnectivity-agent-2vj4h","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmkhs","openshift-cluster-node-tuning-operator/tuned-wv4bc","openshift-dns/node-resolver-twzs7","openshift-multus/multus-additional-cni-plugins-ps929","openshift-ovn-kubernetes/ovnkube-node-8g9fl","kube-system/global-pull-secret-syncer-n7dj7","kube-system/kube-apiserver-proxy-ip-10-0-142-238.ec2.internal","openshift-image-registry/node-ca-2m2ss","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-238.ec2.internal","openshift-multus/multus-5h525","openshift-multus/network-metrics-daemon-s247d"]
Jul 29 01:12:31.960484 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.960460    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ps929"
Jul 29 01:12:31.961582 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.961558    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 01:12:31.963063 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.963030    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5h525"
Jul 29 01:12:31.963177 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.963141    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 29 01:12:31.963267 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.963246    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 29 01:12:31.963560 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.963540    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 29 01:12:31.963654 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.963577    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 29 01:12:31.963822 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.963807    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 29 01:12:31.964690 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.964634    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-49mch\""
Jul 29 01:12:31.965255 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.965227    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2v7k4\""
Jul 29 01:12:31.965595 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.965572    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2vj4h"
Jul 29 01:12:31.965788 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.965576    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 29 01:12:31.967974 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.967719    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmkhs"
Jul 29 01:12:31.967974 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.967757    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-bv5fs\""
Jul 29 01:12:31.967974 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.967784    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 29 01:12:31.967974 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.967919    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 29 01:12:31.970011 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.969990    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 29 01:12:31.970446 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.970209    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 29 01:12:31.970446 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.970369    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 29 01:12:31.970546 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.970458    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6v4zf\""
Jul 29 01:12:31.970595 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.970548    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wv4bc"
Jul 29 01:12:31.970595 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.970565    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 29 01:12:31.972481 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.972446    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-twzs7"
Jul 29 01:12:31.973214 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.973177    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 29 01:12:31.974292 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.974103    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 29 01:12:31.974397 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.974372    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-fp5nd\""
Jul 29 01:12:31.974811 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.974761    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 29 01:12:31.975116 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.975097    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7dj7"
Jul 29 01:12:31.975323 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:31.975280    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7dj7" podUID="aee511a0-1681-4291-90ee-eda4bfb122dc"
Jul 29 01:12:31.976172 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.976151    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 29 01:12:31.976172 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.976170    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9wslv\""
Jul 29 01:12:31.979221 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.979197    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6deac2fc-a413-4f50-8fb6-674172396beb-etc-sysctl-conf\") pod \"tuned-wv4bc\" (UID: \"6deac2fc-a413-4f50-8fb6-674172396beb\") " pod="openshift-cluster-node-tuning-operator/tuned-wv4bc"
Jul 29 01:12:31.979330 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.979239    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/84b80591-4471-4103-9031-3e72a0a3ca7a-host-run-multus-certs\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:31.979330 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.979266    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2fc7f511-69f2-44bd-9e16-fd635c4bb098-agent-certs\") pod \"konnectivity-agent-2vj4h\" (UID: \"2fc7f511-69f2-44bd-9e16-fd635c4bb098\") " pod="kube-system/konnectivity-agent-2vj4h"
Jul 29 01:12:31.979330 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.979290    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a175742e-f244-4f5f-abc7-4fac5676789e-device-dir\") pod \"aws-ebs-csi-driver-node-xmkhs\" (UID: \"a175742e-f244-4f5f-abc7-4fac5676789e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmkhs"
Jul 29 01:12:31.979330 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.979297    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k5r4"
Jul 29 01:12:31.979330 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.979314    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9c156d63-8457-4165-b635-a1e0a523c733-cnibin\") pod \"multus-additional-cni-plugins-ps929\" (UID: \"9c156d63-8457-4165-b635-a1e0a523c733\") " pod="openshift-multus/multus-additional-cni-plugins-ps929"
Jul 29 01:12:31.979579 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.979341    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/84b80591-4471-4103-9031-3e72a0a3ca7a-host-run-netns\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:31.979579 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.979364    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/84b80591-4471-4103-9031-3e72a0a3ca7a-multus-conf-dir\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:31.979579 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.979388    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/84b80591-4471-4103-9031-3e72a0a3ca7a-multus-daemon-config\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:31.979579 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.979432    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2fc7f511-69f2-44bd-9e16-fd635c4bb098-konnectivity-ca\") pod \"konnectivity-agent-2vj4h\" (UID: \"2fc7f511-69f2-44bd-9e16-fd635c4bb098\") " pod="kube-system/konnectivity-agent-2vj4h"
Jul 29 01:12:31.979579 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.979455    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6deac2fc-a413-4f50-8fb6-674172396beb-etc-sysconfig\") pod \"tuned-wv4bc\" (UID: \"6deac2fc-a413-4f50-8fb6-674172396beb\") " pod="openshift-cluster-node-tuning-operator/tuned-wv4bc"
Jul 29 01:12:31.979579 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.979478    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6deac2fc-a413-4f50-8fb6-674172396beb-etc-kubernetes\") pod \"tuned-wv4bc\" (UID: \"6deac2fc-a413-4f50-8fb6-674172396beb\") " pod="openshift-cluster-node-tuning-operator/tuned-wv4bc"
Jul 29 01:12:31.979579 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:31.979362    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k5r4" podUID="5066ce06-1832-4291-9b2e-852aff936a92"
Jul 29 01:12:31.979579 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.979500    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcbg9\" (UniqueName: \"kubernetes.io/projected/84b80591-4471-4103-9031-3e72a0a3ca7a-kube-api-access-xcbg9\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:31.979579 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.979537    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9c156d63-8457-4165-b635-a1e0a523c733-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ps929\" (UID: \"9c156d63-8457-4165-b635-a1e0a523c733\") " pod="openshift-multus/multus-additional-cni-plugins-ps929"
Jul 29 01:12:31.979579 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.979568    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9c156d63-8457-4165-b635-a1e0a523c733-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ps929\" (UID: \"9c156d63-8457-4165-b635-a1e0a523c733\") " pod="openshift-multus/multus-additional-cni-plugins-ps929"
Jul 29 01:12:31.980056 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.979594    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9c156d63-8457-4165-b635-a1e0a523c733-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ps929\" (UID: \"9c156d63-8457-4165-b635-a1e0a523c733\") " pod="openshift-multus/multus-additional-cni-plugins-ps929"
Jul 29 01:12:31.980056 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.979619    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84b80591-4471-4103-9031-3e72a0a3ca7a-system-cni-dir\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:31.980056 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.979641    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84b80591-4471-4103-9031-3e72a0a3ca7a-multus-cni-dir\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:31.980056 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.979666    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/84b80591-4471-4103-9031-3e72a0a3ca7a-host-run-k8s-cni-cncf-io\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:31.980056 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.979695    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/84b80591-4471-4103-9031-3e72a0a3ca7a-host-var-lib-cni-multus\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:31.980056 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.979753    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c156d63-8457-4165-b635-a1e0a523c733-system-cni-dir\") pod \"multus-additional-cni-plugins-ps929\" (UID: \"9c156d63-8457-4165-b635-a1e0a523c733\") " pod="openshift-multus/multus-additional-cni-plugins-ps929"
Jul 29 01:12:31.980056 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.979789    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9c156d63-8457-4165-b635-a1e0a523c733-os-release\") pod \"multus-additional-cni-plugins-ps929\" (UID: \"9c156d63-8457-4165-b635-a1e0a523c733\") " pod="openshift-multus/multus-additional-cni-plugins-ps929"
Jul 29 01:12:31.980056 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.979816    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84b80591-4471-4103-9031-3e72a0a3ca7a-etc-kubernetes\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:31.980056 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.979845    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a175742e-f244-4f5f-abc7-4fac5676789e-sys-fs\") pod \"aws-ebs-csi-driver-node-xmkhs\" (UID: \"a175742e-f244-4f5f-abc7-4fac5676789e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmkhs"
Jul 29 01:12:31.980056 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.979868    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6deac2fc-a413-4f50-8fb6-674172396beb-etc-systemd\") pod \"tuned-wv4bc\" (UID: \"6deac2fc-a413-4f50-8fb6-674172396beb\") " pod="openshift-cluster-node-tuning-operator/tuned-wv4bc"
Jul 29 01:12:31.980056 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.979891    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6deac2fc-a413-4f50-8fb6-674172396beb-run\") pod \"tuned-wv4bc\" (UID: \"6deac2fc-a413-4f50-8fb6-674172396beb\") " pod="openshift-cluster-node-tuning-operator/tuned-wv4bc"
Jul 29 01:12:31.980056 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.979971    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8l9d\" (UniqueName: \"kubernetes.io/projected/9c156d63-8457-4165-b635-a1e0a523c733-kube-api-access-j8l9d\") pod \"multus-additional-cni-plugins-ps929\" (UID: \"9c156d63-8457-4165-b635-a1e0a523c733\") " pod="openshift-multus/multus-additional-cni-plugins-ps929"
Jul 29 01:12:31.980056 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.980011    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/84b80591-4471-4103-9031-3e72a0a3ca7a-cnibin\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:31.980056 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.980037    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/84b80591-4471-4103-9031-3e72a0a3ca7a-os-release\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:31.980056 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.980060    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/84b80591-4471-4103-9031-3e72a0a3ca7a-host-var-lib-cni-bin\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:31.980739 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.980083    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6deac2fc-a413-4f50-8fb6-674172396beb-etc-sysctl-d\") pod \"tuned-wv4bc\" (UID: \"6deac2fc-a413-4f50-8fb6-674172396beb\") " pod="openshift-cluster-node-tuning-operator/tuned-wv4bc"
Jul 29 01:12:31.980739 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.980106    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6deac2fc-a413-4f50-8fb6-674172396beb-sys\") pod \"tuned-wv4bc\" (UID: \"6deac2fc-a413-4f50-8fb6-674172396beb\") " pod="openshift-cluster-node-tuning-operator/tuned-wv4bc"
Jul 29 01:12:31.980739 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.980130    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6deac2fc-a413-4f50-8fb6-674172396beb-var-lib-kubelet\") pod \"tuned-wv4bc\" (UID: \"6deac2fc-a413-4f50-8fb6-674172396beb\") " pod="openshift-cluster-node-tuning-operator/tuned-wv4bc"
Jul 29 01:12:31.980739 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.980151    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c04440bc-a775-4a45-8ce2-32be6df62627-tmp-dir\") pod \"node-resolver-twzs7\" (UID: \"c04440bc-a775-4a45-8ce2-32be6df62627\") " pod="openshift-dns/node-resolver-twzs7"
Jul 29 01:12:31.980739 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.980177    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a175742e-f244-4f5f-abc7-4fac5676789e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xmkhs\" (UID: \"a175742e-f244-4f5f-abc7-4fac5676789e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmkhs"
Jul 29 01:12:31.980739 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.980201    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnlcn\" (UniqueName: \"kubernetes.io/projected/a175742e-f244-4f5f-abc7-4fac5676789e-kube-api-access-qnlcn\") pod \"aws-ebs-csi-driver-node-xmkhs\" (UID: \"a175742e-f244-4f5f-abc7-4fac5676789e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmkhs"
Jul 29 01:12:31.980739 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.980225    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6deac2fc-a413-4f50-8fb6-674172396beb-etc-modprobe-d\") pod \"tuned-wv4bc\" (UID: \"6deac2fc-a413-4f50-8fb6-674172396beb\") " pod="openshift-cluster-node-tuning-operator/tuned-wv4bc"
Jul 29 01:12:31.980739 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.980248    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6deac2fc-a413-4f50-8fb6-674172396beb-lib-modules\") pod \"tuned-wv4bc\" (UID: \"6deac2fc-a413-4f50-8fb6-674172396beb\") " pod="openshift-cluster-node-tuning-operator/tuned-wv4bc"
Jul 29 01:12:31.980739 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.980455    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6deac2fc-a413-4f50-8fb6-674172396beb-host\") pod \"tuned-wv4bc\" (UID: \"6deac2fc-a413-4f50-8fb6-674172396beb\") " pod="openshift-cluster-node-tuning-operator/tuned-wv4bc"
Jul 29 01:12:31.980739 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.980499    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6deac2fc-a413-4f50-8fb6-674172396beb-etc-tuned\") pod \"tuned-wv4bc\" (UID: \"6deac2fc-a413-4f50-8fb6-674172396beb\") " pod="openshift-cluster-node-tuning-operator/tuned-wv4bc"
Jul 29 01:12:31.980739 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.980540    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6deac2fc-a413-4f50-8fb6-674172396beb-tmp\") pod \"tuned-wv4bc\" (UID: \"6deac2fc-a413-4f50-8fb6-674172396beb\") " pod="openshift-cluster-node-tuning-operator/tuned-wv4bc"
Jul 29 01:12:31.980739 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.980563    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c04440bc-a775-4a45-8ce2-32be6df62627-hosts-file\") pod \"node-resolver-twzs7\" (UID: \"c04440bc-a775-4a45-8ce2-32be6df62627\") " pod="openshift-dns/node-resolver-twzs7"
Jul 29 01:12:31.980739 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.980606    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a175742e-f244-4f5f-abc7-4fac5676789e-socket-dir\") pod \"aws-ebs-csi-driver-node-xmkhs\" (UID: \"a175742e-f244-4f5f-abc7-4fac5676789e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmkhs"
Jul 29 01:12:31.980739 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.980631    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a175742e-f244-4f5f-abc7-4fac5676789e-etc-selinux\") pod \"aws-ebs-csi-driver-node-xmkhs\" (UID: \"a175742e-f244-4f5f-abc7-4fac5676789e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmkhs"
Jul 29 01:12:31.980739 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.980714    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzmk9\" (UniqueName: \"kubernetes.io/projected/6deac2fc-a413-4f50-8fb6-674172396beb-kube-api-access-rzmk9\") pod \"tuned-wv4bc\" (UID: \"6deac2fc-a413-4f50-8fb6-674172396beb\") " pod="openshift-cluster-node-tuning-operator/tuned-wv4bc"
Jul 29 01:12:31.980739 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.980743    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b9t4\" (UniqueName: \"kubernetes.io/projected/c04440bc-a775-4a45-8ce2-32be6df62627-kube-api-access-6b9t4\") pod \"node-resolver-twzs7\" (UID: \"c04440bc-a775-4a45-8ce2-32be6df62627\") " pod="openshift-dns/node-resolver-twzs7"
Jul 29 01:12:31.981491 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.980766    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9c156d63-8457-4165-b635-a1e0a523c733-cni-binary-copy\") pod \"multus-additional-cni-plugins-ps929\" (UID: \"9c156d63-8457-4165-b635-a1e0a523c733\") " pod="openshift-multus/multus-additional-cni-plugins-ps929"
Jul 29 01:12:31.981491 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.980813    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/84b80591-4471-4103-9031-3e72a0a3ca7a-cni-binary-copy\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:31.981491 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.980836    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/84b80591-4471-4103-9031-3e72a0a3ca7a-multus-socket-dir-parent\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:31.981491 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.980880    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84b80591-4471-4103-9031-3e72a0a3ca7a-host-var-lib-kubelet\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:31.981491 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.980909    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/84b80591-4471-4103-9031-3e72a0a3ca7a-hostroot\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:31.981491 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.980963    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a175742e-f244-4f5f-abc7-4fac5676789e-registration-dir\") pod \"aws-ebs-csi-driver-node-xmkhs\" (UID: \"a175742e-f244-4f5f-abc7-4fac5676789e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmkhs"
Jul 29 01:12:31.981491 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.981207    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tqlp2"
Jul 29 01:12:31.982442 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.982418    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 01:12:31.983689 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.983512    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 29 01:12:31.983689 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.983612    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s247d"
Jul 29 01:12:31.983844 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:31.983702    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s247d" podUID="c57c897c-c75e-4bd5-8c5d-7682906914f2"
Jul 29 01:12:31.984166 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.984145    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jqfq4\""
Jul 29 01:12:31.984512 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.984497    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 29 01:12:31.984880 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.984701    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 29 01:12:31.986308 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.986042    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2m2ss"
Jul 29 01:12:31.988634 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.988381    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 29 01:12:31.988739 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.988656    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 29 01:12:31.989024 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.988823    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:31.989024 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.988872    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-fk7s9\""
Jul 29 01:12:31.989159 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.989126    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 29 01:12:31.991941 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.991900    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 29 01:12:31.992492 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.992148    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 29 01:12:31.992492 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.992154    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 29 01:12:31.992492 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.992215    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 29 01:12:31.992492 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.992165    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 29 01:12:31.992492 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.992274    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bs558\""
Jul 29 01:12:31.992940 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:31.992921    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 29 01:12:32.002984 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.002935    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-nccqx"
Jul 29 01:12:32.010660 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.010636    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nccqx"
Jul 29 01:12:32.070859 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.070831    2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 29 01:12:32.081371 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.081333    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6deac2fc-a413-4f50-8fb6-674172396beb-var-lib-kubelet\") pod \"tuned-wv4bc\" (UID: \"6deac2fc-a413-4f50-8fb6-674172396beb\") " pod="openshift-cluster-node-tuning-operator/tuned-wv4bc"
Jul 29 01:12:32.081548 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.081377    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6deac2fc-a413-4f50-8fb6-674172396beb-lib-modules\") pod \"tuned-wv4bc\" (UID: \"6deac2fc-a413-4f50-8fb6-674172396beb\") " pod="openshift-cluster-node-tuning-operator/tuned-wv4bc"
Jul 29 01:12:32.081548 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.081474    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6deac2fc-a413-4f50-8fb6-674172396beb-var-lib-kubelet\") pod \"tuned-wv4bc\" (UID: \"6deac2fc-a413-4f50-8fb6-674172396beb\") " pod="openshift-cluster-node-tuning-operator/tuned-wv4bc"
Jul 29 01:12:32.081548 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.081490    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-systemd-units\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.081548 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.081519    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6deac2fc-a413-4f50-8fb6-674172396beb-lib-modules\") pod \"tuned-wv4bc\" (UID: \"6deac2fc-a413-4f50-8fb6-674172396beb\") " pod="openshift-cluster-node-tuning-operator/tuned-wv4bc"
Jul 29 01:12:32.081548 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.081528    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-run-systemd\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.081780 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.081570    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-host-run-netns\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.081780 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.081608    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/aee511a0-1681-4291-90ee-eda4bfb122dc-dbus\") pod \"global-pull-secret-syncer-n7dj7\" (UID: \"aee511a0-1681-4291-90ee-eda4bfb122dc\") " pod="kube-system/global-pull-secret-syncer-n7dj7"
Jul 29 01:12:32.081780 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.081636    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gps42\" (UniqueName: \"kubernetes.io/projected/5066ce06-1832-4291-9b2e-852aff936a92-kube-api-access-gps42\") pod \"network-check-target-7k5r4\" (UID: \"5066ce06-1832-4291-9b2e-852aff936a92\") " pod="openshift-network-diagnostics/network-check-target-7k5r4"
Jul 29 01:12:32.081780 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.081660    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/84b80591-4471-4103-9031-3e72a0a3ca7a-cni-binary-copy\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:32.081780 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.081758    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6deac2fc-a413-4f50-8fb6-674172396beb-etc-sysctl-conf\") pod \"tuned-wv4bc\" (UID: \"6deac2fc-a413-4f50-8fb6-674172396beb\") " pod="openshift-cluster-node-tuning-operator/tuned-wv4bc"
Jul 29 01:12:32.082028 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.081808    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-run-openvswitch\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.082028 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.081896    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cwrc\" (UniqueName: \"kubernetes.io/projected/747ed8ca-b021-4f6c-a9ef-8505bc6efdad-kube-api-access-6cwrc\") pod \"iptables-alerter-tqlp2\" (UID: \"747ed8ca-b021-4f6c-a9ef-8505bc6efdad\") " pod="openshift-network-operator/iptables-alerter-tqlp2"
Jul 29 01:12:32.082028 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.081920    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6bf91238-2331-4c79-be9b-4d85192cb848-host\") pod \"node-ca-2m2ss\" (UID: \"6bf91238-2331-4c79-be9b-4d85192cb848\") " pod="openshift-image-registry/node-ca-2m2ss"
Jul 29 01:12:32.082028 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.081965    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/84b80591-4471-4103-9031-3e72a0a3ca7a-host-run-multus-certs\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:32.082028 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.081946    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6deac2fc-a413-4f50-8fb6-674172396beb-etc-sysctl-conf\") pod \"tuned-wv4bc\" (UID: \"6deac2fc-a413-4f50-8fb6-674172396beb\") " pod="openshift-cluster-node-tuning-operator/tuned-wv4bc"
Jul 29 01:12:32.082028 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.082012    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-host-cni-netd\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.082253 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.082063    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/84b80591-4471-4103-9031-3e72a0a3ca7a-host-run-multus-certs\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:32.082253 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.082105    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/747ed8ca-b021-4f6c-a9ef-8505bc6efdad-host-slash\") pod \"iptables-alerter-tqlp2\" (UID: \"747ed8ca-b021-4f6c-a9ef-8505bc6efdad\") " pod="openshift-network-operator/iptables-alerter-tqlp2"
Jul 29 01:12:32.082253 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.082141    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/84b80591-4471-4103-9031-3e72a0a3ca7a-host-run-netns\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:32.082253 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.082158    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/84b80591-4471-4103-9031-3e72a0a3ca7a-multus-conf-dir\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:32.082253 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.082173    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6deac2fc-a413-4f50-8fb6-674172396beb-etc-sysconfig\") pod \"tuned-wv4bc\" (UID: \"6deac2fc-a413-4f50-8fb6-674172396beb\") " pod="openshift-cluster-node-tuning-operator/tuned-wv4bc"
Jul 29 01:12:32.082253 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.082211    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/84b80591-4471-4103-9031-3e72a0a3ca7a-host-run-netns\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:32.082253 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.082219    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6deac2fc-a413-4f50-8fb6-674172396beb-etc-sysconfig\") pod \"tuned-wv4bc\" (UID: \"6deac2fc-a413-4f50-8fb6-674172396beb\") " pod="openshift-cluster-node-tuning-operator/tuned-wv4bc"
Jul 29 01:12:32.082253 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.082234    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/84b80591-4471-4103-9031-3e72a0a3ca7a-multus-conf-dir\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:32.082253 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.082247    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-host-cni-bin\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.082658 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.082273    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-ovnkube-config\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.082658 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.082317    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9c156d63-8457-4165-b635-a1e0a523c733-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ps929\" (UID: \"9c156d63-8457-4165-b635-a1e0a523c733\") " pod="openshift-multus/multus-additional-cni-plugins-ps929"
Jul 29 01:12:32.082658 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.082343    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9c156d63-8457-4165-b635-a1e0a523c733-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ps929\" (UID: \"9c156d63-8457-4165-b635-a1e0a523c733\") " pod="openshift-multus/multus-additional-cni-plugins-ps929"
Jul 29 01:12:32.082658 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.082342    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/84b80591-4471-4103-9031-3e72a0a3ca7a-cni-binary-copy\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:32.082658 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.082358    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84b80591-4471-4103-9031-3e72a0a3ca7a-system-cni-dir\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:32.082658 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.082378    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84b80591-4471-4103-9031-3e72a0a3ca7a-multus-cni-dir\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:32.082658 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.082402    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/84b80591-4471-4103-9031-3e72a0a3ca7a-host-run-k8s-cni-cncf-io\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:32.082658 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.082423    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84b80591-4471-4103-9031-3e72a0a3ca7a-system-cni-dir\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:32.082658 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.082460    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/84b80591-4471-4103-9031-3e72a0a3ca7a-host-run-k8s-cni-cncf-io\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:32.082658 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.082467    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6deac2fc-a413-4f50-8fb6-674172396beb-host\") pod \"tuned-wv4bc\" (UID: \"6deac2fc-a413-4f50-8fb6-674172396beb\") " pod="openshift-cluster-node-tuning-operator/tuned-wv4bc"
Jul 29 01:12:32.082658 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.082471    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9c156d63-8457-4165-b635-a1e0a523c733-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ps929\" (UID: \"9c156d63-8457-4165-b635-a1e0a523c733\") " pod="openshift-multus/multus-additional-cni-plugins-ps929"
Jul 29 01:12:32.082658 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.082426    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6deac2fc-a413-4f50-8fb6-674172396beb-host\") pod \"tuned-wv4bc\" (UID: \"6deac2fc-a413-4f50-8fb6-674172396beb\") " pod="openshift-cluster-node-tuning-operator/tuned-wv4bc"
Jul 29 01:12:32.082658 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.082521    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-host-kubelet\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.082658 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.082548    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-ovn-node-metrics-cert\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.082658 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.082574    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84b80591-4471-4103-9031-3e72a0a3ca7a-multus-cni-dir\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:32.082658 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.082579    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9c156d63-8457-4165-b635-a1e0a523c733-os-release\") pod \"multus-additional-cni-plugins-ps929\" (UID: \"9c156d63-8457-4165-b635-a1e0a523c733\") " pod="openshift-multus/multus-additional-cni-plugins-ps929"
Jul 29 01:12:32.082658 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.082626    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a175742e-f244-4f5f-abc7-4fac5676789e-sys-fs\") pod \"aws-ebs-csi-driver-node-xmkhs\" (UID: \"a175742e-f244-4f5f-abc7-4fac5676789e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmkhs"
Jul 29 01:12:32.083433 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.082633    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9c156d63-8457-4165-b635-a1e0a523c733-os-release\") pod \"multus-additional-cni-plugins-ps929\" (UID: \"9c156d63-8457-4165-b635-a1e0a523c733\") " pod="openshift-multus/multus-additional-cni-plugins-ps929"
Jul 29 01:12:32.083433 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.082650    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6deac2fc-a413-4f50-8fb6-674172396beb-etc-systemd\") pod \"tuned-wv4bc\" (UID: \"6deac2fc-a413-4f50-8fb6-674172396beb\") " pod="openshift-cluster-node-tuning-operator/tuned-wv4bc"
Jul 29 01:12:32.083433 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.082674    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6deac2fc-a413-4f50-8fb6-674172396beb-run\") pod \"tuned-wv4bc\" (UID: \"6deac2fc-a413-4f50-8fb6-674172396beb\") " pod="openshift-cluster-node-tuning-operator/tuned-wv4bc"
Jul 29 01:12:32.083433 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.082701    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-ovnkube-script-lib\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.083433 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.082673    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a175742e-f244-4f5f-abc7-4fac5676789e-sys-fs\") pod \"aws-ebs-csi-driver-node-xmkhs\" (UID: \"a175742e-f244-4f5f-abc7-4fac5676789e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmkhs"
Jul 29 01:12:32.083433 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.082729    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6deac2fc-a413-4f50-8fb6-674172396beb-etc-systemd\") pod \"tuned-wv4bc\" (UID: \"6deac2fc-a413-4f50-8fb6-674172396beb\") " pod="openshift-cluster-node-tuning-operator/tuned-wv4bc"
Jul 29 01:12:32.083433 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.082728    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/aee511a0-1681-4291-90ee-eda4bfb122dc-kubelet-config\") pod \"global-pull-secret-syncer-n7dj7\" (UID: \"aee511a0-1681-4291-90ee-eda4bfb122dc\") " pod="kube-system/global-pull-secret-syncer-n7dj7"
Jul 29 01:12:32.083433 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.082754    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6deac2fc-a413-4f50-8fb6-674172396beb-run\") pod \"tuned-wv4bc\" (UID: \"6deac2fc-a413-4f50-8fb6-674172396beb\") " pod="openshift-cluster-node-tuning-operator/tuned-wv4bc"
Jul 29 01:12:32.083433 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.082773    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfq45\" (UniqueName: \"kubernetes.io/projected/c57c897c-c75e-4bd5-8c5d-7682906914f2-kube-api-access-sfq45\") pod \"network-metrics-daemon-s247d\" (UID: \"c57c897c-c75e-4bd5-8c5d-7682906914f2\") " pod="openshift-multus/network-metrics-daemon-s247d"
Jul 29 01:12:32.083433 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.082800    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8l9d\" (UniqueName: \"kubernetes.io/projected/9c156d63-8457-4165-b635-a1e0a523c733-kube-api-access-j8l9d\") pod \"multus-additional-cni-plugins-ps929\" (UID: \"9c156d63-8457-4165-b635-a1e0a523c733\") " pod="openshift-multus/multus-additional-cni-plugins-ps929"
Jul 29 01:12:32.083433 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.082839    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9c156d63-8457-4165-b635-a1e0a523c733-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ps929\" (UID: \"9c156d63-8457-4165-b635-a1e0a523c733\") " pod="openshift-multus/multus-additional-cni-plugins-ps929"
Jul 29 01:12:32.083433 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.082872    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/84b80591-4471-4103-9031-3e72a0a3ca7a-cnibin\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:32.083433 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.082931    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/84b80591-4471-4103-9031-3e72a0a3ca7a-os-release\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:32.083433 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.082970    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/84b80591-4471-4103-9031-3e72a0a3ca7a-cnibin\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:32.083433 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.082996    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/84b80591-4471-4103-9031-3e72a0a3ca7a-host-var-lib-cni-bin\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:32.083433 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.083019    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/84b80591-4471-4103-9031-3e72a0a3ca7a-os-release\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:32.083433 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.083028    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6deac2fc-a413-4f50-8fb6-674172396beb-etc-sysctl-d\") pod \"tuned-wv4bc\" (UID: \"6deac2fc-a413-4f50-8fb6-674172396beb\") " pod="openshift-cluster-node-tuning-operator/tuned-wv4bc"
Jul 29 01:12:32.083433 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.083053    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c04440bc-a775-4a45-8ce2-32be6df62627-tmp-dir\") pod \"node-resolver-twzs7\" (UID: \"c04440bc-a775-4a45-8ce2-32be6df62627\") " pod="openshift-dns/node-resolver-twzs7"
Jul 29 01:12:32.084260 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.083066    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/84b80591-4471-4103-9031-3e72a0a3ca7a-host-var-lib-cni-bin\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:32.084260 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.083080    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-host-run-ovn-kubernetes\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.084260 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.083106    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c57c897c-c75e-4bd5-8c5d-7682906914f2-metrics-certs\") pod \"network-metrics-daemon-s247d\" (UID: \"c57c897c-c75e-4bd5-8c5d-7682906914f2\") " pod="openshift-multus/network-metrics-daemon-s247d"
Jul 29 01:12:32.084260 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.083128    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6deac2fc-a413-4f50-8fb6-674172396beb-etc-sysctl-d\") pod \"tuned-wv4bc\" (UID: \"6deac2fc-a413-4f50-8fb6-674172396beb\") " pod="openshift-cluster-node-tuning-operator/tuned-wv4bc"
Jul 29 01:12:32.084260 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.083141    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a175742e-f244-4f5f-abc7-4fac5676789e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xmkhs\" (UID: \"a175742e-f244-4f5f-abc7-4fac5676789e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmkhs"
Jul 29 01:12:32.084260 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.083167    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnlcn\" (UniqueName: \"kubernetes.io/projected/a175742e-f244-4f5f-abc7-4fac5676789e-kube-api-access-qnlcn\") pod \"aws-ebs-csi-driver-node-xmkhs\" (UID: \"a175742e-f244-4f5f-abc7-4fac5676789e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmkhs"
Jul 29 01:12:32.084260 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.083193    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6deac2fc-a413-4f50-8fb6-674172396beb-etc-modprobe-d\") pod \"tuned-wv4bc\" (UID: \"6deac2fc-a413-4f50-8fb6-674172396beb\") " pod="openshift-cluster-node-tuning-operator/tuned-wv4bc"
Jul 29 01:12:32.084260 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.083215    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6deac2fc-a413-4f50-8fb6-674172396beb-etc-tuned\") pod \"tuned-wv4bc\" (UID: \"6deac2fc-a413-4f50-8fb6-674172396beb\") " pod="openshift-cluster-node-tuning-operator/tuned-wv4bc"
Jul 29 01:12:32.084260 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.083253    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6deac2fc-a413-4f50-8fb6-674172396beb-tmp\") pod \"tuned-wv4bc\" (UID: \"6deac2fc-a413-4f50-8fb6-674172396beb\") " pod="openshift-cluster-node-tuning-operator/tuned-wv4bc"
Jul 29 01:12:32.084260 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.083278    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6b9t4\" (UniqueName: \"kubernetes.io/projected/c04440bc-a775-4a45-8ce2-32be6df62627-kube-api-access-6b9t4\") pod \"node-resolver-twzs7\" (UID: \"c04440bc-a775-4a45-8ce2-32be6df62627\") " pod="openshift-dns/node-resolver-twzs7"
Jul 29 01:12:32.084260 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.083304    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-run-ovn\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.084260 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.083337    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.084260 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.083344    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c04440bc-a775-4a45-8ce2-32be6df62627-tmp-dir\") pod \"node-resolver-twzs7\" (UID: \"c04440bc-a775-4a45-8ce2-32be6df62627\") " pod="openshift-dns/node-resolver-twzs7"
Jul 29 01:12:32.084260 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.083364    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a175742e-f244-4f5f-abc7-4fac5676789e-socket-dir\") pod \"aws-ebs-csi-driver-node-xmkhs\" (UID: \"a175742e-f244-4f5f-abc7-4fac5676789e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmkhs"
Jul 29 01:12:32.084260 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.083391    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a175742e-f244-4f5f-abc7-4fac5676789e-etc-selinux\") pod \"aws-ebs-csi-driver-node-xmkhs\" (UID: \"a175742e-f244-4f5f-abc7-4fac5676789e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmkhs"
Jul 29 01:12:32.084260 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.083424    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzmk9\" (UniqueName: \"kubernetes.io/projected/6deac2fc-a413-4f50-8fb6-674172396beb-kube-api-access-rzmk9\") pod \"tuned-wv4bc\" (UID: \"6deac2fc-a413-4f50-8fb6-674172396beb\") " pod="openshift-cluster-node-tuning-operator/tuned-wv4bc"
Jul 29 01:12:32.084260 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.083448    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6bf91238-2331-4c79-be9b-4d85192cb848-serviceca\") pod \"node-ca-2m2ss\" (UID: \"6bf91238-2331-4c79-be9b-4d85192cb848\") " pod="openshift-image-registry/node-ca-2m2ss"
Jul 29 01:12:32.085068 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.083471    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9c156d63-8457-4165-b635-a1e0a523c733-cni-binary-copy\") pod \"multus-additional-cni-plugins-ps929\" (UID: \"9c156d63-8457-4165-b635-a1e0a523c733\") " pod="openshift-multus/multus-additional-cni-plugins-ps929"
Jul 29 01:12:32.085068 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.083498    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/84b80591-4471-4103-9031-3e72a0a3ca7a-multus-socket-dir-parent\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:32.085068 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.083521    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84b80591-4471-4103-9031-3e72a0a3ca7a-host-var-lib-kubelet\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:32.085068 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.083544    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/84b80591-4471-4103-9031-3e72a0a3ca7a-hostroot\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:32.085068 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.083570    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a175742e-f244-4f5f-abc7-4fac5676789e-registration-dir\") pod \"aws-ebs-csi-driver-node-xmkhs\" (UID: \"a175742e-f244-4f5f-abc7-4fac5676789e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmkhs"
Jul 29 01:12:32.085068 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.083594    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-node-log\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.085068 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.083618    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-log-socket\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.085068 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.083643    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2fc7f511-69f2-44bd-9e16-fd635c4bb098-agent-certs\") pod \"konnectivity-agent-2vj4h\" (UID: \"2fc7f511-69f2-44bd-9e16-fd635c4bb098\") " pod="kube-system/konnectivity-agent-2vj4h"
Jul 29 01:12:32.085068 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.083669    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a175742e-f244-4f5f-abc7-4fac5676789e-device-dir\") pod \"aws-ebs-csi-driver-node-xmkhs\" (UID: \"a175742e-f244-4f5f-abc7-4fac5676789e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmkhs"
Jul 29 01:12:32.085068 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.083469    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a175742e-f244-4f5f-abc7-4fac5676789e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xmkhs\" (UID: \"a175742e-f244-4f5f-abc7-4fac5676789e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmkhs"
Jul 29 01:12:32.085068 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.083748    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84b80591-4471-4103-9031-3e72a0a3ca7a-host-var-lib-kubelet\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:32.085068 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.083745    2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 29 01:12:32.085068 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.083821    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a175742e-f244-4f5f-abc7-4fac5676789e-socket-dir\") pod \"aws-ebs-csi-driver-node-xmkhs\" (UID: \"a175742e-f244-4f5f-abc7-4fac5676789e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmkhs"
Jul 29 01:12:32.085068 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.083840    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6deac2fc-a413-4f50-8fb6-674172396beb-etc-modprobe-d\") pod \"tuned-wv4bc\" (UID: \"6deac2fc-a413-4f50-8fb6-674172396beb\") " pod="openshift-cluster-node-tuning-operator/tuned-wv4bc"
Jul 29 01:12:32.085068 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.083889    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/84b80591-4471-4103-9031-3e72a0a3ca7a-hostroot\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:32.085068 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.083896    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a175742e-f244-4f5f-abc7-4fac5676789e-etc-selinux\") pod \"aws-ebs-csi-driver-node-xmkhs\" (UID: \"a175742e-f244-4f5f-abc7-4fac5676789e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmkhs"
Jul 29 01:12:32.085068 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.083924    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a175742e-f244-4f5f-abc7-4fac5676789e-registration-dir\") pod \"aws-ebs-csi-driver-node-xmkhs\" (UID: \"a175742e-f244-4f5f-abc7-4fac5676789e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmkhs"
Jul 29 01:12:32.085068 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.084091    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a175742e-f244-4f5f-abc7-4fac5676789e-device-dir\") pod \"aws-ebs-csi-driver-node-xmkhs\" (UID: \"a175742e-f244-4f5f-abc7-4fac5676789e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmkhs"
Jul 29 01:12:32.085974 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.083694    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-host-slash\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.085974 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.084137    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aee511a0-1681-4291-90ee-eda4bfb122dc-original-pull-secret\") pod \"global-pull-secret-syncer-n7dj7\" (UID: \"aee511a0-1681-4291-90ee-eda4bfb122dc\") " pod="kube-system/global-pull-secret-syncer-n7dj7"
Jul 29 01:12:32.085974 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.084172    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/747ed8ca-b021-4f6c-a9ef-8505bc6efdad-iptables-alerter-script\") pod \"iptables-alerter-tqlp2\" (UID: \"747ed8ca-b021-4f6c-a9ef-8505bc6efdad\") " pod="openshift-network-operator/iptables-alerter-tqlp2"
Jul 29 01:12:32.085974 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.084182    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/84b80591-4471-4103-9031-3e72a0a3ca7a-multus-socket-dir-parent\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:32.085974 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.084199    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9c156d63-8457-4165-b635-a1e0a523c733-cnibin\") pod \"multus-additional-cni-plugins-ps929\" (UID: \"9c156d63-8457-4165-b635-a1e0a523c733\") " pod="openshift-multus/multus-additional-cni-plugins-ps929"
Jul 29 01:12:32.085974 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.084224    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/84b80591-4471-4103-9031-3e72a0a3ca7a-multus-daemon-config\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:32.085974 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.084247    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2fc7f511-69f2-44bd-9e16-fd635c4bb098-konnectivity-ca\") pod \"konnectivity-agent-2vj4h\" (UID: \"2fc7f511-69f2-44bd-9e16-fd635c4bb098\") " pod="kube-system/konnectivity-agent-2vj4h"
Jul 29 01:12:32.085974 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.084258    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9c156d63-8457-4165-b635-a1e0a523c733-cnibin\") pod \"multus-additional-cni-plugins-ps929\" (UID: \"9c156d63-8457-4165-b635-a1e0a523c733\") " pod="openshift-multus/multus-additional-cni-plugins-ps929"
Jul 29 01:12:32.085974 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.084270    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6deac2fc-a413-4f50-8fb6-674172396beb-etc-kubernetes\") pod \"tuned-wv4bc\" (UID: \"6deac2fc-a413-4f50-8fb6-674172396beb\") " pod="openshift-cluster-node-tuning-operator/tuned-wv4bc"
Jul 29 01:12:32.085974 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.084298    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-var-lib-openvswitch\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.085974 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.084322    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kx9sh\" (UniqueName: \"kubernetes.io/projected/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-kube-api-access-kx9sh\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.085974 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.084346    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h92qj\" (UniqueName: \"kubernetes.io/projected/6bf91238-2331-4c79-be9b-4d85192cb848-kube-api-access-h92qj\") pod \"node-ca-2m2ss\" (UID: \"6bf91238-2331-4c79-be9b-4d85192cb848\") " pod="openshift-image-registry/node-ca-2m2ss"
Jul 29 01:12:32.085974 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.084372    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcbg9\" (UniqueName: \"kubernetes.io/projected/84b80591-4471-4103-9031-3e72a0a3ca7a-kube-api-access-xcbg9\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:32.085974 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.084378    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9c156d63-8457-4165-b635-a1e0a523c733-cni-binary-copy\") pod \"multus-additional-cni-plugins-ps929\" (UID: \"9c156d63-8457-4165-b635-a1e0a523c733\") " pod="openshift-multus/multus-additional-cni-plugins-ps929"
Jul 29 01:12:32.085974 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.084401    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9c156d63-8457-4165-b635-a1e0a523c733-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ps929\" (UID: \"9c156d63-8457-4165-b635-a1e0a523c733\") " pod="openshift-multus/multus-additional-cni-plugins-ps929"
Jul 29 01:12:32.085974 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.084469    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/84b80591-4471-4103-9031-3e72a0a3ca7a-host-var-lib-cni-multus\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:32.085974 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.084508    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/84b80591-4471-4103-9031-3e72a0a3ca7a-host-var-lib-cni-multus\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:32.086792 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.084658    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6deac2fc-a413-4f50-8fb6-674172396beb-etc-kubernetes\") pod \"tuned-wv4bc\" (UID: \"6deac2fc-a413-4f50-8fb6-674172396beb\") " pod="openshift-cluster-node-tuning-operator/tuned-wv4bc"
Jul 29 01:12:32.086792 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.084710    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c04440bc-a775-4a45-8ce2-32be6df62627-hosts-file\") pod \"node-resolver-twzs7\" (UID: \"c04440bc-a775-4a45-8ce2-32be6df62627\") " pod="openshift-dns/node-resolver-twzs7"
Jul 29 01:12:32.086792 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.084754    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/84b80591-4471-4103-9031-3e72a0a3ca7a-multus-daemon-config\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:32.086792 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.084741    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-etc-openvswitch\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.086792 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.084791    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-env-overrides\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.086792 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.084824    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c156d63-8457-4165-b635-a1e0a523c733-system-cni-dir\") pod \"multus-additional-cni-plugins-ps929\" (UID: \"9c156d63-8457-4165-b635-a1e0a523c733\") " pod="openshift-multus/multus-additional-cni-plugins-ps929"
Jul 29 01:12:32.086792 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.084828    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c04440bc-a775-4a45-8ce2-32be6df62627-hosts-file\") pod \"node-resolver-twzs7\" (UID: \"c04440bc-a775-4a45-8ce2-32be6df62627\") " pod="openshift-dns/node-resolver-twzs7"
Jul 29 01:12:32.086792 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.084866    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84b80591-4471-4103-9031-3e72a0a3ca7a-etc-kubernetes\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:32.086792 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.084874    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c156d63-8457-4165-b635-a1e0a523c733-system-cni-dir\") pod \"multus-additional-cni-plugins-ps929\" (UID: \"9c156d63-8457-4165-b635-a1e0a523c733\") " pod="openshift-multus/multus-additional-cni-plugins-ps929"
Jul 29 01:12:32.086792 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.084891    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6deac2fc-a413-4f50-8fb6-674172396beb-sys\") pod \"tuned-wv4bc\" (UID: \"6deac2fc-a413-4f50-8fb6-674172396beb\") " pod="openshift-cluster-node-tuning-operator/tuned-wv4bc"
Jul 29 01:12:32.086792 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.084923    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84b80591-4471-4103-9031-3e72a0a3ca7a-etc-kubernetes\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:32.086792 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.084936    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2fc7f511-69f2-44bd-9e16-fd635c4bb098-konnectivity-ca\") pod \"konnectivity-agent-2vj4h\" (UID: \"2fc7f511-69f2-44bd-9e16-fd635c4bb098\") " pod="kube-system/konnectivity-agent-2vj4h"
Jul 29 01:12:32.086792 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.085009    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6deac2fc-a413-4f50-8fb6-674172396beb-sys\") pod \"tuned-wv4bc\" (UID: \"6deac2fc-a413-4f50-8fb6-674172396beb\") " pod="openshift-cluster-node-tuning-operator/tuned-wv4bc"
Jul 29 01:12:32.086792 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.085034    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9c156d63-8457-4165-b635-a1e0a523c733-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ps929\" (UID: \"9c156d63-8457-4165-b635-a1e0a523c733\") " pod="openshift-multus/multus-additional-cni-plugins-ps929"
Jul 29 01:12:32.087615 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.087592    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6deac2fc-a413-4f50-8fb6-674172396beb-etc-tuned\") pod \"tuned-wv4bc\" (UID: \"6deac2fc-a413-4f50-8fb6-674172396beb\") " pod="openshift-cluster-node-tuning-operator/tuned-wv4bc"
Jul 29 01:12:32.087836 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.087790    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2fc7f511-69f2-44bd-9e16-fd635c4bb098-agent-certs\") pod \"konnectivity-agent-2vj4h\" (UID: \"2fc7f511-69f2-44bd-9e16-fd635c4bb098\") " pod="kube-system/konnectivity-agent-2vj4h"
Jul 29 01:12:32.088171 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.088151    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6deac2fc-a413-4f50-8fb6-674172396beb-tmp\") pod \"tuned-wv4bc\" (UID: \"6deac2fc-a413-4f50-8fb6-674172396beb\") " pod="openshift-cluster-node-tuning-operator/tuned-wv4bc"
Jul 29 01:12:32.091514 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.091485    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b9t4\" (UniqueName: \"kubernetes.io/projected/c04440bc-a775-4a45-8ce2-32be6df62627-kube-api-access-6b9t4\") pod \"node-resolver-twzs7\" (UID: \"c04440bc-a775-4a45-8ce2-32be6df62627\") " pod="openshift-dns/node-resolver-twzs7"
Jul 29 01:12:32.091665 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.091486    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnlcn\" (UniqueName: \"kubernetes.io/projected/a175742e-f244-4f5f-abc7-4fac5676789e-kube-api-access-qnlcn\") pod \"aws-ebs-csi-driver-node-xmkhs\" (UID: \"a175742e-f244-4f5f-abc7-4fac5676789e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmkhs"
Jul 29 01:12:32.091774 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.091753    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzmk9\" (UniqueName: \"kubernetes.io/projected/6deac2fc-a413-4f50-8fb6-674172396beb-kube-api-access-rzmk9\") pod \"tuned-wv4bc\" (UID: \"6deac2fc-a413-4f50-8fb6-674172396beb\") " pod="openshift-cluster-node-tuning-operator/tuned-wv4bc"
Jul 29 01:12:32.091909 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.091880    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8l9d\" (UniqueName: \"kubernetes.io/projected/9c156d63-8457-4165-b635-a1e0a523c733-kube-api-access-j8l9d\") pod \"multus-additional-cni-plugins-ps929\" (UID: \"9c156d63-8457-4165-b635-a1e0a523c733\") " pod="openshift-multus/multus-additional-cni-plugins-ps929"
Jul 29 01:12:32.092747 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.092716    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcbg9\" (UniqueName: \"kubernetes.io/projected/84b80591-4471-4103-9031-3e72a0a3ca7a-kube-api-access-xcbg9\") pod \"multus-5h525\" (UID: \"84b80591-4471-4103-9031-3e72a0a3ca7a\") " pod="openshift-multus/multus-5h525"
Jul 29 01:12:32.185790 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.185755    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-host-slash\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.185790 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.185792    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aee511a0-1681-4291-90ee-eda4bfb122dc-original-pull-secret\") pod \"global-pull-secret-syncer-n7dj7\" (UID: \"aee511a0-1681-4291-90ee-eda4bfb122dc\") " pod="kube-system/global-pull-secret-syncer-n7dj7"
Jul 29 01:12:32.186099 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.185812    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/747ed8ca-b021-4f6c-a9ef-8505bc6efdad-iptables-alerter-script\") pod \"iptables-alerter-tqlp2\" (UID: \"747ed8ca-b021-4f6c-a9ef-8505bc6efdad\") " pod="openshift-network-operator/iptables-alerter-tqlp2"
Jul 29 01:12:32.186099 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.185871    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-host-slash\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.186099 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.185915    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-var-lib-openvswitch\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.186099 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:32.185962    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 01:12:32.186099 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.186025    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-var-lib-openvswitch\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.186099 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.185970    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kx9sh\" (UniqueName: \"kubernetes.io/projected/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-kube-api-access-kx9sh\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.186099 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:32.186062    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aee511a0-1681-4291-90ee-eda4bfb122dc-original-pull-secret podName:aee511a0-1681-4291-90ee-eda4bfb122dc nodeName:}" failed. No retries permitted until 2026-07-29 01:12:32.686037532 +0000 UTC m=+2.998430238 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aee511a0-1681-4291-90ee-eda4bfb122dc-original-pull-secret") pod "global-pull-secret-syncer-n7dj7" (UID: "aee511a0-1681-4291-90ee-eda4bfb122dc") : object "kube-system"/"original-pull-secret" not registered
Jul 29 01:12:32.186448 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.186148    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h92qj\" (UniqueName: \"kubernetes.io/projected/6bf91238-2331-4c79-be9b-4d85192cb848-kube-api-access-h92qj\") pod \"node-ca-2m2ss\" (UID: \"6bf91238-2331-4c79-be9b-4d85192cb848\") " pod="openshift-image-registry/node-ca-2m2ss"
Jul 29 01:12:32.186448 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.186186    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-etc-openvswitch\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.186448 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.186215    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-env-overrides\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.186448 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.186246    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-systemd-units\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.186448 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.186257    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-etc-openvswitch\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.186448 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.186270    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-run-systemd\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.186448 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.186299    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-host-run-netns\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.186448 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.186314    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-systemd-units\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.186448 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.186323    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/aee511a0-1681-4291-90ee-eda4bfb122dc-dbus\") pod \"global-pull-secret-syncer-n7dj7\" (UID: \"aee511a0-1681-4291-90ee-eda4bfb122dc\") " pod="kube-system/global-pull-secret-syncer-n7dj7"
Jul 29 01:12:32.186448 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.186333    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-run-systemd\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.186448 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.186375    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-host-run-netns\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.186448 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.186389    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/aee511a0-1681-4291-90ee-eda4bfb122dc-dbus\") pod \"global-pull-secret-syncer-n7dj7\" (UID: \"aee511a0-1681-4291-90ee-eda4bfb122dc\") " pod="kube-system/global-pull-secret-syncer-n7dj7"
Jul 29 01:12:32.186448 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.186409    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gps42\" (UniqueName: \"kubernetes.io/projected/5066ce06-1832-4291-9b2e-852aff936a92-kube-api-access-gps42\") pod \"network-check-target-7k5r4\" (UID: \"5066ce06-1832-4291-9b2e-852aff936a92\") " pod="openshift-network-diagnostics/network-check-target-7k5r4"
Jul 29 01:12:32.186448 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.186443    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-run-openvswitch\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.187038 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.186470    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cwrc\" (UniqueName: \"kubernetes.io/projected/747ed8ca-b021-4f6c-a9ef-8505bc6efdad-kube-api-access-6cwrc\") pod \"iptables-alerter-tqlp2\" (UID: \"747ed8ca-b021-4f6c-a9ef-8505bc6efdad\") " pod="openshift-network-operator/iptables-alerter-tqlp2"
Jul 29 01:12:32.187038 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.186516    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-run-openvswitch\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.187038 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.186638    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6bf91238-2331-4c79-be9b-4d85192cb848-host\") pod \"node-ca-2m2ss\" (UID: \"6bf91238-2331-4c79-be9b-4d85192cb848\") " pod="openshift-image-registry/node-ca-2m2ss"
Jul 29 01:12:32.187038 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.186667    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-host-cni-netd\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.187038 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.186691    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/747ed8ca-b021-4f6c-a9ef-8505bc6efdad-host-slash\") pod \"iptables-alerter-tqlp2\" (UID: \"747ed8ca-b021-4f6c-a9ef-8505bc6efdad\") " pod="openshift-network-operator/iptables-alerter-tqlp2"
Jul 29 01:12:32.187038 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.186696    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6bf91238-2331-4c79-be9b-4d85192cb848-host\") pod \"node-ca-2m2ss\" (UID: \"6bf91238-2331-4c79-be9b-4d85192cb848\") " pod="openshift-image-registry/node-ca-2m2ss"
Jul 29 01:12:32.187038 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.186720    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-host-cni-bin\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.187038 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.186732    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-env-overrides\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.187038 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.186747    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-ovnkube-config\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.187038 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.186752    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-host-cni-netd\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.187038 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.186913    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/747ed8ca-b021-4f6c-a9ef-8505bc6efdad-iptables-alerter-script\") pod \"iptables-alerter-tqlp2\" (UID: \"747ed8ca-b021-4f6c-a9ef-8505bc6efdad\") " pod="openshift-network-operator/iptables-alerter-tqlp2"
Jul 29 01:12:32.187441 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.187274    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/747ed8ca-b021-4f6c-a9ef-8505bc6efdad-host-slash\") pod \"iptables-alerter-tqlp2\" (UID: \"747ed8ca-b021-4f6c-a9ef-8505bc6efdad\") " pod="openshift-network-operator/iptables-alerter-tqlp2"
Jul 29 01:12:32.187441 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.187290    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-host-cni-bin\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.187441 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.187305    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-host-kubelet\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.187441 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.187337    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-host-kubelet\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.187441 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.187341    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-ovn-node-metrics-cert\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.187441 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.187369    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-ovnkube-script-lib\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.187441 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.187385    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/aee511a0-1681-4291-90ee-eda4bfb122dc-kubelet-config\") pod \"global-pull-secret-syncer-n7dj7\" (UID: \"aee511a0-1681-4291-90ee-eda4bfb122dc\") " pod="kube-system/global-pull-secret-syncer-n7dj7"
Jul 29 01:12:32.187441 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.187403    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfq45\" (UniqueName: \"kubernetes.io/projected/c57c897c-c75e-4bd5-8c5d-7682906914f2-kube-api-access-sfq45\") pod \"network-metrics-daemon-s247d\" (UID: \"c57c897c-c75e-4bd5-8c5d-7682906914f2\") " pod="openshift-multus/network-metrics-daemon-s247d"
Jul 29 01:12:32.187748 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.187444    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-host-run-ovn-kubernetes\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.187748 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.187457    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/aee511a0-1681-4291-90ee-eda4bfb122dc-kubelet-config\") pod \"global-pull-secret-syncer-n7dj7\" (UID: \"aee511a0-1681-4291-90ee-eda4bfb122dc\") " pod="kube-system/global-pull-secret-syncer-n7dj7"
Jul 29 01:12:32.187748 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.187549    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c57c897c-c75e-4bd5-8c5d-7682906914f2-metrics-certs\") pod \"network-metrics-daemon-s247d\" (UID: \"c57c897c-c75e-4bd5-8c5d-7682906914f2\") " pod="openshift-multus/network-metrics-daemon-s247d"
Jul 29 01:12:32.187980 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.187934    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-run-ovn\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.188051 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.188002    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.188051 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.188041    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6bf91238-2331-4c79-be9b-4d85192cb848-serviceca\") pod \"node-ca-2m2ss\" (UID: \"6bf91238-2331-4c79-be9b-4d85192cb848\") " pod="openshift-image-registry/node-ca-2m2ss"
Jul 29 01:12:32.188150 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.188121    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-node-log\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.188212 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.188186    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-run-ovn\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.188263 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.188235    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.188263 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.187485    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-host-run-ovn-kubernetes\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.188369 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.188286    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-ovnkube-script-lib\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.188369 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.188078    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-node-log\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.188469 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.188394    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-log-socket\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.188517 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.188479    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-log-socket\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.188517 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:32.188491    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:12:32.188609 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:32.188571    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c57c897c-c75e-4bd5-8c5d-7682906914f2-metrics-certs podName:c57c897c-c75e-4bd5-8c5d-7682906914f2 nodeName:}" failed. No retries permitted until 2026-07-29 01:12:32.688550282 +0000 UTC m=+3.000942982 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c57c897c-c75e-4bd5-8c5d-7682906914f2-metrics-certs") pod "network-metrics-daemon-s247d" (UID: "c57c897c-c75e-4bd5-8c5d-7682906914f2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:12:32.188687 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.188648    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-ovnkube-config\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.188687 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.188670    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6bf91238-2331-4c79-be9b-4d85192cb848-serviceca\") pod \"node-ca-2m2ss\" (UID: \"6bf91238-2331-4c79-be9b-4d85192cb848\") " pod="openshift-image-registry/node-ca-2m2ss"
Jul 29 01:12:32.192286 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.192256    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-ovn-node-metrics-cert\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.196149 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:32.196113    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 01:12:32.196149 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:32.196151    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 01:12:32.196370 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:32.196170    2580 projected.go:196] Error preparing data for projected volume kube-api-access-gps42 for pod openshift-network-diagnostics/network-check-target-7k5r4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:12:32.196370 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:32.196262    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5066ce06-1832-4291-9b2e-852aff936a92-kube-api-access-gps42 podName:5066ce06-1832-4291-9b2e-852aff936a92 nodeName:}" failed. No retries permitted until 2026-07-29 01:12:32.696241715 +0000 UTC m=+3.008634424 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gps42" (UniqueName: "kubernetes.io/projected/5066ce06-1832-4291-9b2e-852aff936a92-kube-api-access-gps42") pod "network-check-target-7k5r4" (UID: "5066ce06-1832-4291-9b2e-852aff936a92") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:12:32.198274 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.198237    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kx9sh\" (UniqueName: \"kubernetes.io/projected/e044d9fa-39c8-49b8-94e1-550f3dbe7b26-kube-api-access-kx9sh\") pod \"ovnkube-node-8g9fl\" (UID: \"e044d9fa-39c8-49b8-94e1-550f3dbe7b26\") " pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.198425 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.198306    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cwrc\" (UniqueName: \"kubernetes.io/projected/747ed8ca-b021-4f6c-a9ef-8505bc6efdad-kube-api-access-6cwrc\") pod \"iptables-alerter-tqlp2\" (UID: \"747ed8ca-b021-4f6c-a9ef-8505bc6efdad\") " pod="openshift-network-operator/iptables-alerter-tqlp2"
Jul 29 01:12:32.198523 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.198505    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h92qj\" (UniqueName: \"kubernetes.io/projected/6bf91238-2331-4c79-be9b-4d85192cb848-kube-api-access-h92qj\") pod \"node-ca-2m2ss\" (UID: \"6bf91238-2331-4c79-be9b-4d85192cb848\") " pod="openshift-image-registry/node-ca-2m2ss"
Jul 29 01:12:32.198656 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.198636    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfq45\" (UniqueName: \"kubernetes.io/projected/c57c897c-c75e-4bd5-8c5d-7682906914f2-kube-api-access-sfq45\") pod \"network-metrics-daemon-s247d\" (UID: \"c57c897c-c75e-4bd5-8c5d-7682906914f2\") " pod="openshift-multus/network-metrics-daemon-s247d"
Jul 29 01:12:32.275712 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.275619    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ps929"
Jul 29 01:12:32.286858 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.286823    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2vj4h"
Jul 29 01:12:32.297806 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.297771    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5h525"
Jul 29 01:12:32.302824 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.302799    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmkhs"
Jul 29 01:12:32.308747 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.308717    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wv4bc"
Jul 29 01:12:32.315728 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.315695    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-twzs7"
Jul 29 01:12:32.323690 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.323654    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tqlp2"
Jul 29 01:12:32.330633 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.330606    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2m2ss"
Jul 29 01:12:32.335608 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.335588    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:32.692533 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.692444    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c57c897c-c75e-4bd5-8c5d-7682906914f2-metrics-certs\") pod \"network-metrics-daemon-s247d\" (UID: \"c57c897c-c75e-4bd5-8c5d-7682906914f2\") " pod="openshift-multus/network-metrics-daemon-s247d"
Jul 29 01:12:32.692533 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.692486    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aee511a0-1681-4291-90ee-eda4bfb122dc-original-pull-secret\") pod \"global-pull-secret-syncer-n7dj7\" (UID: \"aee511a0-1681-4291-90ee-eda4bfb122dc\") " pod="kube-system/global-pull-secret-syncer-n7dj7"
Jul 29 01:12:32.692754 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:32.692600    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 01:12:32.692754 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:32.692661    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aee511a0-1681-4291-90ee-eda4bfb122dc-original-pull-secret podName:aee511a0-1681-4291-90ee-eda4bfb122dc nodeName:}" failed. No retries permitted until 2026-07-29 01:12:33.692646859 +0000 UTC m=+4.005039545 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aee511a0-1681-4291-90ee-eda4bfb122dc-original-pull-secret") pod "global-pull-secret-syncer-n7dj7" (UID: "aee511a0-1681-4291-90ee-eda4bfb122dc") : object "kube-system"/"original-pull-secret" not registered
Jul 29 01:12:32.692754 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:32.692604    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:12:32.692913 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:32.692757    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c57c897c-c75e-4bd5-8c5d-7682906914f2-metrics-certs podName:c57c897c-c75e-4bd5-8c5d-7682906914f2 nodeName:}" failed. No retries permitted until 2026-07-29 01:12:33.69273895 +0000 UTC m=+4.005131656 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c57c897c-c75e-4bd5-8c5d-7682906914f2-metrics-certs") pod "network-metrics-daemon-s247d" (UID: "c57c897c-c75e-4bd5-8c5d-7682906914f2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:12:32.793673 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:32.793631    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gps42\" (UniqueName: \"kubernetes.io/projected/5066ce06-1832-4291-9b2e-852aff936a92-kube-api-access-gps42\") pod \"network-check-target-7k5r4\" (UID: \"5066ce06-1832-4291-9b2e-852aff936a92\") " pod="openshift-network-diagnostics/network-check-target-7k5r4"
Jul 29 01:12:32.793836 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:32.793800    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 01:12:32.793836 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:32.793821    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 01:12:32.793836 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:32.793831    2580 projected.go:196] Error preparing data for projected volume kube-api-access-gps42 for pod openshift-network-diagnostics/network-check-target-7k5r4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:12:32.794018 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:32.793885    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5066ce06-1832-4291-9b2e-852aff936a92-kube-api-access-gps42 podName:5066ce06-1832-4291-9b2e-852aff936a92 nodeName:}" failed. No retries permitted until 2026-07-29 01:12:33.793869943 +0000 UTC m=+4.106262631 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gps42" (UniqueName: "kubernetes.io/projected/5066ce06-1832-4291-9b2e-852aff936a92-kube-api-access-gps42") pod "network-check-target-7k5r4" (UID: "5066ce06-1832-4291-9b2e-852aff936a92") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:12:32.851060 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:32.851018    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fc7f511_69f2_44bd_9e16_fd635c4bb098.slice/crio-6b372e456b8e55fa97729ff833039c714f88d23b2d0fdc14390a87fa119da836 WatchSource:0}: Error finding container 6b372e456b8e55fa97729ff833039c714f88d23b2d0fdc14390a87fa119da836: Status 404 returned error can't find the container with id 6b372e456b8e55fa97729ff833039c714f88d23b2d0fdc14390a87fa119da836
Jul 29 01:12:32.852079 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:32.852048    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bf91238_2331_4c79_be9b_4d85192cb848.slice/crio-6238b74bfa2382cfa28544e674fed87e99c90e61d35b08bc93d9f9989309ea1e WatchSource:0}: Error finding container 6238b74bfa2382cfa28544e674fed87e99c90e61d35b08bc93d9f9989309ea1e: Status 404 returned error can't find the container with id 6238b74bfa2382cfa28544e674fed87e99c90e61d35b08bc93d9f9989309ea1e
Jul 29 01:12:32.855328 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:32.855306    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode044d9fa_39c8_49b8_94e1_550f3dbe7b26.slice/crio-5c763a9df6e68f379100d327b02db9c7d5d6329c23b016c0b56a66715a4ce6b4 WatchSource:0}: Error finding container 5c763a9df6e68f379100d327b02db9c7d5d6329c23b016c0b56a66715a4ce6b4: Status 404 returned error can't find the container with id 5c763a9df6e68f379100d327b02db9c7d5d6329c23b016c0b56a66715a4ce6b4
Jul 29 01:12:32.856182 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:32.856154    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84b80591_4471_4103_9031_3e72a0a3ca7a.slice/crio-89a8adbc1f406097cd4bd2f3c9a229750326a51011fcbf68488af5c0101b13d5 WatchSource:0}: Error finding container 89a8adbc1f406097cd4bd2f3c9a229750326a51011fcbf68488af5c0101b13d5: Status 404 returned error can't find the container with id 89a8adbc1f406097cd4bd2f3c9a229750326a51011fcbf68488af5c0101b13d5
Jul 29 01:12:32.856900 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:32.856881    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc04440bc_a775_4a45_8ce2_32be6df62627.slice/crio-426c40a001176b34e1d964072d72e37049e14615e4c4791386d0c6c9f4899910 WatchSource:0}: Error finding container 426c40a001176b34e1d964072d72e37049e14615e4c4791386d0c6c9f4899910: Status 404 returned error can't find the container with id 426c40a001176b34e1d964072d72e37049e14615e4c4791386d0c6c9f4899910
Jul 29 01:12:32.858184 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:32.858160    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda175742e_f244_4f5f_abc7_4fac5676789e.slice/crio-b14189094e42ef2a5a9cde3de3713b492fb6f344c4c1a93546f8ace10a285b3a WatchSource:0}: Error finding container b14189094e42ef2a5a9cde3de3713b492fb6f344c4c1a93546f8ace10a285b3a: Status 404 returned error can't find the container with id b14189094e42ef2a5a9cde3de3713b492fb6f344c4c1a93546f8ace10a285b3a
Jul 29 01:12:32.859354 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:32.859249    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c156d63_8457_4165_b635_a1e0a523c733.slice/crio-a07414a62fffa8863d4fe2ad935c76186a63a3307aed6ea948a276fbee3ce058 WatchSource:0}: Error finding container a07414a62fffa8863d4fe2ad935c76186a63a3307aed6ea948a276fbee3ce058: Status 404 returned error can't find the container with id a07414a62fffa8863d4fe2ad935c76186a63a3307aed6ea948a276fbee3ce058
Jul 29 01:12:32.859621 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:32.859600    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6deac2fc_a413_4f50_8fb6_674172396beb.slice/crio-de32208ca94575c940bb8d07c2a68d4a3affe50e8094ac8fb447229b027f4a9e WatchSource:0}: Error finding container de32208ca94575c940bb8d07c2a68d4a3affe50e8094ac8fb447229b027f4a9e: Status 404 returned error can't find the container with id de32208ca94575c940bb8d07c2a68d4a3affe50e8094ac8fb447229b027f4a9e
Jul 29 01:12:32.860625 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:12:32.860566    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod747ed8ca_b021_4f6c_a9ef_8505bc6efdad.slice/crio-bfeea8ac3f8546f689f0b1e95028e3bdfc2d5605ca74ec73095fa65113c8cf7e WatchSource:0}: Error finding container bfeea8ac3f8546f689f0b1e95028e3bdfc2d5605ca74ec73095fa65113c8cf7e: Status 404 returned error can't find the container with id bfeea8ac3f8546f689f0b1e95028e3bdfc2d5605ca74ec73095fa65113c8cf7e
Jul 29 01:12:33.014230 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:33.014158    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 01:07:32 +0000 UTC" deadline="2028-01-11 11:53:39.695275495 +0000 UTC"
Jul 29 01:12:33.014230 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:33.014229    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12754h41m6.681050576s"
Jul 29 01:12:33.172820 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:33.172650    2580 generic.go:356] "Generic (PLEG): container finished" podID="058b030a4d40dd193c07301663f4e12e" containerID="06a804712ef1c0863e55075fc7c9300e4b952724a91a87f3d2ed7047d44ef796" exitCode=0
Jul 29 01:12:33.172980 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:33.172734    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-238.ec2.internal" event={"ID":"058b030a4d40dd193c07301663f4e12e","Type":"ContainerDied","Data":"06a804712ef1c0863e55075fc7c9300e4b952724a91a87f3d2ed7047d44ef796"}
Jul 29 01:12:33.174278 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:33.174257    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-238.ec2.internal" event={"ID":"fc633d594ee9635d73371706219c2df2","Type":"ContainerStarted","Data":"6e5a1a75aab4d9682dc41392c8b192de21c9902424bd244e10418b92bf554571"}
Jul 29 01:12:33.175328 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:33.175294    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tqlp2" event={"ID":"747ed8ca-b021-4f6c-a9ef-8505bc6efdad","Type":"ContainerStarted","Data":"bfeea8ac3f8546f689f0b1e95028e3bdfc2d5605ca74ec73095fa65113c8cf7e"}
Jul 29 01:12:33.176304 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:33.176281    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wv4bc" event={"ID":"6deac2fc-a413-4f50-8fb6-674172396beb","Type":"ContainerStarted","Data":"de32208ca94575c940bb8d07c2a68d4a3affe50e8094ac8fb447229b027f4a9e"}
Jul 29 01:12:33.177402 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:33.177380    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ps929" event={"ID":"9c156d63-8457-4165-b635-a1e0a523c733","Type":"ContainerStarted","Data":"a07414a62fffa8863d4fe2ad935c76186a63a3307aed6ea948a276fbee3ce058"}
Jul 29 01:12:33.178349 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:33.178327    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-twzs7" event={"ID":"c04440bc-a775-4a45-8ce2-32be6df62627","Type":"ContainerStarted","Data":"426c40a001176b34e1d964072d72e37049e14615e4c4791386d0c6c9f4899910"}
Jul 29 01:12:33.179238 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:33.179216    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmkhs" event={"ID":"a175742e-f244-4f5f-abc7-4fac5676789e","Type":"ContainerStarted","Data":"b14189094e42ef2a5a9cde3de3713b492fb6f344c4c1a93546f8ace10a285b3a"}
Jul 29 01:12:33.180187 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:33.180154    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2vj4h" event={"ID":"2fc7f511-69f2-44bd-9e16-fd635c4bb098","Type":"ContainerStarted","Data":"6b372e456b8e55fa97729ff833039c714f88d23b2d0fdc14390a87fa119da836"}
Jul 29 01:12:33.181212 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:33.181194    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5h525" event={"ID":"84b80591-4471-4103-9031-3e72a0a3ca7a","Type":"ContainerStarted","Data":"89a8adbc1f406097cd4bd2f3c9a229750326a51011fcbf68488af5c0101b13d5"}
Jul 29 01:12:33.182390 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:33.182367    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl" event={"ID":"e044d9fa-39c8-49b8-94e1-550f3dbe7b26","Type":"ContainerStarted","Data":"5c763a9df6e68f379100d327b02db9c7d5d6329c23b016c0b56a66715a4ce6b4"}
Jul 29 01:12:33.183888 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:33.183855    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2m2ss" event={"ID":"6bf91238-2331-4c79-be9b-4d85192cb848","Type":"ContainerStarted","Data":"6238b74bfa2382cfa28544e674fed87e99c90e61d35b08bc93d9f9989309ea1e"}
Jul 29 01:12:33.201435 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:33.201376    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-238.ec2.internal" podStartSLOduration=2.201360214 podStartE2EDuration="2.201360214s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:12:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:12:33.200776936 +0000 UTC m=+3.513169645" watchObservedRunningTime="2026-07-29 01:12:33.201360214 +0000 UTC m=+3.513752922"
Jul 29 01:12:33.686771 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:33.686649    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 01:12:33.705991 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:33.705865    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c57c897c-c75e-4bd5-8c5d-7682906914f2-metrics-certs\") pod \"network-metrics-daemon-s247d\" (UID: \"c57c897c-c75e-4bd5-8c5d-7682906914f2\") " pod="openshift-multus/network-metrics-daemon-s247d"
Jul 29 01:12:33.705991 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:33.705922    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aee511a0-1681-4291-90ee-eda4bfb122dc-original-pull-secret\") pod \"global-pull-secret-syncer-n7dj7\" (UID: \"aee511a0-1681-4291-90ee-eda4bfb122dc\") " pod="kube-system/global-pull-secret-syncer-n7dj7"
Jul 29 01:12:33.706250 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:33.706100    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 01:12:33.706250 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:33.706158    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aee511a0-1681-4291-90ee-eda4bfb122dc-original-pull-secret podName:aee511a0-1681-4291-90ee-eda4bfb122dc nodeName:}" failed. No retries permitted until 2026-07-29 01:12:35.706141906 +0000 UTC m=+6.018534599 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aee511a0-1681-4291-90ee-eda4bfb122dc-original-pull-secret") pod "global-pull-secret-syncer-n7dj7" (UID: "aee511a0-1681-4291-90ee-eda4bfb122dc") : object "kube-system"/"original-pull-secret" not registered
Jul 29 01:12:33.706528 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:33.706502    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:12:33.706590 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:33.706547    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c57c897c-c75e-4bd5-8c5d-7682906914f2-metrics-certs podName:c57c897c-c75e-4bd5-8c5d-7682906914f2 nodeName:}" failed. No retries permitted until 2026-07-29 01:12:35.706534523 +0000 UTC m=+6.018927212 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c57c897c-c75e-4bd5-8c5d-7682906914f2-metrics-certs") pod "network-metrics-daemon-s247d" (UID: "c57c897c-c75e-4bd5-8c5d-7682906914f2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:12:33.806834 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:33.806783    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gps42\" (UniqueName: \"kubernetes.io/projected/5066ce06-1832-4291-9b2e-852aff936a92-kube-api-access-gps42\") pod \"network-check-target-7k5r4\" (UID: \"5066ce06-1832-4291-9b2e-852aff936a92\") " pod="openshift-network-diagnostics/network-check-target-7k5r4"
Jul 29 01:12:33.807051 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:33.807034    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 01:12:33.807114 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:33.807062    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 01:12:33.807114 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:33.807075    2580 projected.go:196] Error preparing data for projected volume kube-api-access-gps42 for pod openshift-network-diagnostics/network-check-target-7k5r4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:12:33.807229 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:33.807133    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5066ce06-1832-4291-9b2e-852aff936a92-kube-api-access-gps42 podName:5066ce06-1832-4291-9b2e-852aff936a92 nodeName:}" failed. No retries permitted until 2026-07-29 01:12:35.807114191 +0000 UTC m=+6.119506893 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gps42" (UniqueName: "kubernetes.io/projected/5066ce06-1832-4291-9b2e-852aff936a92-kube-api-access-gps42") pod "network-check-target-7k5r4" (UID: "5066ce06-1832-4291-9b2e-852aff936a92") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:12:34.014809 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:34.014735    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 01:07:32 +0000 UTC" deadline="2028-02-26 09:19:14.850052622 +0000 UTC"
Jul 29 01:12:34.015351 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:34.014828    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13856h6m40.835248977s"
Jul 29 01:12:34.170651 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:34.169404    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k5r4"
Jul 29 01:12:34.170651 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:34.169532    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k5r4" podUID="5066ce06-1832-4291-9b2e-852aff936a92"
Jul 29 01:12:34.170651 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:34.170069    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7dj7"
Jul 29 01:12:34.170651 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:34.170163    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7dj7" podUID="aee511a0-1681-4291-90ee-eda4bfb122dc"
Jul 29 01:12:34.170651 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:34.170231    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s247d"
Jul 29 01:12:34.170651 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:34.170313    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s247d" podUID="c57c897c-c75e-4bd5-8c5d-7682906914f2"
Jul 29 01:12:34.206749 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:34.201994    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-238.ec2.internal" event={"ID":"058b030a4d40dd193c07301663f4e12e","Type":"ContainerStarted","Data":"5c5a208babf2449d8fc3cc94767ce370d92c9cad58c60373ec3a6c206f0ad2d0"}
Jul 29 01:12:35.720912 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:35.720833    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c57c897c-c75e-4bd5-8c5d-7682906914f2-metrics-certs\") pod \"network-metrics-daemon-s247d\" (UID: \"c57c897c-c75e-4bd5-8c5d-7682906914f2\") " pod="openshift-multus/network-metrics-daemon-s247d"
Jul 29 01:12:35.720912 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:35.720895    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aee511a0-1681-4291-90ee-eda4bfb122dc-original-pull-secret\") pod \"global-pull-secret-syncer-n7dj7\" (UID: \"aee511a0-1681-4291-90ee-eda4bfb122dc\") " pod="kube-system/global-pull-secret-syncer-n7dj7"
Jul 29 01:12:35.721452 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:35.721035    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 01:12:35.721452 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:35.721096    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aee511a0-1681-4291-90ee-eda4bfb122dc-original-pull-secret podName:aee511a0-1681-4291-90ee-eda4bfb122dc nodeName:}" failed. No retries permitted until 2026-07-29 01:12:39.721077677 +0000 UTC m=+10.033470366 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aee511a0-1681-4291-90ee-eda4bfb122dc-original-pull-secret") pod "global-pull-secret-syncer-n7dj7" (UID: "aee511a0-1681-4291-90ee-eda4bfb122dc") : object "kube-system"/"original-pull-secret" not registered
Jul 29 01:12:35.721622 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:35.721492    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:12:35.721622 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:35.721546    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c57c897c-c75e-4bd5-8c5d-7682906914f2-metrics-certs podName:c57c897c-c75e-4bd5-8c5d-7682906914f2 nodeName:}" failed. No retries permitted until 2026-07-29 01:12:39.721528492 +0000 UTC m=+10.033921181 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c57c897c-c75e-4bd5-8c5d-7682906914f2-metrics-certs") pod "network-metrics-daemon-s247d" (UID: "c57c897c-c75e-4bd5-8c5d-7682906914f2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:12:35.821276 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:35.821238    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gps42\" (UniqueName: \"kubernetes.io/projected/5066ce06-1832-4291-9b2e-852aff936a92-kube-api-access-gps42\") pod \"network-check-target-7k5r4\" (UID: \"5066ce06-1832-4291-9b2e-852aff936a92\") " pod="openshift-network-diagnostics/network-check-target-7k5r4"
Jul 29 01:12:35.821449 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:35.821396    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 01:12:35.821449 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:35.821414    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 01:12:35.821449 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:35.821427    2580 projected.go:196] Error preparing data for projected volume kube-api-access-gps42 for pod openshift-network-diagnostics/network-check-target-7k5r4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:12:35.821651 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:35.821484    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5066ce06-1832-4291-9b2e-852aff936a92-kube-api-access-gps42 podName:5066ce06-1832-4291-9b2e-852aff936a92 nodeName:}" failed. No retries permitted until 2026-07-29 01:12:39.821466179 +0000 UTC m=+10.133858885 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gps42" (UniqueName: "kubernetes.io/projected/5066ce06-1832-4291-9b2e-852aff936a92-kube-api-access-gps42") pod "network-check-target-7k5r4" (UID: "5066ce06-1832-4291-9b2e-852aff936a92") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:12:36.165237 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:36.164780    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s247d"
Jul 29 01:12:36.165237 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:36.164771    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7dj7"
Jul 29 01:12:36.165237 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:36.164904    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s247d" podUID="c57c897c-c75e-4bd5-8c5d-7682906914f2"
Jul 29 01:12:36.165237 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:36.164997    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7dj7" podUID="aee511a0-1681-4291-90ee-eda4bfb122dc"
Jul 29 01:12:36.165237 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:36.165063    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k5r4"
Jul 29 01:12:36.165237 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:36.165138    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k5r4" podUID="5066ce06-1832-4291-9b2e-852aff936a92"
Jul 29 01:12:38.166982 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:38.166424    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k5r4"
Jul 29 01:12:38.166982 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:38.166591    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k5r4" podUID="5066ce06-1832-4291-9b2e-852aff936a92"
Jul 29 01:12:38.166982 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:38.166610    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7dj7"
Jul 29 01:12:38.166982 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:38.166703    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7dj7" podUID="aee511a0-1681-4291-90ee-eda4bfb122dc"
Jul 29 01:12:38.166982 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:38.166741    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s247d"
Jul 29 01:12:38.166982 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:38.166817    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s247d" podUID="c57c897c-c75e-4bd5-8c5d-7682906914f2"
Jul 29 01:12:39.755293 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:39.755259    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c57c897c-c75e-4bd5-8c5d-7682906914f2-metrics-certs\") pod \"network-metrics-daemon-s247d\" (UID: \"c57c897c-c75e-4bd5-8c5d-7682906914f2\") " pod="openshift-multus/network-metrics-daemon-s247d"
Jul 29 01:12:39.755293 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:39.755317    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aee511a0-1681-4291-90ee-eda4bfb122dc-original-pull-secret\") pod \"global-pull-secret-syncer-n7dj7\" (UID: \"aee511a0-1681-4291-90ee-eda4bfb122dc\") " pod="kube-system/global-pull-secret-syncer-n7dj7"
Jul 29 01:12:39.755939 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:39.755418    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:12:39.755939 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:39.755435    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 01:12:39.755939 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:39.755495    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c57c897c-c75e-4bd5-8c5d-7682906914f2-metrics-certs podName:c57c897c-c75e-4bd5-8c5d-7682906914f2 nodeName:}" failed. No retries permitted until 2026-07-29 01:12:47.755473526 +0000 UTC m=+18.067866215 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c57c897c-c75e-4bd5-8c5d-7682906914f2-metrics-certs") pod "network-metrics-daemon-s247d" (UID: "c57c897c-c75e-4bd5-8c5d-7682906914f2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:12:39.755939 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:39.755518    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aee511a0-1681-4291-90ee-eda4bfb122dc-original-pull-secret podName:aee511a0-1681-4291-90ee-eda4bfb122dc nodeName:}" failed. No retries permitted until 2026-07-29 01:12:47.755507725 +0000 UTC m=+18.067900418 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aee511a0-1681-4291-90ee-eda4bfb122dc-original-pull-secret") pod "global-pull-secret-syncer-n7dj7" (UID: "aee511a0-1681-4291-90ee-eda4bfb122dc") : object "kube-system"/"original-pull-secret" not registered
Jul 29 01:12:39.856477 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:39.856446    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gps42\" (UniqueName: \"kubernetes.io/projected/5066ce06-1832-4291-9b2e-852aff936a92-kube-api-access-gps42\") pod \"network-check-target-7k5r4\" (UID: \"5066ce06-1832-4291-9b2e-852aff936a92\") " pod="openshift-network-diagnostics/network-check-target-7k5r4"
Jul 29 01:12:39.856615 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:39.856593    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 01:12:39.856615 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:39.856613    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 01:12:39.856707 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:39.856622    2580 projected.go:196] Error preparing data for projected volume kube-api-access-gps42 for pod openshift-network-diagnostics/network-check-target-7k5r4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:12:39.856707 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:39.856675    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5066ce06-1832-4291-9b2e-852aff936a92-kube-api-access-gps42 podName:5066ce06-1832-4291-9b2e-852aff936a92 nodeName:}" failed. No retries permitted until 2026-07-29 01:12:47.856656106 +0000 UTC m=+18.169048809 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gps42" (UniqueName: "kubernetes.io/projected/5066ce06-1832-4291-9b2e-852aff936a92-kube-api-access-gps42") pod "network-check-target-7k5r4" (UID: "5066ce06-1832-4291-9b2e-852aff936a92") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:12:40.165528 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:40.165460    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7dj7"
Jul 29 01:12:40.165671 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:40.165572    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7dj7" podUID="aee511a0-1681-4291-90ee-eda4bfb122dc"
Jul 29 01:12:40.165671 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:40.165620    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s247d"
Jul 29 01:12:40.165784 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:40.165753    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s247d" podUID="c57c897c-c75e-4bd5-8c5d-7682906914f2"
Jul 29 01:12:40.165846 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:40.165787    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k5r4"
Jul 29 01:12:40.165897 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:40.165850    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k5r4" podUID="5066ce06-1832-4291-9b2e-852aff936a92"
Jul 29 01:12:42.164931 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:42.164881    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k5r4"
Jul 29 01:12:42.165445 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:42.164985    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7dj7"
Jul 29 01:12:42.165445 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:42.165088    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7dj7" podUID="aee511a0-1681-4291-90ee-eda4bfb122dc"
Jul 29 01:12:42.165445 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:42.165161    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s247d"
Jul 29 01:12:42.165445 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:42.165285    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s247d" podUID="c57c897c-c75e-4bd5-8c5d-7682906914f2"
Jul 29 01:12:42.165445 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:42.165439    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k5r4" podUID="5066ce06-1832-4291-9b2e-852aff936a92"
Jul 29 01:12:44.164006 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:44.163965    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k5r4"
Jul 29 01:12:44.164502 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:44.164029    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s247d"
Jul 29 01:12:44.164502 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:44.163981    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7dj7"
Jul 29 01:12:44.164502 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:44.164131    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k5r4" podUID="5066ce06-1832-4291-9b2e-852aff936a92"
Jul 29 01:12:44.164502 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:44.164202    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7dj7" podUID="aee511a0-1681-4291-90ee-eda4bfb122dc"
Jul 29 01:12:44.164502 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:44.164284    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s247d" podUID="c57c897c-c75e-4bd5-8c5d-7682906914f2"
Jul 29 01:12:46.164269 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:46.164238    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7dj7"
Jul 29 01:12:46.164727 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:46.164359    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s247d"
Jul 29 01:12:46.164727 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:46.164369    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7dj7" podUID="aee511a0-1681-4291-90ee-eda4bfb122dc"
Jul 29 01:12:46.164727 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:46.164491    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s247d" podUID="c57c897c-c75e-4bd5-8c5d-7682906914f2"
Jul 29 01:12:46.164727 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:46.164541    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k5r4"
Jul 29 01:12:46.164727 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:46.164618    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k5r4" podUID="5066ce06-1832-4291-9b2e-852aff936a92"
Jul 29 01:12:47.816010 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:47.815979    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c57c897c-c75e-4bd5-8c5d-7682906914f2-metrics-certs\") pod \"network-metrics-daemon-s247d\" (UID: \"c57c897c-c75e-4bd5-8c5d-7682906914f2\") " pod="openshift-multus/network-metrics-daemon-s247d"
Jul 29 01:12:47.816513 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:47.816031    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aee511a0-1681-4291-90ee-eda4bfb122dc-original-pull-secret\") pod \"global-pull-secret-syncer-n7dj7\" (UID: \"aee511a0-1681-4291-90ee-eda4bfb122dc\") " pod="kube-system/global-pull-secret-syncer-n7dj7"
Jul 29 01:12:47.816513 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:47.816141    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:12:47.816513 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:47.816171    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 01:12:47.816513 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:47.816210    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c57c897c-c75e-4bd5-8c5d-7682906914f2-metrics-certs podName:c57c897c-c75e-4bd5-8c5d-7682906914f2 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:03.816192073 +0000 UTC m=+34.128584779 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c57c897c-c75e-4bd5-8c5d-7682906914f2-metrics-certs") pod "network-metrics-daemon-s247d" (UID: "c57c897c-c75e-4bd5-8c5d-7682906914f2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:12:47.816513 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:47.816232    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aee511a0-1681-4291-90ee-eda4bfb122dc-original-pull-secret podName:aee511a0-1681-4291-90ee-eda4bfb122dc nodeName:}" failed. No retries permitted until 2026-07-29 01:13:03.816222752 +0000 UTC m=+34.128615441 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aee511a0-1681-4291-90ee-eda4bfb122dc-original-pull-secret") pod "global-pull-secret-syncer-n7dj7" (UID: "aee511a0-1681-4291-90ee-eda4bfb122dc") : object "kube-system"/"original-pull-secret" not registered
Jul 29 01:12:47.917171 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:47.917144    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gps42\" (UniqueName: \"kubernetes.io/projected/5066ce06-1832-4291-9b2e-852aff936a92-kube-api-access-gps42\") pod \"network-check-target-7k5r4\" (UID: \"5066ce06-1832-4291-9b2e-852aff936a92\") " pod="openshift-network-diagnostics/network-check-target-7k5r4"
Jul 29 01:12:47.917357 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:47.917306    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 01:12:47.917357 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:47.917324    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 01:12:47.917357 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:47.917333    2580 projected.go:196] Error preparing data for projected volume kube-api-access-gps42 for pod openshift-network-diagnostics/network-check-target-7k5r4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:12:47.917524 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:47.917388    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5066ce06-1832-4291-9b2e-852aff936a92-kube-api-access-gps42 podName:5066ce06-1832-4291-9b2e-852aff936a92 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:03.917369643 +0000 UTC m=+34.229762333 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gps42" (UniqueName: "kubernetes.io/projected/5066ce06-1832-4291-9b2e-852aff936a92-kube-api-access-gps42") pod "network-check-target-7k5r4" (UID: "5066ce06-1832-4291-9b2e-852aff936a92") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:12:48.164589 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:48.164513    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s247d"
Jul 29 01:12:48.164589 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:48.164545    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7dj7"
Jul 29 01:12:48.164822 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:48.164633    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k5r4"
Jul 29 01:12:48.164822 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:48.164670    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s247d" podUID="c57c897c-c75e-4bd5-8c5d-7682906914f2"
Jul 29 01:12:48.164822 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:48.164690    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7dj7" podUID="aee511a0-1681-4291-90ee-eda4bfb122dc"
Jul 29 01:12:48.164822 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:48.164767    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k5r4" podUID="5066ce06-1832-4291-9b2e-852aff936a92"
Jul 29 01:12:50.165154 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:50.165114    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7dj7"
Jul 29 01:12:50.165578 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:50.165162    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s247d"
Jul 29 01:12:50.165578 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:50.165236    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7dj7" podUID="aee511a0-1681-4291-90ee-eda4bfb122dc"
Jul 29 01:12:50.165578 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:50.165275    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s247d" podUID="c57c897c-c75e-4bd5-8c5d-7682906914f2"
Jul 29 01:12:50.165578 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:50.165338    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k5r4"
Jul 29 01:12:50.165578 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:50.165525    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k5r4" podUID="5066ce06-1832-4291-9b2e-852aff936a92"
Jul 29 01:12:52.165226 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:52.164896    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s247d"
Jul 29 01:12:52.165785 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:52.164896    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7dj7"
Jul 29 01:12:52.165785 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:52.165330    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s247d" podUID="c57c897c-c75e-4bd5-8c5d-7682906914f2"
Jul 29 01:12:52.165785 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:52.164943    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k5r4"
Jul 29 01:12:52.165785 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:52.165374    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7dj7" podUID="aee511a0-1681-4291-90ee-eda4bfb122dc"
Jul 29 01:12:52.165785 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:52.165458    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k5r4" podUID="5066ce06-1832-4291-9b2e-852aff936a92"
Jul 29 01:12:52.243385 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:52.243351    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wv4bc" event={"ID":"6deac2fc-a413-4f50-8fb6-674172396beb","Type":"ContainerStarted","Data":"08f45b23290ec98f16dd4ab74fc6848e01aac6b7e6cca7edb33b5c160eb55184"}
Jul 29 01:12:52.244905 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:52.244882    2580 generic.go:356] "Generic (PLEG): container finished" podID="9c156d63-8457-4165-b635-a1e0a523c733" containerID="b1d506f89cb118bb5e4c21b3311202b91150caed7adef0d7654b110e26d8e17f" exitCode=0
Jul 29 01:12:52.245027 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:52.244980    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ps929" event={"ID":"9c156d63-8457-4165-b635-a1e0a523c733","Type":"ContainerDied","Data":"b1d506f89cb118bb5e4c21b3311202b91150caed7adef0d7654b110e26d8e17f"}
Jul 29 01:12:52.246452 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:52.246388    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-twzs7" event={"ID":"c04440bc-a775-4a45-8ce2-32be6df62627","Type":"ContainerStarted","Data":"3c846c3c065b50948bcedd8332d2f81e9d13013970891ae3d899b8362d1862b9"}
Jul 29 01:12:52.247960 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:52.247905    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmkhs" event={"ID":"a175742e-f244-4f5f-abc7-4fac5676789e","Type":"ContainerStarted","Data":"47b349d62f482385401d71a4ec4a7ae9f21a498303a75d71c9eb115460b77880"}
Jul 29 01:12:52.249400 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:52.249370    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2vj4h" event={"ID":"2fc7f511-69f2-44bd-9e16-fd635c4bb098","Type":"ContainerStarted","Data":"9a9b847769e08210bfdb2fe13598cc279969f43c3fcd54998b8c8ee242908a3f"}
Jul 29 01:12:52.250734 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:52.250715    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5h525" event={"ID":"84b80591-4471-4103-9031-3e72a0a3ca7a","Type":"ContainerStarted","Data":"64b37bad1c9ec7340f5f3ded5a09599f4c72840b8e88d972f4bdc50aba619841"}
Jul 29 01:12:52.253531 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:52.253515    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8g9fl_e044d9fa-39c8-49b8-94e1-550f3dbe7b26/ovn-acl-logging/0.log"
Jul 29 01:12:52.253815 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:52.253796    2580 generic.go:356] "Generic (PLEG): container finished" podID="e044d9fa-39c8-49b8-94e1-550f3dbe7b26" containerID="8a4869c14f7e8c0b4895c8d5986d7c9261d0ca3bd0618766cd219effd8e10074" exitCode=1
Jul 29 01:12:52.253893 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:52.253854    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl" event={"ID":"e044d9fa-39c8-49b8-94e1-550f3dbe7b26","Type":"ContainerStarted","Data":"808e368865c06547c984f492badeea84131c358a81c0778fb9693ad327cafbc8"}
Jul 29 01:12:52.253963 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:52.253921    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl" event={"ID":"e044d9fa-39c8-49b8-94e1-550f3dbe7b26","Type":"ContainerStarted","Data":"828524f195c37ea82306840cee29693ed7cd8436a8429b5a90bbf4e35789e334"}
Jul 29 01:12:52.254077 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:52.254004    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl" event={"ID":"e044d9fa-39c8-49b8-94e1-550f3dbe7b26","Type":"ContainerStarted","Data":"f4de4a85e5adad06370b6326619eeacbfdd96dcffe6277e05fc52fd5d35b1034"}
Jul 29 01:12:52.254077 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:52.254056    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl" event={"ID":"e044d9fa-39c8-49b8-94e1-550f3dbe7b26","Type":"ContainerDied","Data":"8a4869c14f7e8c0b4895c8d5986d7c9261d0ca3bd0618766cd219effd8e10074"}
Jul 29 01:12:52.254187 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:52.254090    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl" event={"ID":"e044d9fa-39c8-49b8-94e1-550f3dbe7b26","Type":"ContainerStarted","Data":"776aaba5dc76e348ee05eb9396ee265b4d604e6f07427a2bd3ba95ef417768aa"}
Jul 29 01:12:52.255348 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:52.255328    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2m2ss" event={"ID":"6bf91238-2331-4c79-be9b-4d85192cb848","Type":"ContainerStarted","Data":"1327d1155fc17613c76171739f902c397a6ba667af5ecbe0d6593c8536360c02"}
Jul 29 01:12:52.258467 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:52.258423    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wv4bc" podStartSLOduration=3.723580799 podStartE2EDuration="22.258409151s" totalImagesPullingTime="18.534828352s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:12:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:12:52.258292223 +0000 UTC m=+22.570684930" watchObservedRunningTime="2026-07-29 01:12:52.258409151 +0000 UTC m=+22.570801860"
Jul 29 01:12:52.259102 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:52.259058    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-238.ec2.internal" podStartSLOduration=21.2590457 podStartE2EDuration="21.2590457s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:12:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:12:34.231585575 +0000 UTC m=+4.543978284" watchObservedRunningTime="2026-07-29 01:12:52.2590457 +0000 UTC m=+22.571438409"
Jul 29 01:12:52.271891 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:52.271858    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-twzs7" podStartSLOduration=3.9326478639999998 podStartE2EDuration="22.271846203s" totalImagesPullingTime="18.339198339s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:12:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:12:52.271585565 +0000 UTC m=+22.583978274" watchObservedRunningTime="2026-07-29 01:12:52.271846203 +0000 UTC m=+22.584238910"
Jul 29 01:12:52.289514 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:52.289467    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2m2ss" podStartSLOduration=3.945830479 podStartE2EDuration="22.289449171s" totalImagesPullingTime="18.343618692s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:12:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:12:52.285013112 +0000 UTC m=+22.597405821" watchObservedRunningTime="2026-07-29 01:12:52.289449171 +0000 UTC m=+22.601841880"
Jul 29 01:12:52.300524 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:52.300480    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5h525" podStartSLOduration=3.739133092 podStartE2EDuration="22.300465626s" totalImagesPullingTime="18.561332534s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:12:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:12:52.300428902 +0000 UTC m=+22.612821611" watchObservedRunningTime="2026-07-29 01:12:52.300465626 +0000 UTC m=+22.612858337"
Jul 29 01:12:52.334783 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:52.334740    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2vj4h" podStartSLOduration=12.032031532 podStartE2EDuration="22.3347222s" totalImagesPullingTime="10.302690668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:12:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:12:52.334556827 +0000 UTC m=+22.646949535" watchObservedRunningTime="2026-07-29 01:12:52.3347222 +0000 UTC m=+22.647114909"
Jul 29 01:12:52.890297 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:52.890275    2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 29 01:12:53.043176 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:53.043025    2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T01:12:52.890292557Z","UUID":"39703744-5c72-4f8c-8396-1f552f60c2cb","Handler":null,"Name":"","Endpoint":""}
Jul 29 01:12:53.044657 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:53.044636    2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 29 01:12:53.044778 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:53.044674    2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 29 01:12:53.259367 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:53.259334    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmkhs" event={"ID":"a175742e-f244-4f5f-abc7-4fac5676789e","Type":"ContainerStarted","Data":"f09d2881a456ad180e0aef7d881af212d321cfb889cad85ba89c8c363d99811a"}
Jul 29 01:12:53.262247 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:53.262228    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8g9fl_e044d9fa-39c8-49b8-94e1-550f3dbe7b26/ovn-acl-logging/0.log"
Jul 29 01:12:53.262722 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:53.262699    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl" event={"ID":"e044d9fa-39c8-49b8-94e1-550f3dbe7b26","Type":"ContainerStarted","Data":"a1700706a47941cc8ea06fb289369e931e6b3b28b909ff79e075e65969519944"}
Jul 29 01:12:53.264275 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:53.264252    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tqlp2" event={"ID":"747ed8ca-b021-4f6c-a9ef-8505bc6efdad","Type":"ContainerStarted","Data":"71d1d46780af5c3ab9af32eb723a4f1e89ea98ac4112b7b677c3970b1c1ed18c"}
Jul 29 01:12:54.165631 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:54.165601    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s247d"
Jul 29 01:12:54.165777 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:54.165650    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7dj7"
Jul 29 01:12:54.165832 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:54.165780    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k5r4"
Jul 29 01:12:54.166116 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:54.165940    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s247d" podUID="c57c897c-c75e-4bd5-8c5d-7682906914f2"
Jul 29 01:12:54.166192 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:54.166168    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k5r4" podUID="5066ce06-1832-4291-9b2e-852aff936a92"
Jul 29 01:12:54.166257 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:54.166202    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7dj7" podUID="aee511a0-1681-4291-90ee-eda4bfb122dc"
Jul 29 01:12:54.268223 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:54.268189    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmkhs" event={"ID":"a175742e-f244-4f5f-abc7-4fac5676789e","Type":"ContainerStarted","Data":"b36ccc8f22e44940977428e38c854c5f4ce320773c1282ba70e73eae1a1a25c2"}
Jul 29 01:12:54.286929 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:54.286882    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-tqlp2" podStartSLOduration=5.786050737 podStartE2EDuration="24.286864314s" totalImagesPullingTime="18.500813577s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:12:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:12:53.278048024 +0000 UTC m=+23.590440733" watchObservedRunningTime="2026-07-29 01:12:54.286864314 +0000 UTC m=+24.599257073"
Jul 29 01:12:54.287093 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:54.287024    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmkhs" podStartSLOduration=3.515995866 podStartE2EDuration="24.287016886s" totalImagesPullingTime="20.77102102s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:12:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:12:54.286521236 +0000 UTC m=+24.598913944" watchObservedRunningTime="2026-07-29 01:12:54.287016886 +0000 UTC m=+24.599409594"
Jul 29 01:12:55.273913 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:55.273884    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8g9fl_e044d9fa-39c8-49b8-94e1-550f3dbe7b26/ovn-acl-logging/0.log"
Jul 29 01:12:55.274468 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:55.274334    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl" event={"ID":"e044d9fa-39c8-49b8-94e1-550f3dbe7b26","Type":"ContainerStarted","Data":"971eb927cc5761a4782fe091a139b68645cc3837bf2e15925242a7829a485aef"}
Jul 29 01:12:55.374130 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:55.374096    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2vj4h"
Jul 29 01:12:55.374724 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:55.374698    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2vj4h"
Jul 29 01:12:56.164206 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:56.164171    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7dj7"
Jul 29 01:12:56.164383 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:56.164171    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k5r4"
Jul 29 01:12:56.164383 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:56.164304    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7dj7" podUID="aee511a0-1681-4291-90ee-eda4bfb122dc"
Jul 29 01:12:56.164383 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:56.164177    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s247d"
Jul 29 01:12:56.164543 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:56.164348    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k5r4" podUID="5066ce06-1832-4291-9b2e-852aff936a92"
Jul 29 01:12:56.164543 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:56.164444    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s247d" podUID="c57c897c-c75e-4bd5-8c5d-7682906914f2"
Jul 29 01:12:56.276110 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:56.276086    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2vj4h"
Jul 29 01:12:56.276526 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:56.276511    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2vj4h"
Jul 29 01:12:57.279992 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:57.279793    2580 generic.go:356] "Generic (PLEG): container finished" podID="9c156d63-8457-4165-b635-a1e0a523c733" containerID="e84a4fdc05aa61e26818a2a06a844859450ef8fdb4c28c64b382fde398136744" exitCode=0
Jul 29 01:12:57.280664 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:57.279875    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ps929" event={"ID":"9c156d63-8457-4165-b635-a1e0a523c733","Type":"ContainerDied","Data":"e84a4fdc05aa61e26818a2a06a844859450ef8fdb4c28c64b382fde398136744"}
Jul 29 01:12:57.283557 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:57.283541    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8g9fl_e044d9fa-39c8-49b8-94e1-550f3dbe7b26/ovn-acl-logging/0.log"
Jul 29 01:12:57.283916 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:57.283896    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl" event={"ID":"e044d9fa-39c8-49b8-94e1-550f3dbe7b26","Type":"ContainerStarted","Data":"6649278beec27b8da712200c6fbf7b5f5b2f6a6dfd58159a9c7573fa7a82c4fd"}
Jul 29 01:12:57.284463 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:57.284444    2580 scope.go:117] "RemoveContainer" containerID="8a4869c14f7e8c0b4895c8d5986d7c9261d0ca3bd0618766cd219effd8e10074"
Jul 29 01:12:58.164852 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:58.164819    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s247d"
Jul 29 01:12:58.165023 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:58.164931    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7dj7"
Jul 29 01:12:58.165023 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:58.164963    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s247d" podUID="c57c897c-c75e-4bd5-8c5d-7682906914f2"
Jul 29 01:12:58.165111 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:58.165021    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7dj7" podUID="aee511a0-1681-4291-90ee-eda4bfb122dc"
Jul 29 01:12:58.165111 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:58.165073    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k5r4"
Jul 29 01:12:58.165176 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:58.165139    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k5r4" podUID="5066ce06-1832-4291-9b2e-852aff936a92"
Jul 29 01:12:58.289733 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:58.289666    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8g9fl_e044d9fa-39c8-49b8-94e1-550f3dbe7b26/ovn-acl-logging/0.log"
Jul 29 01:12:58.290157 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:58.289988    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl" event={"ID":"e044d9fa-39c8-49b8-94e1-550f3dbe7b26","Type":"ContainerStarted","Data":"bb82096aaf3e9e7e8c69d5674d9c1b4cb6b42f8bab5ef6b14a320a5aa0b2958f"}
Jul 29 01:12:58.290319 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:58.290299    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:58.290401 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:58.290367    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:58.290401 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:58.290400    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:58.305421 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:58.305394    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:58.305574 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:58.305492    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:12:58.320381 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:58.320318    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl" podStartSLOduration=9.552314263 podStartE2EDuration="28.320293752s" totalImagesPullingTime="18.767979489s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:12:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:12:58.317679212 +0000 UTC m=+28.630071920" watchObservedRunningTime="2026-07-29 01:12:58.320293752 +0000 UTC m=+28.632686460"
Jul 29 01:12:58.819631 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:58.819595    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n7dj7"]
Jul 29 01:12:58.819789 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:58.819758    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7dj7"
Jul 29 01:12:58.819864 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:58.819845    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7dj7" podUID="aee511a0-1681-4291-90ee-eda4bfb122dc"
Jul 29 01:12:58.822629 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:58.822604    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7k5r4"]
Jul 29 01:12:58.822758 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:58.822692    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k5r4"
Jul 29 01:12:58.822814 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:58.822761    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k5r4" podUID="5066ce06-1832-4291-9b2e-852aff936a92"
Jul 29 01:12:58.823200 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:58.823178    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-s247d"]
Jul 29 01:12:58.823290 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:58.823269    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s247d"
Jul 29 01:12:58.823376 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:12:58.823354    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s247d" podUID="c57c897c-c75e-4bd5-8c5d-7682906914f2"
Jul 29 01:12:59.294316 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:59.294283    2580 generic.go:356] "Generic (PLEG): container finished" podID="9c156d63-8457-4165-b635-a1e0a523c733" containerID="6223bee7fe6239f68df086ed1b78e31e62be24c3bba8b245dc39b4b0a746d6c1" exitCode=0
Jul 29 01:12:59.294692 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:12:59.294330    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ps929" event={"ID":"9c156d63-8457-4165-b635-a1e0a523c733","Type":"ContainerDied","Data":"6223bee7fe6239f68df086ed1b78e31e62be24c3bba8b245dc39b4b0a746d6c1"}
Jul 29 01:13:00.165031 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:00.164850    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k5r4"
Jul 29 01:13:00.165173 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:00.165086    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k5r4" podUID="5066ce06-1832-4291-9b2e-852aff936a92"
Jul 29 01:13:01.164760 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:01.164729    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s247d"
Jul 29 01:13:01.165371 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:01.164839    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s247d" podUID="c57c897c-c75e-4bd5-8c5d-7682906914f2"
Jul 29 01:13:01.165371 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:01.164892    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7dj7"
Jul 29 01:13:01.165371 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:01.165027    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7dj7" podUID="aee511a0-1681-4291-90ee-eda4bfb122dc"
Jul 29 01:13:01.300740 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:01.300710    2580 generic.go:356] "Generic (PLEG): container finished" podID="9c156d63-8457-4165-b635-a1e0a523c733" containerID="6ff6bde41f707406f8dd22979b3606e30523ad40c08a3712ca2edaebd79cadaa" exitCode=0
Jul 29 01:13:01.300880 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:01.300769    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ps929" event={"ID":"9c156d63-8457-4165-b635-a1e0a523c733","Type":"ContainerDied","Data":"6ff6bde41f707406f8dd22979b3606e30523ad40c08a3712ca2edaebd79cadaa"}
Jul 29 01:13:02.164582 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:02.164549    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k5r4"
Jul 29 01:13:02.164756 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:02.164667    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k5r4" podUID="5066ce06-1832-4291-9b2e-852aff936a92"
Jul 29 01:13:02.200483 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:02.200438    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:02.306453 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:02.306407    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:03.164920 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:03.164882    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s247d"
Jul 29 01:13:03.164920 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:03.164906    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7dj7"
Jul 29 01:13:03.165163 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:03.165031    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7dj7" podUID="aee511a0-1681-4291-90ee-eda4bfb122dc"
Jul 29 01:13:03.165163 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:03.165121    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s247d" podUID="c57c897c-c75e-4bd5-8c5d-7682906914f2"
Jul 29 01:13:03.835197 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:03.835114    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aee511a0-1681-4291-90ee-eda4bfb122dc-original-pull-secret\") pod \"global-pull-secret-syncer-n7dj7\" (UID: \"aee511a0-1681-4291-90ee-eda4bfb122dc\") " pod="kube-system/global-pull-secret-syncer-n7dj7"
Jul 29 01:13:03.835686 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:03.835250    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 01:13:03.835686 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:03.835304    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c57c897c-c75e-4bd5-8c5d-7682906914f2-metrics-certs\") pod \"network-metrics-daemon-s247d\" (UID: \"c57c897c-c75e-4bd5-8c5d-7682906914f2\") " pod="openshift-multus/network-metrics-daemon-s247d"
Jul 29 01:13:03.835686 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:03.835315    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aee511a0-1681-4291-90ee-eda4bfb122dc-original-pull-secret podName:aee511a0-1681-4291-90ee-eda4bfb122dc nodeName:}" failed. No retries permitted until 2026-07-29 01:13:35.835297294 +0000 UTC m=+66.147689981 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aee511a0-1681-4291-90ee-eda4bfb122dc-original-pull-secret") pod "global-pull-secret-syncer-n7dj7" (UID: "aee511a0-1681-4291-90ee-eda4bfb122dc") : object "kube-system"/"original-pull-secret" not registered
Jul 29 01:13:03.835686 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:03.835440    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:13:03.835686 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:03.835522    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c57c897c-c75e-4bd5-8c5d-7682906914f2-metrics-certs podName:c57c897c-c75e-4bd5-8c5d-7682906914f2 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:35.835504917 +0000 UTC m=+66.147897603 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c57c897c-c75e-4bd5-8c5d-7682906914f2-metrics-certs") pod "network-metrics-daemon-s247d" (UID: "c57c897c-c75e-4bd5-8c5d-7682906914f2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:13:03.936179 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:03.936137    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gps42\" (UniqueName: \"kubernetes.io/projected/5066ce06-1832-4291-9b2e-852aff936a92-kube-api-access-gps42\") pod \"network-check-target-7k5r4\" (UID: \"5066ce06-1832-4291-9b2e-852aff936a92\") " pod="openshift-network-diagnostics/network-check-target-7k5r4"
Jul 29 01:13:03.936348 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:03.936285    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 01:13:03.936348 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:03.936306    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 01:13:03.936348 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:03.936316    2580 projected.go:196] Error preparing data for projected volume kube-api-access-gps42 for pod openshift-network-diagnostics/network-check-target-7k5r4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:13:03.936487 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:03.936376    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5066ce06-1832-4291-9b2e-852aff936a92-kube-api-access-gps42 podName:5066ce06-1832-4291-9b2e-852aff936a92 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:35.936358552 +0000 UTC m=+66.248751238 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gps42" (UniqueName: "kubernetes.io/projected/5066ce06-1832-4291-9b2e-852aff936a92-kube-api-access-gps42") pod "network-check-target-7k5r4" (UID: "5066ce06-1832-4291-9b2e-852aff936a92") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:13:04.116435 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:04.116401    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:04.164281 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:04.164247    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k5r4"
Jul 29 01:13:04.164446 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:04.164378    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k5r4" podUID="5066ce06-1832-4291-9b2e-852aff936a92"
Jul 29 01:13:04.467658 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:04.467584    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:04.568397 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:04.568362    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:05.032558 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.032536    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-238.ec2.internal" event="NodeReady"
Jul 29 01:13:05.033048 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.032685    2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 29 01:13:05.066661 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.066633    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-dd9d7ccf5-2vqpn"]
Jul 29 01:13:05.070330 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.070309    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-dd9d7ccf5-2vqpn"
Jul 29 01:13:05.073083 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.073056    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-sgklk\""
Jul 29 01:13:05.073179 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.073056    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 29 01:13:05.073372 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.073343    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 29 01:13:05.073628 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.073604    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 29 01:13:05.078889 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.078577    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 29 01:13:05.084630 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.084606    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cbv98"]
Jul 29 01:13:05.088080 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.088061    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-slkdh"]
Jul 29 01:13:05.088218 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.088189    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cbv98"
Jul 29 01:13:05.090809 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.090788    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 29 01:13:05.091205 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.091187    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-n8mzz\""
Jul 29 01:13:05.091438 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.091419    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-dd9d7ccf5-2vqpn"]
Jul 29 01:13:05.091531 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.091506    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-slkdh"
Jul 29 01:13:05.091692 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.091656    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 29 01:13:05.094385 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.094358    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 29 01:13:05.094723 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.094700    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7zbhk\""
Jul 29 01:13:05.094915 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.094866    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 29 01:13:05.096107 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.095309    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 29 01:13:05.098828 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.098751    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-slkdh"]
Jul 29 01:13:05.101713 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.101528    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cbv98"]
Jul 29 01:13:05.164219 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.164192    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7dj7"
Jul 29 01:13:05.164378 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.164197    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s247d"
Jul 29 01:13:05.166532 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.166512    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 01:13:05.166532 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.166523    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 01:13:05.166699 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.166544    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nbzfd\""
Jul 29 01:13:05.246766 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.246741    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ff3a285d-75d7-46d8-ad12-11739e8d433e-ca-trust-extracted\") pod \"image-registry-dd9d7ccf5-2vqpn\" (UID: \"ff3a285d-75d7-46d8-ad12-11739e8d433e\") " pod="openshift-image-registry/image-registry-dd9d7ccf5-2vqpn"
Jul 29 01:13:05.246858 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.246774    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ff3a285d-75d7-46d8-ad12-11739e8d433e-installation-pull-secrets\") pod \"image-registry-dd9d7ccf5-2vqpn\" (UID: \"ff3a285d-75d7-46d8-ad12-11739e8d433e\") " pod="openshift-image-registry/image-registry-dd9d7ccf5-2vqpn"
Jul 29 01:13:05.246858 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.246797    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b783cf19-736b-4578-8839-b8e5201addde-config-volume\") pod \"dns-default-cbv98\" (UID: \"b783cf19-736b-4578-8839-b8e5201addde\") " pod="openshift-dns/dns-default-cbv98"
Jul 29 01:13:05.246942 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.246920    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff3a285d-75d7-46d8-ad12-11739e8d433e-registry-tls\") pod \"image-registry-dd9d7ccf5-2vqpn\" (UID: \"ff3a285d-75d7-46d8-ad12-11739e8d433e\") " pod="openshift-image-registry/image-registry-dd9d7ccf5-2vqpn"
Jul 29 01:13:05.247014 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.246996    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff3a285d-75d7-46d8-ad12-11739e8d433e-bound-sa-token\") pod \"image-registry-dd9d7ccf5-2vqpn\" (UID: \"ff3a285d-75d7-46d8-ad12-11739e8d433e\") " pod="openshift-image-registry/image-registry-dd9d7ccf5-2vqpn"
Jul 29 01:13:05.247056 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.247029    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h97hn\" (UniqueName: \"kubernetes.io/projected/ff3a285d-75d7-46d8-ad12-11739e8d433e-kube-api-access-h97hn\") pod \"image-registry-dd9d7ccf5-2vqpn\" (UID: \"ff3a285d-75d7-46d8-ad12-11739e8d433e\") " pod="openshift-image-registry/image-registry-dd9d7ccf5-2vqpn"
Jul 29 01:13:05.247091 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.247054    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b783cf19-736b-4578-8839-b8e5201addde-tmp-dir\") pod \"dns-default-cbv98\" (UID: \"b783cf19-736b-4578-8839-b8e5201addde\") " pod="openshift-dns/dns-default-cbv98"
Jul 29 01:13:05.247125 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.247103    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ff3a285d-75d7-46d8-ad12-11739e8d433e-image-registry-private-configuration\") pod \"image-registry-dd9d7ccf5-2vqpn\" (UID: \"ff3a285d-75d7-46d8-ad12-11739e8d433e\") " pod="openshift-image-registry/image-registry-dd9d7ccf5-2vqpn"
Jul 29 01:13:05.247163 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.247126    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ff3a285d-75d7-46d8-ad12-11739e8d433e-registry-certificates\") pod \"image-registry-dd9d7ccf5-2vqpn\" (UID: \"ff3a285d-75d7-46d8-ad12-11739e8d433e\") " pod="openshift-image-registry/image-registry-dd9d7ccf5-2vqpn"
Jul 29 01:13:05.247163 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.247142    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ff3a285d-75d7-46d8-ad12-11739e8d433e-trusted-ca\") pod \"image-registry-dd9d7ccf5-2vqpn\" (UID: \"ff3a285d-75d7-46d8-ad12-11739e8d433e\") " pod="openshift-image-registry/image-registry-dd9d7ccf5-2vqpn"
Jul 29 01:13:05.247163 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.247160    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq4vl\" (UniqueName: \"kubernetes.io/projected/db8a4b26-e014-4f49-9ce8-1381c14657e8-kube-api-access-vq4vl\") pod \"ingress-canary-slkdh\" (UID: \"db8a4b26-e014-4f49-9ce8-1381c14657e8\") " pod="openshift-ingress-canary/ingress-canary-slkdh"
Jul 29 01:13:05.247264 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.247175    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bb58q\" (UniqueName: \"kubernetes.io/projected/b783cf19-736b-4578-8839-b8e5201addde-kube-api-access-bb58q\") pod \"dns-default-cbv98\" (UID: \"b783cf19-736b-4578-8839-b8e5201addde\") " pod="openshift-dns/dns-default-cbv98"
Jul 29 01:13:05.247264 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.247209    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b783cf19-736b-4578-8839-b8e5201addde-metrics-tls\") pod \"dns-default-cbv98\" (UID: \"b783cf19-736b-4578-8839-b8e5201addde\") " pod="openshift-dns/dns-default-cbv98"
Jul 29 01:13:05.247340 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.247276    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db8a4b26-e014-4f49-9ce8-1381c14657e8-cert\") pod \"ingress-canary-slkdh\" (UID: \"db8a4b26-e014-4f49-9ce8-1381c14657e8\") " pod="openshift-ingress-canary/ingress-canary-slkdh"
Jul 29 01:13:05.313364 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.313332    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ps929" event={"ID":"9c156d63-8457-4165-b635-a1e0a523c733","Type":"ContainerStarted","Data":"176ce358f56403703509f0a0dda7d1c1add7ed0a4b1971bfe76ae7bff6ba24b9"}
Jul 29 01:13:05.347538 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.347514    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ff3a285d-75d7-46d8-ad12-11739e8d433e-image-registry-private-configuration\") pod \"image-registry-dd9d7ccf5-2vqpn\" (UID: \"ff3a285d-75d7-46d8-ad12-11739e8d433e\") " pod="openshift-image-registry/image-registry-dd9d7ccf5-2vqpn"
Jul 29 01:13:05.347657 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.347548    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ff3a285d-75d7-46d8-ad12-11739e8d433e-registry-certificates\") pod \"image-registry-dd9d7ccf5-2vqpn\" (UID: \"ff3a285d-75d7-46d8-ad12-11739e8d433e\") " pod="openshift-image-registry/image-registry-dd9d7ccf5-2vqpn"
Jul 29 01:13:05.347657 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.347563    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ff3a285d-75d7-46d8-ad12-11739e8d433e-trusted-ca\") pod \"image-registry-dd9d7ccf5-2vqpn\" (UID: \"ff3a285d-75d7-46d8-ad12-11739e8d433e\") " pod="openshift-image-registry/image-registry-dd9d7ccf5-2vqpn"
Jul 29 01:13:05.347657 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.347580    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq4vl\" (UniqueName: \"kubernetes.io/projected/db8a4b26-e014-4f49-9ce8-1381c14657e8-kube-api-access-vq4vl\") pod \"ingress-canary-slkdh\" (UID: \"db8a4b26-e014-4f49-9ce8-1381c14657e8\") " pod="openshift-ingress-canary/ingress-canary-slkdh"
Jul 29 01:13:05.347657 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.347596    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb58q\" (UniqueName: \"kubernetes.io/projected/b783cf19-736b-4578-8839-b8e5201addde-kube-api-access-bb58q\") pod \"dns-default-cbv98\" (UID: \"b783cf19-736b-4578-8839-b8e5201addde\") " pod="openshift-dns/dns-default-cbv98"
Jul 29 01:13:05.347657 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.347613    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b783cf19-736b-4578-8839-b8e5201addde-metrics-tls\") pod \"dns-default-cbv98\" (UID: \"b783cf19-736b-4578-8839-b8e5201addde\") " pod="openshift-dns/dns-default-cbv98"
Jul 29 01:13:05.347916 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:05.347698    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:13:05.347916 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:05.347752    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b783cf19-736b-4578-8839-b8e5201addde-metrics-tls podName:b783cf19-736b-4578-8839-b8e5201addde nodeName:}" failed. No retries permitted until 2026-07-29 01:13:05.847733959 +0000 UTC m=+36.160126648 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b783cf19-736b-4578-8839-b8e5201addde-metrics-tls") pod "dns-default-cbv98" (UID: "b783cf19-736b-4578-8839-b8e5201addde") : secret "dns-default-metrics-tls" not found
Jul 29 01:13:05.347916 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.347845    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db8a4b26-e014-4f49-9ce8-1381c14657e8-cert\") pod \"ingress-canary-slkdh\" (UID: \"db8a4b26-e014-4f49-9ce8-1381c14657e8\") " pod="openshift-ingress-canary/ingress-canary-slkdh"
Jul 29 01:13:05.347916 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.347898    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ff3a285d-75d7-46d8-ad12-11739e8d433e-ca-trust-extracted\") pod \"image-registry-dd9d7ccf5-2vqpn\" (UID: \"ff3a285d-75d7-46d8-ad12-11739e8d433e\") " pod="openshift-image-registry/image-registry-dd9d7ccf5-2vqpn"
Jul 29 01:13:05.348124 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.347928    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ff3a285d-75d7-46d8-ad12-11739e8d433e-installation-pull-secrets\") pod \"image-registry-dd9d7ccf5-2vqpn\" (UID: \"ff3a285d-75d7-46d8-ad12-11739e8d433e\") " pod="openshift-image-registry/image-registry-dd9d7ccf5-2vqpn"
Jul 29 01:13:05.348124 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.347978    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b783cf19-736b-4578-8839-b8e5201addde-config-volume\") pod \"dns-default-cbv98\" (UID: \"b783cf19-736b-4578-8839-b8e5201addde\") " pod="openshift-dns/dns-default-cbv98"
Jul 29 01:13:05.348124 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.348064    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff3a285d-75d7-46d8-ad12-11739e8d433e-registry-tls\") pod \"image-registry-dd9d7ccf5-2vqpn\" (UID: \"ff3a285d-75d7-46d8-ad12-11739e8d433e\") " pod="openshift-image-registry/image-registry-dd9d7ccf5-2vqpn"
Jul 29 01:13:05.348124 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.348113    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff3a285d-75d7-46d8-ad12-11739e8d433e-bound-sa-token\") pod \"image-registry-dd9d7ccf5-2vqpn\" (UID: \"ff3a285d-75d7-46d8-ad12-11739e8d433e\") " pod="openshift-image-registry/image-registry-dd9d7ccf5-2vqpn"
Jul 29 01:13:05.348310 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.348137    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h97hn\" (UniqueName: \"kubernetes.io/projected/ff3a285d-75d7-46d8-ad12-11739e8d433e-kube-api-access-h97hn\") pod \"image-registry-dd9d7ccf5-2vqpn\" (UID: \"ff3a285d-75d7-46d8-ad12-11739e8d433e\") " pod="openshift-image-registry/image-registry-dd9d7ccf5-2vqpn"
Jul 29 01:13:05.348310 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.348157    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b783cf19-736b-4578-8839-b8e5201addde-tmp-dir\") pod \"dns-default-cbv98\" (UID: \"b783cf19-736b-4578-8839-b8e5201addde\") " pod="openshift-dns/dns-default-cbv98"
Jul 29 01:13:05.348310 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.348233    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ff3a285d-75d7-46d8-ad12-11739e8d433e-registry-certificates\") pod \"image-registry-dd9d7ccf5-2vqpn\" (UID: \"ff3a285d-75d7-46d8-ad12-11739e8d433e\") " pod="openshift-image-registry/image-registry-dd9d7ccf5-2vqpn"
Jul 29 01:13:05.348310 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.348280    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ff3a285d-75d7-46d8-ad12-11739e8d433e-ca-trust-extracted\") pod \"image-registry-dd9d7ccf5-2vqpn\" (UID: \"ff3a285d-75d7-46d8-ad12-11739e8d433e\") " pod="openshift-image-registry/image-registry-dd9d7ccf5-2vqpn"
Jul 29 01:13:05.348489 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.348429    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b783cf19-736b-4578-8839-b8e5201addde-tmp-dir\") pod \"dns-default-cbv98\" (UID: \"b783cf19-736b-4578-8839-b8e5201addde\") " pod="openshift-dns/dns-default-cbv98"
Jul 29 01:13:05.348584 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:05.348567    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 01:13:05.348644 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:05.348585    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dd9d7ccf5-2vqpn: secret "image-registry-tls" not found
Jul 29 01:13:05.348644 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.348622    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ff3a285d-75d7-46d8-ad12-11739e8d433e-trusted-ca\") pod \"image-registry-dd9d7ccf5-2vqpn\" (UID: \"ff3a285d-75d7-46d8-ad12-11739e8d433e\") " pod="openshift-image-registry/image-registry-dd9d7ccf5-2vqpn"
Jul 29 01:13:05.348644 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:05.348636    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff3a285d-75d7-46d8-ad12-11739e8d433e-registry-tls podName:ff3a285d-75d7-46d8-ad12-11739e8d433e nodeName:}" failed. No retries permitted until 2026-07-29 01:13:05.848622158 +0000 UTC m=+36.161014844 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ff3a285d-75d7-46d8-ad12-11739e8d433e-registry-tls") pod "image-registry-dd9d7ccf5-2vqpn" (UID: "ff3a285d-75d7-46d8-ad12-11739e8d433e") : secret "image-registry-tls" not found
Jul 29 01:13:05.349137 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.349118    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b783cf19-736b-4578-8839-b8e5201addde-config-volume\") pod \"dns-default-cbv98\" (UID: \"b783cf19-736b-4578-8839-b8e5201addde\") " pod="openshift-dns/dns-default-cbv98"
Jul 29 01:13:05.351847 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.351822    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ff3a285d-75d7-46d8-ad12-11739e8d433e-installation-pull-secrets\") pod \"image-registry-dd9d7ccf5-2vqpn\" (UID: \"ff3a285d-75d7-46d8-ad12-11739e8d433e\") " pod="openshift-image-registry/image-registry-dd9d7ccf5-2vqpn"
Jul 29 01:13:05.351935 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.351872    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ff3a285d-75d7-46d8-ad12-11739e8d433e-image-registry-private-configuration\") pod \"image-registry-dd9d7ccf5-2vqpn\" (UID: \"ff3a285d-75d7-46d8-ad12-11739e8d433e\") " pod="openshift-image-registry/image-registry-dd9d7ccf5-2vqpn"
Jul 29 01:13:05.351935 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.351921    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db8a4b26-e014-4f49-9ce8-1381c14657e8-cert\") pod \"ingress-canary-slkdh\" (UID: \"db8a4b26-e014-4f49-9ce8-1381c14657e8\") " pod="openshift-ingress-canary/ingress-canary-slkdh"
Jul 29 01:13:05.356601 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.356574    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bb58q\" (UniqueName: \"kubernetes.io/projected/b783cf19-736b-4578-8839-b8e5201addde-kube-api-access-bb58q\") pod \"dns-default-cbv98\" (UID: \"b783cf19-736b-4578-8839-b8e5201addde\") " pod="openshift-dns/dns-default-cbv98"
Jul 29 01:13:05.356763 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.356725    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq4vl\" (UniqueName: \"kubernetes.io/projected/db8a4b26-e014-4f49-9ce8-1381c14657e8-kube-api-access-vq4vl\") pod \"ingress-canary-slkdh\" (UID: \"db8a4b26-e014-4f49-9ce8-1381c14657e8\") " pod="openshift-ingress-canary/ingress-canary-slkdh"
Jul 29 01:13:05.357031 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.357012    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff3a285d-75d7-46d8-ad12-11739e8d433e-bound-sa-token\") pod \"image-registry-dd9d7ccf5-2vqpn\" (UID: \"ff3a285d-75d7-46d8-ad12-11739e8d433e\") " pod="openshift-image-registry/image-registry-dd9d7ccf5-2vqpn"
Jul 29 01:13:05.360723 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.360702    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h97hn\" (UniqueName: \"kubernetes.io/projected/ff3a285d-75d7-46d8-ad12-11739e8d433e-kube-api-access-h97hn\") pod \"image-registry-dd9d7ccf5-2vqpn\" (UID: \"ff3a285d-75d7-46d8-ad12-11739e8d433e\") " pod="openshift-image-registry/image-registry-dd9d7ccf5-2vqpn"
Jul 29 01:13:05.408094 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.408072    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-slkdh"
Jul 29 01:13:05.548925 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.548897    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-slkdh"]
Jul 29 01:13:05.552941 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:13:05.552919    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb8a4b26_e014_4f49_9ce8_1381c14657e8.slice/crio-b10b2a07e55a286c16f47f5ad2a1b3188ccfe88b074b68abdfa5b7cf41ff4c43 WatchSource:0}: Error finding container b10b2a07e55a286c16f47f5ad2a1b3188ccfe88b074b68abdfa5b7cf41ff4c43: Status 404 returned error can't find the container with id b10b2a07e55a286c16f47f5ad2a1b3188ccfe88b074b68abdfa5b7cf41ff4c43
Jul 29 01:13:05.631845 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.631810    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:05.733220 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.733146    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:05.852830 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.852797    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff3a285d-75d7-46d8-ad12-11739e8d433e-registry-tls\") pod \"image-registry-dd9d7ccf5-2vqpn\" (UID: \"ff3a285d-75d7-46d8-ad12-11739e8d433e\") " pod="openshift-image-registry/image-registry-dd9d7ccf5-2vqpn"
Jul 29 01:13:05.853021 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:05.852852    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b783cf19-736b-4578-8839-b8e5201addde-metrics-tls\") pod \"dns-default-cbv98\" (UID: \"b783cf19-736b-4578-8839-b8e5201addde\") " pod="openshift-dns/dns-default-cbv98"
Jul 29 01:13:05.853021 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:05.852943    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:13:05.853021 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:05.852965    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 01:13:05.853021 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:05.852986    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dd9d7ccf5-2vqpn: secret "image-registry-tls" not found
Jul 29 01:13:05.853021 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:05.853019    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b783cf19-736b-4578-8839-b8e5201addde-metrics-tls podName:b783cf19-736b-4578-8839-b8e5201addde nodeName:}" failed. No retries permitted until 2026-07-29 01:13:06.853005986 +0000 UTC m=+37.165398671 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b783cf19-736b-4578-8839-b8e5201addde-metrics-tls") pod "dns-default-cbv98" (UID: "b783cf19-736b-4578-8839-b8e5201addde") : secret "dns-default-metrics-tls" not found
Jul 29 01:13:05.853188 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:05.853032    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff3a285d-75d7-46d8-ad12-11739e8d433e-registry-tls podName:ff3a285d-75d7-46d8-ad12-11739e8d433e nodeName:}" failed. No retries permitted until 2026-07-29 01:13:06.853026738 +0000 UTC m=+37.165419424 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ff3a285d-75d7-46d8-ad12-11739e8d433e-registry-tls") pod "image-registry-dd9d7ccf5-2vqpn" (UID: "ff3a285d-75d7-46d8-ad12-11739e8d433e") : secret "image-registry-tls" not found
Jul 29 01:13:06.164740 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:06.164704    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k5r4"
Jul 29 01:13:06.167619 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:06.167596    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 01:13:06.167746 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:06.167679    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-82b2w\""
Jul 29 01:13:06.167837 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:06.167820    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 01:13:06.317526 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:06.317486    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-slkdh" event={"ID":"db8a4b26-e014-4f49-9ce8-1381c14657e8","Type":"ContainerStarted","Data":"b10b2a07e55a286c16f47f5ad2a1b3188ccfe88b074b68abdfa5b7cf41ff4c43"}
Jul 29 01:13:06.320815 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:06.320783    2580 generic.go:356] "Generic (PLEG): container finished" podID="9c156d63-8457-4165-b635-a1e0a523c733" containerID="176ce358f56403703509f0a0dda7d1c1add7ed0a4b1971bfe76ae7bff6ba24b9" exitCode=0
Jul 29 01:13:06.320979 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:06.320827    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ps929" event={"ID":"9c156d63-8457-4165-b635-a1e0a523c733","Type":"ContainerDied","Data":"176ce358f56403703509f0a0dda7d1c1add7ed0a4b1971bfe76ae7bff6ba24b9"}
Jul 29 01:13:06.862745 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:06.862713    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff3a285d-75d7-46d8-ad12-11739e8d433e-registry-tls\") pod \"image-registry-dd9d7ccf5-2vqpn\" (UID: \"ff3a285d-75d7-46d8-ad12-11739e8d433e\") " pod="openshift-image-registry/image-registry-dd9d7ccf5-2vqpn"
Jul 29 01:13:06.862892 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:06.862766    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b783cf19-736b-4578-8839-b8e5201addde-metrics-tls\") pod \"dns-default-cbv98\" (UID: \"b783cf19-736b-4578-8839-b8e5201addde\") " pod="openshift-dns/dns-default-cbv98"
Jul 29 01:13:06.862892 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:06.862864    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:13:06.862976 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:06.862916    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b783cf19-736b-4578-8839-b8e5201addde-metrics-tls podName:b783cf19-736b-4578-8839-b8e5201addde nodeName:}" failed. No retries permitted until 2026-07-29 01:13:08.862903482 +0000 UTC m=+39.175296168 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b783cf19-736b-4578-8839-b8e5201addde-metrics-tls") pod "dns-default-cbv98" (UID: "b783cf19-736b-4578-8839-b8e5201addde") : secret "dns-default-metrics-tls" not found
Jul 29 01:13:06.862976 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:06.862862    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 01:13:06.863089 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:06.862974    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dd9d7ccf5-2vqpn: secret "image-registry-tls" not found
Jul 29 01:13:06.863089 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:06.863024    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff3a285d-75d7-46d8-ad12-11739e8d433e-registry-tls podName:ff3a285d-75d7-46d8-ad12-11739e8d433e nodeName:}" failed. No retries permitted until 2026-07-29 01:13:08.863010849 +0000 UTC m=+39.175403538 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ff3a285d-75d7-46d8-ad12-11739e8d433e-registry-tls") pod "image-registry-dd9d7ccf5-2vqpn" (UID: "ff3a285d-75d7-46d8-ad12-11739e8d433e") : secret "image-registry-tls" not found
Jul 29 01:13:07.327761 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:07.327488    2580 generic.go:356] "Generic (PLEG): container finished" podID="9c156d63-8457-4165-b635-a1e0a523c733" containerID="63227555cb86161e0a4bce65a0bfb32bced5e5684d49dac7704350196876e8e1" exitCode=0
Jul 29 01:13:07.327761 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:07.327575    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ps929" event={"ID":"9c156d63-8457-4165-b635-a1e0a523c733","Type":"ContainerDied","Data":"63227555cb86161e0a4bce65a0bfb32bced5e5684d49dac7704350196876e8e1"}
Jul 29 01:13:08.332181 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:08.332075    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-slkdh" event={"ID":"db8a4b26-e014-4f49-9ce8-1381c14657e8","Type":"ContainerStarted","Data":"ab1e26a52ae02c365126e4e12d5fbe7fa8f1aff7bf7ac204b10d1111bd0cb76b"}
Jul 29 01:13:08.335887 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:08.335861    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ps929" event={"ID":"9c156d63-8457-4165-b635-a1e0a523c733","Type":"ContainerStarted","Data":"695b08830b7d05d933840aad84f7486f14b9611d0f26f0b270293eabc88757c8"}
Jul 29 01:13:08.347279 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:08.347230    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-slkdh" podStartSLOduration=0.827241799 podStartE2EDuration="3.347211804s" totalImagesPullingTime="2.519970005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:13:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:08.347166254 +0000 UTC m=+38.659558975" watchObservedRunningTime="2026-07-29 01:13:08.347211804 +0000 UTC m=+38.659604504"
Jul 29 01:13:08.367806 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:08.367759    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ps929" podStartSLOduration=10.068631015 podStartE2EDuration="38.367743433s" totalImagesPullingTime="28.299112418s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:12:30 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:08.366470916 +0000 UTC m=+38.678863624" watchObservedRunningTime="2026-07-29 01:13:08.367743433 +0000 UTC m=+38.680136141"
Jul 29 01:13:08.486736 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:08.486705    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:08.544279 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:08.544249    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:08.827771 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:08.827727    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:08.878834 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:08.878799    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b783cf19-736b-4578-8839-b8e5201addde-metrics-tls\") pod \"dns-default-cbv98\" (UID: \"b783cf19-736b-4578-8839-b8e5201addde\") " pod="openshift-dns/dns-default-cbv98"
Jul 29 01:13:08.878975 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:08.878874    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff3a285d-75d7-46d8-ad12-11739e8d433e-registry-tls\") pod \"image-registry-dd9d7ccf5-2vqpn\" (UID: \"ff3a285d-75d7-46d8-ad12-11739e8d433e\") " pod="openshift-image-registry/image-registry-dd9d7ccf5-2vqpn"
Jul 29 01:13:08.879011 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:08.878972    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:13:08.879011 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:08.878979    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 01:13:08.879011 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:08.878992    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dd9d7ccf5-2vqpn: secret "image-registry-tls" not found
Jul 29 01:13:08.879116 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:08.879035    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b783cf19-736b-4578-8839-b8e5201addde-metrics-tls podName:b783cf19-736b-4578-8839-b8e5201addde nodeName:}" failed. No retries permitted until 2026-07-29 01:13:12.879021953 +0000 UTC m=+43.191414643 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b783cf19-736b-4578-8839-b8e5201addde-metrics-tls") pod "dns-default-cbv98" (UID: "b783cf19-736b-4578-8839-b8e5201addde") : secret "dns-default-metrics-tls" not found
Jul 29 01:13:08.879116 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:08.879051    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff3a285d-75d7-46d8-ad12-11739e8d433e-registry-tls podName:ff3a285d-75d7-46d8-ad12-11739e8d433e nodeName:}" failed. No retries permitted until 2026-07-29 01:13:12.879044049 +0000 UTC m=+43.191436735 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ff3a285d-75d7-46d8-ad12-11739e8d433e-registry-tls") pod "image-registry-dd9d7ccf5-2vqpn" (UID: "ff3a285d-75d7-46d8-ad12-11739e8d433e") : secret "image-registry-tls" not found
Jul 29 01:13:08.929285 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:08.929257    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:10.737113 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:10.737078    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-84mml"]
Jul 29 01:13:10.752011 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:10.751972    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:10.767865 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:10.767837    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-84mml"]
Jul 29 01:13:10.768021 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:10.767936    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-84mml"
Jul 29 01:13:10.770453 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:10.770430    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 29 01:13:10.770598 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:10.770514    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 29 01:13:10.770598 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:10.770530    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 29 01:13:10.770598 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:10.770541    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-z5fvs\""
Jul 29 01:13:10.771748 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:10.771730    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 29 01:13:10.823136 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:10.823090    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:10.891372 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:10.891339    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/51893d87-31b0-4e20-97b2-e0f5cc864175-crio-socket\") pod \"insights-runtime-extractor-84mml\" (UID: \"51893d87-31b0-4e20-97b2-e0f5cc864175\") " pod="openshift-insights/insights-runtime-extractor-84mml"
Jul 29 01:13:10.891495 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:10.891377    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/51893d87-31b0-4e20-97b2-e0f5cc864175-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-84mml\" (UID: \"51893d87-31b0-4e20-97b2-e0f5cc864175\") " pod="openshift-insights/insights-runtime-extractor-84mml"
Jul 29 01:13:10.891495 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:10.891453    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bc47n\" (UniqueName: \"kubernetes.io/projected/51893d87-31b0-4e20-97b2-e0f5cc864175-kube-api-access-bc47n\") pod \"insights-runtime-extractor-84mml\" (UID: \"51893d87-31b0-4e20-97b2-e0f5cc864175\") " pod="openshift-insights/insights-runtime-extractor-84mml"
Jul 29 01:13:10.891596 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:10.891490    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/51893d87-31b0-4e20-97b2-e0f5cc864175-data-volume\") pod \"insights-runtime-extractor-84mml\" (UID: \"51893d87-31b0-4e20-97b2-e0f5cc864175\") " pod="openshift-insights/insights-runtime-extractor-84mml"
Jul 29 01:13:10.891596 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:10.891526    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/51893d87-31b0-4e20-97b2-e0f5cc864175-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-84mml\" (UID: \"51893d87-31b0-4e20-97b2-e0f5cc864175\") " pod="openshift-insights/insights-runtime-extractor-84mml"
Jul 29 01:13:10.992704 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:10.992633    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/51893d87-31b0-4e20-97b2-e0f5cc864175-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-84mml\" (UID: \"51893d87-31b0-4e20-97b2-e0f5cc864175\") " pod="openshift-insights/insights-runtime-extractor-84mml"
Jul 29 01:13:10.992799 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:10.992710    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/51893d87-31b0-4e20-97b2-e0f5cc864175-crio-socket\") pod \"insights-runtime-extractor-84mml\" (UID: \"51893d87-31b0-4e20-97b2-e0f5cc864175\") " pod="openshift-insights/insights-runtime-extractor-84mml"
Jul 29 01:13:10.992799 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:10.992738    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/51893d87-31b0-4e20-97b2-e0f5cc864175-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-84mml\" (UID: \"51893d87-31b0-4e20-97b2-e0f5cc864175\") " pod="openshift-insights/insights-runtime-extractor-84mml"
Jul 29 01:13:10.992799 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:10.992766    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 01:13:10.992799 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:10.992784    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bc47n\" (UniqueName: \"kubernetes.io/projected/51893d87-31b0-4e20-97b2-e0f5cc864175-kube-api-access-bc47n\") pod \"insights-runtime-extractor-84mml\" (UID: \"51893d87-31b0-4e20-97b2-e0f5cc864175\") " pod="openshift-insights/insights-runtime-extractor-84mml"
Jul 29 01:13:10.992938 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:10.992850    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/51893d87-31b0-4e20-97b2-e0f5cc864175-kube-rbac-proxy-cm podName:51893d87-31b0-4e20-97b2-e0f5cc864175 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:11.492830385 +0000 UTC m=+41.805223088 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/51893d87-31b0-4e20-97b2-e0f5cc864175-kube-rbac-proxy-cm") pod "insights-runtime-extractor-84mml" (UID: "51893d87-31b0-4e20-97b2-e0f5cc864175") : configmap "kube-rbac-proxy" not found
Jul 29 01:13:10.992938 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:10.992881    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 01:13:10.992938 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:10.992916    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/51893d87-31b0-4e20-97b2-e0f5cc864175-data-volume\") pod \"insights-runtime-extractor-84mml\" (UID: \"51893d87-31b0-4e20-97b2-e0f5cc864175\") " pod="openshift-insights/insights-runtime-extractor-84mml"
Jul 29 01:13:10.993073 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:10.992981    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51893d87-31b0-4e20-97b2-e0f5cc864175-insights-runtime-extractor-tls podName:51893d87-31b0-4e20-97b2-e0f5cc864175 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:11.492935667 +0000 UTC m=+41.805328361 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/51893d87-31b0-4e20-97b2-e0f5cc864175-insights-runtime-extractor-tls") pod "insights-runtime-extractor-84mml" (UID: "51893d87-31b0-4e20-97b2-e0f5cc864175") : secret "insights-runtime-extractor-tls" not found
Jul 29 01:13:10.993073 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:10.992978    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/51893d87-31b0-4e20-97b2-e0f5cc864175-crio-socket\") pod \"insights-runtime-extractor-84mml\" (UID: \"51893d87-31b0-4e20-97b2-e0f5cc864175\") " pod="openshift-insights/insights-runtime-extractor-84mml"
Jul 29 01:13:10.993248 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:10.993232    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/51893d87-31b0-4e20-97b2-e0f5cc864175-data-volume\") pod \"insights-runtime-extractor-84mml\" (UID: \"51893d87-31b0-4e20-97b2-e0f5cc864175\") " pod="openshift-insights/insights-runtime-extractor-84mml"
Jul 29 01:13:11.001988 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:11.001967    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bc47n\" (UniqueName: \"kubernetes.io/projected/51893d87-31b0-4e20-97b2-e0f5cc864175-kube-api-access-bc47n\") pod \"insights-runtime-extractor-84mml\" (UID: \"51893d87-31b0-4e20-97b2-e0f5cc864175\") " pod="openshift-insights/insights-runtime-extractor-84mml"
Jul 29 01:13:11.399212 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:11.399172    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:11.496553 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:11.496521    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/51893d87-31b0-4e20-97b2-e0f5cc864175-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-84mml\" (UID: \"51893d87-31b0-4e20-97b2-e0f5cc864175\") " pod="openshift-insights/insights-runtime-extractor-84mml"
Jul 29 01:13:11.496711 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:11.496594    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/51893d87-31b0-4e20-97b2-e0f5cc864175-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-84mml\" (UID: \"51893d87-31b0-4e20-97b2-e0f5cc864175\") " pod="openshift-insights/insights-runtime-extractor-84mml"
Jul 29 01:13:11.496711 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:11.496667    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 01:13:11.496779 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:11.496713    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/51893d87-31b0-4e20-97b2-e0f5cc864175-kube-rbac-proxy-cm podName:51893d87-31b0-4e20-97b2-e0f5cc864175 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:12.496699851 +0000 UTC m=+42.809092536 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/51893d87-31b0-4e20-97b2-e0f5cc864175-kube-rbac-proxy-cm") pod "insights-runtime-extractor-84mml" (UID: "51893d87-31b0-4e20-97b2-e0f5cc864175") : configmap "kube-rbac-proxy" not found
Jul 29 01:13:11.496779 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:11.496669    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 01:13:11.496779 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:11.496748    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51893d87-31b0-4e20-97b2-e0f5cc864175-insights-runtime-extractor-tls podName:51893d87-31b0-4e20-97b2-e0f5cc864175 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:12.496739899 +0000 UTC m=+42.809132585 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/51893d87-31b0-4e20-97b2-e0f5cc864175-insights-runtime-extractor-tls") pod "insights-runtime-extractor-84mml" (UID: "51893d87-31b0-4e20-97b2-e0f5cc864175") : secret "insights-runtime-extractor-tls" not found
Jul 29 01:13:11.499910 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:11.499884    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:11.925297 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:11.925260    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:11.981693 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:11.981664    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:12.356709 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:12.356632    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:12.390093 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:12.390063    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-dfw8c"]
Jul 29 01:13:12.414810 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:12.414784    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-dfw8c"]
Jul 29 01:13:12.414961 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:12.414878    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-dfw8c"
Jul 29 01:13:12.418092 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:12.418059    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 29 01:13:12.418210 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:12.418143    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 29 01:13:12.419224 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:12.419206    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-fdxrb\""
Jul 29 01:13:12.437925 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:12.437896    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:12.487307 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:12.487276    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:12.503204 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:12.503181    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/51893d87-31b0-4e20-97b2-e0f5cc864175-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-84mml\" (UID: \"51893d87-31b0-4e20-97b2-e0f5cc864175\") " pod="openshift-insights/insights-runtime-extractor-84mml"
Jul 29 01:13:12.503331 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:12.503316    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 01:13:12.503376 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:12.503343    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/51893d87-31b0-4e20-97b2-e0f5cc864175-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-84mml\" (UID: \"51893d87-31b0-4e20-97b2-e0f5cc864175\") " pod="openshift-insights/insights-runtime-extractor-84mml"
Jul 29 01:13:12.503376 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:12.503370    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51893d87-31b0-4e20-97b2-e0f5cc864175-insights-runtime-extractor-tls podName:51893d87-31b0-4e20-97b2-e0f5cc864175 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:14.503356751 +0000 UTC m=+44.815749437 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/51893d87-31b0-4e20-97b2-e0f5cc864175-insights-runtime-extractor-tls") pod "insights-runtime-extractor-84mml" (UID: "51893d87-31b0-4e20-97b2-e0f5cc864175") : secret "insights-runtime-extractor-tls" not found
Jul 29 01:13:12.503455 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:12.503395    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 01:13:12.503455 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:12.503442    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/51893d87-31b0-4e20-97b2-e0f5cc864175-kube-rbac-proxy-cm podName:51893d87-31b0-4e20-97b2-e0f5cc864175 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:14.50343168 +0000 UTC m=+44.815824366 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/51893d87-31b0-4e20-97b2-e0f5cc864175-kube-rbac-proxy-cm") pod "insights-runtime-extractor-84mml" (UID: "51893d87-31b0-4e20-97b2-e0f5cc864175") : configmap "kube-rbac-proxy" not found
Jul 29 01:13:12.604394 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:12.604365    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4w8l\" (UniqueName: \"kubernetes.io/projected/3f28ea1a-6863-4d28-8dd1-61d75523b441-kube-api-access-k4w8l\") pod \"migrator-6865c9967-dfw8c\" (UID: \"3f28ea1a-6863-4d28-8dd1-61d75523b441\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-dfw8c"
Jul 29 01:13:12.627316 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:12.627292    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-twzs7_c04440bc-a775-4a45-8ce2-32be6df62627/dns-node-resolver/0.log"
Jul 29 01:13:12.641550 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:12.641521    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:12.704738 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:12.704707    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4w8l\" (UniqueName: \"kubernetes.io/projected/3f28ea1a-6863-4d28-8dd1-61d75523b441-kube-api-access-k4w8l\") pod \"migrator-6865c9967-dfw8c\" (UID: \"3f28ea1a-6863-4d28-8dd1-61d75523b441\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-dfw8c"
Jul 29 01:13:12.713058 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:12.713031    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4w8l\" (UniqueName: \"kubernetes.io/projected/3f28ea1a-6863-4d28-8dd1-61d75523b441-kube-api-access-k4w8l\") pod \"migrator-6865c9967-dfw8c\" (UID: \"3f28ea1a-6863-4d28-8dd1-61d75523b441\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-dfw8c"
Jul 29 01:13:12.723927 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:12.723908    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-dfw8c"
Jul 29 01:13:12.744117 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:12.744093    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:12.874207 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:12.874178    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-dfw8c"]
Jul 29 01:13:12.889789 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:13:12.889753    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f28ea1a_6863_4d28_8dd1_61d75523b441.slice/crio-dcbc5a6dd5dddc2c3ec986fd47cb10e3fe41a7071dc990beb7d053a5908215c5 WatchSource:0}: Error finding container dcbc5a6dd5dddc2c3ec986fd47cb10e3fe41a7071dc990beb7d053a5908215c5: Status 404 returned error can't find the container with id dcbc5a6dd5dddc2c3ec986fd47cb10e3fe41a7071dc990beb7d053a5908215c5
Jul 29 01:13:12.906660 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:12.906636    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff3a285d-75d7-46d8-ad12-11739e8d433e-registry-tls\") pod \"image-registry-dd9d7ccf5-2vqpn\" (UID: \"ff3a285d-75d7-46d8-ad12-11739e8d433e\") " pod="openshift-image-registry/image-registry-dd9d7ccf5-2vqpn"
Jul 29 01:13:12.906756 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:12.906694    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b783cf19-736b-4578-8839-b8e5201addde-metrics-tls\") pod \"dns-default-cbv98\" (UID: \"b783cf19-736b-4578-8839-b8e5201addde\") " pod="openshift-dns/dns-default-cbv98"
Jul 29 01:13:12.906793 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:12.906774    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 01:13:12.906793 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:12.906784    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:13:12.906851 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:12.906792    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dd9d7ccf5-2vqpn: secret "image-registry-tls" not found
Jul 29 01:13:12.906851 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:12.906838    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b783cf19-736b-4578-8839-b8e5201addde-metrics-tls podName:b783cf19-736b-4578-8839-b8e5201addde nodeName:}" failed. No retries permitted until 2026-07-29 01:13:20.906822001 +0000 UTC m=+51.219214697 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b783cf19-736b-4578-8839-b8e5201addde-metrics-tls") pod "dns-default-cbv98" (UID: "b783cf19-736b-4578-8839-b8e5201addde") : secret "dns-default-metrics-tls" not found
Jul 29 01:13:12.906920 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:12.906852    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff3a285d-75d7-46d8-ad12-11739e8d433e-registry-tls podName:ff3a285d-75d7-46d8-ad12-11739e8d433e nodeName:}" failed. No retries permitted until 2026-07-29 01:13:20.906846552 +0000 UTC m=+51.219239238 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ff3a285d-75d7-46d8-ad12-11739e8d433e-registry-tls") pod "image-registry-dd9d7ccf5-2vqpn" (UID: "ff3a285d-75d7-46d8-ad12-11739e8d433e") : secret "image-registry-tls" not found
Jul 29 01:13:13.348851 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:13.348764    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-dfw8c" event={"ID":"3f28ea1a-6863-4d28-8dd1-61d75523b441","Type":"ContainerStarted","Data":"dcbc5a6dd5dddc2c3ec986fd47cb10e3fe41a7071dc990beb7d053a5908215c5"}
Jul 29 01:13:13.423172 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:13.423146    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2m2ss_6bf91238-2331-4c79-be9b-4d85192cb848/node-ca/0.log"
Jul 29 01:13:14.228918 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:14.228887    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-slkdh_db8a4b26-e014-4f49-9ce8-1381c14657e8/serve-healthcheck-canary/0.log"
Jul 29 01:13:14.274517 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:14.274489    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:14.333404 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:14.333373    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:14.517813 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:14.517737    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/51893d87-31b0-4e20-97b2-e0f5cc864175-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-84mml\" (UID: \"51893d87-31b0-4e20-97b2-e0f5cc864175\") " pod="openshift-insights/insights-runtime-extractor-84mml"
Jul 29 01:13:14.517813 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:14.517810    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/51893d87-31b0-4e20-97b2-e0f5cc864175-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-84mml\" (UID: \"51893d87-31b0-4e20-97b2-e0f5cc864175\") " pod="openshift-insights/insights-runtime-extractor-84mml"
Jul 29 01:13:14.518184 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:14.517889    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 01:13:14.518184 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:14.517976    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51893d87-31b0-4e20-97b2-e0f5cc864175-insights-runtime-extractor-tls podName:51893d87-31b0-4e20-97b2-e0f5cc864175 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:18.517944678 +0000 UTC m=+48.830337363 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/51893d87-31b0-4e20-97b2-e0f5cc864175-insights-runtime-extractor-tls") pod "insights-runtime-extractor-84mml" (UID: "51893d87-31b0-4e20-97b2-e0f5cc864175") : secret "insights-runtime-extractor-tls" not found
Jul 29 01:13:14.518184 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:14.517894    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 01:13:14.518184 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:14.518009    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/51893d87-31b0-4e20-97b2-e0f5cc864175-kube-rbac-proxy-cm podName:51893d87-31b0-4e20-97b2-e0f5cc864175 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:18.51800039 +0000 UTC m=+48.830393076 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/51893d87-31b0-4e20-97b2-e0f5cc864175-kube-rbac-proxy-cm") pod "insights-runtime-extractor-84mml" (UID: "51893d87-31b0-4e20-97b2-e0f5cc864175") : configmap "kube-rbac-proxy" not found
Jul 29 01:13:15.109508 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:15.109468    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:15.354163 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:15.354127    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-dfw8c" event={"ID":"3f28ea1a-6863-4d28-8dd1-61d75523b441","Type":"ContainerStarted","Data":"3b79869edd75c303ec5fe78c64a262eb07b45e0729fce2290e53635a364fee6e"}
Jul 29 01:13:15.354297 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:15.354188    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-dfw8c" event={"ID":"3f28ea1a-6863-4d28-8dd1-61d75523b441","Type":"ContainerStarted","Data":"7ba57e6f243896704005d28b468f3fe614f633cea3ac19ea8ab8c54cb25828c1"}
Jul 29 01:13:15.371932 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:15.371891    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-dfw8c" podStartSLOduration=1.723626224 podStartE2EDuration="3.371877074s" totalImagesPullingTime="1.64825085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:13:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:15.370195881 +0000 UTC m=+45.682588588" watchObservedRunningTime="2026-07-29 01:13:15.371877074 +0000 UTC m=+45.684269781"
Jul 29 01:13:16.170252 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:16.170204    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:16.225535 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:16.225503    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:16.922595 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:16.922552    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:17.591115 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:17.591081    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:18.136656 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:18.136622    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:18.209447 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:18.209409    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:18.547090 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:18.546998    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/51893d87-31b0-4e20-97b2-e0f5cc864175-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-84mml\" (UID: \"51893d87-31b0-4e20-97b2-e0f5cc864175\") " pod="openshift-insights/insights-runtime-extractor-84mml"
Jul 29 01:13:18.547264 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:18.547110    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/51893d87-31b0-4e20-97b2-e0f5cc864175-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-84mml\" (UID: \"51893d87-31b0-4e20-97b2-e0f5cc864175\") " pod="openshift-insights/insights-runtime-extractor-84mml"
Jul 29 01:13:18.547264 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:18.547134    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 01:13:18.547264 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:18.547199    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51893d87-31b0-4e20-97b2-e0f5cc864175-insights-runtime-extractor-tls podName:51893d87-31b0-4e20-97b2-e0f5cc864175 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:26.547184801 +0000 UTC m=+56.859577487 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/51893d87-31b0-4e20-97b2-e0f5cc864175-insights-runtime-extractor-tls") pod "insights-runtime-extractor-84mml" (UID: "51893d87-31b0-4e20-97b2-e0f5cc864175") : secret "insights-runtime-extractor-tls" not found
Jul 29 01:13:18.547683 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:18.547666    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/51893d87-31b0-4e20-97b2-e0f5cc864175-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-84mml\" (UID: \"51893d87-31b0-4e20-97b2-e0f5cc864175\") " pod="openshift-insights/insights-runtime-extractor-84mml"
Jul 29 01:13:19.130763 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:19.130727    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:19.231754 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:19.231722    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:19.331252 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:19.331224    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:19.431628 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:19.431549    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:19.532300 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:19.532257    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:19.634152 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:19.634118    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:20.253066 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:20.253035    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:20.630045 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:20.630014    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:20.825819 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:20.825786    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:20.963129 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:20.963038    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b783cf19-736b-4578-8839-b8e5201addde-metrics-tls\") pod \"dns-default-cbv98\" (UID: \"b783cf19-736b-4578-8839-b8e5201addde\") " pod="openshift-dns/dns-default-cbv98"
Jul 29 01:13:20.963129 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:20.963125    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff3a285d-75d7-46d8-ad12-11739e8d433e-registry-tls\") pod \"image-registry-dd9d7ccf5-2vqpn\" (UID: \"ff3a285d-75d7-46d8-ad12-11739e8d433e\") " pod="openshift-image-registry/image-registry-dd9d7ccf5-2vqpn"
Jul 29 01:13:20.963363 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:20.963188    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:13:20.963363 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:20.963226    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 01:13:20.963363 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:20.963240    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dd9d7ccf5-2vqpn: secret "image-registry-tls" not found
Jul 29 01:13:20.963363 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:20.963257    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b783cf19-736b-4578-8839-b8e5201addde-metrics-tls podName:b783cf19-736b-4578-8839-b8e5201addde nodeName:}" failed. No retries permitted until 2026-07-29 01:13:36.963240339 +0000 UTC m=+67.275633024 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b783cf19-736b-4578-8839-b8e5201addde-metrics-tls") pod "dns-default-cbv98" (UID: "b783cf19-736b-4578-8839-b8e5201addde") : secret "dns-default-metrics-tls" not found
Jul 29 01:13:20.963363 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:20.963287    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff3a285d-75d7-46d8-ad12-11739e8d433e-registry-tls podName:ff3a285d-75d7-46d8-ad12-11739e8d433e nodeName:}" failed. No retries permitted until 2026-07-29 01:13:36.96327128 +0000 UTC m=+67.275663966 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ff3a285d-75d7-46d8-ad12-11739e8d433e-registry-tls") pod "image-registry-dd9d7ccf5-2vqpn" (UID: "ff3a285d-75d7-46d8-ad12-11739e8d433e") : secret "image-registry-tls" not found
Jul 29 01:13:21.020669 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:21.020629    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:21.821763 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:21.821731    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:22.421698 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:22.421664    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:22.628254 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:22.628221    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:22.831411 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:22.831328    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:23.026728 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:23.026685    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:23.083851 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:23.083754    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:23.222785 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:23.222755    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:23.824178 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:23.824084    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:23.874358 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:23.874330    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:24.423788 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:24.423752    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:24.624028 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:24.623992    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:24.725278 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:24.725183    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:24.790514 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:24.790482    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:25.028692 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:25.028612    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:25.221609 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:25.221583    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:25.323097 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:25.323006    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:25.421896 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:25.421855    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:26.220448 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:26.220420    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:26.604559 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:26.604469    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/51893d87-31b0-4e20-97b2-e0f5cc864175-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-84mml\" (UID: \"51893d87-31b0-4e20-97b2-e0f5cc864175\") " pod="openshift-insights/insights-runtime-extractor-84mml"
Jul 29 01:13:26.606697 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:26.606676    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/51893d87-31b0-4e20-97b2-e0f5cc864175-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-84mml\" (UID: \"51893d87-31b0-4e20-97b2-e0f5cc864175\") " pod="openshift-insights/insights-runtime-extractor-84mml"
Jul 29 01:13:26.676687 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:26.676654    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-84mml"
Jul 29 01:13:26.795341 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:26.795312    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-84mml"]
Jul 29 01:13:26.798507 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:13:26.798479    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51893d87_31b0_4e20_97b2_e0f5cc864175.slice/crio-4c660d9d46b101ee4d046930373beddb0510b45e7500756875495517cac85318 WatchSource:0}: Error finding container 4c660d9d46b101ee4d046930373beddb0510b45e7500756875495517cac85318: Status 404 returned error can't find the container with id 4c660d9d46b101ee4d046930373beddb0510b45e7500756875495517cac85318
Jul 29 01:13:26.821396 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:26.821372    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:26.988836 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:26.988801    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:27.086255 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:27.086215    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:27.386613 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:27.386575    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-84mml" event={"ID":"51893d87-31b0-4e20-97b2-e0f5cc864175","Type":"ContainerStarted","Data":"4c660d9d46b101ee4d046930373beddb0510b45e7500756875495517cac85318"}
Jul 29 01:13:27.445870 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:27.445834    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:27.627445 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:27.627362    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:28.226853 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:28.226817    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:28.823883 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:28.823835    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:29.019790 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:29.019757    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:29.226370 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:29.226322    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:29.424591 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:29.424559    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:29.822694 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:29.822650    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:30.313080 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:30.313046    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8g9fl"
Jul 29 01:13:31.116714 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:31.116679    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:31.173801 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:31.173768    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:32.402291 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:32.402216    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-84mml" event={"ID":"51893d87-31b0-4e20-97b2-e0f5cc864175","Type":"ContainerStarted","Data":"3508e4eb68e67f8c973a07991a7320cb680628cd3619e1f81fb4249c74d60141"}
Jul 29 01:13:34.507918 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.507887    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-847f6f8449-jfs9g"]
Jul 29 01:13:34.512581 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.512555    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-847f6f8449-jfs9g"
Jul 29 01:13:34.515442 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.515407    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 29 01:13:34.515768 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.515749    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 29 01:13:34.515979 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.515943    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 29 01:13:34.521901 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.521878    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 29 01:13:34.527062 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.527032    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-847f6f8449-jfs9g"]
Jul 29 01:13:34.562919 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.562886    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-dd9d7ccf5-2vqpn"]
Jul 29 01:13:34.563124 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:34.563100    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-dd9d7ccf5-2vqpn" podUID="ff3a285d-75d7-46d8-ad12-11739e8d433e"
Jul 29 01:13:34.566181 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.566153    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/529e6e3f-b8ce-45ff-8d6b-437e8337653a-tmp\") pod \"klusterlet-addon-workmgr-847f6f8449-jfs9g\" (UID: \"529e6e3f-b8ce-45ff-8d6b-437e8337653a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-847f6f8449-jfs9g"
Jul 29 01:13:34.566288 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.566263    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/529e6e3f-b8ce-45ff-8d6b-437e8337653a-klusterlet-config\") pod \"klusterlet-addon-workmgr-847f6f8449-jfs9g\" (UID: \"529e6e3f-b8ce-45ff-8d6b-437e8337653a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-847f6f8449-jfs9g"
Jul 29 01:13:34.566288 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.566282    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j8s9\" (UniqueName: \"kubernetes.io/projected/529e6e3f-b8ce-45ff-8d6b-437e8337653a-kube-api-access-2j8s9\") pod \"klusterlet-addon-workmgr-847f6f8449-jfs9g\" (UID: \"529e6e3f-b8ce-45ff-8d6b-437e8337653a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-847f6f8449-jfs9g"
Jul 29 01:13:34.621111 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.621077    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5d4684d768-95cff"]
Jul 29 01:13:34.626305 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.626270    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:34.628964 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.628932    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d4684d768-95cff"
Jul 29 01:13:34.639751 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.639727    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d4684d768-95cff"]
Jul 29 01:13:34.667379 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.667348    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a718bd29-d225-4a1c-9d43-1f0e2113565a-installation-pull-secrets\") pod \"image-registry-5d4684d768-95cff\" (UID: \"a718bd29-d225-4a1c-9d43-1f0e2113565a\") " pod="openshift-image-registry/image-registry-5d4684d768-95cff"
Jul 29 01:13:34.667511 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.667388    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a718bd29-d225-4a1c-9d43-1f0e2113565a-image-registry-private-configuration\") pod \"image-registry-5d4684d768-95cff\" (UID: \"a718bd29-d225-4a1c-9d43-1f0e2113565a\") " pod="openshift-image-registry/image-registry-5d4684d768-95cff"
Jul 29 01:13:34.667511 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.667413    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a718bd29-d225-4a1c-9d43-1f0e2113565a-ca-trust-extracted\") pod \"image-registry-5d4684d768-95cff\" (UID: \"a718bd29-d225-4a1c-9d43-1f0e2113565a\") " pod="openshift-image-registry/image-registry-5d4684d768-95cff"
Jul 29 01:13:34.667627 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.667511    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a718bd29-d225-4a1c-9d43-1f0e2113565a-registry-tls\") pod \"image-registry-5d4684d768-95cff\" (UID: \"a718bd29-d225-4a1c-9d43-1f0e2113565a\") " pod="openshift-image-registry/image-registry-5d4684d768-95cff"
Jul 29 01:13:34.667627 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.667555    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j8s9\" (UniqueName: \"kubernetes.io/projected/529e6e3f-b8ce-45ff-8d6b-437e8337653a-kube-api-access-2j8s9\") pod \"klusterlet-addon-workmgr-847f6f8449-jfs9g\" (UID: \"529e6e3f-b8ce-45ff-8d6b-437e8337653a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-847f6f8449-jfs9g"
Jul 29 01:13:34.667627 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.667604    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a718bd29-d225-4a1c-9d43-1f0e2113565a-trusted-ca\") pod \"image-registry-5d4684d768-95cff\" (UID: \"a718bd29-d225-4a1c-9d43-1f0e2113565a\") " pod="openshift-image-registry/image-registry-5d4684d768-95cff"
Jul 29 01:13:34.667779 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.667660    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wj6jp\" (UniqueName: \"kubernetes.io/projected/a718bd29-d225-4a1c-9d43-1f0e2113565a-kube-api-access-wj6jp\") pod \"image-registry-5d4684d768-95cff\" (UID: \"a718bd29-d225-4a1c-9d43-1f0e2113565a\") " pod="openshift-image-registry/image-registry-5d4684d768-95cff"
Jul 29 01:13:34.667779 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.667688    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a718bd29-d225-4a1c-9d43-1f0e2113565a-registry-certificates\") pod \"image-registry-5d4684d768-95cff\" (UID: \"a718bd29-d225-4a1c-9d43-1f0e2113565a\") " pod="openshift-image-registry/image-registry-5d4684d768-95cff"
Jul 29 01:13:34.667779 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.667742    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/529e6e3f-b8ce-45ff-8d6b-437e8337653a-klusterlet-config\") pod \"klusterlet-addon-workmgr-847f6f8449-jfs9g\" (UID: \"529e6e3f-b8ce-45ff-8d6b-437e8337653a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-847f6f8449-jfs9g"
Jul 29 01:13:34.667920 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.667777    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a718bd29-d225-4a1c-9d43-1f0e2113565a-bound-sa-token\") pod \"image-registry-5d4684d768-95cff\" (UID: \"a718bd29-d225-4a1c-9d43-1f0e2113565a\") " pod="openshift-image-registry/image-registry-5d4684d768-95cff"
Jul 29 01:13:34.667920 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.667807    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/529e6e3f-b8ce-45ff-8d6b-437e8337653a-tmp\") pod \"klusterlet-addon-workmgr-847f6f8449-jfs9g\" (UID: \"529e6e3f-b8ce-45ff-8d6b-437e8337653a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-847f6f8449-jfs9g"
Jul 29 01:13:34.668249 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.668227    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/529e6e3f-b8ce-45ff-8d6b-437e8337653a-tmp\") pod \"klusterlet-addon-workmgr-847f6f8449-jfs9g\" (UID: \"529e6e3f-b8ce-45ff-8d6b-437e8337653a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-847f6f8449-jfs9g"
Jul 29 01:13:34.670383 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.670363    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/529e6e3f-b8ce-45ff-8d6b-437e8337653a-klusterlet-config\") pod \"klusterlet-addon-workmgr-847f6f8449-jfs9g\" (UID: \"529e6e3f-b8ce-45ff-8d6b-437e8337653a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-847f6f8449-jfs9g"
Jul 29 01:13:34.677899 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.677875    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j8s9\" (UniqueName: \"kubernetes.io/projected/529e6e3f-b8ce-45ff-8d6b-437e8337653a-kube-api-access-2j8s9\") pod \"klusterlet-addon-workmgr-847f6f8449-jfs9g\" (UID: \"529e6e3f-b8ce-45ff-8d6b-437e8337653a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-847f6f8449-jfs9g"
Jul 29 01:13:34.723845 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.723811    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:34.769074 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.769009    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a718bd29-d225-4a1c-9d43-1f0e2113565a-installation-pull-secrets\") pod \"image-registry-5d4684d768-95cff\" (UID: \"a718bd29-d225-4a1c-9d43-1f0e2113565a\") " pod="openshift-image-registry/image-registry-5d4684d768-95cff"
Jul 29 01:13:34.769074 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.769058    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a718bd29-d225-4a1c-9d43-1f0e2113565a-image-registry-private-configuration\") pod \"image-registry-5d4684d768-95cff\" (UID: \"a718bd29-d225-4a1c-9d43-1f0e2113565a\") " pod="openshift-image-registry/image-registry-5d4684d768-95cff"
Jul 29 01:13:34.769248 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.769087    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a718bd29-d225-4a1c-9d43-1f0e2113565a-ca-trust-extracted\") pod \"image-registry-5d4684d768-95cff\" (UID: \"a718bd29-d225-4a1c-9d43-1f0e2113565a\") " pod="openshift-image-registry/image-registry-5d4684d768-95cff"
Jul 29 01:13:34.769248 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.769136    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a718bd29-d225-4a1c-9d43-1f0e2113565a-registry-tls\") pod \"image-registry-5d4684d768-95cff\" (UID: \"a718bd29-d225-4a1c-9d43-1f0e2113565a\") " pod="openshift-image-registry/image-registry-5d4684d768-95cff"
Jul 29 01:13:34.769248 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.769175    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a718bd29-d225-4a1c-9d43-1f0e2113565a-trusted-ca\") pod \"image-registry-5d4684d768-95cff\" (UID: \"a718bd29-d225-4a1c-9d43-1f0e2113565a\") " pod="openshift-image-registry/image-registry-5d4684d768-95cff"
Jul 29 01:13:34.769248 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.769222    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wj6jp\" (UniqueName: \"kubernetes.io/projected/a718bd29-d225-4a1c-9d43-1f0e2113565a-kube-api-access-wj6jp\") pod \"image-registry-5d4684d768-95cff\" (UID: \"a718bd29-d225-4a1c-9d43-1f0e2113565a\") " pod="openshift-image-registry/image-registry-5d4684d768-95cff"
Jul 29 01:13:34.769455 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.769250    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a718bd29-d225-4a1c-9d43-1f0e2113565a-registry-certificates\") pod \"image-registry-5d4684d768-95cff\" (UID: \"a718bd29-d225-4a1c-9d43-1f0e2113565a\") " pod="openshift-image-registry/image-registry-5d4684d768-95cff"
Jul 29 01:13:34.769455 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.769304    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a718bd29-d225-4a1c-9d43-1f0e2113565a-bound-sa-token\") pod \"image-registry-5d4684d768-95cff\" (UID: \"a718bd29-d225-4a1c-9d43-1f0e2113565a\") " pod="openshift-image-registry/image-registry-5d4684d768-95cff"
Jul 29 01:13:34.769561 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.769459    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a718bd29-d225-4a1c-9d43-1f0e2113565a-ca-trust-extracted\") pod \"image-registry-5d4684d768-95cff\" (UID: \"a718bd29-d225-4a1c-9d43-1f0e2113565a\") " pod="openshift-image-registry/image-registry-5d4684d768-95cff"
Jul 29 01:13:34.770219 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.770194    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a718bd29-d225-4a1c-9d43-1f0e2113565a-trusted-ca\") pod \"image-registry-5d4684d768-95cff\" (UID: \"a718bd29-d225-4a1c-9d43-1f0e2113565a\") " pod="openshift-image-registry/image-registry-5d4684d768-95cff"
Jul 29 01:13:34.770315 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.770196    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a718bd29-d225-4a1c-9d43-1f0e2113565a-registry-certificates\") pod \"image-registry-5d4684d768-95cff\" (UID: \"a718bd29-d225-4a1c-9d43-1f0e2113565a\") " pod="openshift-image-registry/image-registry-5d4684d768-95cff"
Jul 29 01:13:34.771823 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.771801    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a718bd29-d225-4a1c-9d43-1f0e2113565a-installation-pull-secrets\") pod \"image-registry-5d4684d768-95cff\" (UID: \"a718bd29-d225-4a1c-9d43-1f0e2113565a\") " pod="openshift-image-registry/image-registry-5d4684d768-95cff"
Jul 29 01:13:34.771995 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.771971    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a718bd29-d225-4a1c-9d43-1f0e2113565a-registry-tls\") pod \"image-registry-5d4684d768-95cff\" (UID: \"a718bd29-d225-4a1c-9d43-1f0e2113565a\") " pod="openshift-image-registry/image-registry-5d4684d768-95cff"
Jul 29 01:13:34.772068 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.772050    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a718bd29-d225-4a1c-9d43-1f0e2113565a-image-registry-private-configuration\") pod \"image-registry-5d4684d768-95cff\" (UID: \"a718bd29-d225-4a1c-9d43-1f0e2113565a\") " pod="openshift-image-registry/image-registry-5d4684d768-95cff"
Jul 29 01:13:34.781930 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.781906    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a718bd29-d225-4a1c-9d43-1f0e2113565a-bound-sa-token\") pod \"image-registry-5d4684d768-95cff\" (UID: \"a718bd29-d225-4a1c-9d43-1f0e2113565a\") " pod="openshift-image-registry/image-registry-5d4684d768-95cff"
Jul 29 01:13:34.782022 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.781967    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wj6jp\" (UniqueName: \"kubernetes.io/projected/a718bd29-d225-4a1c-9d43-1f0e2113565a-kube-api-access-wj6jp\") pod \"image-registry-5d4684d768-95cff\" (UID: \"a718bd29-d225-4a1c-9d43-1f0e2113565a\") " pod="openshift-image-registry/image-registry-5d4684d768-95cff"
Jul 29 01:13:34.825923 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.825896    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-847f6f8449-jfs9g"
Jul 29 01:13:34.844233 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.844192    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:34.941231 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.941203    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-sgklk\""
Jul 29 01:13:34.945234 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.945176    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:34.949010 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:34.948974    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d4684d768-95cff"
Jul 29 01:13:35.214738 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:35.214703    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-847f6f8449-jfs9g"]
Jul 29 01:13:35.218222 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:13:35.218197    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod529e6e3f_b8ce_45ff_8d6b_437e8337653a.slice/crio-54bcb59473b7a2f86e3cad6095f6598fba97522e0cf297a255e167b2e1752ba4 WatchSource:0}: Error finding container 54bcb59473b7a2f86e3cad6095f6598fba97522e0cf297a255e167b2e1752ba4: Status 404 returned error can't find the container with id 54bcb59473b7a2f86e3cad6095f6598fba97522e0cf297a255e167b2e1752ba4
Jul 29 01:13:35.229766 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:35.229702    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d4684d768-95cff"]
Jul 29 01:13:35.231801 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:13:35.231780    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda718bd29_d225_4a1c_9d43_1f0e2113565a.slice/crio-9bc712601ef9c72152d7448c72bebe286cce11a45fe9dfdafdc26fc747d729d6 WatchSource:0}: Error finding container 9bc712601ef9c72152d7448c72bebe286cce11a45fe9dfdafdc26fc747d729d6: Status 404 returned error can't find the container with id 9bc712601ef9c72152d7448c72bebe286cce11a45fe9dfdafdc26fc747d729d6
Jul 29 01:13:35.245836 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:35.245809    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:35.347034 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:35.346940    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:35.412889 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:35.412853    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-84mml" event={"ID":"51893d87-31b0-4e20-97b2-e0f5cc864175","Type":"ContainerStarted","Data":"1b73fd9022dc5efc84841b6d06532f665b672a9a9e1ca830f5c54ac28714713c"}
Jul 29 01:13:35.414328 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:35.414300    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d4684d768-95cff" event={"ID":"a718bd29-d225-4a1c-9d43-1f0e2113565a","Type":"ContainerStarted","Data":"2b3e90913957d72db63612cc20a02f1418545413dcf78b33f399d29539519e09"}
Jul 29 01:13:35.414448 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:35.414348    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d4684d768-95cff" event={"ID":"a718bd29-d225-4a1c-9d43-1f0e2113565a","Type":"ContainerStarted","Data":"9bc712601ef9c72152d7448c72bebe286cce11a45fe9dfdafdc26fc747d729d6"}
Jul 29 01:13:35.414448 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:35.414408    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5d4684d768-95cff"
Jul 29 01:13:35.415406 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:35.415387    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-dd9d7ccf5-2vqpn"
Jul 29 01:13:35.415483 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:35.415422    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-847f6f8449-jfs9g" event={"ID":"529e6e3f-b8ce-45ff-8d6b-437e8337653a","Type":"ContainerStarted","Data":"54bcb59473b7a2f86e3cad6095f6598fba97522e0cf297a255e167b2e1752ba4"}
Jul 29 01:13:35.421562 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:35.421543    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-dd9d7ccf5-2vqpn"
Jul 29 01:13:35.432222 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:35.432180    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5d4684d768-95cff" podStartSLOduration=1.432167361 podStartE2EDuration="1.432167361s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:13:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:35.431237248 +0000 UTC m=+65.743629957" watchObservedRunningTime="2026-07-29 01:13:35.432167361 +0000 UTC m=+65.744560062"
Jul 29 01:13:35.475915 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:35.475882    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h97hn\" (UniqueName: \"kubernetes.io/projected/ff3a285d-75d7-46d8-ad12-11739e8d433e-kube-api-access-h97hn\") pod \"ff3a285d-75d7-46d8-ad12-11739e8d433e\" (UID: \"ff3a285d-75d7-46d8-ad12-11739e8d433e\") "
Jul 29 01:13:35.476044 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:35.475939    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ff3a285d-75d7-46d8-ad12-11739e8d433e-registry-certificates\") pod \"ff3a285d-75d7-46d8-ad12-11739e8d433e\" (UID: \"ff3a285d-75d7-46d8-ad12-11739e8d433e\") "
Jul 29 01:13:35.476044 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:35.476002    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ff3a285d-75d7-46d8-ad12-11739e8d433e-installation-pull-secrets\") pod \"ff3a285d-75d7-46d8-ad12-11739e8d433e\" (UID: \"ff3a285d-75d7-46d8-ad12-11739e8d433e\") "
Jul 29 01:13:35.476044 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:35.476034    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ff3a285d-75d7-46d8-ad12-11739e8d433e-image-registry-private-configuration\") pod \"ff3a285d-75d7-46d8-ad12-11739e8d433e\" (UID: \"ff3a285d-75d7-46d8-ad12-11739e8d433e\") "
Jul 29 01:13:35.476189 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:35.476059    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ff3a285d-75d7-46d8-ad12-11739e8d433e-trusted-ca\") pod \"ff3a285d-75d7-46d8-ad12-11739e8d433e\" (UID: \"ff3a285d-75d7-46d8-ad12-11739e8d433e\") "
Jul 29 01:13:35.476189 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:35.476090    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ff3a285d-75d7-46d8-ad12-11739e8d433e-ca-trust-extracted\") pod \"ff3a285d-75d7-46d8-ad12-11739e8d433e\" (UID: \"ff3a285d-75d7-46d8-ad12-11739e8d433e\") "
Jul 29 01:13:35.476189 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:35.476147    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff3a285d-75d7-46d8-ad12-11739e8d433e-bound-sa-token\") pod \"ff3a285d-75d7-46d8-ad12-11739e8d433e\" (UID: \"ff3a285d-75d7-46d8-ad12-11739e8d433e\") "
Jul 29 01:13:35.476340 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:35.476300    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff3a285d-75d7-46d8-ad12-11739e8d433e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ff3a285d-75d7-46d8-ad12-11739e8d433e" (UID: "ff3a285d-75d7-46d8-ad12-11739e8d433e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:13:35.477225 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:35.476482    2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ff3a285d-75d7-46d8-ad12-11739e8d433e-registry-certificates\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:13:35.477225 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:35.476533    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff3a285d-75d7-46d8-ad12-11739e8d433e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ff3a285d-75d7-46d8-ad12-11739e8d433e" (UID: "ff3a285d-75d7-46d8-ad12-11739e8d433e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:13:35.477225 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:35.476609    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff3a285d-75d7-46d8-ad12-11739e8d433e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ff3a285d-75d7-46d8-ad12-11739e8d433e" (UID: "ff3a285d-75d7-46d8-ad12-11739e8d433e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:13:35.478336 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:35.478308    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff3a285d-75d7-46d8-ad12-11739e8d433e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ff3a285d-75d7-46d8-ad12-11739e8d433e" (UID: "ff3a285d-75d7-46d8-ad12-11739e8d433e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:13:35.478420 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:35.478320    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff3a285d-75d7-46d8-ad12-11739e8d433e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ff3a285d-75d7-46d8-ad12-11739e8d433e" (UID: "ff3a285d-75d7-46d8-ad12-11739e8d433e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:13:35.478483 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:35.478422    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff3a285d-75d7-46d8-ad12-11739e8d433e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ff3a285d-75d7-46d8-ad12-11739e8d433e" (UID: "ff3a285d-75d7-46d8-ad12-11739e8d433e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:13:35.478483 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:35.478441    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff3a285d-75d7-46d8-ad12-11739e8d433e-kube-api-access-h97hn" (OuterVolumeSpecName: "kube-api-access-h97hn") pod "ff3a285d-75d7-46d8-ad12-11739e8d433e" (UID: "ff3a285d-75d7-46d8-ad12-11739e8d433e"). InnerVolumeSpecName "kube-api-access-h97hn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:13:35.577082 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:35.577047    2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ff3a285d-75d7-46d8-ad12-11739e8d433e-image-registry-private-configuration\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:13:35.577082 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:35.577075    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ff3a285d-75d7-46d8-ad12-11739e8d433e-trusted-ca\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:13:35.577082 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:35.577084    2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ff3a285d-75d7-46d8-ad12-11739e8d433e-ca-trust-extracted\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:13:35.577488 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:35.577094    2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff3a285d-75d7-46d8-ad12-11739e8d433e-bound-sa-token\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:13:35.577488 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:35.577105    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h97hn\" (UniqueName: \"kubernetes.io/projected/ff3a285d-75d7-46d8-ad12-11739e8d433e-kube-api-access-h97hn\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:13:35.577488 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:35.577115    2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ff3a285d-75d7-46d8-ad12-11739e8d433e-installation-pull-secrets\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:13:35.880396 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:35.880354    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c57c897c-c75e-4bd5-8c5d-7682906914f2-metrics-certs\") pod \"network-metrics-daemon-s247d\" (UID: \"c57c897c-c75e-4bd5-8c5d-7682906914f2\") " pod="openshift-multus/network-metrics-daemon-s247d"
Jul 29 01:13:35.880578 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:35.880414    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aee511a0-1681-4291-90ee-eda4bfb122dc-original-pull-secret\") pod \"global-pull-secret-syncer-n7dj7\" (UID: \"aee511a0-1681-4291-90ee-eda4bfb122dc\") " pod="kube-system/global-pull-secret-syncer-n7dj7"
Jul 29 01:13:35.883056 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:35.883033    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 01:13:35.884118 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:35.884093    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 01:13:35.893860 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:35.893825    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c57c897c-c75e-4bd5-8c5d-7682906914f2-metrics-certs\") pod \"network-metrics-daemon-s247d\" (UID: \"c57c897c-c75e-4bd5-8c5d-7682906914f2\") " pod="openshift-multus/network-metrics-daemon-s247d"
Jul 29 01:13:35.893860 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:35.893853    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aee511a0-1681-4291-90ee-eda4bfb122dc-original-pull-secret\") pod \"global-pull-secret-syncer-n7dj7\" (UID: \"aee511a0-1681-4291-90ee-eda4bfb122dc\") " pod="kube-system/global-pull-secret-syncer-n7dj7"
Jul 29 01:13:35.981491 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:35.981405    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gps42\" (UniqueName: \"kubernetes.io/projected/5066ce06-1832-4291-9b2e-852aff936a92-kube-api-access-gps42\") pod \"network-check-target-7k5r4\" (UID: \"5066ce06-1832-4291-9b2e-852aff936a92\") " pod="openshift-network-diagnostics/network-check-target-7k5r4"
Jul 29 01:13:35.984121 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:35.984101    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 01:13:35.994101 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:35.994081    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 01:13:36.005178 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:36.005157    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gps42\" (UniqueName: \"kubernetes.io/projected/5066ce06-1832-4291-9b2e-852aff936a92-kube-api-access-gps42\") pod \"network-check-target-7k5r4\" (UID: \"5066ce06-1832-4291-9b2e-852aff936a92\") " pod="openshift-network-diagnostics/network-check-target-7k5r4"
Jul 29 01:13:36.073991 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:36.073936    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7dj7"
Jul 29 01:13:36.081229 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:36.081204    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nbzfd\""
Jul 29 01:13:36.089266 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:36.089243    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s247d"
Jul 29 01:13:36.178265 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:36.178236    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-82b2w\""
Jul 29 01:13:36.186998 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:36.186138    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k5r4"
Jul 29 01:13:36.253765 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:36.253670    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n7dj7"]
Jul 29 01:13:36.258088 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:13:36.258054    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaee511a0_1681_4291_90ee_eda4bfb122dc.slice/crio-73d2b8c45576da22a784f66ecf30bc187846cf103e4d95cf9bc67a58671c31f2 WatchSource:0}: Error finding container 73d2b8c45576da22a784f66ecf30bc187846cf103e4d95cf9bc67a58671c31f2: Status 404 returned error can't find the container with id 73d2b8c45576da22a784f66ecf30bc187846cf103e4d95cf9bc67a58671c31f2
Jul 29 01:13:36.265962 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:36.265762    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-s247d"]
Jul 29 01:13:36.360824 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:36.360744    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7k5r4"]
Jul 29 01:13:36.365130 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:13:36.365097    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5066ce06_1832_4291_9b2e_852aff936a92.slice/crio-49f1a727bc95beae37672ad6cb168e5029c351e9a140b6a9e89c3b3b44b6684c WatchSource:0}: Error finding container 49f1a727bc95beae37672ad6cb168e5029c351e9a140b6a9e89c3b3b44b6684c: Status 404 returned error can't find the container with id 49f1a727bc95beae37672ad6cb168e5029c351e9a140b6a9e89c3b3b44b6684c
Jul 29 01:13:36.420733 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:36.420693    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7k5r4" event={"ID":"5066ce06-1832-4291-9b2e-852aff936a92","Type":"ContainerStarted","Data":"49f1a727bc95beae37672ad6cb168e5029c351e9a140b6a9e89c3b3b44b6684c"}
Jul 29 01:13:36.422386 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:36.422354    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s247d" event={"ID":"c57c897c-c75e-4bd5-8c5d-7682906914f2","Type":"ContainerStarted","Data":"c8867a3050dca3cc5d6db7840b249f42c85a7f39a1d9be7277f40afc0899f99c"}
Jul 29 01:13:36.424071 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:36.424019    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n7dj7" event={"ID":"aee511a0-1681-4291-90ee-eda4bfb122dc","Type":"ContainerStarted","Data":"73d2b8c45576da22a784f66ecf30bc187846cf103e4d95cf9bc67a58671c31f2"}
Jul 29 01:13:36.424546 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:36.424262    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-dd9d7ccf5-2vqpn"
Jul 29 01:13:36.456545 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:36.456500    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-dd9d7ccf5-2vqpn"]
Jul 29 01:13:36.460564 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:36.460519    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-dd9d7ccf5-2vqpn"]
Jul 29 01:13:36.591271 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:36.591174    2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff3a285d-75d7-46d8-ad12-11739e8d433e-registry-tls\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:13:36.994304 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:36.994270    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b783cf19-736b-4578-8839-b8e5201addde-metrics-tls\") pod \"dns-default-cbv98\" (UID: \"b783cf19-736b-4578-8839-b8e5201addde\") " pod="openshift-dns/dns-default-cbv98"
Jul 29 01:13:37.000543 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:37.000511    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b783cf19-736b-4578-8839-b8e5201addde-metrics-tls\") pod \"dns-default-cbv98\" (UID: \"b783cf19-736b-4578-8839-b8e5201addde\") " pod="openshift-dns/dns-default-cbv98"
Jul 29 01:13:37.203706 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:37.203678    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-n8mzz\""
Jul 29 01:13:37.211839 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:37.211809    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cbv98"
Jul 29 01:13:37.423041 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:37.422964    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cbv98"]
Jul 29 01:13:38.169990 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:38.169938    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff3a285d-75d7-46d8-ad12-11739e8d433e" path="/var/lib/kubelet/pods/ff3a285d-75d7-46d8-ad12-11739e8d433e/volumes"
Jul 29 01:13:38.214588 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:38.214552    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:38.271925 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:38.271872    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:39.086026 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:13:39.085978    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb783cf19_736b_4578_8839_b8e5201addde.slice/crio-0a67af122c293512bf7ce76499bb30a53e67dcf6ce2542d3226fe2097c1801a4 WatchSource:0}: Error finding container 0a67af122c293512bf7ce76499bb30a53e67dcf6ce2542d3226fe2097c1801a4: Status 404 returned error can't find the container with id 0a67af122c293512bf7ce76499bb30a53e67dcf6ce2542d3226fe2097c1801a4
Jul 29 01:13:39.439994 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:39.439900    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cbv98" event={"ID":"b783cf19-736b-4578-8839-b8e5201addde","Type":"ContainerStarted","Data":"0a67af122c293512bf7ce76499bb30a53e67dcf6ce2542d3226fe2097c1801a4"}
Jul 29 01:13:40.616643 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:40.616534    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:40.668177 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:40.668135    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:41.712385 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:41.712347    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:41.811347 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:41.811305    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:41.915224 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:41.915191    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:41.923845 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:41.923813    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sxjwk"]
Jul 29 01:13:41.927142 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:41.927122    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sxjwk"
Jul 29 01:13:41.929566 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:41.929542    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 29 01:13:41.929697 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:41.929679    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-sv4x7\""
Jul 29 01:13:41.934078 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:41.934054    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sxjwk"]
Jul 29 01:13:42.036477 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:42.036405    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/340c0f05-58f8-4adc-a39d-ef87ac591e2e-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-sxjwk\" (UID: \"340c0f05-58f8-4adc-a39d-ef87ac591e2e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sxjwk"
Jul 29 01:13:42.137046 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:42.136998    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/340c0f05-58f8-4adc-a39d-ef87ac591e2e-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-sxjwk\" (UID: \"340c0f05-58f8-4adc-a39d-ef87ac591e2e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sxjwk"
Jul 29 01:13:42.137236 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:42.137179    2580 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 29 01:13:42.137298 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:42.137282    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/340c0f05-58f8-4adc-a39d-ef87ac591e2e-tls-certificates podName:340c0f05-58f8-4adc-a39d-ef87ac591e2e nodeName:}" failed. No retries permitted until 2026-07-29 01:13:42.637257004 +0000 UTC m=+72.949649720 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/340c0f05-58f8-4adc-a39d-ef87ac591e2e-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-sxjwk" (UID: "340c0f05-58f8-4adc-a39d-ef87ac591e2e") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 29 01:13:42.256683 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:42.256629    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:42.641146 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:42.641111    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/340c0f05-58f8-4adc-a39d-ef87ac591e2e-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-sxjwk\" (UID: \"340c0f05-58f8-4adc-a39d-ef87ac591e2e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sxjwk"
Jul 29 01:13:42.643784 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:42.643754    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/340c0f05-58f8-4adc-a39d-ef87ac591e2e-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-sxjwk\" (UID: \"340c0f05-58f8-4adc-a39d-ef87ac591e2e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sxjwk"
Jul 29 01:13:42.837104 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:42.837067    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sxjwk"
Jul 29 01:13:45.013392 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:45.013170    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sxjwk"]
Jul 29 01:13:45.462017 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:45.461914    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n7dj7" event={"ID":"aee511a0-1681-4291-90ee-eda4bfb122dc","Type":"ContainerStarted","Data":"cf37d4989073e967421c197c0870e82719e66a346c9c1e576418243ae95136fe"}
Jul 29 01:13:45.463842 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:45.463815    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cbv98" event={"ID":"b783cf19-736b-4578-8839-b8e5201addde","Type":"ContainerStarted","Data":"3bd905121c2424b7aa9f86d105039d092056752963702c8cafa4f018cbff1ce7"}
Jul 29 01:13:45.463994 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:45.463858    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cbv98" event={"ID":"b783cf19-736b-4578-8839-b8e5201addde","Type":"ContainerStarted","Data":"d1bf716ec262474a960aba0548733fbaa3eedbad248ed4a8675b32ecba50dc7f"}
Jul 29 01:13:45.463994 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:45.463888    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-cbv98"
Jul 29 01:13:45.465265 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:45.465235    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sxjwk" event={"ID":"340c0f05-58f8-4adc-a39d-ef87ac591e2e","Type":"ContainerStarted","Data":"0917b364032a1a5edc0cf7621ced969b200c2c0386fc0b90f8e82065a5d7f48c"}
Jul 29 01:13:45.467232 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:45.467212    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-84mml" event={"ID":"51893d87-31b0-4e20-97b2-e0f5cc864175","Type":"ContainerStarted","Data":"b06061d6b2ee399f25cc942d60b1258126a27ef7721c32ace034522338be9d1d"}
Jul 29 01:13:45.468586 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:45.468561    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-847f6f8449-jfs9g" event={"ID":"529e6e3f-b8ce-45ff-8d6b-437e8337653a","Type":"ContainerStarted","Data":"f50d63bc65a044c4bc09e82ecb3782ae320944e5ab970d54c2449462599be123"}
Jul 29 01:13:45.468687 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:45.468615    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-847f6f8449-jfs9g"
Jul 29 01:13:45.470318 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:45.470280    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7k5r4" event={"ID":"5066ce06-1832-4291-9b2e-852aff936a92","Type":"ContainerStarted","Data":"88ee824f6ea50aa9f23cd84d882159c9ecb16619e7c3f407298b9e3ff7939d75"}
Jul 29 01:13:45.470418 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:45.470333    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7k5r4"
Jul 29 01:13:45.470688 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:45.470666    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-847f6f8449-jfs9g"
Jul 29 01:13:45.472270 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:45.472251    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s247d" event={"ID":"c57c897c-c75e-4bd5-8c5d-7682906914f2","Type":"ContainerStarted","Data":"1d9e63ea2cee5ce5eb464b8ad5c5b0a7a5825c720daebf764b35cee6bbd4194b"}
Jul 29 01:13:45.472366 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:45.472293    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s247d" event={"ID":"c57c897c-c75e-4bd5-8c5d-7682906914f2","Type":"ContainerStarted","Data":"b2b4dc48f5ded2f794b6411d1786ef7b46a2957ca6333089eb1c55f85a3a22c5"}
Jul 29 01:13:45.475641 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:45.475587    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-n7dj7" podStartSLOduration=66.871339669 podStartE2EDuration="1m15.47557347s" totalImagesPullingTime="8.604233801s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:12:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:45.475181756 +0000 UTC m=+75.787574466" watchObservedRunningTime="2026-07-29 01:13:45.47557347 +0000 UTC m=+75.787966158"
Jul 29 01:13:45.490487 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:45.490447    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-cbv98" podStartSLOduration=34.646408429 podStartE2EDuration="40.490432984s" totalImagesPullingTime="5.844024555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:13:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:45.489784866 +0000 UTC m=+75.802177574" watchObservedRunningTime="2026-07-29 01:13:45.490432984 +0000 UTC m=+75.802825693"
Jul 29 01:13:45.505586 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:45.505536    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-84mml" podStartSLOduration=17.550959678 podStartE2EDuration="35.505521059s" totalImagesPullingTime="17.954561381s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:13:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:45.505325142 +0000 UTC m=+75.817717863" watchObservedRunningTime="2026-07-29 01:13:45.505521059 +0000 UTC m=+75.817913768"
Jul 29 01:13:45.519793 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:45.519754    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-s247d" podStartSLOduration=67.390409861 podStartE2EDuration="1m15.519738092s" totalImagesPullingTime="8.129328231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:12:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:45.519450329 +0000 UTC m=+75.831843049" watchObservedRunningTime="2026-07-29 01:13:45.519738092 +0000 UTC m=+75.832130801"
Jul 29 01:13:45.534955 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:45.534919    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-847f6f8449-jfs9g" podStartSLOduration=1.890478723 podStartE2EDuration="11.534910342s" totalImagesPullingTime="9.644431619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:13:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:45.534527052 +0000 UTC m=+75.846919762" watchObservedRunningTime="2026-07-29 01:13:45.534910342 +0000 UTC m=+75.847303055"
Jul 29 01:13:45.548446 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:45.548405    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7k5r4" podStartSLOduration=67.050552286 podStartE2EDuration="1m15.548393809s" totalImagesPullingTime="8.497841523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:12:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:45.547999364 +0000 UTC m=+75.860392073" watchObservedRunningTime="2026-07-29 01:13:45.548393809 +0000 UTC m=+75.860786517"
Jul 29 01:13:45.610775 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:45.610738    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:45.711652 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:45.711616    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:45.908133 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:45.908101    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-4z2fj"]
Jul 29 01:13:45.911114 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:45.911092    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-4z2fj"
Jul 29 01:13:45.912562 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:45.912532    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:45.913715 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:45.913692    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 29 01:13:45.913904 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:45.913886    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-dj5pd\""
Jul 29 01:13:45.914014 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:45.913968    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 29 01:13:45.919290 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:45.919259    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-4z2fj"]
Jul 29 01:13:45.964622 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:45.964588    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp54p\" (UniqueName: \"kubernetes.io/projected/a11bee19-78af-4a9c-bb1e-3a89dccf1fe2-kube-api-access-wp54p\") pod \"downloads-7c97dc4555-4z2fj\" (UID: \"a11bee19-78af-4a9c-bb1e-3a89dccf1fe2\") " pod="openshift-console/downloads-7c97dc4555-4z2fj"
Jul 29 01:13:46.016340 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:46.016286    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:46.065545 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:46.065507    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp54p\" (UniqueName: \"kubernetes.io/projected/a11bee19-78af-4a9c-bb1e-3a89dccf1fe2-kube-api-access-wp54p\") pod \"downloads-7c97dc4555-4z2fj\" (UID: \"a11bee19-78af-4a9c-bb1e-3a89dccf1fe2\") " pod="openshift-console/downloads-7c97dc4555-4z2fj"
Jul 29 01:13:46.075917 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:46.075887    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp54p\" (UniqueName: \"kubernetes.io/projected/a11bee19-78af-4a9c-bb1e-3a89dccf1fe2-kube-api-access-wp54p\") pod \"downloads-7c97dc4555-4z2fj\" (UID: \"a11bee19-78af-4a9c-bb1e-3a89dccf1fe2\") " pod="openshift-console/downloads-7c97dc4555-4z2fj"
Jul 29 01:13:46.118460 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:46.118419    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:46.213914 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:46.213883    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:46.221496 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:46.221480    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-4z2fj"
Jul 29 01:13:46.315034 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:46.314944    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:46.346744 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:46.346714    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-4z2fj"]
Jul 29 01:13:46.350409 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:13:46.350379    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda11bee19_78af_4a9c_bb1e_3a89dccf1fe2.slice/crio-29429c12297f9ebcccfff56a579ce3d48e1b1aeb4c5c8a1a43030a604812d0ef WatchSource:0}: Error finding container 29429c12297f9ebcccfff56a579ce3d48e1b1aeb4c5c8a1a43030a604812d0ef: Status 404 returned error can't find the container with id 29429c12297f9ebcccfff56a579ce3d48e1b1aeb4c5c8a1a43030a604812d0ef
Jul 29 01:13:46.416169 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:46.416139    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:46.481662 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:46.481572    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sxjwk" event={"ID":"340c0f05-58f8-4adc-a39d-ef87ac591e2e","Type":"ContainerStarted","Data":"d61317411d0579722f75a8e04814e936ea0b5365a7d3dc7f958618708021a92c"}
Jul 29 01:13:46.481827 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:46.481788    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sxjwk"
Jul 29 01:13:46.482895 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:46.482864    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-4z2fj" event={"ID":"a11bee19-78af-4a9c-bb1e-3a89dccf1fe2","Type":"ContainerStarted","Data":"29429c12297f9ebcccfff56a579ce3d48e1b1aeb4c5c8a1a43030a604812d0ef"}
Jul 29 01:13:46.486682 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:46.486659    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sxjwk"
Jul 29 01:13:46.496750 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:46.496705    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sxjwk" podStartSLOduration=4.33766557 podStartE2EDuration="5.496689243s" totalImagesPullingTime="1.159023673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:13:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:46.496080063 +0000 UTC m=+76.808472763" watchObservedRunningTime="2026-07-29 01:13:46.496689243 +0000 UTC m=+76.809081951"
Jul 29 01:13:46.500420 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:46.500393    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:46.802239 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:46.802147    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:46.930647 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:46.930598    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:46.970360 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:46.970328    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-l2j7z"]
Jul 29 01:13:46.973717 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:46.973696    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-l2j7z"
Jul 29 01:13:46.976787 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:46.976567    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 29 01:13:46.976787 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:46.976612    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 29 01:13:46.977981 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:46.977905    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 29 01:13:46.977981 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:46.977965    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 29 01:13:46.978381 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:46.978203    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-xtmd2\""
Jul 29 01:13:46.978381 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:46.978295    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 29 01:13:46.984709 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:46.983975    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-l2j7z"]
Jul 29 01:13:47.001640 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:47.001610    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:47.060247 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:47.060162    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:47.073878 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:47.073837    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7774e259-04cb-4070-9c71-183e5ef496a2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-l2j7z\" (UID: \"7774e259-04cb-4070-9c71-183e5ef496a2\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-l2j7z"
Jul 29 01:13:47.074041 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:47.073932    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddqb5\" (UniqueName: \"kubernetes.io/projected/7774e259-04cb-4070-9c71-183e5ef496a2-kube-api-access-ddqb5\") pod \"prometheus-operator-84d69f794d-l2j7z\" (UID: \"7774e259-04cb-4070-9c71-183e5ef496a2\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-l2j7z"
Jul 29 01:13:47.074041 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:47.073994    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7774e259-04cb-4070-9c71-183e5ef496a2-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-l2j7z\" (UID: \"7774e259-04cb-4070-9c71-183e5ef496a2\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-l2j7z"
Jul 29 01:13:47.074041 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:47.074037    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7774e259-04cb-4070-9c71-183e5ef496a2-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-l2j7z\" (UID: \"7774e259-04cb-4070-9c71-183e5ef496a2\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-l2j7z"
Jul 29 01:13:47.174962 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:47.174909    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7774e259-04cb-4070-9c71-183e5ef496a2-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-l2j7z\" (UID: \"7774e259-04cb-4070-9c71-183e5ef496a2\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-l2j7z"
Jul 29 01:13:47.175145 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:47.174977    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7774e259-04cb-4070-9c71-183e5ef496a2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-l2j7z\" (UID: \"7774e259-04cb-4070-9c71-183e5ef496a2\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-l2j7z"
Jul 29 01:13:47.175145 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:47.175057    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddqb5\" (UniqueName: \"kubernetes.io/projected/7774e259-04cb-4070-9c71-183e5ef496a2-kube-api-access-ddqb5\") pod \"prometheus-operator-84d69f794d-l2j7z\" (UID: \"7774e259-04cb-4070-9c71-183e5ef496a2\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-l2j7z"
Jul 29 01:13:47.175145 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:47.175099    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7774e259-04cb-4070-9c71-183e5ef496a2-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-l2j7z\" (UID: \"7774e259-04cb-4070-9c71-183e5ef496a2\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-l2j7z"
Jul 29 01:13:47.175320 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:47.175218    2580 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 29 01:13:47.175320 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:47.175287    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7774e259-04cb-4070-9c71-183e5ef496a2-prometheus-operator-tls podName:7774e259-04cb-4070-9c71-183e5ef496a2 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:47.675265135 +0000 UTC m=+77.987657826 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/7774e259-04cb-4070-9c71-183e5ef496a2-prometheus-operator-tls") pod "prometheus-operator-84d69f794d-l2j7z" (UID: "7774e259-04cb-4070-9c71-183e5ef496a2") : secret "prometheus-operator-tls" not found
Jul 29 01:13:47.175736 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:47.175690    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7774e259-04cb-4070-9c71-183e5ef496a2-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-l2j7z\" (UID: \"7774e259-04cb-4070-9c71-183e5ef496a2\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-l2j7z"
Jul 29 01:13:47.177768 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:47.177748    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7774e259-04cb-4070-9c71-183e5ef496a2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-l2j7z\" (UID: \"7774e259-04cb-4070-9c71-183e5ef496a2\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-l2j7z"
Jul 29 01:13:47.184505 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:47.184480    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddqb5\" (UniqueName: \"kubernetes.io/projected/7774e259-04cb-4070-9c71-183e5ef496a2-kube-api-access-ddqb5\") pod \"prometheus-operator-84d69f794d-l2j7z\" (UID: \"7774e259-04cb-4070-9c71-183e5ef496a2\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-l2j7z"
Jul 29 01:13:47.368478 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:47.368388    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:47.462967 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:47.462915    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:47.588207 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:47.588177    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:47.678009 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:47.677923    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7774e259-04cb-4070-9c71-183e5ef496a2-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-l2j7z\" (UID: \"7774e259-04cb-4070-9c71-183e5ef496a2\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-l2j7z"
Jul 29 01:13:47.680599 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:47.680574    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7774e259-04cb-4070-9c71-183e5ef496a2-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-l2j7z\" (UID: \"7774e259-04cb-4070-9c71-183e5ef496a2\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-l2j7z"
Jul 29 01:13:47.886328 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:47.886292    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-l2j7z"
Jul 29 01:13:47.893587 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:47.893510    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:48.037889 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:48.037855    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-l2j7z"]
Jul 29 01:13:48.040153 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:13:48.040127    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7774e259_04cb_4070_9c71_183e5ef496a2.slice/crio-a9ce3040aa775486e19ee1b87189caa16da35af3b3518dd5724b10c19d774a6e WatchSource:0}: Error finding container a9ce3040aa775486e19ee1b87189caa16da35af3b3518dd5724b10c19d774a6e: Status 404 returned error can't find the container with id a9ce3040aa775486e19ee1b87189caa16da35af3b3518dd5724b10c19d774a6e
Jul 29 01:13:48.491827 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:48.491787    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-l2j7z" event={"ID":"7774e259-04cb-4070-9c71-183e5ef496a2","Type":"ContainerStarted","Data":"a9ce3040aa775486e19ee1b87189caa16da35af3b3518dd5724b10c19d774a6e"}
Jul 29 01:13:49.445589 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:49.445498    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:49.497387 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:49.497352    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-l2j7z" event={"ID":"7774e259-04cb-4070-9c71-183e5ef496a2","Type":"ContainerStarted","Data":"03c33e599f37c61f27a731cece421d70fa30fec76ee68706b22578c7c58feef3"}
Jul 29 01:13:49.497798 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:49.497410    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-l2j7z" event={"ID":"7774e259-04cb-4070-9c71-183e5ef496a2","Type":"ContainerStarted","Data":"10248276ca0224a7256dd692bbc3d8b945ae1fd76c29a5ccbbeb669127503deb"}
Jul 29 01:13:49.513103 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:49.513050    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-l2j7z" podStartSLOduration=2.37277427 podStartE2EDuration="3.513029741s" totalImagesPullingTime="1.140255471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:13:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:49.512292526 +0000 UTC m=+79.824685235" watchObservedRunningTime="2026-07-29 01:13:49.513029741 +0000 UTC m=+79.825422452"
Jul 29 01:13:49.632803 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:49.632762    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:49.722708 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:49.722619    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:51.052533 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.052500    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:51.152334 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.152303    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:51.264319 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.264284    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:51.298365 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.298330    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-79wzl"]
Jul 29 01:13:51.302013 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.301984    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-79wzl"
Jul 29 01:13:51.304595 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.304526    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 29 01:13:51.304595 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.304548    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-n7s6f\""
Jul 29 01:13:51.304595 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.304566    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 29 01:13:51.314134 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.314114    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-79wzl"]
Jul 29 01:13:51.326712 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.326687    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7bc76"]
Jul 29 01:13:51.329934 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.329914    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7bc76"
Jul 29 01:13:51.332195 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.332176    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 29 01:13:51.332349 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.332330    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 29 01:13:51.332442 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.332428    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 29 01:13:51.332569 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.332550    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9pv8q\""
Jul 29 01:13:51.348119 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.348080    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:51.405120 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.405089    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9d972976-65f8-43de-82a8-accd5fa57ec7-node-exporter-wtmp\") pod \"node-exporter-7bc76\" (UID: \"9d972976-65f8-43de-82a8-accd5fa57ec7\") " pod="openshift-monitoring/node-exporter-7bc76"
Jul 29 01:13:51.405305 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.405136    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9d972976-65f8-43de-82a8-accd5fa57ec7-node-exporter-tls\") pod \"node-exporter-7bc76\" (UID: \"9d972976-65f8-43de-82a8-accd5fa57ec7\") " pod="openshift-monitoring/node-exporter-7bc76"
Jul 29 01:13:51.405305 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.405188    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9d972976-65f8-43de-82a8-accd5fa57ec7-node-exporter-accelerators-collector-config\") pod \"node-exporter-7bc76\" (UID: \"9d972976-65f8-43de-82a8-accd5fa57ec7\") " pod="openshift-monitoring/node-exporter-7bc76"
Jul 29 01:13:51.405305 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.405223    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz9nq\" (UniqueName: \"kubernetes.io/projected/ea98c435-63e1-4b9b-b451-8013f67695e5-kube-api-access-xz9nq\") pod \"openshift-state-metrics-b8f49f5c6-79wzl\" (UID: \"ea98c435-63e1-4b9b-b451-8013f67695e5\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-79wzl"
Jul 29 01:13:51.405305 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.405254    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ea98c435-63e1-4b9b-b451-8013f67695e5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-79wzl\" (UID: \"ea98c435-63e1-4b9b-b451-8013f67695e5\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-79wzl"
Jul 29 01:13:51.405305 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.405282    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9d972976-65f8-43de-82a8-accd5fa57ec7-node-exporter-textfile\") pod \"node-exporter-7bc76\" (UID: \"9d972976-65f8-43de-82a8-accd5fa57ec7\") " pod="openshift-monitoring/node-exporter-7bc76"
Jul 29 01:13:51.405557 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.405319    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d972976-65f8-43de-82a8-accd5fa57ec7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7bc76\" (UID: \"9d972976-65f8-43de-82a8-accd5fa57ec7\") " pod="openshift-monitoring/node-exporter-7bc76"
Jul 29 01:13:51.405557 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.405371    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ea98c435-63e1-4b9b-b451-8013f67695e5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-79wzl\" (UID: \"ea98c435-63e1-4b9b-b451-8013f67695e5\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-79wzl"
Jul 29 01:13:51.405557 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.405446    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d972976-65f8-43de-82a8-accd5fa57ec7-metrics-client-ca\") pod \"node-exporter-7bc76\" (UID: \"9d972976-65f8-43de-82a8-accd5fa57ec7\") " pod="openshift-monitoring/node-exporter-7bc76"
Jul 29 01:13:51.405557 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.405483    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea98c435-63e1-4b9b-b451-8013f67695e5-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-79wzl\" (UID: \"ea98c435-63e1-4b9b-b451-8013f67695e5\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-79wzl"
Jul 29 01:13:51.405557 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.405532    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9d972976-65f8-43de-82a8-accd5fa57ec7-root\") pod \"node-exporter-7bc76\" (UID: \"9d972976-65f8-43de-82a8-accd5fa57ec7\") " pod="openshift-monitoring/node-exporter-7bc76"
Jul 29 01:13:51.405760 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.405560    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d972976-65f8-43de-82a8-accd5fa57ec7-sys\") pod \"node-exporter-7bc76\" (UID: \"9d972976-65f8-43de-82a8-accd5fa57ec7\") " pod="openshift-monitoring/node-exporter-7bc76"
Jul 29 01:13:51.405760 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.405576    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq7qz\" (UniqueName: \"kubernetes.io/projected/9d972976-65f8-43de-82a8-accd5fa57ec7-kube-api-access-lq7qz\") pod \"node-exporter-7bc76\" (UID: \"9d972976-65f8-43de-82a8-accd5fa57ec7\") " pod="openshift-monitoring/node-exporter-7bc76"
Jul 29 01:13:51.414958 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.414926    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:51.506452 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.506422    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d972976-65f8-43de-82a8-accd5fa57ec7-metrics-client-ca\") pod \"node-exporter-7bc76\" (UID: \"9d972976-65f8-43de-82a8-accd5fa57ec7\") " pod="openshift-monitoring/node-exporter-7bc76"
Jul 29 01:13:51.506623 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.506457    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea98c435-63e1-4b9b-b451-8013f67695e5-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-79wzl\" (UID: \"ea98c435-63e1-4b9b-b451-8013f67695e5\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-79wzl"
Jul 29 01:13:51.506623 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.506484    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9d972976-65f8-43de-82a8-accd5fa57ec7-root\") pod \"node-exporter-7bc76\" (UID: \"9d972976-65f8-43de-82a8-accd5fa57ec7\") " pod="openshift-monitoring/node-exporter-7bc76"
Jul 29 01:13:51.506623 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.506509    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d972976-65f8-43de-82a8-accd5fa57ec7-sys\") pod \"node-exporter-7bc76\" (UID: \"9d972976-65f8-43de-82a8-accd5fa57ec7\") " pod="openshift-monitoring/node-exporter-7bc76"
Jul 29 01:13:51.506623 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.506529    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq7qz\" (UniqueName: \"kubernetes.io/projected/9d972976-65f8-43de-82a8-accd5fa57ec7-kube-api-access-lq7qz\") pod \"node-exporter-7bc76\" (UID: \"9d972976-65f8-43de-82a8-accd5fa57ec7\") " pod="openshift-monitoring/node-exporter-7bc76"
Jul 29 01:13:51.506623 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.506565    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9d972976-65f8-43de-82a8-accd5fa57ec7-root\") pod \"node-exporter-7bc76\" (UID: \"9d972976-65f8-43de-82a8-accd5fa57ec7\") " pod="openshift-monitoring/node-exporter-7bc76"
Jul 29 01:13:51.506623 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.506577    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d972976-65f8-43de-82a8-accd5fa57ec7-sys\") pod \"node-exporter-7bc76\" (UID: \"9d972976-65f8-43de-82a8-accd5fa57ec7\") " pod="openshift-monitoring/node-exporter-7bc76"
Jul 29 01:13:51.506623 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.506565    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9d972976-65f8-43de-82a8-accd5fa57ec7-node-exporter-wtmp\") pod \"node-exporter-7bc76\" (UID: \"9d972976-65f8-43de-82a8-accd5fa57ec7\") " pod="openshift-monitoring/node-exporter-7bc76"
Jul 29 01:13:51.507006 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.506632    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9d972976-65f8-43de-82a8-accd5fa57ec7-node-exporter-tls\") pod \"node-exporter-7bc76\" (UID: \"9d972976-65f8-43de-82a8-accd5fa57ec7\") " pod="openshift-monitoring/node-exporter-7bc76"
Jul 29 01:13:51.507006 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.506663    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9d972976-65f8-43de-82a8-accd5fa57ec7-node-exporter-accelerators-collector-config\") pod \"node-exporter-7bc76\" (UID: \"9d972976-65f8-43de-82a8-accd5fa57ec7\") " pod="openshift-monitoring/node-exporter-7bc76"
Jul 29 01:13:51.507006 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.506704    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz9nq\" (UniqueName: \"kubernetes.io/projected/ea98c435-63e1-4b9b-b451-8013f67695e5-kube-api-access-xz9nq\") pod \"openshift-state-metrics-b8f49f5c6-79wzl\" (UID: \"ea98c435-63e1-4b9b-b451-8013f67695e5\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-79wzl"
Jul 29 01:13:51.507006 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.506728    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ea98c435-63e1-4b9b-b451-8013f67695e5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-79wzl\" (UID: \"ea98c435-63e1-4b9b-b451-8013f67695e5\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-79wzl"
Jul 29 01:13:51.507006 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.506758    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9d972976-65f8-43de-82a8-accd5fa57ec7-node-exporter-textfile\") pod \"node-exporter-7bc76\" (UID: \"9d972976-65f8-43de-82a8-accd5fa57ec7\") " pod="openshift-monitoring/node-exporter-7bc76"
Jul 29 01:13:51.507006 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.506774    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9d972976-65f8-43de-82a8-accd5fa57ec7-node-exporter-wtmp\") pod \"node-exporter-7bc76\" (UID: \"9d972976-65f8-43de-82a8-accd5fa57ec7\") " pod="openshift-monitoring/node-exporter-7bc76"
Jul 29 01:13:51.507006 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.506806    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d972976-65f8-43de-82a8-accd5fa57ec7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7bc76\" (UID: \"9d972976-65f8-43de-82a8-accd5fa57ec7\") " pod="openshift-monitoring/node-exporter-7bc76"
Jul 29 01:13:51.507006 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.506842    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ea98c435-63e1-4b9b-b451-8013f67695e5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-79wzl\" (UID: \"ea98c435-63e1-4b9b-b451-8013f67695e5\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-79wzl"
Jul 29 01:13:51.507006 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:51.506941    2580 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 29 01:13:51.507424 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:51.507021    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea98c435-63e1-4b9b-b451-8013f67695e5-openshift-state-metrics-tls podName:ea98c435-63e1-4b9b-b451-8013f67695e5 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:52.007002371 +0000 UTC m=+82.319395063 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/ea98c435-63e1-4b9b-b451-8013f67695e5-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-79wzl" (UID: "ea98c435-63e1-4b9b-b451-8013f67695e5") : secret "openshift-state-metrics-tls" not found
Jul 29 01:13:51.507424 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.507062    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d972976-65f8-43de-82a8-accd5fa57ec7-metrics-client-ca\") pod \"node-exporter-7bc76\" (UID: \"9d972976-65f8-43de-82a8-accd5fa57ec7\") " pod="openshift-monitoring/node-exporter-7bc76"
Jul 29 01:13:51.507424 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.507097    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9d972976-65f8-43de-82a8-accd5fa57ec7-node-exporter-textfile\") pod \"node-exporter-7bc76\" (UID: \"9d972976-65f8-43de-82a8-accd5fa57ec7\") " pod="openshift-monitoring/node-exporter-7bc76"
Jul 29 01:13:51.507424 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.507378    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea98c435-63e1-4b9b-b451-8013f67695e5-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-79wzl\" (UID: \"ea98c435-63e1-4b9b-b451-8013f67695e5\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-79wzl"
Jul 29 01:13:51.507569 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.507519    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9d972976-65f8-43de-82a8-accd5fa57ec7-node-exporter-accelerators-collector-config\") pod \"node-exporter-7bc76\" (UID: \"9d972976-65f8-43de-82a8-accd5fa57ec7\") " pod="openshift-monitoring/node-exporter-7bc76"
Jul 29 01:13:51.509111 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.509087    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9d972976-65f8-43de-82a8-accd5fa57ec7-node-exporter-tls\") pod \"node-exporter-7bc76\" (UID: \"9d972976-65f8-43de-82a8-accd5fa57ec7\") " pod="openshift-monitoring/node-exporter-7bc76"
Jul 29 01:13:51.509223 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.509096    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d972976-65f8-43de-82a8-accd5fa57ec7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7bc76\" (UID: \"9d972976-65f8-43de-82a8-accd5fa57ec7\") " pod="openshift-monitoring/node-exporter-7bc76"
Jul 29 01:13:51.509271 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.509251    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ea98c435-63e1-4b9b-b451-8013f67695e5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-79wzl\" (UID: \"ea98c435-63e1-4b9b-b451-8013f67695e5\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-79wzl"
Jul 29 01:13:51.517457 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.517428    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:51.518416 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.518395    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq7qz\" (UniqueName: \"kubernetes.io/projected/9d972976-65f8-43de-82a8-accd5fa57ec7-kube-api-access-lq7qz\") pod \"node-exporter-7bc76\" (UID: \"9d972976-65f8-43de-82a8-accd5fa57ec7\") " pod="openshift-monitoring/node-exporter-7bc76"
Jul 29 01:13:51.518658 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.518641    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz9nq\" (UniqueName: \"kubernetes.io/projected/ea98c435-63e1-4b9b-b451-8013f67695e5-kube-api-access-xz9nq\") pod \"openshift-state-metrics-b8f49f5c6-79wzl\" (UID: \"ea98c435-63e1-4b9b-b451-8013f67695e5\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-79wzl"
Jul 29 01:13:51.616031 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.615994    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:51.639715 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.639691    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7bc76"
Jul 29 01:13:51.652439 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:13:51.652413    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d972976_65f8_43de_82a8_accd5fa57ec7.slice/crio-743cee846c9641ba02b3f5161afa6ff12375b7f6938e33d08a0acfc392a9c058 WatchSource:0}: Error finding container 743cee846c9641ba02b3f5161afa6ff12375b7f6938e33d08a0acfc392a9c058: Status 404 returned error can't find the container with id 743cee846c9641ba02b3f5161afa6ff12375b7f6938e33d08a0acfc392a9c058
Jul 29 01:13:51.717241 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.717209    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:51.939869 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:51.939710    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:52.015318 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.012230    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ea98c435-63e1-4b9b-b451-8013f67695e5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-79wzl\" (UID: \"ea98c435-63e1-4b9b-b451-8013f67695e5\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-79wzl"
Jul 29 01:13:52.015318 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.013414    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-785cb497c6-t5kvd"]
Jul 29 01:13:52.017402 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.017373    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ea98c435-63e1-4b9b-b451-8013f67695e5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-79wzl\" (UID: \"ea98c435-63e1-4b9b-b451-8013f67695e5\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-79wzl"
Jul 29 01:13:52.020668 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.020648    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-785cb497c6-t5kvd"
Jul 29 01:13:52.023076 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.023053    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 29 01:13:52.023188 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.023101    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 29 01:13:52.023356 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.023325    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 29 01:13:52.023603 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.023510    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 29 01:13:52.024206 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.024150    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 29 01:13:52.024542 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.024526    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jm8j4\""
Jul 29 01:13:52.030376 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.030356    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-785cb497c6-t5kvd"]
Jul 29 01:13:52.112744 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.112712    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59b13f02-28aa-40a1-bd27-813b56fbfc86-service-ca\") pod \"console-785cb497c6-t5kvd\" (UID: \"59b13f02-28aa-40a1-bd27-813b56fbfc86\") " pod="openshift-console/console-785cb497c6-t5kvd"
Jul 29 01:13:52.113205 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.112751    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59b13f02-28aa-40a1-bd27-813b56fbfc86-console-oauth-config\") pod \"console-785cb497c6-t5kvd\" (UID: \"59b13f02-28aa-40a1-bd27-813b56fbfc86\") " pod="openshift-console/console-785cb497c6-t5kvd"
Jul 29 01:13:52.113205 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.112784    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6d662\" (UniqueName: \"kubernetes.io/projected/59b13f02-28aa-40a1-bd27-813b56fbfc86-kube-api-access-6d662\") pod \"console-785cb497c6-t5kvd\" (UID: \"59b13f02-28aa-40a1-bd27-813b56fbfc86\") " pod="openshift-console/console-785cb497c6-t5kvd"
Jul 29 01:13:52.113205 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.112856    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59b13f02-28aa-40a1-bd27-813b56fbfc86-console-config\") pod \"console-785cb497c6-t5kvd\" (UID: \"59b13f02-28aa-40a1-bd27-813b56fbfc86\") " pod="openshift-console/console-785cb497c6-t5kvd"
Jul 29 01:13:52.113205 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.112889    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59b13f02-28aa-40a1-bd27-813b56fbfc86-oauth-serving-cert\") pod \"console-785cb497c6-t5kvd\" (UID: \"59b13f02-28aa-40a1-bd27-813b56fbfc86\") " pod="openshift-console/console-785cb497c6-t5kvd"
Jul 29 01:13:52.113205 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.112975    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59b13f02-28aa-40a1-bd27-813b56fbfc86-console-serving-cert\") pod \"console-785cb497c6-t5kvd\" (UID: \"59b13f02-28aa-40a1-bd27-813b56fbfc86\") " pod="openshift-console/console-785cb497c6-t5kvd"
Jul 29 01:13:52.213051 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.212977    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-79wzl"
Jul 29 01:13:52.214317 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.214288    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59b13f02-28aa-40a1-bd27-813b56fbfc86-console-config\") pod \"console-785cb497c6-t5kvd\" (UID: \"59b13f02-28aa-40a1-bd27-813b56fbfc86\") " pod="openshift-console/console-785cb497c6-t5kvd"
Jul 29 01:13:52.214447 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.214333    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59b13f02-28aa-40a1-bd27-813b56fbfc86-oauth-serving-cert\") pod \"console-785cb497c6-t5kvd\" (UID: \"59b13f02-28aa-40a1-bd27-813b56fbfc86\") " pod="openshift-console/console-785cb497c6-t5kvd"
Jul 29 01:13:52.214447 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.214388    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59b13f02-28aa-40a1-bd27-813b56fbfc86-console-serving-cert\") pod \"console-785cb497c6-t5kvd\" (UID: \"59b13f02-28aa-40a1-bd27-813b56fbfc86\") " pod="openshift-console/console-785cb497c6-t5kvd"
Jul 29 01:13:52.214447 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.214419    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59b13f02-28aa-40a1-bd27-813b56fbfc86-service-ca\") pod \"console-785cb497c6-t5kvd\" (UID: \"59b13f02-28aa-40a1-bd27-813b56fbfc86\") " pod="openshift-console/console-785cb497c6-t5kvd"
Jul 29 01:13:52.214447 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.214442    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59b13f02-28aa-40a1-bd27-813b56fbfc86-console-oauth-config\") pod \"console-785cb497c6-t5kvd\" (UID: \"59b13f02-28aa-40a1-bd27-813b56fbfc86\") " pod="openshift-console/console-785cb497c6-t5kvd"
Jul 29 01:13:52.214583 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.214470    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6d662\" (UniqueName: \"kubernetes.io/projected/59b13f02-28aa-40a1-bd27-813b56fbfc86-kube-api-access-6d662\") pod \"console-785cb497c6-t5kvd\" (UID: \"59b13f02-28aa-40a1-bd27-813b56fbfc86\") " pod="openshift-console/console-785cb497c6-t5kvd"
Jul 29 01:13:52.215087 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.215062    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59b13f02-28aa-40a1-bd27-813b56fbfc86-console-config\") pod \"console-785cb497c6-t5kvd\" (UID: \"59b13f02-28aa-40a1-bd27-813b56fbfc86\") " pod="openshift-console/console-785cb497c6-t5kvd"
Jul 29 01:13:52.215567 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.215535    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59b13f02-28aa-40a1-bd27-813b56fbfc86-service-ca\") pod \"console-785cb497c6-t5kvd\" (UID: \"59b13f02-28aa-40a1-bd27-813b56fbfc86\") " pod="openshift-console/console-785cb497c6-t5kvd"
Jul 29 01:13:52.215978 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.215918    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59b13f02-28aa-40a1-bd27-813b56fbfc86-oauth-serving-cert\") pod \"console-785cb497c6-t5kvd\" (UID: \"59b13f02-28aa-40a1-bd27-813b56fbfc86\") " pod="openshift-console/console-785cb497c6-t5kvd"
Jul 29 01:13:52.217908 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.217884    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59b13f02-28aa-40a1-bd27-813b56fbfc86-console-serving-cert\") pod \"console-785cb497c6-t5kvd\" (UID: \"59b13f02-28aa-40a1-bd27-813b56fbfc86\") " pod="openshift-console/console-785cb497c6-t5kvd"
Jul 29 01:13:52.218022 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.217934    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59b13f02-28aa-40a1-bd27-813b56fbfc86-console-oauth-config\") pod \"console-785cb497c6-t5kvd\" (UID: \"59b13f02-28aa-40a1-bd27-813b56fbfc86\") " pod="openshift-console/console-785cb497c6-t5kvd"
Jul 29 01:13:52.224611 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.224540    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6d662\" (UniqueName: \"kubernetes.io/projected/59b13f02-28aa-40a1-bd27-813b56fbfc86-kube-api-access-6d662\") pod \"console-785cb497c6-t5kvd\" (UID: \"59b13f02-28aa-40a1-bd27-813b56fbfc86\") " pod="openshift-console/console-785cb497c6-t5kvd"
Jul 29 01:13:52.297323 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.297267    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:52.332865 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.332667    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-785cb497c6-t5kvd"
Jul 29 01:13:52.371211 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.367445    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-79wzl"]
Jul 29 01:13:52.372384 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.372280    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:52.378669 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:13:52.378586    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea98c435_63e1_4b9b_b451_8013f67695e5.slice/crio-08d3dfd1cc3ffba7b45351bde9f7279d14d49f5d94d41b73d397a57bbf6f4bef WatchSource:0}: Error finding container 08d3dfd1cc3ffba7b45351bde9f7279d14d49f5d94d41b73d397a57bbf6f4bef: Status 404 returned error can't find the container with id 08d3dfd1cc3ffba7b45351bde9f7279d14d49f5d94d41b73d397a57bbf6f4bef
Jul 29 01:13:52.378902 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.378881    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 29 01:13:52.386029 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.385359    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:13:52.388073 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.387796    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 29 01:13:52.388073 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.387933    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 29 01:13:52.388237 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.388137    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 29 01:13:52.392408 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.389606    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 29 01:13:52.392408 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.390797    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 29 01:13:52.392408 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.391066    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-5s7r7\""
Jul 29 01:13:52.392408 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.391236    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 29 01:13:52.392408 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.391419    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 29 01:13:52.392408 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.391622    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 29 01:13:52.392408 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.391927    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 29 01:13:52.398584 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.398564    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 29 01:13:52.501534 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.501462    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-785cb497c6-t5kvd"]
Jul 29 01:13:52.510635 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.510548    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7bc76" event={"ID":"9d972976-65f8-43de-82a8-accd5fa57ec7","Type":"ContainerStarted","Data":"743cee846c9641ba02b3f5161afa6ff12375b7f6938e33d08a0acfc392a9c058"}
Jul 29 01:13:52.513936 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.513830    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-79wzl" event={"ID":"ea98c435-63e1-4b9b-b451-8013f67695e5","Type":"ContainerStarted","Data":"f5817c91b9402aa2bc4b38c65af310fc99f905c5ff094cf245ba5419b41bd8a8"}
Jul 29 01:13:52.513936 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.513886    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-79wzl" event={"ID":"ea98c435-63e1-4b9b-b451-8013f67695e5","Type":"ContainerStarted","Data":"08d3dfd1cc3ffba7b45351bde9f7279d14d49f5d94d41b73d397a57bbf6f4bef"}
Jul 29 01:13:52.517799 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.517583    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/28b57994-0cab-4771-a72a-b3e276fb811d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:13:52.517799 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.517625    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/28b57994-0cab-4771-a72a-b3e276fb811d-web-config\") pod \"alertmanager-main-0\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:13:52.517799 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.517660    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28b57994-0cab-4771-a72a-b3e276fb811d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:13:52.517799 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.517687    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/28b57994-0cab-4771-a72a-b3e276fb811d-config-volume\") pod \"alertmanager-main-0\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:13:52.517799 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.517718    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28b57994-0cab-4771-a72a-b3e276fb811d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:13:52.517799 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.517763    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/28b57994-0cab-4771-a72a-b3e276fb811d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:13:52.518360 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.518210    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/28b57994-0cab-4771-a72a-b3e276fb811d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:13:52.518462 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.518384    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/28b57994-0cab-4771-a72a-b3e276fb811d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:13:52.518462 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.518425    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/28b57994-0cab-4771-a72a-b3e276fb811d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:13:52.518644 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.518458    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlqd7\" (UniqueName: \"kubernetes.io/projected/28b57994-0cab-4771-a72a-b3e276fb811d-kube-api-access-wlqd7\") pod \"alertmanager-main-0\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:13:52.518644 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.518539    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/28b57994-0cab-4771-a72a-b3e276fb811d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:13:52.518644 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.518577    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/28b57994-0cab-4771-a72a-b3e276fb811d-config-out\") pod \"alertmanager-main-0\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:13:52.518644 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.518603    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/28b57994-0cab-4771-a72a-b3e276fb811d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:13:52.620089 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.619313    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/28b57994-0cab-4771-a72a-b3e276fb811d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:13:52.620089 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.619365    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/28b57994-0cab-4771-a72a-b3e276fb811d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:13:52.620089 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.619402    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlqd7\" (UniqueName: \"kubernetes.io/projected/28b57994-0cab-4771-a72a-b3e276fb811d-kube-api-access-wlqd7\") pod \"alertmanager-main-0\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:13:52.620089 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.619433    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/28b57994-0cab-4771-a72a-b3e276fb811d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:13:52.620089 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.619468    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/28b57994-0cab-4771-a72a-b3e276fb811d-config-out\") pod \"alertmanager-main-0\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:13:52.620089 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:52.619484    2580 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 29 01:13:52.620089 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.619494    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/28b57994-0cab-4771-a72a-b3e276fb811d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:13:52.620089 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.619526    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/28b57994-0cab-4771-a72a-b3e276fb811d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:13:52.620089 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:13:52.619555    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28b57994-0cab-4771-a72a-b3e276fb811d-secret-alertmanager-main-tls podName:28b57994-0cab-4771-a72a-b3e276fb811d nodeName:}" failed. No retries permitted until 2026-07-29 01:13:53.119533213 +0000 UTC m=+83.431925901 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/28b57994-0cab-4771-a72a-b3e276fb811d-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "28b57994-0cab-4771-a72a-b3e276fb811d") : secret "alertmanager-main-tls" not found
Jul 29 01:13:52.620089 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.619602    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/28b57994-0cab-4771-a72a-b3e276fb811d-web-config\") pod \"alertmanager-main-0\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:13:52.620089 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.619644    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28b57994-0cab-4771-a72a-b3e276fb811d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:13:52.620089 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.619672    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/28b57994-0cab-4771-a72a-b3e276fb811d-config-volume\") pod \"alertmanager-main-0\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:13:52.620089 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.619704    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28b57994-0cab-4771-a72a-b3e276fb811d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:13:52.620089 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.619752    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/28b57994-0cab-4771-a72a-b3e276fb811d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:13:52.620089 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.619783    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/28b57994-0cab-4771-a72a-b3e276fb811d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:13:52.620968 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.620719    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28b57994-0cab-4771-a72a-b3e276fb811d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:13:52.621686 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.621658    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/28b57994-0cab-4771-a72a-b3e276fb811d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:13:52.621784 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.621757    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28b57994-0cab-4771-a72a-b3e276fb811d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:13:52.623547 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.623504    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/28b57994-0cab-4771-a72a-b3e276fb811d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:13:52.624171 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.624147    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/28b57994-0cab-4771-a72a-b3e276fb811d-web-config\") pod \"alertmanager-main-0\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:13:52.624394 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.624369    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/28b57994-0cab-4771-a72a-b3e276fb811d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:13:52.624733 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.624708    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/28b57994-0cab-4771-a72a-b3e276fb811d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:13:52.625282 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.625240    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/28b57994-0cab-4771-a72a-b3e276fb811d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:13:52.626038 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.625995    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/28b57994-0cab-4771-a72a-b3e276fb811d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:13:52.626644 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.626620    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/28b57994-0cab-4771-a72a-b3e276fb811d-config-out\") pod \"alertmanager-main-0\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:13:52.626898 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.626877    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/28b57994-0cab-4771-a72a-b3e276fb811d-config-volume\") pod \"alertmanager-main-0\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:13:52.632392 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:52.632367    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlqd7\" (UniqueName: \"kubernetes.io/projected/28b57994-0cab-4771-a72a-b3e276fb811d-kube-api-access-wlqd7\") pod \"alertmanager-main-0\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:13:52.711000 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:13:52.710788    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59b13f02_28aa_40a1_bd27_813b56fbfc86.slice/crio-e3fcd72ee31222b937c937db6f99949317f77c333b99fedaba76830f2cca4825 WatchSource:0}: Error finding container e3fcd72ee31222b937c937db6f99949317f77c333b99fedaba76830f2cca4825: Status 404 returned error can't find the container with id e3fcd72ee31222b937c937db6f99949317f77c333b99fedaba76830f2cca4825
Jul 29 01:13:53.123874 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:53.123837    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/28b57994-0cab-4771-a72a-b3e276fb811d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:13:53.126259 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:53.126237    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/28b57994-0cab-4771-a72a-b3e276fb811d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:13:53.183916 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:53.183878    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:53.302994 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:53.302938    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:53.312843 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:53.312810    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:13:53.360229 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:53.360193    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:53.493913 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:53.493811    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 29 01:13:53.496438 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:13:53.496412    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28b57994_0cab_4771_a72a_b3e276fb811d.slice/crio-8a04fc029d61b84afd1f5e3b89b0570fff1027dc6d4a1e1d855fd1eaaf6e3200 WatchSource:0}: Error finding container 8a04fc029d61b84afd1f5e3b89b0570fff1027dc6d4a1e1d855fd1eaaf6e3200: Status 404 returned error can't find the container with id 8a04fc029d61b84afd1f5e3b89b0570fff1027dc6d4a1e1d855fd1eaaf6e3200
Jul 29 01:13:53.521889 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:53.521605    2580 generic.go:356] "Generic (PLEG): container finished" podID="9d972976-65f8-43de-82a8-accd5fa57ec7" containerID="066ad0ecbcc0c11c1808138b02dda61969c17d98f146936d7709eb953bef3b47" exitCode=0
Jul 29 01:13:53.521889 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:53.521687    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7bc76" event={"ID":"9d972976-65f8-43de-82a8-accd5fa57ec7","Type":"ContainerDied","Data":"066ad0ecbcc0c11c1808138b02dda61969c17d98f146936d7709eb953bef3b47"}
Jul 29 01:13:53.526577 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:53.525155    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-785cb497c6-t5kvd" event={"ID":"59b13f02-28aa-40a1-bd27-813b56fbfc86","Type":"ContainerStarted","Data":"e3fcd72ee31222b937c937db6f99949317f77c333b99fedaba76830f2cca4825"}
Jul 29 01:13:53.528015 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:53.527920    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-79wzl" event={"ID":"ea98c435-63e1-4b9b-b451-8013f67695e5","Type":"ContainerStarted","Data":"85743b2aa1077c337b9509519279407c92f2c6033eaa0d64b3698031722ba96f"}
Jul 29 01:13:53.530296 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:53.530223    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"28b57994-0cab-4771-a72a-b3e276fb811d","Type":"ContainerStarted","Data":"8a04fc029d61b84afd1f5e3b89b0570fff1027dc6d4a1e1d855fd1eaaf6e3200"}
Jul 29 01:13:54.223009 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:54.222966    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:54.283542 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:54.283410    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:54.284409 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:54.284375    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-556f954dcc-h2l27"]
Jul 29 01:13:54.288284 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:54.288264    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-556f954dcc-h2l27"
Jul 29 01:13:54.292987 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:54.292478    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 29 01:13:54.292987 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:54.292703    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-15elahq43dvnv\""
Jul 29 01:13:54.292987 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:54.292879    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 29 01:13:54.292987 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:54.292971    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 29 01:13:54.293238 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:54.293196    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 29 01:13:54.293540 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:54.293384    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-26hzs\""
Jul 29 01:13:54.293540 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:54.293462    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 29 01:13:54.301842 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:54.301798    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-556f954dcc-h2l27"]
Jul 29 01:13:54.434325 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:54.433913    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8cmk\" (UniqueName: \"kubernetes.io/projected/041860ba-c9b7-4a72-a526-187b513c9a6e-kube-api-access-j8cmk\") pod \"thanos-querier-556f954dcc-h2l27\" (UID: \"041860ba-c9b7-4a72-a526-187b513c9a6e\") " pod="openshift-monitoring/thanos-querier-556f954dcc-h2l27"
Jul 29 01:13:54.434325 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:54.433989    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/041860ba-c9b7-4a72-a526-187b513c9a6e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-556f954dcc-h2l27\" (UID: \"041860ba-c9b7-4a72-a526-187b513c9a6e\") " pod="openshift-monitoring/thanos-querier-556f954dcc-h2l27"
Jul 29 01:13:54.434325 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:54.434026    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/041860ba-c9b7-4a72-a526-187b513c9a6e-secret-grpc-tls\") pod \"thanos-querier-556f954dcc-h2l27\" (UID: \"041860ba-c9b7-4a72-a526-187b513c9a6e\") " pod="openshift-monitoring/thanos-querier-556f954dcc-h2l27"
Jul 29 01:13:54.435043 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:54.434766    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/041860ba-c9b7-4a72-a526-187b513c9a6e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-556f954dcc-h2l27\" (UID: \"041860ba-c9b7-4a72-a526-187b513c9a6e\") " pod="openshift-monitoring/thanos-querier-556f954dcc-h2l27"
Jul 29 01:13:54.435043 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:54.434811    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/041860ba-c9b7-4a72-a526-187b513c9a6e-secret-thanos-querier-tls\") pod \"thanos-querier-556f954dcc-h2l27\" (UID: \"041860ba-c9b7-4a72-a526-187b513c9a6e\") " pod="openshift-monitoring/thanos-querier-556f954dcc-h2l27"
Jul 29 01:13:54.435043 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:54.434844    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/041860ba-c9b7-4a72-a526-187b513c9a6e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-556f954dcc-h2l27\" (UID: \"041860ba-c9b7-4a72-a526-187b513c9a6e\") " pod="openshift-monitoring/thanos-querier-556f954dcc-h2l27"
Jul 29 01:13:54.435043 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:54.434873    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/041860ba-c9b7-4a72-a526-187b513c9a6e-metrics-client-ca\") pod \"thanos-querier-556f954dcc-h2l27\" (UID: \"041860ba-c9b7-4a72-a526-187b513c9a6e\") " pod="openshift-monitoring/thanos-querier-556f954dcc-h2l27"
Jul 29 01:13:54.435043 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:54.434903    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/041860ba-c9b7-4a72-a526-187b513c9a6e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-556f954dcc-h2l27\" (UID: \"041860ba-c9b7-4a72-a526-187b513c9a6e\") " pod="openshift-monitoring/thanos-querier-556f954dcc-h2l27"
Jul 29 01:13:54.459559 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:54.459514    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:54.536285 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:54.536192    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/041860ba-c9b7-4a72-a526-187b513c9a6e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-556f954dcc-h2l27\" (UID: \"041860ba-c9b7-4a72-a526-187b513c9a6e\") " pod="openshift-monitoring/thanos-querier-556f954dcc-h2l27"
Jul 29 01:13:54.536285 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:54.536232    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/041860ba-c9b7-4a72-a526-187b513c9a6e-secret-thanos-querier-tls\") pod \"thanos-querier-556f954dcc-h2l27\" (UID: \"041860ba-c9b7-4a72-a526-187b513c9a6e\") " pod="openshift-monitoring/thanos-querier-556f954dcc-h2l27"
Jul 29 01:13:54.536285 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:54.536259    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/041860ba-c9b7-4a72-a526-187b513c9a6e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-556f954dcc-h2l27\" (UID: \"041860ba-c9b7-4a72-a526-187b513c9a6e\") " pod="openshift-monitoring/thanos-querier-556f954dcc-h2l27"
Jul 29 01:13:54.536617 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:54.536288    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/041860ba-c9b7-4a72-a526-187b513c9a6e-metrics-client-ca\") pod \"thanos-querier-556f954dcc-h2l27\" (UID: \"041860ba-c9b7-4a72-a526-187b513c9a6e\") " pod="openshift-monitoring/thanos-querier-556f954dcc-h2l27"
Jul 29 01:13:54.536617 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:54.536318    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/041860ba-c9b7-4a72-a526-187b513c9a6e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-556f954dcc-h2l27\" (UID: \"041860ba-c9b7-4a72-a526-187b513c9a6e\") " pod="openshift-monitoring/thanos-querier-556f954dcc-h2l27"
Jul 29 01:13:54.536617 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:54.536359    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8cmk\" (UniqueName: \"kubernetes.io/projected/041860ba-c9b7-4a72-a526-187b513c9a6e-kube-api-access-j8cmk\") pod \"thanos-querier-556f954dcc-h2l27\" (UID: \"041860ba-c9b7-4a72-a526-187b513c9a6e\") " pod="openshift-monitoring/thanos-querier-556f954dcc-h2l27"
Jul 29 01:13:54.536617 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:54.536394    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/041860ba-c9b7-4a72-a526-187b513c9a6e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-556f954dcc-h2l27\" (UID: \"041860ba-c9b7-4a72-a526-187b513c9a6e\") " pod="openshift-monitoring/thanos-querier-556f954dcc-h2l27"
Jul 29 01:13:54.536617 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:54.536420    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/041860ba-c9b7-4a72-a526-187b513c9a6e-secret-grpc-tls\") pod \"thanos-querier-556f954dcc-h2l27\" (UID: \"041860ba-c9b7-4a72-a526-187b513c9a6e\") " pod="openshift-monitoring/thanos-querier-556f954dcc-h2l27"
Jul 29 01:13:54.538431 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:54.538174    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/041860ba-c9b7-4a72-a526-187b513c9a6e-metrics-client-ca\") pod \"thanos-querier-556f954dcc-h2l27\" (UID: \"041860ba-c9b7-4a72-a526-187b513c9a6e\") " pod="openshift-monitoring/thanos-querier-556f954dcc-h2l27"
Jul 29 01:13:54.540849 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:54.539761    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/041860ba-c9b7-4a72-a526-187b513c9a6e-secret-grpc-tls\") pod \"thanos-querier-556f954dcc-h2l27\" (UID: \"041860ba-c9b7-4a72-a526-187b513c9a6e\") " pod="openshift-monitoring/thanos-querier-556f954dcc-h2l27"
Jul 29 01:13:54.541530 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:54.541491    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/041860ba-c9b7-4a72-a526-187b513c9a6e-secret-thanos-querier-tls\") pod \"thanos-querier-556f954dcc-h2l27\" (UID: \"041860ba-c9b7-4a72-a526-187b513c9a6e\") " pod="openshift-monitoring/thanos-querier-556f954dcc-h2l27"
Jul 29 01:13:54.541618 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:54.541567    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/041860ba-c9b7-4a72-a526-187b513c9a6e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-556f954dcc-h2l27\" (UID: \"041860ba-c9b7-4a72-a526-187b513c9a6e\") " pod="openshift-monitoring/thanos-querier-556f954dcc-h2l27"
Jul 29 01:13:54.542278 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:54.542019    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/041860ba-c9b7-4a72-a526-187b513c9a6e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-556f954dcc-h2l27\" (UID: \"041860ba-c9b7-4a72-a526-187b513c9a6e\") " pod="openshift-monitoring/thanos-querier-556f954dcc-h2l27"
Jul 29 01:13:54.542278 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:54.542227    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/041860ba-c9b7-4a72-a526-187b513c9a6e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-556f954dcc-h2l27\" (UID: \"041860ba-c9b7-4a72-a526-187b513c9a6e\") " pod="openshift-monitoring/thanos-querier-556f954dcc-h2l27"
Jul 29 01:13:54.542684 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:54.542656    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-79wzl" event={"ID":"ea98c435-63e1-4b9b-b451-8013f67695e5","Type":"ContainerStarted","Data":"5c9415f45140a13221987206fd48724bb926320b00f3c604a571c1354c1dbb85"}
Jul 29 01:13:54.544294 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:54.544254    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/041860ba-c9b7-4a72-a526-187b513c9a6e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-556f954dcc-h2l27\" (UID: \"041860ba-c9b7-4a72-a526-187b513c9a6e\") " pod="openshift-monitoring/thanos-querier-556f954dcc-h2l27"
Jul 29 01:13:54.545346 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:54.545317    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7bc76" event={"ID":"9d972976-65f8-43de-82a8-accd5fa57ec7","Type":"ContainerStarted","Data":"03bd70a535ccec9cc8ba1e5fef5f4d148c0489eb51969c1a0f5d4ffef1c09871"}
Jul 29 01:13:54.545435 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:54.545366    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7bc76" event={"ID":"9d972976-65f8-43de-82a8-accd5fa57ec7","Type":"ContainerStarted","Data":"d200ce559199705595ea65c8c41af30b75d9fe30a45b62624a4400932f8af63e"}
Jul 29 01:13:54.549487 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:54.549467    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8cmk\" (UniqueName: \"kubernetes.io/projected/041860ba-c9b7-4a72-a526-187b513c9a6e-kube-api-access-j8cmk\") pod \"thanos-querier-556f954dcc-h2l27\" (UID: \"041860ba-c9b7-4a72-a526-187b513c9a6e\") " pod="openshift-monitoring/thanos-querier-556f954dcc-h2l27"
Jul 29 01:13:54.562016 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:54.561881    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-79wzl" podStartSLOduration=2.326817431 podStartE2EDuration="3.561863069s" totalImagesPullingTime="1.235045638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:13:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:54.559901712 +0000 UTC m=+84.872294421" watchObservedRunningTime="2026-07-29 01:13:54.561863069 +0000 UTC m=+84.874255777"
Jul 29 01:13:54.577556 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:54.577493    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7bc76" podStartSLOduration=2.398762948 podStartE2EDuration="3.577479917s" totalImagesPullingTime="1.103537971s" totalInitContainerRuntime="75.178998ms" isStatefulPod=true podCreationTimestamp="2026-07-29 01:13:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:54.576640276 +0000 UTC m=+84.889032986" watchObservedRunningTime="2026-07-29 01:13:54.577479917 +0000 UTC m=+84.889872626"
Jul 29 01:13:54.606266 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:54.606138    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-556f954dcc-h2l27"
Jul 29 01:13:54.646069 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:54.645972    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:54.712440 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:54.712405    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:54.813391 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:54.813264    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:54.964401 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:54.964377    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-556f954dcc-h2l27"]
Jul 29 01:13:55.485338 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:55.485294    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cbv98"
Jul 29 01:13:55.607476 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:55.607442    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-66ff4d7657-7h92s"]
Jul 29 01:13:55.612537 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:55.612504    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-66ff4d7657-7h92s"
Jul 29 01:13:55.615264 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:55.615066    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-frdh5\""
Jul 29 01:13:55.615264 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:55.615106    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-ac8v4t5so7rv7\""
Jul 29 01:13:55.615264 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:55.615261    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 29 01:13:55.615508 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:55.615262    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 29 01:13:55.615662 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:55.615506    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 29 01:13:55.615662 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:55.615514    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 29 01:13:55.619688 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:55.619662    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-66ff4d7657-7h92s"]
Jul 29 01:13:55.749207 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:55.749114    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3694d390-7790-4db6-8df9-d04a820a99c6-metrics-server-audit-profiles\") pod \"metrics-server-66ff4d7657-7h92s\" (UID: \"3694d390-7790-4db6-8df9-d04a820a99c6\") " pod="openshift-monitoring/metrics-server-66ff4d7657-7h92s"
Jul 29 01:13:55.749373 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:55.749203    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3694d390-7790-4db6-8df9-d04a820a99c6-secret-metrics-server-client-certs\") pod \"metrics-server-66ff4d7657-7h92s\" (UID: \"3694d390-7790-4db6-8df9-d04a820a99c6\") " pod="openshift-monitoring/metrics-server-66ff4d7657-7h92s"
Jul 29 01:13:55.749466 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:55.749252    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3694d390-7790-4db6-8df9-d04a820a99c6-audit-log\") pod \"metrics-server-66ff4d7657-7h92s\" (UID: \"3694d390-7790-4db6-8df9-d04a820a99c6\") " pod="openshift-monitoring/metrics-server-66ff4d7657-7h92s"
Jul 29 01:13:55.751564 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:55.749712    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3694d390-7790-4db6-8df9-d04a820a99c6-client-ca-bundle\") pod \"metrics-server-66ff4d7657-7h92s\" (UID: \"3694d390-7790-4db6-8df9-d04a820a99c6\") " pod="openshift-monitoring/metrics-server-66ff4d7657-7h92s"
Jul 29 01:13:55.751564 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:55.750045    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3694d390-7790-4db6-8df9-d04a820a99c6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-66ff4d7657-7h92s\" (UID: \"3694d390-7790-4db6-8df9-d04a820a99c6\") " pod="openshift-monitoring/metrics-server-66ff4d7657-7h92s"
Jul 29 01:13:55.751564 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:55.750132    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66pn2\" (UniqueName: \"kubernetes.io/projected/3694d390-7790-4db6-8df9-d04a820a99c6-kube-api-access-66pn2\") pod \"metrics-server-66ff4d7657-7h92s\" (UID: \"3694d390-7790-4db6-8df9-d04a820a99c6\") " pod="openshift-monitoring/metrics-server-66ff4d7657-7h92s"
Jul 29 01:13:55.751564 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:55.750229    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3694d390-7790-4db6-8df9-d04a820a99c6-secret-metrics-server-tls\") pod \"metrics-server-66ff4d7657-7h92s\" (UID: \"3694d390-7790-4db6-8df9-d04a820a99c6\") " pod="openshift-monitoring/metrics-server-66ff4d7657-7h92s"
Jul 29 01:13:55.851420 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:55.851385    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3694d390-7790-4db6-8df9-d04a820a99c6-metrics-server-audit-profiles\") pod \"metrics-server-66ff4d7657-7h92s\" (UID: \"3694d390-7790-4db6-8df9-d04a820a99c6\") " pod="openshift-monitoring/metrics-server-66ff4d7657-7h92s"
Jul 29 01:13:55.851602 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:55.851453    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3694d390-7790-4db6-8df9-d04a820a99c6-secret-metrics-server-client-certs\") pod \"metrics-server-66ff4d7657-7h92s\" (UID: \"3694d390-7790-4db6-8df9-d04a820a99c6\") " pod="openshift-monitoring/metrics-server-66ff4d7657-7h92s"
Jul 29 01:13:55.851602 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:55.851489    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3694d390-7790-4db6-8df9-d04a820a99c6-audit-log\") pod \"metrics-server-66ff4d7657-7h92s\" (UID: \"3694d390-7790-4db6-8df9-d04a820a99c6\") " pod="openshift-monitoring/metrics-server-66ff4d7657-7h92s"
Jul 29 01:13:55.851602 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:55.851510    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3694d390-7790-4db6-8df9-d04a820a99c6-client-ca-bundle\") pod \"metrics-server-66ff4d7657-7h92s\" (UID: \"3694d390-7790-4db6-8df9-d04a820a99c6\") " pod="openshift-monitoring/metrics-server-66ff4d7657-7h92s"
Jul 29 01:13:55.851602 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:55.851539    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3694d390-7790-4db6-8df9-d04a820a99c6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-66ff4d7657-7h92s\" (UID: \"3694d390-7790-4db6-8df9-d04a820a99c6\") " pod="openshift-monitoring/metrics-server-66ff4d7657-7h92s"
Jul 29 01:13:55.851602 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:55.851576    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66pn2\" (UniqueName: \"kubernetes.io/projected/3694d390-7790-4db6-8df9-d04a820a99c6-kube-api-access-66pn2\") pod \"metrics-server-66ff4d7657-7h92s\" (UID: \"3694d390-7790-4db6-8df9-d04a820a99c6\") " pod="openshift-monitoring/metrics-server-66ff4d7657-7h92s"
Jul 29 01:13:55.851861 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:55.851610    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3694d390-7790-4db6-8df9-d04a820a99c6-secret-metrics-server-tls\") pod \"metrics-server-66ff4d7657-7h92s\" (UID: \"3694d390-7790-4db6-8df9-d04a820a99c6\") " pod="openshift-monitoring/metrics-server-66ff4d7657-7h92s"
Jul 29 01:13:55.852541 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:55.852490    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3694d390-7790-4db6-8df9-d04a820a99c6-metrics-server-audit-profiles\") pod \"metrics-server-66ff4d7657-7h92s\" (UID: \"3694d390-7790-4db6-8df9-d04a820a99c6\") " pod="openshift-monitoring/metrics-server-66ff4d7657-7h92s"
Jul 29 01:13:55.852674 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:55.852609    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3694d390-7790-4db6-8df9-d04a820a99c6-audit-log\") pod \"metrics-server-66ff4d7657-7h92s\" (UID: \"3694d390-7790-4db6-8df9-d04a820a99c6\") " pod="openshift-monitoring/metrics-server-66ff4d7657-7h92s"
Jul 29 01:13:55.852870 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:55.852846    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3694d390-7790-4db6-8df9-d04a820a99c6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-66ff4d7657-7h92s\" (UID: \"3694d390-7790-4db6-8df9-d04a820a99c6\") " pod="openshift-monitoring/metrics-server-66ff4d7657-7h92s"
Jul 29 01:13:55.854854 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:55.854827    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3694d390-7790-4db6-8df9-d04a820a99c6-secret-metrics-server-client-certs\") pod \"metrics-server-66ff4d7657-7h92s\" (UID: \"3694d390-7790-4db6-8df9-d04a820a99c6\") " pod="openshift-monitoring/metrics-server-66ff4d7657-7h92s"
Jul 29 01:13:55.855277 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:55.855256    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3694d390-7790-4db6-8df9-d04a820a99c6-client-ca-bundle\") pod \"metrics-server-66ff4d7657-7h92s\" (UID: \"3694d390-7790-4db6-8df9-d04a820a99c6\") " pod="openshift-monitoring/metrics-server-66ff4d7657-7h92s"
Jul 29 01:13:55.857413 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:55.857392    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3694d390-7790-4db6-8df9-d04a820a99c6-secret-metrics-server-tls\") pod \"metrics-server-66ff4d7657-7h92s\" (UID: \"3694d390-7790-4db6-8df9-d04a820a99c6\") " pod="openshift-monitoring/metrics-server-66ff4d7657-7h92s"
Jul 29 01:13:55.861012 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:55.860994    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66pn2\" (UniqueName: \"kubernetes.io/projected/3694d390-7790-4db6-8df9-d04a820a99c6-kube-api-access-66pn2\") pod \"metrics-server-66ff4d7657-7h92s\" (UID: \"3694d390-7790-4db6-8df9-d04a820a99c6\") " pod="openshift-monitoring/metrics-server-66ff4d7657-7h92s"
Jul 29 01:13:55.926090 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:55.926054    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-66ff4d7657-7h92s"
Jul 29 01:13:56.076178 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:56.076074    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:56.123262 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:13:56.123223    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod041860ba_c9b7_4a72_a526_187b513c9a6e.slice/crio-aae98c581fb9dcd662bace2cb8a18f2592602d96c00b37c2a46f40369ab05971 WatchSource:0}: Error finding container aae98c581fb9dcd662bace2cb8a18f2592602d96c00b37c2a46f40369ab05971: Status 404 returned error can't find the container with id aae98c581fb9dcd662bace2cb8a18f2592602d96c00b37c2a46f40369ab05971
Jul 29 01:13:56.130081 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:56.130055    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:56.281693 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:56.281617    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-66ff4d7657-7h92s"]
Jul 29 01:13:56.294745 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:13:56.294714    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3694d390_7790_4db6_8df9_d04a820a99c6.slice/crio-cced9d9884826a6462eafc8c4329a87dd50982a36cc30b14a6e2849be93dc56b WatchSource:0}: Error finding container cced9d9884826a6462eafc8c4329a87dd50982a36cc30b14a6e2849be93dc56b: Status 404 returned error can't find the container with id cced9d9884826a6462eafc8c4329a87dd50982a36cc30b14a6e2849be93dc56b
Jul 29 01:13:56.429087 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:56.429054    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5d4684d768-95cff"
Jul 29 01:13:56.555872 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:56.555841    2580 generic.go:356] "Generic (PLEG): container finished" podID="28b57994-0cab-4771-a72a-b3e276fb811d" containerID="a967c9aae79be492c630f2d2c54ad135262a44b70ff061cc9ed29eec8c8e7564" exitCode=0
Jul 29 01:13:56.556309 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:56.555915    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"28b57994-0cab-4771-a72a-b3e276fb811d","Type":"ContainerDied","Data":"a967c9aae79be492c630f2d2c54ad135262a44b70ff061cc9ed29eec8c8e7564"}
Jul 29 01:13:56.557129 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:56.557094    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-66ff4d7657-7h92s" event={"ID":"3694d390-7790-4db6-8df9-d04a820a99c6","Type":"ContainerStarted","Data":"cced9d9884826a6462eafc8c4329a87dd50982a36cc30b14a6e2849be93dc56b"}
Jul 29 01:13:56.559141 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:56.559105    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-785cb497c6-t5kvd" event={"ID":"59b13f02-28aa-40a1-bd27-813b56fbfc86","Type":"ContainerStarted","Data":"696b3a781ab76188b2664ebe6a8e2d6e08a0508db975548016d58c4b46e2c01b"}
Jul 29 01:13:56.560682 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:56.560661    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-556f954dcc-h2l27" event={"ID":"041860ba-c9b7-4a72-a526-187b513c9a6e","Type":"ContainerStarted","Data":"aae98c581fb9dcd662bace2cb8a18f2592602d96c00b37c2a46f40369ab05971"}
Jul 29 01:13:56.617474 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:56.617418    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-785cb497c6-t5kvd" podStartSLOduration=2.137868981 podStartE2EDuration="5.617398742s" totalImagesPullingTime="3.479529761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:13:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:56.615561224 +0000 UTC m=+86.927953933" watchObservedRunningTime="2026-07-29 01:13:56.617398742 +0000 UTC m=+86.929791449"
Jul 29 01:13:56.672189 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:56.672151    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:56.739295 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:56.739200    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:57.278342 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.278178    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:57.338031 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.337982    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:57.537692 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.537483    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:57.545243 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.544120    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 01:13:57.553029 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.552438    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.555598 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.555576    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 29 01:13:57.556395 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.556373    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 29 01:13:57.556771 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.556603    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 29 01:13:57.556844 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.556786    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 29 01:13:57.556895 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.556873    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 29 01:13:57.557386 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.557200    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 29 01:13:57.557386 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.557211    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-qjwfh\""
Jul 29 01:13:57.558902 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.558871    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 29 01:13:57.559236 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.558995    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9omu9lc2gfnjr\""
Jul 29 01:13:57.559236 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.559121    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 29 01:13:57.559383 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.559291    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 29 01:13:57.559383 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.559314    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 29 01:13:57.561175 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.559705    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 29 01:13:57.561175 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.559837    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 29 01:13:57.561175 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.559975    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 29 01:13:57.561175 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.561048    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 29 01:13:57.562072 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.561931    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 01:13:57.668326 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.667611    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.668326 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.667669    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.668326 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.667701    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.668326 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.667732    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.668326 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.667769    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.668326 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.667804    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.668326 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.667833    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.668326 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.667866    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.668326 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.667888    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.668326 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.667937    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.668326 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.667980    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.668326 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.668004    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.668326 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.668130    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.668326 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.668191    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fxl2\" (UniqueName: \"kubernetes.io/projected/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-kube-api-access-7fxl2\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.669196 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.668379    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.669196 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.668437    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-config-out\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.669196 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.668463    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-web-config\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.669196 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.668503    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.669196 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.668607    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-config\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.669196 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.668639    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.769334 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.769288    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.769499 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.769344    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-config-out\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.769499 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.769368    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-web-config\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.769499 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.769394    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.769499 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.769420    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-config\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.769499 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.769443    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.769755 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.769502    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.769755 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.769536    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.769755 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.769595    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.769755 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.769625    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.769755 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.769664    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.769755 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.769732    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.770080 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.769761    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.770080 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.769795    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.770080 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.769819    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.770080 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.769852    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.770080 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.769874    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.770080 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.769895    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.770080 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.769922    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.770080 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.769963    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fxl2\" (UniqueName: \"kubernetes.io/projected/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-kube-api-access-7fxl2\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.773592 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.770643    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.773592 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.770743    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.773592 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.771438    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.773592 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.773400    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.775479 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.774164    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.775479 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.774450    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.775479 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.775228    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.781939 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.781894    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.782178 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.782154    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.786153 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.786105    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.788485 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.788412    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.788648 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.788605    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.789473 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.789431    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-config\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.793403 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.793378    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.793502 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.793411    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-web-config\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.793502 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.793422    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.793609 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.793546    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-config-out\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.794096 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.794009    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fxl2\" (UniqueName: \"kubernetes.io/projected/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-kube-api-access-7fxl2\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.794453 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.794412    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.795744 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.795719    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:13:57.873873 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:13:57.873554    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:01.119425 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:01.119381    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:01.218011 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:01.217975    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:02.298055 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:02.298013    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:02.333835 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:02.333805    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-785cb497c6-t5kvd"
Jul 29 01:14:02.334040 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:02.333980    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-785cb497c6-t5kvd"
Jul 29 01:14:02.339506 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:02.339482    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-785cb497c6-t5kvd"
Jul 29 01:14:02.358510 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:02.358481    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:02.603608 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:02.603515    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-785cb497c6-t5kvd"
Jul 29 01:14:04.019689 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:04.019627    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:04.116852 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:04.116806    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:04.171929 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:04.171874    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:04.793300 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:04.793259    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:04.894530 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:04.894498    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:07.910751 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:07.910718    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 01:14:08.220101 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:08.220064    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:08.320249 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:08.320186    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:08.626858 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:08.626820    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-4z2fj" event={"ID":"a11bee19-78af-4a9c-bb1e-3a89dccf1fe2","Type":"ContainerStarted","Data":"92883c065862851a3cbbd7b26edb518dce6e49d4731d76374f7eb8687640be72"}
Jul 29 01:14:08.627327 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:08.627299    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-4z2fj"
Jul 29 01:14:08.631002 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:08.630976    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"28b57994-0cab-4771-a72a-b3e276fb811d","Type":"ContainerStarted","Data":"54308475f221ddb83c6bbaa249bde83a5354e7594eee880aebb1469e43587502"}
Jul 29 01:14:08.631121 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:08.631047    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"28b57994-0cab-4771-a72a-b3e276fb811d","Type":"ContainerStarted","Data":"e77134849352c8197579fb2d265d4edc1db0cb1c7210772627a387e7c1b0d24c"}
Jul 29 01:14:08.631121 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:08.631096    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"28b57994-0cab-4771-a72a-b3e276fb811d","Type":"ContainerStarted","Data":"22c30b8b0918ce37a9fff3a43fa6f66c3e7a6bd5f87170a91a05771db1359715"}
Jul 29 01:14:08.631200 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:08.631136    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"28b57994-0cab-4771-a72a-b3e276fb811d","Type":"ContainerStarted","Data":"238274d7866dfea1c11ccf4862aab248d3e7ca9259d8c7c04ba53e5d36deac3f"}
Jul 29 01:14:08.631200 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:08.631172    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"28b57994-0cab-4771-a72a-b3e276fb811d","Type":"ContainerStarted","Data":"6991f43dddc2a12b70ceb8030dabc0dfc2c55fb268b0f80db30529219445394d"}
Jul 29 01:14:08.632830 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:08.632805    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-66ff4d7657-7h92s" event={"ID":"3694d390-7790-4db6-8df9-d04a820a99c6","Type":"ContainerStarted","Data":"e8b4bebb8eaf1ed333a3db9f11ef9c8a2c4ae5617e900a62c6874e3379baa72c"}
Jul 29 01:14:08.635661 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:08.635638    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-556f954dcc-h2l27" event={"ID":"041860ba-c9b7-4a72-a526-187b513c9a6e","Type":"ContainerStarted","Data":"52033a7530d2acb1b235a91e578339b68d9acf9387d70afd05b270925bc839c3"}
Jul 29 01:14:08.635763 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:08.635700    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-556f954dcc-h2l27" event={"ID":"041860ba-c9b7-4a72-a526-187b513c9a6e","Type":"ContainerStarted","Data":"7245a7fe33b7f1f16ecca84b6ad1456aae607c22667b436b10fc29cda4af810e"}
Jul 29 01:14:08.635763 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:08.635742    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-556f954dcc-h2l27" event={"ID":"041860ba-c9b7-4a72-a526-187b513c9a6e","Type":"ContainerStarted","Data":"aebdac73dc5156ef3f8fa8670ee4a57c6388d9852d2194a0e30bef08bd31d5d7"}
Jul 29 01:14:08.637584 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:08.637440    2580 generic.go:356] "Generic (PLEG): container finished" podID="01ec6c1d-3d8f-42c7-aefa-830d4643ac69" containerID="afa397e2a7873355ab58f748eda4c11bfdf6aa0164d6fe1f0f20a987b0c44fbb" exitCode=0
Jul 29 01:14:08.637584 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:08.637482    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"01ec6c1d-3d8f-42c7-aefa-830d4643ac69","Type":"ContainerDied","Data":"afa397e2a7873355ab58f748eda4c11bfdf6aa0164d6fe1f0f20a987b0c44fbb"}
Jul 29 01:14:08.637584 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:08.637536    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"01ec6c1d-3d8f-42c7-aefa-830d4643ac69","Type":"ContainerStarted","Data":"bab2d84c9372404f188b91ba85b102387bfb23840bbfbab9cf5d11ae3752f0e8"}
Jul 29 01:14:08.640066 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:08.640044    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-4z2fj"
Jul 29 01:14:08.647985 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:08.647884    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-4z2fj" podStartSLOduration=2.236717579 podStartE2EDuration="23.647866533s" totalImagesPullingTime="21.411148954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:13:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:14:08.645766302 +0000 UTC m=+98.958159033" watchObservedRunningTime="2026-07-29 01:14:08.647866533 +0000 UTC m=+98.960259242"
Jul 29 01:14:10.448179 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:10.448094    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:10.544527 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:10.544485    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:10.653245 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:10.653202    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"28b57994-0cab-4771-a72a-b3e276fb811d","Type":"ContainerStarted","Data":"bbbf078d586565125df00b0f20c28b45487ad03110978daea241b99a84165131"}
Jul 29 01:14:10.657464 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:10.657436    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-556f954dcc-h2l27" event={"ID":"041860ba-c9b7-4a72-a526-187b513c9a6e","Type":"ContainerStarted","Data":"60dd1b3e88c99c684fd081005c162b6282047bbe3aa0e2f849bb881568e23ed9"}
Jul 29 01:14:10.657614 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:10.657505    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-556f954dcc-h2l27" event={"ID":"041860ba-c9b7-4a72-a526-187b513c9a6e","Type":"ContainerStarted","Data":"ce2ca50c0fa79e9bad86f7448c4ea6bd0d877ac9604cad151bcb5de46751138e"}
Jul 29 01:14:10.657614 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:10.657544    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-556f954dcc-h2l27" event={"ID":"041860ba-c9b7-4a72-a526-187b513c9a6e","Type":"ContainerStarted","Data":"0a71ce60714cce300713c80b4030574d11478a5f18b91ae9c05d3555549c5d07"}
Jul 29 01:14:10.683605 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:10.683553    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.17022928 podStartE2EDuration="18.683537778s" totalImagesPullingTime="15.488954458s" totalInitContainerRuntime="24.35404ms" isStatefulPod=false podCreationTimestamp="2026-07-29 01:13:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:14:10.681793218 +0000 UTC m=+100.994185945" watchObservedRunningTime="2026-07-29 01:14:10.683537778 +0000 UTC m=+100.995930482"
Jul 29 01:14:10.684983 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:10.684768    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-66ff4d7657-7h92s" podStartSLOduration=4.22011817 podStartE2EDuration="15.684752106s" totalImagesPullingTime="11.464633936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:13:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:14:08.716653185 +0000 UTC m=+99.029045895" watchObservedRunningTime="2026-07-29 01:14:10.684752106 +0000 UTC m=+100.997144816"
Jul 29 01:14:11.320676 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:11.320637    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:11.422133 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:11.422092    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:11.664042 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:11.664008    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-556f954dcc-h2l27"
Jul 29 01:14:13.680149 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:13.680114    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"01ec6c1d-3d8f-42c7-aefa-830d4643ac69","Type":"ContainerStarted","Data":"9d6df6592037157e93b0099d0829efda71649baf79ee2becd5fa1645629d5405"}
Jul 29 01:14:13.680433 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:13.680207    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"01ec6c1d-3d8f-42c7-aefa-830d4643ac69","Type":"ContainerStarted","Data":"1e74b8886947966e2e944f7e1a65fb69aef26b4c6d056dcebf11e585096e9622"}
Jul 29 01:14:13.680433 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:13.680255    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"01ec6c1d-3d8f-42c7-aefa-830d4643ac69","Type":"ContainerStarted","Data":"c0cb698ded213d2e1eaf89bfa1483aaab1e1ace8c6e509ebcfb3ca1689e32ec7"}
Jul 29 01:14:13.939100 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:13.939067    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:14.038287 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:14.038206    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:14.136272 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:14.136239    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:14.689981 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:14.689926    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"01ec6c1d-3d8f-42c7-aefa-830d4643ac69","Type":"ContainerStarted","Data":"a5b984c362007da0c61f17a8b7edc54616b051376fac48443e5f460567a527ff"}
Jul 29 01:14:14.690393 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:14.690029    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"01ec6c1d-3d8f-42c7-aefa-830d4643ac69","Type":"ContainerStarted","Data":"9eb8bd16fe609de41bffd49628279dde5ef130ae2c7d33b74cc6180cd3e09214"}
Jul 29 01:14:14.690393 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:14.690075    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"01ec6c1d-3d8f-42c7-aefa-830d4643ac69","Type":"ContainerStarted","Data":"5673e93192badb68d7f462d5b788509f92299752cd6eba2502ca55413411b2a7"}
Jul 29 01:14:14.726055 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:14.725894    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-556f954dcc-h2l27" podStartSLOduration=7.215841832 podStartE2EDuration="20.725843618s" totalImagesPullingTime="13.510001786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:13:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:14:10.709847027 +0000 UTC m=+101.022239764" watchObservedRunningTime="2026-07-29 01:14:14.725843618 +0000 UTC m=+105.038236327"
Jul 29 01:14:14.727679 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:14.727630    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=13.135123902 podStartE2EDuration="17.727616051s" totalImagesPullingTime="4.576318895s" totalInitContainerRuntime="16.173254ms" isStatefulPod=false podCreationTimestamp="2026-07-29 01:13:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:14:14.724087824 +0000 UTC m=+105.036480534" watchObservedRunningTime="2026-07-29 01:14:14.727616051 +0000 UTC m=+105.040008761"
Jul 29 01:14:14.755053 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:14.755032    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-785cb497c6-t5kvd"]
Jul 29 01:14:15.926768 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:15.926730    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-66ff4d7657-7h92s"
Jul 29 01:14:15.927251 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:15.926805    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-66ff4d7657-7h92s"
Jul 29 01:14:16.120149 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:16.120112    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:16.171804 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:16.171769    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:16.486064 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:16.486035    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7k5r4"
Jul 29 01:14:17.679146 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:17.679115    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-556f954dcc-h2l27"
Jul 29 01:14:17.874119 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:17.874084    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:19.127767 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:19.127730    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:19.224428 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:19.224392    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:19.328665 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:19.328631    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:21.022887 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:21.022846    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:21.073334 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:21.073296    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:31.119653 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:31.119539    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:31.183475 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:31.183440    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:35.931784 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:35.931754    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-66ff4d7657-7h92s"
Jul 29 01:14:35.935354 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:35.935332    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-66ff4d7657-7h92s"
Jul 29 01:14:39.778087 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:39.778036    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-785cb497c6-t5kvd" podUID="59b13f02-28aa-40a1-bd27-813b56fbfc86" containerName="console" containerID="cri-o://696b3a781ab76188b2664ebe6a8e2d6e08a0508db975548016d58c4b46e2c01b" gracePeriod=15
Jul 29 01:14:40.021645 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:40.021622    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-785cb497c6-t5kvd"
Jul 29 01:14:40.159332 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:40.159305    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59b13f02-28aa-40a1-bd27-813b56fbfc86-oauth-serving-cert\") pod \"59b13f02-28aa-40a1-bd27-813b56fbfc86\" (UID: \"59b13f02-28aa-40a1-bd27-813b56fbfc86\") "
Jul 29 01:14:40.159511 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:40.159351    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6d662\" (UniqueName: \"kubernetes.io/projected/59b13f02-28aa-40a1-bd27-813b56fbfc86-kube-api-access-6d662\") pod \"59b13f02-28aa-40a1-bd27-813b56fbfc86\" (UID: \"59b13f02-28aa-40a1-bd27-813b56fbfc86\") "
Jul 29 01:14:40.159511 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:40.159376    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59b13f02-28aa-40a1-bd27-813b56fbfc86-console-serving-cert\") pod \"59b13f02-28aa-40a1-bd27-813b56fbfc86\" (UID: \"59b13f02-28aa-40a1-bd27-813b56fbfc86\") "
Jul 29 01:14:40.159511 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:40.159496    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59b13f02-28aa-40a1-bd27-813b56fbfc86-console-config\") pod \"59b13f02-28aa-40a1-bd27-813b56fbfc86\" (UID: \"59b13f02-28aa-40a1-bd27-813b56fbfc86\") "
Jul 29 01:14:40.159685 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:40.159538    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59b13f02-28aa-40a1-bd27-813b56fbfc86-service-ca\") pod \"59b13f02-28aa-40a1-bd27-813b56fbfc86\" (UID: \"59b13f02-28aa-40a1-bd27-813b56fbfc86\") "
Jul 29 01:14:40.159685 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:40.159578    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59b13f02-28aa-40a1-bd27-813b56fbfc86-console-oauth-config\") pod \"59b13f02-28aa-40a1-bd27-813b56fbfc86\" (UID: \"59b13f02-28aa-40a1-bd27-813b56fbfc86\") "
Jul 29 01:14:40.159873 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:40.159844    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59b13f02-28aa-40a1-bd27-813b56fbfc86-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "59b13f02-28aa-40a1-bd27-813b56fbfc86" (UID: "59b13f02-28aa-40a1-bd27-813b56fbfc86"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:14:40.159926 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:40.159850    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59b13f02-28aa-40a1-bd27-813b56fbfc86-console-config" (OuterVolumeSpecName: "console-config") pod "59b13f02-28aa-40a1-bd27-813b56fbfc86" (UID: "59b13f02-28aa-40a1-bd27-813b56fbfc86"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:14:40.159980 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:40.159921    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59b13f02-28aa-40a1-bd27-813b56fbfc86-service-ca" (OuterVolumeSpecName: "service-ca") pod "59b13f02-28aa-40a1-bd27-813b56fbfc86" (UID: "59b13f02-28aa-40a1-bd27-813b56fbfc86"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:14:40.161608 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:40.161578    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59b13f02-28aa-40a1-bd27-813b56fbfc86-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "59b13f02-28aa-40a1-bd27-813b56fbfc86" (UID: "59b13f02-28aa-40a1-bd27-813b56fbfc86"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:14:40.161608 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:40.161602    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59b13f02-28aa-40a1-bd27-813b56fbfc86-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "59b13f02-28aa-40a1-bd27-813b56fbfc86" (UID: "59b13f02-28aa-40a1-bd27-813b56fbfc86"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:14:40.161746 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:40.161640    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59b13f02-28aa-40a1-bd27-813b56fbfc86-kube-api-access-6d662" (OuterVolumeSpecName: "kube-api-access-6d662") pod "59b13f02-28aa-40a1-bd27-813b56fbfc86" (UID: "59b13f02-28aa-40a1-bd27-813b56fbfc86"). InnerVolumeSpecName "kube-api-access-6d662". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:14:40.260641 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:40.260604    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59b13f02-28aa-40a1-bd27-813b56fbfc86-oauth-serving-cert\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:14:40.260641 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:40.260636    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6d662\" (UniqueName: \"kubernetes.io/projected/59b13f02-28aa-40a1-bd27-813b56fbfc86-kube-api-access-6d662\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:14:40.260821 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:40.260650    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59b13f02-28aa-40a1-bd27-813b56fbfc86-console-serving-cert\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:14:40.260821 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:40.260662    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59b13f02-28aa-40a1-bd27-813b56fbfc86-console-config\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:14:40.260821 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:40.260674    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59b13f02-28aa-40a1-bd27-813b56fbfc86-service-ca\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:14:40.260821 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:40.260685    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59b13f02-28aa-40a1-bd27-813b56fbfc86-console-oauth-config\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:14:40.799170 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:40.799132    2580 generic.go:356] "Generic (PLEG): container finished" podID="59b13f02-28aa-40a1-bd27-813b56fbfc86" containerID="696b3a781ab76188b2664ebe6a8e2d6e08a0508db975548016d58c4b46e2c01b" exitCode=0
Jul 29 01:14:40.799649 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:40.799195    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-785cb497c6-t5kvd"
Jul 29 01:14:40.799649 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:40.799219    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-785cb497c6-t5kvd" event={"ID":"59b13f02-28aa-40a1-bd27-813b56fbfc86","Type":"ContainerDied","Data":"696b3a781ab76188b2664ebe6a8e2d6e08a0508db975548016d58c4b46e2c01b"}
Jul 29 01:14:40.799649 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:40.799321    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-785cb497c6-t5kvd" event={"ID":"59b13f02-28aa-40a1-bd27-813b56fbfc86","Type":"ContainerDied","Data":"e3fcd72ee31222b937c937db6f99949317f77c333b99fedaba76830f2cca4825"}
Jul 29 01:14:40.799649 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:40.799365    2580 scope.go:117] "RemoveContainer" containerID="696b3a781ab76188b2664ebe6a8e2d6e08a0508db975548016d58c4b46e2c01b"
Jul 29 01:14:40.807730 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:40.807711    2580 scope.go:117] "RemoveContainer" containerID="696b3a781ab76188b2664ebe6a8e2d6e08a0508db975548016d58c4b46e2c01b"
Jul 29 01:14:40.807996 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:14:40.807976    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"696b3a781ab76188b2664ebe6a8e2d6e08a0508db975548016d58c4b46e2c01b\": container with ID starting with 696b3a781ab76188b2664ebe6a8e2d6e08a0508db975548016d58c4b46e2c01b not found: ID does not exist" containerID="696b3a781ab76188b2664ebe6a8e2d6e08a0508db975548016d58c4b46e2c01b"
Jul 29 01:14:40.808086 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:40.808003    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"696b3a781ab76188b2664ebe6a8e2d6e08a0508db975548016d58c4b46e2c01b"} err="failed to get container status \"696b3a781ab76188b2664ebe6a8e2d6e08a0508db975548016d58c4b46e2c01b\": rpc error: code = NotFound desc = could not find container \"696b3a781ab76188b2664ebe6a8e2d6e08a0508db975548016d58c4b46e2c01b\": container with ID starting with 696b3a781ab76188b2664ebe6a8e2d6e08a0508db975548016d58c4b46e2c01b not found: ID does not exist"
Jul 29 01:14:40.819024 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:40.819003    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-785cb497c6-t5kvd"]
Jul 29 01:14:40.827503 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:40.827476    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-785cb497c6-t5kvd"]
Jul 29 01:14:42.169519 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:42.169488    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59b13f02-28aa-40a1-bd27-813b56fbfc86" path="/var/lib/kubelet/pods/59b13f02-28aa-40a1-bd27-813b56fbfc86/volumes"
Jul 29 01:14:57.874558 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:57.874520    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:57.929322 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:57.929293    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:58.888242 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:14:58.888211    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:07.353402 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:07.353362    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:07.454072 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:07.454037    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:11.588480 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:11.588446    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 29 01:15:11.588893 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:11.588722    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="28b57994-0cab-4771-a72a-b3e276fb811d" containerName="alertmanager" containerID="cri-o://6991f43dddc2a12b70ceb8030dabc0dfc2c55fb268b0f80db30529219445394d" gracePeriod=120
Jul 29 01:15:11.588893 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:11.588815    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="28b57994-0cab-4771-a72a-b3e276fb811d" containerName="config-reloader" containerID="cri-o://238274d7866dfea1c11ccf4862aab248d3e7ca9259d8c7c04ba53e5d36deac3f" gracePeriod=120
Jul 29 01:15:11.588893 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:11.588812    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="28b57994-0cab-4771-a72a-b3e276fb811d" containerName="kube-rbac-proxy-metric" containerID="cri-o://54308475f221ddb83c6bbaa249bde83a5354e7594eee880aebb1469e43587502" gracePeriod=120
Jul 29 01:15:11.588893 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:11.588871    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="28b57994-0cab-4771-a72a-b3e276fb811d" containerName="prom-label-proxy" containerID="cri-o://bbbf078d586565125df00b0f20c28b45487ad03110978daea241b99a84165131" gracePeriod=120
Jul 29 01:15:11.589175 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:11.588813    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="28b57994-0cab-4771-a72a-b3e276fb811d" containerName="kube-rbac-proxy-web" containerID="cri-o://22c30b8b0918ce37a9fff3a43fa6f66c3e7a6bd5f87170a91a05771db1359715" gracePeriod=120
Jul 29 01:15:11.589175 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:11.588850    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="28b57994-0cab-4771-a72a-b3e276fb811d" containerName="kube-rbac-proxy" containerID="cri-o://e77134849352c8197579fb2d265d4edc1db0cb1c7210772627a387e7c1b0d24c" gracePeriod=120
Jul 29 01:15:11.927569 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:11.927538    2580 generic.go:356] "Generic (PLEG): container finished" podID="28b57994-0cab-4771-a72a-b3e276fb811d" containerID="bbbf078d586565125df00b0f20c28b45487ad03110978daea241b99a84165131" exitCode=0
Jul 29 01:15:11.927569 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:11.927566    2580 generic.go:356] "Generic (PLEG): container finished" podID="28b57994-0cab-4771-a72a-b3e276fb811d" containerID="e77134849352c8197579fb2d265d4edc1db0cb1c7210772627a387e7c1b0d24c" exitCode=0
Jul 29 01:15:11.927569 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:11.927572    2580 generic.go:356] "Generic (PLEG): container finished" podID="28b57994-0cab-4771-a72a-b3e276fb811d" containerID="238274d7866dfea1c11ccf4862aab248d3e7ca9259d8c7c04ba53e5d36deac3f" exitCode=0
Jul 29 01:15:11.927569 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:11.927578    2580 generic.go:356] "Generic (PLEG): container finished" podID="28b57994-0cab-4771-a72a-b3e276fb811d" containerID="6991f43dddc2a12b70ceb8030dabc0dfc2c55fb268b0f80db30529219445394d" exitCode=0
Jul 29 01:15:11.927813 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:11.927607    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"28b57994-0cab-4771-a72a-b3e276fb811d","Type":"ContainerDied","Data":"bbbf078d586565125df00b0f20c28b45487ad03110978daea241b99a84165131"}
Jul 29 01:15:11.927813 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:11.927702    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"28b57994-0cab-4771-a72a-b3e276fb811d","Type":"ContainerDied","Data":"e77134849352c8197579fb2d265d4edc1db0cb1c7210772627a387e7c1b0d24c"}
Jul 29 01:15:11.927813 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:11.927728    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"28b57994-0cab-4771-a72a-b3e276fb811d","Type":"ContainerDied","Data":"238274d7866dfea1c11ccf4862aab248d3e7ca9259d8c7c04ba53e5d36deac3f"}
Jul 29 01:15:11.927813 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:11.927752    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"28b57994-0cab-4771-a72a-b3e276fb811d","Type":"ContainerDied","Data":"6991f43dddc2a12b70ceb8030dabc0dfc2c55fb268b0f80db30529219445394d"}
Jul 29 01:15:12.841841 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.841820    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:12.935101 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.935017    2580 generic.go:356] "Generic (PLEG): container finished" podID="28b57994-0cab-4771-a72a-b3e276fb811d" containerID="54308475f221ddb83c6bbaa249bde83a5354e7594eee880aebb1469e43587502" exitCode=0
Jul 29 01:15:12.935101 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.935040    2580 generic.go:356] "Generic (PLEG): container finished" podID="28b57994-0cab-4771-a72a-b3e276fb811d" containerID="22c30b8b0918ce37a9fff3a43fa6f66c3e7a6bd5f87170a91a05771db1359715" exitCode=0
Jul 29 01:15:12.935101 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.935075    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"28b57994-0cab-4771-a72a-b3e276fb811d","Type":"ContainerDied","Data":"54308475f221ddb83c6bbaa249bde83a5354e7594eee880aebb1469e43587502"}
Jul 29 01:15:12.935293 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.935122    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:12.935293 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.935160    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"28b57994-0cab-4771-a72a-b3e276fb811d","Type":"ContainerDied","Data":"22c30b8b0918ce37a9fff3a43fa6f66c3e7a6bd5f87170a91a05771db1359715"}
Jul 29 01:15:12.935293 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.935190    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"28b57994-0cab-4771-a72a-b3e276fb811d","Type":"ContainerDied","Data":"8a04fc029d61b84afd1f5e3b89b0570fff1027dc6d4a1e1d855fd1eaaf6e3200"}
Jul 29 01:15:12.935293 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.935226    2580 scope.go:117] "RemoveContainer" containerID="bbbf078d586565125df00b0f20c28b45487ad03110978daea241b99a84165131"
Jul 29 01:15:12.942855 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.942839    2580 scope.go:117] "RemoveContainer" containerID="54308475f221ddb83c6bbaa249bde83a5354e7594eee880aebb1469e43587502"
Jul 29 01:15:12.949358 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.949343    2580 scope.go:117] "RemoveContainer" containerID="e77134849352c8197579fb2d265d4edc1db0cb1c7210772627a387e7c1b0d24c"
Jul 29 01:15:12.954431 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.954408    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28b57994-0cab-4771-a72a-b3e276fb811d-metrics-client-ca\") pod \"28b57994-0cab-4771-a72a-b3e276fb811d\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") "
Jul 29 01:15:12.954534 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.954447    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/28b57994-0cab-4771-a72a-b3e276fb811d-config-volume\") pod \"28b57994-0cab-4771-a72a-b3e276fb811d\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") "
Jul 29 01:15:12.954534 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.954466    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/28b57994-0cab-4771-a72a-b3e276fb811d-alertmanager-main-db\") pod \"28b57994-0cab-4771-a72a-b3e276fb811d\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") "
Jul 29 01:15:12.954534 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.954482    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wlqd7\" (UniqueName: \"kubernetes.io/projected/28b57994-0cab-4771-a72a-b3e276fb811d-kube-api-access-wlqd7\") pod \"28b57994-0cab-4771-a72a-b3e276fb811d\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") "
Jul 29 01:15:12.954534 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.954502    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/28b57994-0cab-4771-a72a-b3e276fb811d-cluster-tls-config\") pod \"28b57994-0cab-4771-a72a-b3e276fb811d\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") "
Jul 29 01:15:12.954534 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.954527    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/28b57994-0cab-4771-a72a-b3e276fb811d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"28b57994-0cab-4771-a72a-b3e276fb811d\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") "
Jul 29 01:15:12.954782 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.954564    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/28b57994-0cab-4771-a72a-b3e276fb811d-secret-alertmanager-kube-rbac-proxy-web\") pod \"28b57994-0cab-4771-a72a-b3e276fb811d\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") "
Jul 29 01:15:12.954782 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.954593    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/28b57994-0cab-4771-a72a-b3e276fb811d-secret-alertmanager-main-tls\") pod \"28b57994-0cab-4771-a72a-b3e276fb811d\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") "
Jul 29 01:15:12.954782 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.954641    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/28b57994-0cab-4771-a72a-b3e276fb811d-tls-assets\") pod \"28b57994-0cab-4771-a72a-b3e276fb811d\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") "
Jul 29 01:15:12.954782 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.954672    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28b57994-0cab-4771-a72a-b3e276fb811d-alertmanager-trusted-ca-bundle\") pod \"28b57994-0cab-4771-a72a-b3e276fb811d\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") "
Jul 29 01:15:12.954782 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.954743    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/28b57994-0cab-4771-a72a-b3e276fb811d-secret-alertmanager-kube-rbac-proxy\") pod \"28b57994-0cab-4771-a72a-b3e276fb811d\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") "
Jul 29 01:15:12.955067 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.954776    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28b57994-0cab-4771-a72a-b3e276fb811d-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "28b57994-0cab-4771-a72a-b3e276fb811d" (UID: "28b57994-0cab-4771-a72a-b3e276fb811d"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:15:12.955067 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.954802    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/28b57994-0cab-4771-a72a-b3e276fb811d-config-out\") pod \"28b57994-0cab-4771-a72a-b3e276fb811d\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") "
Jul 29 01:15:12.955067 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.954832    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/28b57994-0cab-4771-a72a-b3e276fb811d-web-config\") pod \"28b57994-0cab-4771-a72a-b3e276fb811d\" (UID: \"28b57994-0cab-4771-a72a-b3e276fb811d\") "
Jul 29 01:15:12.955232 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.955117    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28b57994-0cab-4771-a72a-b3e276fb811d-metrics-client-ca\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:15:12.955751 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.955706    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28b57994-0cab-4771-a72a-b3e276fb811d-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "28b57994-0cab-4771-a72a-b3e276fb811d" (UID: "28b57994-0cab-4771-a72a-b3e276fb811d"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:15:12.955901 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.955874    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28b57994-0cab-4771-a72a-b3e276fb811d-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "28b57994-0cab-4771-a72a-b3e276fb811d" (UID: "28b57994-0cab-4771-a72a-b3e276fb811d"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:15:12.956839 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.956819    2580 scope.go:117] "RemoveContainer" containerID="22c30b8b0918ce37a9fff3a43fa6f66c3e7a6bd5f87170a91a05771db1359715"
Jul 29 01:15:12.958052 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.957940    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28b57994-0cab-4771-a72a-b3e276fb811d-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "28b57994-0cab-4771-a72a-b3e276fb811d" (UID: "28b57994-0cab-4771-a72a-b3e276fb811d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:15:12.958585 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.958473    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28b57994-0cab-4771-a72a-b3e276fb811d-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "28b57994-0cab-4771-a72a-b3e276fb811d" (UID: "28b57994-0cab-4771-a72a-b3e276fb811d"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:15:12.958585 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.958531    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28b57994-0cab-4771-a72a-b3e276fb811d-config-volume" (OuterVolumeSpecName: "config-volume") pod "28b57994-0cab-4771-a72a-b3e276fb811d" (UID: "28b57994-0cab-4771-a72a-b3e276fb811d"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:15:12.958585 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.958540    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28b57994-0cab-4771-a72a-b3e276fb811d-kube-api-access-wlqd7" (OuterVolumeSpecName: "kube-api-access-wlqd7") pod "28b57994-0cab-4771-a72a-b3e276fb811d" (UID: "28b57994-0cab-4771-a72a-b3e276fb811d"). InnerVolumeSpecName "kube-api-access-wlqd7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:15:12.958585 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.958551    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28b57994-0cab-4771-a72a-b3e276fb811d-config-out" (OuterVolumeSpecName: "config-out") pod "28b57994-0cab-4771-a72a-b3e276fb811d" (UID: "28b57994-0cab-4771-a72a-b3e276fb811d"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:15:12.958942 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.958913    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28b57994-0cab-4771-a72a-b3e276fb811d-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "28b57994-0cab-4771-a72a-b3e276fb811d" (UID: "28b57994-0cab-4771-a72a-b3e276fb811d"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:15:12.959375 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.959351    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28b57994-0cab-4771-a72a-b3e276fb811d-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "28b57994-0cab-4771-a72a-b3e276fb811d" (UID: "28b57994-0cab-4771-a72a-b3e276fb811d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:15:12.960171 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.960150    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28b57994-0cab-4771-a72a-b3e276fb811d-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "28b57994-0cab-4771-a72a-b3e276fb811d" (UID: "28b57994-0cab-4771-a72a-b3e276fb811d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:15:12.962914 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.962720    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28b57994-0cab-4771-a72a-b3e276fb811d-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "28b57994-0cab-4771-a72a-b3e276fb811d" (UID: "28b57994-0cab-4771-a72a-b3e276fb811d"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:15:12.969588 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.969566    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28b57994-0cab-4771-a72a-b3e276fb811d-web-config" (OuterVolumeSpecName: "web-config") pod "28b57994-0cab-4771-a72a-b3e276fb811d" (UID: "28b57994-0cab-4771-a72a-b3e276fb811d"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:15:12.970281 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.970250    2580 scope.go:117] "RemoveContainer" containerID="238274d7866dfea1c11ccf4862aab248d3e7ca9259d8c7c04ba53e5d36deac3f"
Jul 29 01:15:12.976925 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.976908    2580 scope.go:117] "RemoveContainer" containerID="6991f43dddc2a12b70ceb8030dabc0dfc2c55fb268b0f80db30529219445394d"
Jul 29 01:15:12.983418 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.983399    2580 scope.go:117] "RemoveContainer" containerID="a967c9aae79be492c630f2d2c54ad135262a44b70ff061cc9ed29eec8c8e7564"
Jul 29 01:15:12.989745 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.989730    2580 scope.go:117] "RemoveContainer" containerID="bbbf078d586565125df00b0f20c28b45487ad03110978daea241b99a84165131"
Jul 29 01:15:12.989999 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:15:12.989960    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbbf078d586565125df00b0f20c28b45487ad03110978daea241b99a84165131\": container with ID starting with bbbf078d586565125df00b0f20c28b45487ad03110978daea241b99a84165131 not found: ID does not exist" containerID="bbbf078d586565125df00b0f20c28b45487ad03110978daea241b99a84165131"
Jul 29 01:15:12.990066 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.989992    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbbf078d586565125df00b0f20c28b45487ad03110978daea241b99a84165131"} err="failed to get container status \"bbbf078d586565125df00b0f20c28b45487ad03110978daea241b99a84165131\": rpc error: code = NotFound desc = could not find container \"bbbf078d586565125df00b0f20c28b45487ad03110978daea241b99a84165131\": container with ID starting with bbbf078d586565125df00b0f20c28b45487ad03110978daea241b99a84165131 not found: ID does not exist"
Jul 29 01:15:12.990066 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.990009    2580 scope.go:117] "RemoveContainer" containerID="54308475f221ddb83c6bbaa249bde83a5354e7594eee880aebb1469e43587502"
Jul 29 01:15:12.990248 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:15:12.990227    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54308475f221ddb83c6bbaa249bde83a5354e7594eee880aebb1469e43587502\": container with ID starting with 54308475f221ddb83c6bbaa249bde83a5354e7594eee880aebb1469e43587502 not found: ID does not exist" containerID="54308475f221ddb83c6bbaa249bde83a5354e7594eee880aebb1469e43587502"
Jul 29 01:15:12.990287 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.990253    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54308475f221ddb83c6bbaa249bde83a5354e7594eee880aebb1469e43587502"} err="failed to get container status \"54308475f221ddb83c6bbaa249bde83a5354e7594eee880aebb1469e43587502\": rpc error: code = NotFound desc = could not find container \"54308475f221ddb83c6bbaa249bde83a5354e7594eee880aebb1469e43587502\": container with ID starting with 54308475f221ddb83c6bbaa249bde83a5354e7594eee880aebb1469e43587502 not found: ID does not exist"
Jul 29 01:15:12.990287 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.990269    2580 scope.go:117] "RemoveContainer" containerID="e77134849352c8197579fb2d265d4edc1db0cb1c7210772627a387e7c1b0d24c"
Jul 29 01:15:12.990490 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:15:12.990471    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e77134849352c8197579fb2d265d4edc1db0cb1c7210772627a387e7c1b0d24c\": container with ID starting with e77134849352c8197579fb2d265d4edc1db0cb1c7210772627a387e7c1b0d24c not found: ID does not exist" containerID="e77134849352c8197579fb2d265d4edc1db0cb1c7210772627a387e7c1b0d24c"
Jul 29 01:15:12.990536 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.990496    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e77134849352c8197579fb2d265d4edc1db0cb1c7210772627a387e7c1b0d24c"} err="failed to get container status \"e77134849352c8197579fb2d265d4edc1db0cb1c7210772627a387e7c1b0d24c\": rpc error: code = NotFound desc = could not find container \"e77134849352c8197579fb2d265d4edc1db0cb1c7210772627a387e7c1b0d24c\": container with ID starting with e77134849352c8197579fb2d265d4edc1db0cb1c7210772627a387e7c1b0d24c not found: ID does not exist"
Jul 29 01:15:12.990536 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.990518    2580 scope.go:117] "RemoveContainer" containerID="22c30b8b0918ce37a9fff3a43fa6f66c3e7a6bd5f87170a91a05771db1359715"
Jul 29 01:15:12.990743 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:15:12.990727    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22c30b8b0918ce37a9fff3a43fa6f66c3e7a6bd5f87170a91a05771db1359715\": container with ID starting with 22c30b8b0918ce37a9fff3a43fa6f66c3e7a6bd5f87170a91a05771db1359715 not found: ID does not exist" containerID="22c30b8b0918ce37a9fff3a43fa6f66c3e7a6bd5f87170a91a05771db1359715"
Jul 29 01:15:12.990794 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.990745    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22c30b8b0918ce37a9fff3a43fa6f66c3e7a6bd5f87170a91a05771db1359715"} err="failed to get container status \"22c30b8b0918ce37a9fff3a43fa6f66c3e7a6bd5f87170a91a05771db1359715\": rpc error: code = NotFound desc = could not find container \"22c30b8b0918ce37a9fff3a43fa6f66c3e7a6bd5f87170a91a05771db1359715\": container with ID starting with 22c30b8b0918ce37a9fff3a43fa6f66c3e7a6bd5f87170a91a05771db1359715 not found: ID does not exist"
Jul 29 01:15:12.990794 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.990765    2580 scope.go:117] "RemoveContainer" containerID="238274d7866dfea1c11ccf4862aab248d3e7ca9259d8c7c04ba53e5d36deac3f"
Jul 29 01:15:12.990991 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:15:12.990973    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"238274d7866dfea1c11ccf4862aab248d3e7ca9259d8c7c04ba53e5d36deac3f\": container with ID starting with 238274d7866dfea1c11ccf4862aab248d3e7ca9259d8c7c04ba53e5d36deac3f not found: ID does not exist" containerID="238274d7866dfea1c11ccf4862aab248d3e7ca9259d8c7c04ba53e5d36deac3f"
Jul 29 01:15:12.991045 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.990994    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"238274d7866dfea1c11ccf4862aab248d3e7ca9259d8c7c04ba53e5d36deac3f"} err="failed to get container status \"238274d7866dfea1c11ccf4862aab248d3e7ca9259d8c7c04ba53e5d36deac3f\": rpc error: code = NotFound desc = could not find container \"238274d7866dfea1c11ccf4862aab248d3e7ca9259d8c7c04ba53e5d36deac3f\": container with ID starting with 238274d7866dfea1c11ccf4862aab248d3e7ca9259d8c7c04ba53e5d36deac3f not found: ID does not exist"
Jul 29 01:15:12.991045 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.991005    2580 scope.go:117] "RemoveContainer" containerID="6991f43dddc2a12b70ceb8030dabc0dfc2c55fb268b0f80db30529219445394d"
Jul 29 01:15:12.991211 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:15:12.991196    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6991f43dddc2a12b70ceb8030dabc0dfc2c55fb268b0f80db30529219445394d\": container with ID starting with 6991f43dddc2a12b70ceb8030dabc0dfc2c55fb268b0f80db30529219445394d not found: ID does not exist" containerID="6991f43dddc2a12b70ceb8030dabc0dfc2c55fb268b0f80db30529219445394d"
Jul 29 01:15:12.991247 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.991213    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6991f43dddc2a12b70ceb8030dabc0dfc2c55fb268b0f80db30529219445394d"} err="failed to get container status \"6991f43dddc2a12b70ceb8030dabc0dfc2c55fb268b0f80db30529219445394d\": rpc error: code = NotFound desc = could not find container \"6991f43dddc2a12b70ceb8030dabc0dfc2c55fb268b0f80db30529219445394d\": container with ID starting with 6991f43dddc2a12b70ceb8030dabc0dfc2c55fb268b0f80db30529219445394d not found: ID does not exist"
Jul 29 01:15:12.991247 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.991225    2580 scope.go:117] "RemoveContainer" containerID="a967c9aae79be492c630f2d2c54ad135262a44b70ff061cc9ed29eec8c8e7564"
Jul 29 01:15:12.991461 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:15:12.991443    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a967c9aae79be492c630f2d2c54ad135262a44b70ff061cc9ed29eec8c8e7564\": container with ID starting with a967c9aae79be492c630f2d2c54ad135262a44b70ff061cc9ed29eec8c8e7564 not found: ID does not exist" containerID="a967c9aae79be492c630f2d2c54ad135262a44b70ff061cc9ed29eec8c8e7564"
Jul 29 01:15:12.991525 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.991468    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a967c9aae79be492c630f2d2c54ad135262a44b70ff061cc9ed29eec8c8e7564"} err="failed to get container status \"a967c9aae79be492c630f2d2c54ad135262a44b70ff061cc9ed29eec8c8e7564\": rpc error: code = NotFound desc = could not find container \"a967c9aae79be492c630f2d2c54ad135262a44b70ff061cc9ed29eec8c8e7564\": container with ID starting with a967c9aae79be492c630f2d2c54ad135262a44b70ff061cc9ed29eec8c8e7564 not found: ID does not exist"
Jul 29 01:15:12.991525 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.991487    2580 scope.go:117] "RemoveContainer" containerID="bbbf078d586565125df00b0f20c28b45487ad03110978daea241b99a84165131"
Jul 29 01:15:12.991722 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.991704    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbbf078d586565125df00b0f20c28b45487ad03110978daea241b99a84165131"} err="failed to get container status \"bbbf078d586565125df00b0f20c28b45487ad03110978daea241b99a84165131\": rpc error: code = NotFound desc = could not find container \"bbbf078d586565125df00b0f20c28b45487ad03110978daea241b99a84165131\": container with ID starting with bbbf078d586565125df00b0f20c28b45487ad03110978daea241b99a84165131 not found: ID does not exist"
Jul 29 01:15:12.991786 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.991723    2580 scope.go:117] "RemoveContainer" containerID="54308475f221ddb83c6bbaa249bde83a5354e7594eee880aebb1469e43587502"
Jul 29 01:15:12.992034 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.991941    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54308475f221ddb83c6bbaa249bde83a5354e7594eee880aebb1469e43587502"} err="failed to get container status \"54308475f221ddb83c6bbaa249bde83a5354e7594eee880aebb1469e43587502\": rpc error: code = NotFound desc = could not find container \"54308475f221ddb83c6bbaa249bde83a5354e7594eee880aebb1469e43587502\": container with ID starting with 54308475f221ddb83c6bbaa249bde83a5354e7594eee880aebb1469e43587502 not found: ID does not exist"
Jul 29 01:15:12.992034 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.991978    2580 scope.go:117] "RemoveContainer" containerID="e77134849352c8197579fb2d265d4edc1db0cb1c7210772627a387e7c1b0d24c"
Jul 29 01:15:12.992200 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.992182    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e77134849352c8197579fb2d265d4edc1db0cb1c7210772627a387e7c1b0d24c"} err="failed to get container status \"e77134849352c8197579fb2d265d4edc1db0cb1c7210772627a387e7c1b0d24c\": rpc error: code = NotFound desc = could not find container \"e77134849352c8197579fb2d265d4edc1db0cb1c7210772627a387e7c1b0d24c\": container with ID starting with e77134849352c8197579fb2d265d4edc1db0cb1c7210772627a387e7c1b0d24c not found: ID does not exist"
Jul 29 01:15:12.992243 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.992201    2580 scope.go:117] "RemoveContainer" containerID="22c30b8b0918ce37a9fff3a43fa6f66c3e7a6bd5f87170a91a05771db1359715"
Jul 29 01:15:12.992423 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.992405    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22c30b8b0918ce37a9fff3a43fa6f66c3e7a6bd5f87170a91a05771db1359715"} err="failed to get container status \"22c30b8b0918ce37a9fff3a43fa6f66c3e7a6bd5f87170a91a05771db1359715\": rpc error: code = NotFound desc = could not find container \"22c30b8b0918ce37a9fff3a43fa6f66c3e7a6bd5f87170a91a05771db1359715\": container with ID starting with 22c30b8b0918ce37a9fff3a43fa6f66c3e7a6bd5f87170a91a05771db1359715 not found: ID does not exist"
Jul 29 01:15:12.992489 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.992424    2580 scope.go:117] "RemoveContainer" containerID="238274d7866dfea1c11ccf4862aab248d3e7ca9259d8c7c04ba53e5d36deac3f"
Jul 29 01:15:12.992635 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.992619    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"238274d7866dfea1c11ccf4862aab248d3e7ca9259d8c7c04ba53e5d36deac3f"} err="failed to get container status \"238274d7866dfea1c11ccf4862aab248d3e7ca9259d8c7c04ba53e5d36deac3f\": rpc error: code = NotFound desc = could not find container \"238274d7866dfea1c11ccf4862aab248d3e7ca9259d8c7c04ba53e5d36deac3f\": container with ID starting with 238274d7866dfea1c11ccf4862aab248d3e7ca9259d8c7c04ba53e5d36deac3f not found: ID does not exist"
Jul 29 01:15:12.992680 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.992636    2580 scope.go:117] "RemoveContainer" containerID="6991f43dddc2a12b70ceb8030dabc0dfc2c55fb268b0f80db30529219445394d"
Jul 29 01:15:12.992833 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.992816    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6991f43dddc2a12b70ceb8030dabc0dfc2c55fb268b0f80db30529219445394d"} err="failed to get container status \"6991f43dddc2a12b70ceb8030dabc0dfc2c55fb268b0f80db30529219445394d\": rpc error: code = NotFound desc = could not find container \"6991f43dddc2a12b70ceb8030dabc0dfc2c55fb268b0f80db30529219445394d\": container with ID starting with 6991f43dddc2a12b70ceb8030dabc0dfc2c55fb268b0f80db30529219445394d not found: ID does not exist"
Jul 29 01:15:12.992899 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.992834    2580 scope.go:117] "RemoveContainer" containerID="a967c9aae79be492c630f2d2c54ad135262a44b70ff061cc9ed29eec8c8e7564"
Jul 29 01:15:12.993051 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:12.993034    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a967c9aae79be492c630f2d2c54ad135262a44b70ff061cc9ed29eec8c8e7564"} err="failed to get container status \"a967c9aae79be492c630f2d2c54ad135262a44b70ff061cc9ed29eec8c8e7564\": rpc error: code = NotFound desc = could not find container \"a967c9aae79be492c630f2d2c54ad135262a44b70ff061cc9ed29eec8c8e7564\": container with ID starting with a967c9aae79be492c630f2d2c54ad135262a44b70ff061cc9ed29eec8c8e7564 not found: ID does not exist"
Jul 29 01:15:13.055593 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:13.055566    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/28b57994-0cab-4771-a72a-b3e276fb811d-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:15:13.055593 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:13.055590    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/28b57994-0cab-4771-a72a-b3e276fb811d-secret-alertmanager-main-tls\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:15:13.055732 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:13.055604    2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/28b57994-0cab-4771-a72a-b3e276fb811d-tls-assets\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:15:13.055732 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:13.055613    2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28b57994-0cab-4771-a72a-b3e276fb811d-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:15:13.055732 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:13.055622    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/28b57994-0cab-4771-a72a-b3e276fb811d-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:15:13.055732 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:13.055630    2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/28b57994-0cab-4771-a72a-b3e276fb811d-config-out\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:15:13.055732 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:13.055640    2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/28b57994-0cab-4771-a72a-b3e276fb811d-web-config\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:15:13.055732 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:13.055647    2580 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/28b57994-0cab-4771-a72a-b3e276fb811d-config-volume\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:15:13.055732 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:13.055654    2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/28b57994-0cab-4771-a72a-b3e276fb811d-alertmanager-main-db\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:15:13.055732 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:13.055662    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wlqd7\" (UniqueName: \"kubernetes.io/projected/28b57994-0cab-4771-a72a-b3e276fb811d-kube-api-access-wlqd7\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:15:13.055732 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:13.055670    2580 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/28b57994-0cab-4771-a72a-b3e276fb811d-cluster-tls-config\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:15:13.055732 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:13.055678    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/28b57994-0cab-4771-a72a-b3e276fb811d-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:15:13.258133 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:13.258108    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 29 01:15:13.262178 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:13.262155    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 29 01:15:14.169247 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:14.169219    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28b57994-0cab-4771-a72a-b3e276fb811d" path="/var/lib/kubelet/pods/28b57994-0cab-4771-a72a-b3e276fb811d/volumes"
Jul 29 01:15:14.424592 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:14.424505    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:14.479205 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:14.479173    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:15.806499 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:15.806468    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 01:15:15.806907 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:15.806791    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="01ec6c1d-3d8f-42c7-aefa-830d4643ac69" containerName="prometheus" containerID="cri-o://c0cb698ded213d2e1eaf89bfa1483aaab1e1ace8c6e509ebcfb3ca1689e32ec7" gracePeriod=600
Jul 29 01:15:15.806907 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:15.806806    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="01ec6c1d-3d8f-42c7-aefa-830d4643ac69" containerName="kube-rbac-proxy" containerID="cri-o://9eb8bd16fe609de41bffd49628279dde5ef130ae2c7d33b74cc6180cd3e09214" gracePeriod=600
Jul 29 01:15:15.806907 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:15.806831    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="01ec6c1d-3d8f-42c7-aefa-830d4643ac69" containerName="thanos-sidecar" containerID="cri-o://9d6df6592037157e93b0099d0829efda71649baf79ee2becd5fa1645629d5405" gracePeriod=600
Jul 29 01:15:15.806907 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:15.806877    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="01ec6c1d-3d8f-42c7-aefa-830d4643ac69" containerName="kube-rbac-proxy-thanos" containerID="cri-o://a5b984c362007da0c61f17a8b7edc54616b051376fac48443e5f460567a527ff" gracePeriod=600
Jul 29 01:15:15.807152 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:15.806929    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="01ec6c1d-3d8f-42c7-aefa-830d4643ac69" containerName="kube-rbac-proxy-web" containerID="cri-o://5673e93192badb68d7f462d5b788509f92299752cd6eba2502ca55413411b2a7" gracePeriod=600
Jul 29 01:15:15.807152 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:15.806960    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="01ec6c1d-3d8f-42c7-aefa-830d4643ac69" containerName="config-reloader" containerID="cri-o://1e74b8886947966e2e944f7e1a65fb69aef26b4c6d056dcebf11e585096e9622" gracePeriod=600
Jul 29 01:15:15.950728 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:15.950701    2580 generic.go:356] "Generic (PLEG): container finished" podID="01ec6c1d-3d8f-42c7-aefa-830d4643ac69" containerID="a5b984c362007da0c61f17a8b7edc54616b051376fac48443e5f460567a527ff" exitCode=0
Jul 29 01:15:15.950728 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:15.950724    2580 generic.go:356] "Generic (PLEG): container finished" podID="01ec6c1d-3d8f-42c7-aefa-830d4643ac69" containerID="9eb8bd16fe609de41bffd49628279dde5ef130ae2c7d33b74cc6180cd3e09214" exitCode=0
Jul 29 01:15:15.950905 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:15.950735    2580 generic.go:356] "Generic (PLEG): container finished" podID="01ec6c1d-3d8f-42c7-aefa-830d4643ac69" containerID="9d6df6592037157e93b0099d0829efda71649baf79ee2becd5fa1645629d5405" exitCode=0
Jul 29 01:15:15.950905 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:15.950745    2580 generic.go:356] "Generic (PLEG): container finished" podID="01ec6c1d-3d8f-42c7-aefa-830d4643ac69" containerID="1e74b8886947966e2e944f7e1a65fb69aef26b4c6d056dcebf11e585096e9622" exitCode=0
Jul 29 01:15:15.950905 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:15.950755    2580 generic.go:356] "Generic (PLEG): container finished" podID="01ec6c1d-3d8f-42c7-aefa-830d4643ac69" containerID="c0cb698ded213d2e1eaf89bfa1483aaab1e1ace8c6e509ebcfb3ca1689e32ec7" exitCode=0
Jul 29 01:15:15.950905 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:15.950769    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"01ec6c1d-3d8f-42c7-aefa-830d4643ac69","Type":"ContainerDied","Data":"a5b984c362007da0c61f17a8b7edc54616b051376fac48443e5f460567a527ff"}
Jul 29 01:15:15.950905 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:15.950833    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"01ec6c1d-3d8f-42c7-aefa-830d4643ac69","Type":"ContainerDied","Data":"9eb8bd16fe609de41bffd49628279dde5ef130ae2c7d33b74cc6180cd3e09214"}
Jul 29 01:15:15.950905 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:15.950858    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"01ec6c1d-3d8f-42c7-aefa-830d4643ac69","Type":"ContainerDied","Data":"9d6df6592037157e93b0099d0829efda71649baf79ee2becd5fa1645629d5405"}
Jul 29 01:15:15.950905 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:15.950882    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"01ec6c1d-3d8f-42c7-aefa-830d4643ac69","Type":"ContainerDied","Data":"1e74b8886947966e2e944f7e1a65fb69aef26b4c6d056dcebf11e585096e9622"}
Jul 29 01:15:15.950905 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:15.950904    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"01ec6c1d-3d8f-42c7-aefa-830d4643ac69","Type":"ContainerDied","Data":"c0cb698ded213d2e1eaf89bfa1483aaab1e1ace8c6e509ebcfb3ca1689e32ec7"}
Jul 29 01:15:16.959476 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:16.959442    2580 generic.go:356] "Generic (PLEG): container finished" podID="01ec6c1d-3d8f-42c7-aefa-830d4643ac69" containerID="5673e93192badb68d7f462d5b788509f92299752cd6eba2502ca55413411b2a7" exitCode=0
Jul 29 01:15:16.959818 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:16.959522    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"01ec6c1d-3d8f-42c7-aefa-830d4643ac69","Type":"ContainerDied","Data":"5673e93192badb68d7f462d5b788509f92299752cd6eba2502ca55413411b2a7"}
Jul 29 01:15:17.064294 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.064269    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:17.188378 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.188302    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-config-out\") pod \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") "
Jul 29 01:15:17.188378 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.188348    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-prometheus-k8s-rulefiles-1\") pod \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") "
Jul 29 01:15:17.188378 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.188375    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-secret-grpc-tls\") pod \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") "
Jul 29 01:15:17.188705 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.188399    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-web-config\") pod \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") "
Jul 29 01:15:17.188705 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.188423    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-prometheus-k8s-rulefiles-0\") pod \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") "
Jul 29 01:15:17.188705 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.188447    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-secret-kube-rbac-proxy\") pod \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") "
Jul 29 01:15:17.188705 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.188499    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-config\") pod \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") "
Jul 29 01:15:17.188705 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.188530    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-configmap-serving-certs-ca-bundle\") pod \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") "
Jul 29 01:15:17.188705 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.188555    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-secret-prometheus-k8s-tls\") pod \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") "
Jul 29 01:15:17.188705 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.188586    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-configmap-metrics-client-ca\") pod \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") "
Jul 29 01:15:17.188705 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.188609    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-prometheus-k8s-rulefiles-2\") pod \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") "
Jul 29 01:15:17.188705 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.188645    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") "
Jul 29 01:15:17.188705 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.188684    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-tls-assets\") pod \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") "
Jul 29 01:15:17.188705 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.188696    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "01ec6c1d-3d8f-42c7-aefa-830d4643ac69" (UID: "01ec6c1d-3d8f-42c7-aefa-830d4643ac69"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:15:17.189264 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.188719    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") "
Jul 29 01:15:17.189264 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.188746    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-thanos-prometheus-http-client-file\") pod \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") "
Jul 29 01:15:17.189264 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.188785    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-secret-metrics-client-certs\") pod \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") "
Jul 29 01:15:17.189264 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.188832    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-configmap-kubelet-serving-ca-bundle\") pod \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") "
Jul 29 01:15:17.189264 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.188877    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-prometheus-trusted-ca-bundle\") pod \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") "
Jul 29 01:15:17.189264 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.188910    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7fxl2\" (UniqueName: \"kubernetes.io/projected/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-kube-api-access-7fxl2\") pod \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") "
Jul 29 01:15:17.189264 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.188940    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-prometheus-k8s-db\") pod \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\" (UID: \"01ec6c1d-3d8f-42c7-aefa-830d4643ac69\") "
Jul 29 01:15:17.189264 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.189224    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:15:17.189662 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.189512    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "01ec6c1d-3d8f-42c7-aefa-830d4643ac69" (UID: "01ec6c1d-3d8f-42c7-aefa-830d4643ac69"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:15:17.190759 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.190039    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "01ec6c1d-3d8f-42c7-aefa-830d4643ac69" (UID: "01ec6c1d-3d8f-42c7-aefa-830d4643ac69"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:15:17.190759 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.190073    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "01ec6c1d-3d8f-42c7-aefa-830d4643ac69" (UID: "01ec6c1d-3d8f-42c7-aefa-830d4643ac69"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:15:17.190759 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.190417    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "01ec6c1d-3d8f-42c7-aefa-830d4643ac69" (UID: "01ec6c1d-3d8f-42c7-aefa-830d4643ac69"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:15:17.190759 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.190440    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "01ec6c1d-3d8f-42c7-aefa-830d4643ac69" (UID: "01ec6c1d-3d8f-42c7-aefa-830d4643ac69"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:15:17.191067 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.190818    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "01ec6c1d-3d8f-42c7-aefa-830d4643ac69" (UID: "01ec6c1d-3d8f-42c7-aefa-830d4643ac69"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:15:17.191067 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.190971    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "01ec6c1d-3d8f-42c7-aefa-830d4643ac69" (UID: "01ec6c1d-3d8f-42c7-aefa-830d4643ac69"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:15:17.192207 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.192056    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-config" (OuterVolumeSpecName: "config") pod "01ec6c1d-3d8f-42c7-aefa-830d4643ac69" (UID: "01ec6c1d-3d8f-42c7-aefa-830d4643ac69"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:15:17.192412 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.192372    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "01ec6c1d-3d8f-42c7-aefa-830d4643ac69" (UID: "01ec6c1d-3d8f-42c7-aefa-830d4643ac69"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:15:17.192741 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.192702    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-config-out" (OuterVolumeSpecName: "config-out") pod "01ec6c1d-3d8f-42c7-aefa-830d4643ac69" (UID: "01ec6c1d-3d8f-42c7-aefa-830d4643ac69"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:15:17.193370 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.193341    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "01ec6c1d-3d8f-42c7-aefa-830d4643ac69" (UID: "01ec6c1d-3d8f-42c7-aefa-830d4643ac69"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:15:17.193482 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.193352    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "01ec6c1d-3d8f-42c7-aefa-830d4643ac69" (UID: "01ec6c1d-3d8f-42c7-aefa-830d4643ac69"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:15:17.193482 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.193381    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "01ec6c1d-3d8f-42c7-aefa-830d4643ac69" (UID: "01ec6c1d-3d8f-42c7-aefa-830d4643ac69"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:15:17.193482 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.193027    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "01ec6c1d-3d8f-42c7-aefa-830d4643ac69" (UID: "01ec6c1d-3d8f-42c7-aefa-830d4643ac69"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:15:17.193482 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.193461    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "01ec6c1d-3d8f-42c7-aefa-830d4643ac69" (UID: "01ec6c1d-3d8f-42c7-aefa-830d4643ac69"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:15:17.193679 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.193660    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-kube-api-access-7fxl2" (OuterVolumeSpecName: "kube-api-access-7fxl2") pod "01ec6c1d-3d8f-42c7-aefa-830d4643ac69" (UID: "01ec6c1d-3d8f-42c7-aefa-830d4643ac69"). InnerVolumeSpecName "kube-api-access-7fxl2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:15:17.193770 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.193750    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "01ec6c1d-3d8f-42c7-aefa-830d4643ac69" (UID: "01ec6c1d-3d8f-42c7-aefa-830d4643ac69"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:15:17.194334 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.194319    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "01ec6c1d-3d8f-42c7-aefa-830d4643ac69" (UID: "01ec6c1d-3d8f-42c7-aefa-830d4643ac69"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:15:17.202630 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.202608    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-web-config" (OuterVolumeSpecName: "web-config") pod "01ec6c1d-3d8f-42c7-aefa-830d4643ac69" (UID: "01ec6c1d-3d8f-42c7-aefa-830d4643ac69"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:15:17.289794 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.289750    2580 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:15:17.289794 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.289788    2580 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-secret-metrics-client-certs\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:15:17.289794 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.289798    2580 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:15:17.289794 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.289808    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-prometheus-trusted-ca-bundle\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:15:17.290035 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.289818    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7fxl2\" (UniqueName: \"kubernetes.io/projected/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-kube-api-access-7fxl2\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:15:17.290035 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.289826    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-prometheus-k8s-db\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:15:17.290035 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.289835    2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-config-out\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:15:17.290035 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.289844    2580 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-secret-grpc-tls\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:15:17.290035 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.289852    2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-web-config\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:15:17.290035 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.289860    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:15:17.290035 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.289868    2580 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-secret-kube-rbac-proxy\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:15:17.290035 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.289877    2580 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-config\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:15:17.290035 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.289885    2580 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:15:17.290035 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.289894    2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-secret-prometheus-k8s-tls\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:15:17.290035 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.289902    2580 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-configmap-metrics-client-ca\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:15:17.290035 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.289911    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:15:17.290035 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.289919    2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:15:17.290035 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.289928    2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-tls-assets\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:15:17.290035 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.289936    2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/01ec6c1d-3d8f-42c7-aefa-830d4643ac69-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:15:17.966903 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.966869    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"01ec6c1d-3d8f-42c7-aefa-830d4643ac69","Type":"ContainerDied","Data":"bab2d84c9372404f188b91ba85b102387bfb23840bbfbab9cf5d11ae3752f0e8"}
Jul 29 01:15:17.966903 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.966894    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:17.967423 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.966960    2580 scope.go:117] "RemoveContainer" containerID="a5b984c362007da0c61f17a8b7edc54616b051376fac48443e5f460567a527ff"
Jul 29 01:15:17.974711 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.974691    2580 scope.go:117] "RemoveContainer" containerID="9eb8bd16fe609de41bffd49628279dde5ef130ae2c7d33b74cc6180cd3e09214"
Jul 29 01:15:17.981360 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.981344    2580 scope.go:117] "RemoveContainer" containerID="5673e93192badb68d7f462d5b788509f92299752cd6eba2502ca55413411b2a7"
Jul 29 01:15:17.988134 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.988118    2580 scope.go:117] "RemoveContainer" containerID="9d6df6592037157e93b0099d0829efda71649baf79ee2becd5fa1645629d5405"
Jul 29 01:15:17.990520 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.990501    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 01:15:17.995432 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.995414    2580 scope.go:117] "RemoveContainer" containerID="1e74b8886947966e2e944f7e1a65fb69aef26b4c6d056dcebf11e585096e9622"
Jul 29 01:15:17.997269 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:17.997249    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 01:15:18.001791 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.001775    2580 scope.go:117] "RemoveContainer" containerID="c0cb698ded213d2e1eaf89bfa1483aaab1e1ace8c6e509ebcfb3ca1689e32ec7"
Jul 29 01:15:18.008772 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.008756    2580 scope.go:117] "RemoveContainer" containerID="afa397e2a7873355ab58f748eda4c11bfdf6aa0164d6fe1f0f20a987b0c44fbb"
Jul 29 01:15:18.020888 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.020869    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 01:15:18.021169 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.021156    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28b57994-0cab-4771-a72a-b3e276fb811d" containerName="config-reloader"
Jul 29 01:15:18.021220 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.021171    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="28b57994-0cab-4771-a72a-b3e276fb811d" containerName="config-reloader"
Jul 29 01:15:18.021220 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.021179    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28b57994-0cab-4771-a72a-b3e276fb811d" containerName="kube-rbac-proxy-web"
Jul 29 01:15:18.021220 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.021185    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="28b57994-0cab-4771-a72a-b3e276fb811d" containerName="kube-rbac-proxy-web"
Jul 29 01:15:18.021220 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.021196    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01ec6c1d-3d8f-42c7-aefa-830d4643ac69" containerName="kube-rbac-proxy-thanos"
Jul 29 01:15:18.021220 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.021201    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="01ec6c1d-3d8f-42c7-aefa-830d4643ac69" containerName="kube-rbac-proxy-thanos"
Jul 29 01:15:18.021220 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.021208    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01ec6c1d-3d8f-42c7-aefa-830d4643ac69" containerName="config-reloader"
Jul 29 01:15:18.021220 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.021213    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="01ec6c1d-3d8f-42c7-aefa-830d4643ac69" containerName="config-reloader"
Jul 29 01:15:18.021220 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.021219    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01ec6c1d-3d8f-42c7-aefa-830d4643ac69" containerName="kube-rbac-proxy"
Jul 29 01:15:18.021450 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.021224    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="01ec6c1d-3d8f-42c7-aefa-830d4643ac69" containerName="kube-rbac-proxy"
Jul 29 01:15:18.021450 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.021232    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59b13f02-28aa-40a1-bd27-813b56fbfc86" containerName="console"
Jul 29 01:15:18.021450 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.021237    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="59b13f02-28aa-40a1-bd27-813b56fbfc86" containerName="console"
Jul 29 01:15:18.021450 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.021243    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28b57994-0cab-4771-a72a-b3e276fb811d" containerName="prom-label-proxy"
Jul 29 01:15:18.021450 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.021247    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="28b57994-0cab-4771-a72a-b3e276fb811d" containerName="prom-label-proxy"
Jul 29 01:15:18.021450 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.021253    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01ec6c1d-3d8f-42c7-aefa-830d4643ac69" containerName="thanos-sidecar"
Jul 29 01:15:18.021450 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.021259    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="01ec6c1d-3d8f-42c7-aefa-830d4643ac69" containerName="thanos-sidecar"
Jul 29 01:15:18.021450 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.021266    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28b57994-0cab-4771-a72a-b3e276fb811d" containerName="alertmanager"
Jul 29 01:15:18.021450 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.021271    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="28b57994-0cab-4771-a72a-b3e276fb811d" containerName="alertmanager"
Jul 29 01:15:18.021450 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.021279    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01ec6c1d-3d8f-42c7-aefa-830d4643ac69" containerName="init-config-reloader"
Jul 29 01:15:18.021450 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.021284    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="01ec6c1d-3d8f-42c7-aefa-830d4643ac69" containerName="init-config-reloader"
Jul 29 01:15:18.021450 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.021292    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01ec6c1d-3d8f-42c7-aefa-830d4643ac69" containerName="prometheus"
Jul 29 01:15:18.021450 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.021298    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="01ec6c1d-3d8f-42c7-aefa-830d4643ac69" containerName="prometheus"
Jul 29 01:15:18.021450 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.021304    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28b57994-0cab-4771-a72a-b3e276fb811d" containerName="init-config-reloader"
Jul 29 01:15:18.021450 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.021310    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="28b57994-0cab-4771-a72a-b3e276fb811d" containerName="init-config-reloader"
Jul 29 01:15:18.021450 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.021316    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28b57994-0cab-4771-a72a-b3e276fb811d" containerName="kube-rbac-proxy"
Jul 29 01:15:18.021450 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.021321    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="28b57994-0cab-4771-a72a-b3e276fb811d" containerName="kube-rbac-proxy"
Jul 29 01:15:18.021450 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.021327    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28b57994-0cab-4771-a72a-b3e276fb811d" containerName="kube-rbac-proxy-metric"
Jul 29 01:15:18.021450 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.021332    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="28b57994-0cab-4771-a72a-b3e276fb811d" containerName="kube-rbac-proxy-metric"
Jul 29 01:15:18.021450 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.021339    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01ec6c1d-3d8f-42c7-aefa-830d4643ac69" containerName="kube-rbac-proxy-web"
Jul 29 01:15:18.021450 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.021344    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="01ec6c1d-3d8f-42c7-aefa-830d4643ac69" containerName="kube-rbac-proxy-web"
Jul 29 01:15:18.021450 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.021387    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="28b57994-0cab-4771-a72a-b3e276fb811d" containerName="kube-rbac-proxy"
Jul 29 01:15:18.021450 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.021393    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="01ec6c1d-3d8f-42c7-aefa-830d4643ac69" containerName="thanos-sidecar"
Jul 29 01:15:18.021450 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.021399    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="28b57994-0cab-4771-a72a-b3e276fb811d" containerName="config-reloader"
Jul 29 01:15:18.021450 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.021407    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="01ec6c1d-3d8f-42c7-aefa-830d4643ac69" containerName="kube-rbac-proxy-thanos"
Jul 29 01:15:18.021450 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.021412    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="28b57994-0cab-4771-a72a-b3e276fb811d" containerName="alertmanager"
Jul 29 01:15:18.021450 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.021417    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="59b13f02-28aa-40a1-bd27-813b56fbfc86" containerName="console"
Jul 29 01:15:18.021450 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.021422    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="28b57994-0cab-4771-a72a-b3e276fb811d" containerName="kube-rbac-proxy-metric"
Jul 29 01:15:18.021450 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.021428    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="01ec6c1d-3d8f-42c7-aefa-830d4643ac69" containerName="prometheus"
Jul 29 01:15:18.021450 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.021432    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="28b57994-0cab-4771-a72a-b3e276fb811d" containerName="prom-label-proxy"
Jul 29 01:15:18.021450 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.021438    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="01ec6c1d-3d8f-42c7-aefa-830d4643ac69" containerName="config-reloader"
Jul 29 01:15:18.021450 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.021444    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="01ec6c1d-3d8f-42c7-aefa-830d4643ac69" containerName="kube-rbac-proxy-web"
Jul 29 01:15:18.021450 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.021449    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="28b57994-0cab-4771-a72a-b3e276fb811d" containerName="kube-rbac-proxy-web"
Jul 29 01:15:18.021450 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.021456    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="01ec6c1d-3d8f-42c7-aefa-830d4643ac69" containerName="kube-rbac-proxy"
Jul 29 01:15:18.027493 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.027477    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.030520 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.030503    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 29 01:15:18.030619 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.030569    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 29 01:15:18.030619 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.030607    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 29 01:15:18.031229 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.031214    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 29 01:15:18.031502 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.031482    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 29 01:15:18.031591 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.031543    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 29 01:15:18.031774 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.031757    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 29 01:15:18.031840 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.031785    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-qjwfh\""
Jul 29 01:15:18.031840 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.031827    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9omu9lc2gfnjr\""
Jul 29 01:15:18.032072 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.032056    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 29 01:15:18.032172 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.032155    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 29 01:15:18.032172 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.032166    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 29 01:15:18.032335 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.032319    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 29 01:15:18.033937 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.033905    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 29 01:15:18.035422 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.035403    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 29 01:15:18.038704 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.038688    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 29 01:15:18.047623 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.047258    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 01:15:18.096021 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.095987    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34179654-a04c-455b-8ec2-14c1171f838f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.096193 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.096026    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/34179654-a04c-455b-8ec2-14c1171f838f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.096193 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.096051    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/34179654-a04c-455b-8ec2-14c1171f838f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.096193 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.096075    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/34179654-a04c-455b-8ec2-14c1171f838f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.096193 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.096099    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34179654-a04c-455b-8ec2-14c1171f838f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.096193 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.096124    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/34179654-a04c-455b-8ec2-14c1171f838f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.096193 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.096147    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34179654-a04c-455b-8ec2-14c1171f838f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.096193 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.096169    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/34179654-a04c-455b-8ec2-14c1171f838f-config\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.096193 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.096190    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dp88s\" (UniqueName: \"kubernetes.io/projected/34179654-a04c-455b-8ec2-14c1171f838f-kube-api-access-dp88s\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.096501 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.096223    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/34179654-a04c-455b-8ec2-14c1171f838f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.096501 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.096248    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/34179654-a04c-455b-8ec2-14c1171f838f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.096501 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.096270    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/34179654-a04c-455b-8ec2-14c1171f838f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.096501 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.096287    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/34179654-a04c-455b-8ec2-14c1171f838f-web-config\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.096501 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.096311    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/34179654-a04c-455b-8ec2-14c1171f838f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.096501 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.096336    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/34179654-a04c-455b-8ec2-14c1171f838f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.096501 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.096365    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/34179654-a04c-455b-8ec2-14c1171f838f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.096501 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.096383    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34179654-a04c-455b-8ec2-14c1171f838f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.096501 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.096401    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/34179654-a04c-455b-8ec2-14c1171f838f-config-out\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.096501 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.096418    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/34179654-a04c-455b-8ec2-14c1171f838f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.096501 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.096462    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/34179654-a04c-455b-8ec2-14c1171f838f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.168412 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.168383    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01ec6c1d-3d8f-42c7-aefa-830d4643ac69" path="/var/lib/kubelet/pods/01ec6c1d-3d8f-42c7-aefa-830d4643ac69/volumes"
Jul 29 01:15:18.197739 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.197720    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/34179654-a04c-455b-8ec2-14c1171f838f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.197807 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.197746    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/34179654-a04c-455b-8ec2-14c1171f838f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.197807 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.197763    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/34179654-a04c-455b-8ec2-14c1171f838f-web-config\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.197807 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.197786    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/34179654-a04c-455b-8ec2-14c1171f838f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.197979 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.197815    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/34179654-a04c-455b-8ec2-14c1171f838f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.197979 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.197845    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/34179654-a04c-455b-8ec2-14c1171f838f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.197979 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.197872    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34179654-a04c-455b-8ec2-14c1171f838f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.197979 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.197905    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/34179654-a04c-455b-8ec2-14c1171f838f-config-out\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.197979 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.197929    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/34179654-a04c-455b-8ec2-14c1171f838f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.197979 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.197979    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/34179654-a04c-455b-8ec2-14c1171f838f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.198270 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.198005    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34179654-a04c-455b-8ec2-14c1171f838f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.198270 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.198039    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/34179654-a04c-455b-8ec2-14c1171f838f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.198270 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.198066    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/34179654-a04c-455b-8ec2-14c1171f838f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.198270 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.198094    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/34179654-a04c-455b-8ec2-14c1171f838f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.198270 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.198127    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34179654-a04c-455b-8ec2-14c1171f838f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.198270 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.198154    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/34179654-a04c-455b-8ec2-14c1171f838f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.198270 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.198179    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34179654-a04c-455b-8ec2-14c1171f838f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.198270 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.198203    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/34179654-a04c-455b-8ec2-14c1171f838f-config\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.198270 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.198226    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dp88s\" (UniqueName: \"kubernetes.io/projected/34179654-a04c-455b-8ec2-14c1171f838f-kube-api-access-dp88s\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.198270 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.198268    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/34179654-a04c-455b-8ec2-14c1171f838f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.198768 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.198476    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/34179654-a04c-455b-8ec2-14c1171f838f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.198768 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.198688    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/34179654-a04c-455b-8ec2-14c1171f838f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.199403 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.199380    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34179654-a04c-455b-8ec2-14c1171f838f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.201570 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.200941    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/34179654-a04c-455b-8ec2-14c1171f838f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.201570 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.201012    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/34179654-a04c-455b-8ec2-14c1171f838f-web-config\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.201570 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.201073    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/34179654-a04c-455b-8ec2-14c1171f838f-config-out\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.201570 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.201102    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/34179654-a04c-455b-8ec2-14c1171f838f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.201570 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.201153    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/34179654-a04c-455b-8ec2-14c1171f838f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.201570 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.201258    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/34179654-a04c-455b-8ec2-14c1171f838f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.201924 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.201682    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34179654-a04c-455b-8ec2-14c1171f838f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.201924 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.201705    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/34179654-a04c-455b-8ec2-14c1171f838f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.202351 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.202295    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/34179654-a04c-455b-8ec2-14c1171f838f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.202448 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.202390    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/34179654-a04c-455b-8ec2-14c1171f838f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.202448 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.202398    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34179654-a04c-455b-8ec2-14c1171f838f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.203295 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.203266    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34179654-a04c-455b-8ec2-14c1171f838f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.203429 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.203405    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/34179654-a04c-455b-8ec2-14c1171f838f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.203520 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.203498    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/34179654-a04c-455b-8ec2-14c1171f838f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.204087 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.204071    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/34179654-a04c-455b-8ec2-14c1171f838f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.204153 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.204133    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/34179654-a04c-455b-8ec2-14c1171f838f-config\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.210378 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.210357    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dp88s\" (UniqueName: \"kubernetes.io/projected/34179654-a04c-455b-8ec2-14c1171f838f-kube-api-access-dp88s\") pod \"prometheus-k8s-0\" (UID: \"34179654-a04c-455b-8ec2-14c1171f838f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.337905 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.337816    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:18.469139 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.469112    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 01:15:18.471001 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:15:18.470973    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34179654_a04c_455b_8ec2_14c1171f838f.slice/crio-6126e4b59d96cd1b7ed4de21182582dc94874fbf95875ab2588439c96d313ef9 WatchSource:0}: Error finding container 6126e4b59d96cd1b7ed4de21182582dc94874fbf95875ab2588439c96d313ef9: Status 404 returned error can't find the container with id 6126e4b59d96cd1b7ed4de21182582dc94874fbf95875ab2588439c96d313ef9
Jul 29 01:15:18.976040 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.976001    2580 generic.go:356] "Generic (PLEG): container finished" podID="34179654-a04c-455b-8ec2-14c1171f838f" containerID="52d27c425fb8dd9cbae85a164cac994fde9ac5aeb98c5ad56690519196dc1964" exitCode=0
Jul 29 01:15:18.976442 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.976078    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"34179654-a04c-455b-8ec2-14c1171f838f","Type":"ContainerDied","Data":"52d27c425fb8dd9cbae85a164cac994fde9ac5aeb98c5ad56690519196dc1964"}
Jul 29 01:15:18.976442 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:18.976169    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"34179654-a04c-455b-8ec2-14c1171f838f","Type":"ContainerStarted","Data":"6126e4b59d96cd1b7ed4de21182582dc94874fbf95875ab2588439c96d313ef9"}
Jul 29 01:15:19.380643 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:19.380608    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:19.481880 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:19.481797    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:19.986209 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:19.984722    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"34179654-a04c-455b-8ec2-14c1171f838f","Type":"ContainerStarted","Data":"cae06de440807b5b9fa4df56b5f04d59d9361178e1270f314ea953cc85ebf848"}
Jul 29 01:15:19.986209 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:19.984826    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"34179654-a04c-455b-8ec2-14c1171f838f","Type":"ContainerStarted","Data":"ba8c9190103d2688ba15c26650200c5afff30efcbcf65a4270b753a52d72f999"}
Jul 29 01:15:19.986209 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:19.984865    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"34179654-a04c-455b-8ec2-14c1171f838f","Type":"ContainerStarted","Data":"a187511a67095dcd63dfd3c99ee5a427c47a76b011ed9a3073660be290f5a133"}
Jul 29 01:15:19.986209 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:19.984914    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"34179654-a04c-455b-8ec2-14c1171f838f","Type":"ContainerStarted","Data":"2accf27bd3f9c26cb936a1fc899b775df72b4b660391608275fb16701e678af6"}
Jul 29 01:15:19.986209 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:19.984976    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"34179654-a04c-455b-8ec2-14c1171f838f","Type":"ContainerStarted","Data":"3770c027198dcc8823b6a1b9ff211705a0d7497e8eaf12786ec66234b1727477"}
Jul 29 01:15:19.986209 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:19.985013    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"34179654-a04c-455b-8ec2-14c1171f838f","Type":"ContainerStarted","Data":"83b42b0bf5e7e389a7af6662fa01926d34f4b4c5b39646e1b9ee869cea753748"}
Jul 29 01:15:20.014513 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:20.014471    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.99629748 podStartE2EDuration="2.014451903s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.154423ms" isStatefulPod=false podCreationTimestamp="2026-07-29 01:15:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:15:20.011605716 +0000 UTC m=+170.323998434" watchObservedRunningTime="2026-07-29 01:15:20.014451903 +0000 UTC m=+170.326844611"
Jul 29 01:15:23.338414 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:23.338323    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:25.122829 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:25.122781    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:25.224344 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:25.224315    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:25.326791 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:25.326761    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:31.152606 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:31.152570    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:31.243662 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:31.243629    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:58.819131 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:15:58.819093    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:03.956974 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:16:03.956920    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:11.769511 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:16:11.769453    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:18.338797 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:16:18.338759    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:18.353971 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:16:18.353929    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:19.223526 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:16:19.223499    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:23.465150 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:16:23.465119    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:23.562724 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:16:23.562688    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:45.307020 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:16:45.306944    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:46.278400 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:16:46.278367    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:48.918574 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:16:48.918536    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:48.977119 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:16:48.977078    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:50.718230 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:16:50.718191    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:50.820045 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:16:50.820010    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:51.118439 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:16:51.118405    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:51.213560 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:16:51.213526    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:52.987938 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:16:52.987863    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:53.729090 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:16:53.729052    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:53.904605 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:16:53.904561    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:56.315590 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:16:56.315557    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:56.400766 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:16:56.400726    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:00.680608 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:00.680555    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:04.524137 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:04.524088    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:04.624607 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:04.624571    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:10.697787 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:10.697752    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:10.799377 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:10.799343    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:12.694404 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:12.694361    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:15.814496 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:15.814457    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:15.894299 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:15.894265    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:26.985998 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:26.985944    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:27.044694 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:27.044664    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-856ff8b689-67xgg"]
Jul 29 01:17:27.047809 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:27.047792    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-856ff8b689-67xgg"
Jul 29 01:17:27.053213 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:27.053186    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 29 01:17:27.053605 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:27.053588    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 29 01:17:27.053659 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:27.053617    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 29 01:17:27.053707 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:27.053666    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 29 01:17:27.054532 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:27.054514    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-jg6qw\""
Jul 29 01:17:27.058312 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:27.058298    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 29 01:17:27.068643 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:27.068619    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-856ff8b689-67xgg"]
Jul 29 01:17:27.110815 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:27.110780    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:27.189303 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:27.189255    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkt77\" (UniqueName: \"kubernetes.io/projected/97499168-db41-433e-83c6-f18b8ad22e82-kube-api-access-qkt77\") pod \"lws-controller-manager-856ff8b689-67xgg\" (UID: \"97499168-db41-433e-83c6-f18b8ad22e82\") " pod="openshift-lws-operator/lws-controller-manager-856ff8b689-67xgg"
Jul 29 01:17:27.189303 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:27.189305    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/97499168-db41-433e-83c6-f18b8ad22e82-manager-config\") pod \"lws-controller-manager-856ff8b689-67xgg\" (UID: \"97499168-db41-433e-83c6-f18b8ad22e82\") " pod="openshift-lws-operator/lws-controller-manager-856ff8b689-67xgg"
Jul 29 01:17:27.189544 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:27.189374    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/97499168-db41-433e-83c6-f18b8ad22e82-metrics-cert\") pod \"lws-controller-manager-856ff8b689-67xgg\" (UID: \"97499168-db41-433e-83c6-f18b8ad22e82\") " pod="openshift-lws-operator/lws-controller-manager-856ff8b689-67xgg"
Jul 29 01:17:27.189544 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:27.189455    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97499168-db41-433e-83c6-f18b8ad22e82-cert\") pod \"lws-controller-manager-856ff8b689-67xgg\" (UID: \"97499168-db41-433e-83c6-f18b8ad22e82\") " pod="openshift-lws-operator/lws-controller-manager-856ff8b689-67xgg"
Jul 29 01:17:27.289944 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:27.289842    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/97499168-db41-433e-83c6-f18b8ad22e82-metrics-cert\") pod \"lws-controller-manager-856ff8b689-67xgg\" (UID: \"97499168-db41-433e-83c6-f18b8ad22e82\") " pod="openshift-lws-operator/lws-controller-manager-856ff8b689-67xgg"
Jul 29 01:17:27.290154 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:27.290093    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97499168-db41-433e-83c6-f18b8ad22e82-cert\") pod \"lws-controller-manager-856ff8b689-67xgg\" (UID: \"97499168-db41-433e-83c6-f18b8ad22e82\") " pod="openshift-lws-operator/lws-controller-manager-856ff8b689-67xgg"
Jul 29 01:17:27.290223 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:27.290158    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkt77\" (UniqueName: \"kubernetes.io/projected/97499168-db41-433e-83c6-f18b8ad22e82-kube-api-access-qkt77\") pod \"lws-controller-manager-856ff8b689-67xgg\" (UID: \"97499168-db41-433e-83c6-f18b8ad22e82\") " pod="openshift-lws-operator/lws-controller-manager-856ff8b689-67xgg"
Jul 29 01:17:27.290223 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:27.290194    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/97499168-db41-433e-83c6-f18b8ad22e82-manager-config\") pod \"lws-controller-manager-856ff8b689-67xgg\" (UID: \"97499168-db41-433e-83c6-f18b8ad22e82\") " pod="openshift-lws-operator/lws-controller-manager-856ff8b689-67xgg"
Jul 29 01:17:27.290798 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:27.290773    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/97499168-db41-433e-83c6-f18b8ad22e82-manager-config\") pod \"lws-controller-manager-856ff8b689-67xgg\" (UID: \"97499168-db41-433e-83c6-f18b8ad22e82\") " pod="openshift-lws-operator/lws-controller-manager-856ff8b689-67xgg"
Jul 29 01:17:27.292364 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:27.292343    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/97499168-db41-433e-83c6-f18b8ad22e82-metrics-cert\") pod \"lws-controller-manager-856ff8b689-67xgg\" (UID: \"97499168-db41-433e-83c6-f18b8ad22e82\") " pod="openshift-lws-operator/lws-controller-manager-856ff8b689-67xgg"
Jul 29 01:17:27.292450 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:27.292386    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97499168-db41-433e-83c6-f18b8ad22e82-cert\") pod \"lws-controller-manager-856ff8b689-67xgg\" (UID: \"97499168-db41-433e-83c6-f18b8ad22e82\") " pod="openshift-lws-operator/lws-controller-manager-856ff8b689-67xgg"
Jul 29 01:17:27.299208 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:27.299186    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkt77\" (UniqueName: \"kubernetes.io/projected/97499168-db41-433e-83c6-f18b8ad22e82-kube-api-access-qkt77\") pod \"lws-controller-manager-856ff8b689-67xgg\" (UID: \"97499168-db41-433e-83c6-f18b8ad22e82\") " pod="openshift-lws-operator/lws-controller-manager-856ff8b689-67xgg"
Jul 29 01:17:27.357058 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:27.357022    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-856ff8b689-67xgg"
Jul 29 01:17:27.503475 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:27.503453    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-856ff8b689-67xgg"]
Jul 29 01:17:27.505331 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:17:27.505303    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97499168_db41_433e_83c6_f18b8ad22e82.slice/crio-4300fd02473b5dc2bdd9667641265316d81c635908be3eb8857a44490b480242 WatchSource:0}: Error finding container 4300fd02473b5dc2bdd9667641265316d81c635908be3eb8857a44490b480242: Status 404 returned error can't find the container with id 4300fd02473b5dc2bdd9667641265316d81c635908be3eb8857a44490b480242
Jul 29 01:17:27.606142 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:27.606057    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:28.261216 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:28.261179    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-c4m82"]
Jul 29 01:17:28.265655 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:28.265634    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-c4m82"
Jul 29 01:17:28.270282 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:28.270258    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 29 01:17:28.270442 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:28.270423    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 29 01:17:28.270514 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:28.270479    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 29 01:17:28.270832 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:28.270816    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 29 01:17:28.270920 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:28.270873    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-9ksqq\""
Jul 29 01:17:28.292046 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:28.292018    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-c4m82"]
Jul 29 01:17:28.297265 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:28.297240    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64080458-f0ba-47de-aff8-b07711c5e314-tmp\") pod \"opendatahub-operator-controller-manager-6f677d9b6b-c4m82\" (UID: \"64080458-f0ba-47de-aff8-b07711c5e314\") " pod="opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-c4m82"
Jul 29 01:17:28.297415 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:28.297305    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/64080458-f0ba-47de-aff8-b07711c5e314-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f677d9b6b-c4m82\" (UID: \"64080458-f0ba-47de-aff8-b07711c5e314\") " pod="opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-c4m82"
Jul 29 01:17:28.297415 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:28.297352    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/64080458-f0ba-47de-aff8-b07711c5e314-manifests\") pod \"opendatahub-operator-controller-manager-6f677d9b6b-c4m82\" (UID: \"64080458-f0ba-47de-aff8-b07711c5e314\") " pod="opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-c4m82"
Jul 29 01:17:28.297415 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:28.297378    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/64080458-f0ba-47de-aff8-b07711c5e314-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f677d9b6b-c4m82\" (UID: \"64080458-f0ba-47de-aff8-b07711c5e314\") " pod="opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-c4m82"
Jul 29 01:17:28.297527 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:28.297482    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bntz\" (UniqueName: \"kubernetes.io/projected/64080458-f0ba-47de-aff8-b07711c5e314-kube-api-access-9bntz\") pod \"opendatahub-operator-controller-manager-6f677d9b6b-c4m82\" (UID: \"64080458-f0ba-47de-aff8-b07711c5e314\") " pod="opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-c4m82"
Jul 29 01:17:28.398381 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:28.398341    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/64080458-f0ba-47de-aff8-b07711c5e314-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f677d9b6b-c4m82\" (UID: \"64080458-f0ba-47de-aff8-b07711c5e314\") " pod="opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-c4m82"
Jul 29 01:17:28.398381 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:28.398385    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/64080458-f0ba-47de-aff8-b07711c5e314-manifests\") pod \"opendatahub-operator-controller-manager-6f677d9b6b-c4m82\" (UID: \"64080458-f0ba-47de-aff8-b07711c5e314\") " pod="opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-c4m82"
Jul 29 01:17:28.398611 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:28.398404    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/64080458-f0ba-47de-aff8-b07711c5e314-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f677d9b6b-c4m82\" (UID: \"64080458-f0ba-47de-aff8-b07711c5e314\") " pod="opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-c4m82"
Jul 29 01:17:28.398611 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:28.398453    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bntz\" (UniqueName: \"kubernetes.io/projected/64080458-f0ba-47de-aff8-b07711c5e314-kube-api-access-9bntz\") pod \"opendatahub-operator-controller-manager-6f677d9b6b-c4m82\" (UID: \"64080458-f0ba-47de-aff8-b07711c5e314\") " pod="opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-c4m82"
Jul 29 01:17:28.398611 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:28.398476    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64080458-f0ba-47de-aff8-b07711c5e314-tmp\") pod \"opendatahub-operator-controller-manager-6f677d9b6b-c4m82\" (UID: \"64080458-f0ba-47de-aff8-b07711c5e314\") " pod="opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-c4m82"
Jul 29 01:17:28.398756 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:28.398729    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/64080458-f0ba-47de-aff8-b07711c5e314-manifests\") pod \"opendatahub-operator-controller-manager-6f677d9b6b-c4m82\" (UID: \"64080458-f0ba-47de-aff8-b07711c5e314\") " pod="opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-c4m82"
Jul 29 01:17:28.400571 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:28.400547    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64080458-f0ba-47de-aff8-b07711c5e314-tmp\") pod \"opendatahub-operator-controller-manager-6f677d9b6b-c4m82\" (UID: \"64080458-f0ba-47de-aff8-b07711c5e314\") " pod="opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-c4m82"
Jul 29 01:17:28.400840 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:28.400826    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/64080458-f0ba-47de-aff8-b07711c5e314-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f677d9b6b-c4m82\" (UID: \"64080458-f0ba-47de-aff8-b07711c5e314\") " pod="opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-c4m82"
Jul 29 01:17:28.400915 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:28.400899    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/64080458-f0ba-47de-aff8-b07711c5e314-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f677d9b6b-c4m82\" (UID: \"64080458-f0ba-47de-aff8-b07711c5e314\") " pod="opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-c4m82"
Jul 29 01:17:28.409849 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:28.409826    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bntz\" (UniqueName: \"kubernetes.io/projected/64080458-f0ba-47de-aff8-b07711c5e314-kube-api-access-9bntz\") pod \"opendatahub-operator-controller-manager-6f677d9b6b-c4m82\" (UID: \"64080458-f0ba-47de-aff8-b07711c5e314\") " pod="opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-c4m82"
Jul 29 01:17:28.465257 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:28.465223    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-856ff8b689-67xgg" event={"ID":"97499168-db41-433e-83c6-f18b8ad22e82","Type":"ContainerStarted","Data":"4300fd02473b5dc2bdd9667641265316d81c635908be3eb8857a44490b480242"}
Jul 29 01:17:28.575896 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:28.575817    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-c4m82"
Jul 29 01:17:28.718169 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:28.718132    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-c4m82"]
Jul 29 01:17:28.722032 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:17:28.722005    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64080458_f0ba_47de_aff8_b07711c5e314.slice/crio-558b7541c7b209a459b0e5d6dd76d98307a9c70ea214c9438e72acea17569d4c WatchSource:0}: Error finding container 558b7541c7b209a459b0e5d6dd76d98307a9c70ea214c9438e72acea17569d4c: Status 404 returned error can't find the container with id 558b7541c7b209a459b0e5d6dd76d98307a9c70ea214c9438e72acea17569d4c
Jul 29 01:17:28.908418 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:28.908384    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:29.479117 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:29.479078    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-c4m82" event={"ID":"64080458-f0ba-47de-aff8-b07711c5e314","Type":"ContainerStarted","Data":"558b7541c7b209a459b0e5d6dd76d98307a9c70ea214c9438e72acea17569d4c"}
Jul 29 01:17:31.515843 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:31.515816    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8g9fl_e044d9fa-39c8-49b8-94e1-550f3dbe7b26/ovn-acl-logging/0.log"
Jul 29 01:17:31.515843 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:31.515831    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8g9fl_e044d9fa-39c8-49b8-94e1-550f3dbe7b26/ovn-acl-logging/0.log"
Jul 29 01:17:31.519050 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:31.519029    2580 kubelet.go:1648] "Image garbage collection succeeded"
Jul 29 01:17:32.110802 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:32.110770    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:32.494897 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:32.494813    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-c4m82" event={"ID":"64080458-f0ba-47de-aff8-b07711c5e314","Type":"ContainerStarted","Data":"8467054a53471bc770909e0189fb61922af8e853dad09c2a07426573af632c6b"}
Jul 29 01:17:33.500771 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:33.500733    2580 generic.go:356] "Generic (PLEG): container finished" podID="64080458-f0ba-47de-aff8-b07711c5e314" containerID="8467054a53471bc770909e0189fb61922af8e853dad09c2a07426573af632c6b" exitCode=0
Jul 29 01:17:33.501188 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:33.500820    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-c4m82" event={"ID":"64080458-f0ba-47de-aff8-b07711c5e314","Type":"ContainerDied","Data":"8467054a53471bc770909e0189fb61922af8e853dad09c2a07426573af632c6b"}
Jul 29 01:17:33.501372 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:33.501357    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 01:17:34.507242 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:34.507212    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-c4m82" event={"ID":"64080458-f0ba-47de-aff8-b07711c5e314","Type":"ContainerStarted","Data":"6360836dad29e1286c1c05c32e6f41a85f70f0cda150b3d341da6c8947287c1d"}
Jul 29 01:17:34.507665 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:34.507337    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-c4m82"
Jul 29 01:17:34.532853 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:34.532798    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-c4m82" podStartSLOduration=2.307253528 podStartE2EDuration="6.53277844s" totalImagesPullingTime="3.196065385s" totalInitContainerRuntime="1.029459527s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:17:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:17:34.531396946 +0000 UTC m=+304.843789653" watchObservedRunningTime="2026-07-29 01:17:34.53277844 +0000 UTC m=+304.845171151"
Jul 29 01:17:37.522039 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:37.521866    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-856ff8b689-67xgg" event={"ID":"97499168-db41-433e-83c6-f18b8ad22e82","Type":"ContainerStarted","Data":"a6f7b69f1d0a1e4a180dbf2521e5e682f2e459e3917e99d62151bd23e23bdd84"}
Jul 29 01:17:37.522039 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:37.521987    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-856ff8b689-67xgg"
Jul 29 01:17:37.541776 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:37.541730    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-856ff8b689-67xgg" podStartSLOduration=1.475283824 podStartE2EDuration="10.541714487s" totalImagesPullingTime="9.066430663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:17:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:17:37.540381444 +0000 UTC m=+307.852774156" watchObservedRunningTime="2026-07-29 01:17:37.541714487 +0000 UTC m=+307.854107194"
Jul 29 01:17:45.514333 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:45.514300    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-c4m82"
Jul 29 01:17:47.225660 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:47.225619    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:47.412245 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:47.412199    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:47.775551 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:47.775511    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:47.901290 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:47.901257    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5dfd7865d-kmlm7"]
Jul 29 01:17:47.917595 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:47.917571    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5dfd7865d-kmlm7"
Jul 29 01:17:47.924115 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:47.924092    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-fxk7q\""
Jul 29 01:17:47.924245 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:47.924143    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 29 01:17:47.924245 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:47.924093    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 29 01:17:47.924245 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:47.924194    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 29 01:17:47.927574 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:47.927553    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 29 01:17:47.928437 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:47.928416    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5dfd7865d-kmlm7"]
Jul 29 01:17:47.971783 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:47.971748    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14a74c15-38c6-4478-ab30-510caf6ea8f5-tls-certs\") pod \"kube-auth-proxy-5dfd7865d-kmlm7\" (UID: \"14a74c15-38c6-4478-ab30-510caf6ea8f5\") " pod="openshift-ingress/kube-auth-proxy-5dfd7865d-kmlm7"
Jul 29 01:17:47.971783 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:47.971786    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qr4kl\" (UniqueName: \"kubernetes.io/projected/14a74c15-38c6-4478-ab30-510caf6ea8f5-kube-api-access-qr4kl\") pod \"kube-auth-proxy-5dfd7865d-kmlm7\" (UID: \"14a74c15-38c6-4478-ab30-510caf6ea8f5\") " pod="openshift-ingress/kube-auth-proxy-5dfd7865d-kmlm7"
Jul 29 01:17:47.971984 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:47.971808    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14a74c15-38c6-4478-ab30-510caf6ea8f5-tmp\") pod \"kube-auth-proxy-5dfd7865d-kmlm7\" (UID: \"14a74c15-38c6-4478-ab30-510caf6ea8f5\") " pod="openshift-ingress/kube-auth-proxy-5dfd7865d-kmlm7"
Jul 29 01:17:47.997375 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:47.997342    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:48.073226 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:48.073138    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14a74c15-38c6-4478-ab30-510caf6ea8f5-tls-certs\") pod \"kube-auth-proxy-5dfd7865d-kmlm7\" (UID: \"14a74c15-38c6-4478-ab30-510caf6ea8f5\") " pod="openshift-ingress/kube-auth-proxy-5dfd7865d-kmlm7"
Jul 29 01:17:48.073226 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:48.073187    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qr4kl\" (UniqueName: \"kubernetes.io/projected/14a74c15-38c6-4478-ab30-510caf6ea8f5-kube-api-access-qr4kl\") pod \"kube-auth-proxy-5dfd7865d-kmlm7\" (UID: \"14a74c15-38c6-4478-ab30-510caf6ea8f5\") " pod="openshift-ingress/kube-auth-proxy-5dfd7865d-kmlm7"
Jul 29 01:17:48.073226 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:48.073217    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14a74c15-38c6-4478-ab30-510caf6ea8f5-tmp\") pod \"kube-auth-proxy-5dfd7865d-kmlm7\" (UID: \"14a74c15-38c6-4478-ab30-510caf6ea8f5\") " pod="openshift-ingress/kube-auth-proxy-5dfd7865d-kmlm7"
Jul 29 01:17:48.075415 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:48.075382    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14a74c15-38c6-4478-ab30-510caf6ea8f5-tmp\") pod \"kube-auth-proxy-5dfd7865d-kmlm7\" (UID: \"14a74c15-38c6-4478-ab30-510caf6ea8f5\") " pod="openshift-ingress/kube-auth-proxy-5dfd7865d-kmlm7"
Jul 29 01:17:48.075531 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:48.075511    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14a74c15-38c6-4478-ab30-510caf6ea8f5-tls-certs\") pod \"kube-auth-proxy-5dfd7865d-kmlm7\" (UID: \"14a74c15-38c6-4478-ab30-510caf6ea8f5\") " pod="openshift-ingress/kube-auth-proxy-5dfd7865d-kmlm7"
Jul 29 01:17:48.085449 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:48.085420    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qr4kl\" (UniqueName: \"kubernetes.io/projected/14a74c15-38c6-4478-ab30-510caf6ea8f5-kube-api-access-qr4kl\") pod \"kube-auth-proxy-5dfd7865d-kmlm7\" (UID: \"14a74c15-38c6-4478-ab30-510caf6ea8f5\") " pod="openshift-ingress/kube-auth-proxy-5dfd7865d-kmlm7"
Jul 29 01:17:48.228046 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:48.228009    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5dfd7865d-kmlm7"
Jul 29 01:17:48.276427 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:48.275467    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:48.367391 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:48.367364    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5dfd7865d-kmlm7"]
Jul 29 01:17:48.369400 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:17:48.369374    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14a74c15_38c6_4478_ab30_510caf6ea8f5.slice/crio-82989c5ee0e3effcf350c0a2ef062c93c6629d8b4254620de7ac19b8908fa49d WatchSource:0}: Error finding container 82989c5ee0e3effcf350c0a2ef062c93c6629d8b4254620de7ac19b8908fa49d: Status 404 returned error can't find the container with id 82989c5ee0e3effcf350c0a2ef062c93c6629d8b4254620de7ac19b8908fa49d
Jul 29 01:17:48.380141 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:48.380109    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:48.484940 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:48.484905    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:48.535166 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:48.535140    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-856ff8b689-67xgg"
Jul 29 01:17:48.576978 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:48.576929    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5dfd7865d-kmlm7" event={"ID":"14a74c15-38c6-4478-ab30-510caf6ea8f5","Type":"ContainerStarted","Data":"82989c5ee0e3effcf350c0a2ef062c93c6629d8b4254620de7ac19b8908fa49d"}
Jul 29 01:17:48.642371 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:48.642288    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:49.151605 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:49.151570    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:49.285862 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:49.285822    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:49.387758 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:49.387721    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:49.514249 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:49.514161    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:50.613373 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:50.613338    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:52.595254 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:52.595160    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5dfd7865d-kmlm7" event={"ID":"14a74c15-38c6-4478-ab30-510caf6ea8f5","Type":"ContainerStarted","Data":"8be2bdbc1ed8cacd9b7534c6703f23ea575be525e1a53b3effda6fb2de7e5160"}
Jul 29 01:17:52.612188 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:52.612138    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5dfd7865d-kmlm7" podStartSLOduration=1.863472393 podStartE2EDuration="5.612124863s" totalImagesPullingTime="3.74865247s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:17:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:17:52.610865383 +0000 UTC m=+322.923258092" watchObservedRunningTime="2026-07-29 01:17:52.612124863 +0000 UTC m=+322.924517571"
Jul 29 01:17:55.259343 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:55.259305    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:55.417446 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:55.417412    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:56.121819 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:56.121783    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:56.378623 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:56.378538    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:56.505766 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:56.505728    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:58.319836 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:58.319794    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:58.442527 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:58.442493    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:58.528341 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:58.528304    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:59.611873 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:59.611836    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:59.729043 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:59.729009    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:59.919018 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:17:59.918891    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:18:01.292926 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:18:01.292891    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:18:01.363846 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:18:01.363810    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:18:26.354280 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:18:26.354194    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:18:48.729525 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:18:48.729480    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:18:48.905661 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:18:48.905628    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:18:48.985640 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:18:48.985558    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:18:49.729478 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:18:49.729436    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:18:49.831554 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:18:49.831514    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:06.953733 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:06.953695    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:07.045497 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:07.045457    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:12.653478 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:12.653433    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:13.195918 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:13.195870    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:13.640370 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:13.640337    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:13.740262 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:13.740229    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:17.722073 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:17.722028    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:18.371238 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:18.371192    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:18.492392 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:18.492361    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:18.662298 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:18.662183    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:20.862377 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:20.862339    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:21.031617 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:21.031578    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:23.532722 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:23.532685    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:23.638023 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:23.637974    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:26.101667 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:26.101633    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:28.617281 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:28.617234    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:28.721198 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:28.721164    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:28.822821 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:28.822788    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:28.922465 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:28.922381    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:32.429406 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:32.429368    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:32.533127 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:32.533096    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:33.768649 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:33.768613    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-tw6nq"]
Jul 29 01:19:33.772062 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:33.772034    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tw6nq"
Jul 29 01:19:33.775564 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:33.775538    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 29 01:19:33.776128 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:33.776112    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 29 01:19:33.776639 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:33.776624    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 29 01:19:33.776736 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:33.776647    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-t5xr4\""
Jul 29 01:19:33.776980 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:33.776965    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 29 01:19:33.787262 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:33.787236    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:33.831389 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:33.831344    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-tw6nq"]
Jul 29 01:19:33.883019 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:33.882981    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:33.887119 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:33.887096    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt4z5\" (UniqueName: \"kubernetes.io/projected/1cc1419b-cbf6-4d65-b390-b5cb901aaaff-kube-api-access-qt4z5\") pod \"kuadrant-console-plugin-66b5774985-tw6nq\" (UID: \"1cc1419b-cbf6-4d65-b390-b5cb901aaaff\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tw6nq"
Jul 29 01:19:33.887216 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:33.887140    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1cc1419b-cbf6-4d65-b390-b5cb901aaaff-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-tw6nq\" (UID: \"1cc1419b-cbf6-4d65-b390-b5cb901aaaff\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tw6nq"
Jul 29 01:19:33.887292 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:33.887271    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1cc1419b-cbf6-4d65-b390-b5cb901aaaff-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-tw6nq\" (UID: \"1cc1419b-cbf6-4d65-b390-b5cb901aaaff\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tw6nq"
Jul 29 01:19:33.988084 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:33.988050    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1cc1419b-cbf6-4d65-b390-b5cb901aaaff-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-tw6nq\" (UID: \"1cc1419b-cbf6-4d65-b390-b5cb901aaaff\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tw6nq"
Jul 29 01:19:33.988261 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:33.988151    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1cc1419b-cbf6-4d65-b390-b5cb901aaaff-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-tw6nq\" (UID: \"1cc1419b-cbf6-4d65-b390-b5cb901aaaff\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tw6nq"
Jul 29 01:19:33.988261 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:33.988193    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qt4z5\" (UniqueName: \"kubernetes.io/projected/1cc1419b-cbf6-4d65-b390-b5cb901aaaff-kube-api-access-qt4z5\") pod \"kuadrant-console-plugin-66b5774985-tw6nq\" (UID: \"1cc1419b-cbf6-4d65-b390-b5cb901aaaff\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tw6nq"
Jul 29 01:19:33.988791 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:33.988766    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1cc1419b-cbf6-4d65-b390-b5cb901aaaff-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-tw6nq\" (UID: \"1cc1419b-cbf6-4d65-b390-b5cb901aaaff\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tw6nq"
Jul 29 01:19:33.990657 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:33.990623    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1cc1419b-cbf6-4d65-b390-b5cb901aaaff-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-tw6nq\" (UID: \"1cc1419b-cbf6-4d65-b390-b5cb901aaaff\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tw6nq"
Jul 29 01:19:33.999920 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:33.999893    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt4z5\" (UniqueName: \"kubernetes.io/projected/1cc1419b-cbf6-4d65-b390-b5cb901aaaff-kube-api-access-qt4z5\") pod \"kuadrant-console-plugin-66b5774985-tw6nq\" (UID: \"1cc1419b-cbf6-4d65-b390-b5cb901aaaff\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tw6nq"
Jul 29 01:19:34.099969 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:34.099872    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tw6nq"
Jul 29 01:19:34.243149 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:34.243065    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-tw6nq"]
Jul 29 01:19:34.245809 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:19:34.245783    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1cc1419b_cbf6_4d65_b390_b5cb901aaaff.slice/crio-72a2b33bc6ebc3d55071729b328832cb5ea3240f2e116cacacded6e78350aaf8 WatchSource:0}: Error finding container 72a2b33bc6ebc3d55071729b328832cb5ea3240f2e116cacacded6e78350aaf8: Status 404 returned error can't find the container with id 72a2b33bc6ebc3d55071729b328832cb5ea3240f2e116cacacded6e78350aaf8
Jul 29 01:19:35.026093 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:35.026051    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tw6nq" event={"ID":"1cc1419b-cbf6-4d65-b390-b5cb901aaaff","Type":"ContainerStarted","Data":"72a2b33bc6ebc3d55071729b328832cb5ea3240f2e116cacacded6e78350aaf8"}
Jul 29 01:19:36.670921 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:36.670873    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:36.798322 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:36.798282    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:40.141611 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:40.141574    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:40.263925 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:40.263861    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:44.842926 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:44.842890    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nsh8h"]
Jul 29 01:19:44.882636 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:44.882591    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:44.914632 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:44.914594    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nsh8h"]
Jul 29 01:19:44.914822 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:44.914703    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nsh8h"
Jul 29 01:19:44.918666 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:44.918634    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-77d5k\""
Jul 29 01:19:45.000164 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:45.000134    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nsh8h"]
Jul 29 01:19:45.000446 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:19:45.000415    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-pvk4m], unattached volumes=[], failed to process volumes=[extensions-socket-volume kube-api-access-pvk4m]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nsh8h" podUID="077e0358-128f-4daf-8dcc-37ef2a3ae497"
Jul 29 01:19:45.024241 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:45.024209    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nsh8h"]
Jul 29 01:19:45.044680 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:45.044647    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nsh8h"]
Jul 29 01:19:45.075136 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:45.075108    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nsh8h"
Jul 29 01:19:45.086542 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:19:45.086507    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-nsh8h\" is forbidden: User \"system:node:ip-10-0-142-238.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-238.ec2.internal' and this object" podUID="077e0358-128f-4daf-8dcc-37ef2a3ae497" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nsh8h"
Jul 29 01:19:45.091591 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:45.091561    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nsh8h"
Jul 29 01:19:45.092910 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:45.092888    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/077e0358-128f-4daf-8dcc-37ef2a3ae497-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-nsh8h\" (UID: \"077e0358-128f-4daf-8dcc-37ef2a3ae497\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nsh8h"
Jul 29 01:19:45.093064 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:45.092919    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvk4m\" (UniqueName: \"kubernetes.io/projected/077e0358-128f-4daf-8dcc-37ef2a3ae497-kube-api-access-pvk4m\") pod \"kuadrant-operator-controller-manager-55467d9f7-nsh8h\" (UID: \"077e0358-128f-4daf-8dcc-37ef2a3ae497\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nsh8h"
Jul 29 01:19:45.094508 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:19:45.094481    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-nsh8h\" is forbidden: User \"system:node:ip-10-0-142-238.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-238.ec2.internal' and this object" podUID="077e0358-128f-4daf-8dcc-37ef2a3ae497" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nsh8h"
Jul 29 01:19:45.185409 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:45.185368    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t6bzj"]
Jul 29 01:19:45.192538 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:45.192503    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t6bzj"
Jul 29 01:19:45.194178 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:45.194137    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pvk4m\" (UniqueName: \"kubernetes.io/projected/077e0358-128f-4daf-8dcc-37ef2a3ae497-kube-api-access-pvk4m\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:19:45.194178 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:45.194167    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/077e0358-128f-4daf-8dcc-37ef2a3ae497-extensions-socket-volume\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:19:45.202626 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:19:45.202000    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-nsh8h\" is forbidden: User \"system:node:ip-10-0-142-238.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-238.ec2.internal' and this object" podUID="077e0358-128f-4daf-8dcc-37ef2a3ae497" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nsh8h"
Jul 29 01:19:45.202626 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:45.202263    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-2vflp\""
Jul 29 01:19:45.230084 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:45.230053    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t6bzj"]
Jul 29 01:19:45.294892 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:45.294851    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bp5q\" (UniqueName: \"kubernetes.io/projected/c9a3f626-95e3-409c-a7ce-60aed362dc47-kube-api-access-8bp5q\") pod \"limitador-operator-controller-manager-859d7b78bd-t6bzj\" (UID: \"c9a3f626-95e3-409c-a7ce-60aed362dc47\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t6bzj"
Jul 29 01:19:45.395472 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:45.395437    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bp5q\" (UniqueName: \"kubernetes.io/projected/c9a3f626-95e3-409c-a7ce-60aed362dc47-kube-api-access-8bp5q\") pod \"limitador-operator-controller-manager-859d7b78bd-t6bzj\" (UID: \"c9a3f626-95e3-409c-a7ce-60aed362dc47\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t6bzj"
Jul 29 01:19:45.406311 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:45.406282    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bp5q\" (UniqueName: \"kubernetes.io/projected/c9a3f626-95e3-409c-a7ce-60aed362dc47-kube-api-access-8bp5q\") pod \"limitador-operator-controller-manager-859d7b78bd-t6bzj\" (UID: \"c9a3f626-95e3-409c-a7ce-60aed362dc47\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t6bzj"
Jul 29 01:19:45.504838 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:45.504801    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t6bzj"
Jul 29 01:19:46.038346 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:46.038306    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:46.079838 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:46.079809    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nsh8h"
Jul 29 01:19:46.086178 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:19:46.085738    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-nsh8h\" is forbidden: User \"system:node:ip-10-0-142-238.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-238.ec2.internal' and this object" podUID="077e0358-128f-4daf-8dcc-37ef2a3ae497" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nsh8h"
Jul 29 01:19:46.093065 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:19:46.093030    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-nsh8h\" is forbidden: User \"system:node:ip-10-0-142-238.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-238.ec2.internal' and this object" podUID="077e0358-128f-4daf-8dcc-37ef2a3ae497" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nsh8h"
Jul 29 01:19:46.170841 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:46.170808    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="077e0358-128f-4daf-8dcc-37ef2a3ae497" path="/var/lib/kubelet/pods/077e0358-128f-4daf-8dcc-37ef2a3ae497/volumes"
Jul 29 01:19:46.191716 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:46.191679    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:48.269779 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:48.269737    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:48.368689 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:48.368639    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:48.638303 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:48.638269    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:48.745855 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:48.745820    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:50.821198 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:50.821155    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:50.921674 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:50.921637    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:55.276365 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:55.276344    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t6bzj"]
Jul 29 01:19:55.279519 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:19:55.279496    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9a3f626_95e3_409c_a7ce_60aed362dc47.slice/crio-f676834145383c5c5b09cafb13edffe53848a223099eb73af3d8ebd9cbd59401 WatchSource:0}: Error finding container f676834145383c5c5b09cafb13edffe53848a223099eb73af3d8ebd9cbd59401: Status 404 returned error can't find the container with id f676834145383c5c5b09cafb13edffe53848a223099eb73af3d8ebd9cbd59401
Jul 29 01:19:55.285174 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:55.285145    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:55.485510 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:55.485416    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:56.132550 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:56.132518    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tw6nq" event={"ID":"1cc1419b-cbf6-4d65-b390-b5cb901aaaff","Type":"ContainerStarted","Data":"a5c82cc25a75145f1a606d32e64c3108030cbe000eecff90a90c7029fdc77768"}
Jul 29 01:19:56.133775 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:56.133750    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t6bzj" event={"ID":"c9a3f626-95e3-409c-a7ce-60aed362dc47","Type":"ContainerStarted","Data":"f676834145383c5c5b09cafb13edffe53848a223099eb73af3d8ebd9cbd59401"}
Jul 29 01:19:56.155155 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:56.155108    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tw6nq" podStartSLOduration=2.185452885 podStartE2EDuration="23.155092539s" totalImagesPullingTime="20.969639654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:19:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:19:56.153482635 +0000 UTC m=+446.465875344" watchObservedRunningTime="2026-07-29 01:19:56.155092539 +0000 UTC m=+446.467485246"
Jul 29 01:19:58.870878 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:58.870842    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:58.986495 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:58.986460    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:59.150262 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:59.150175    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t6bzj" event={"ID":"c9a3f626-95e3-409c-a7ce-60aed362dc47","Type":"ContainerStarted","Data":"9c9e59e060d9eb61df1aacf27f03f791ecc32ff425695fecbd6dd471c938fa59"}
Jul 29 01:19:59.150430 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:59.150329    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t6bzj"
Jul 29 01:19:59.197318 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:19:59.197271    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t6bzj" podStartSLOduration=11.331826964 podStartE2EDuration="14.197257403s" totalImagesPullingTime="2.865430439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:19:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:19:59.196563516 +0000 UTC m=+449.508956225" watchObservedRunningTime="2026-07-29 01:19:59.197257403 +0000 UTC m=+449.509650110"
Jul 29 01:20:10.156344 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:20:10.156312    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t6bzj"
Jul 29 01:20:14.067116 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:20:14.067075    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:14.225315 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:20:14.225279    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:16.684259 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:20:16.684227    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:16.800439 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:20:16.800392    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:16.895173 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:20:16.895129    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:17.691648 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:20:17.691611    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:17.824331 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:20:17.824281    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:37.887619 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:20:37.887579    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:37.992030 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:20:37.991990    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:38.401719 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:20:38.401685    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:51.106196 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:20:51.106154    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:51.305470 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:20:51.305430    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:57.880304 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:20:57.880261    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:58.063642 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:20:58.063606    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:58.169189 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:20:58.169108    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:21:01.257762 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:21:01.257719    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:21:01.397923 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:21:01.397882    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:21:06.747304 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:21:06.747265    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:21:06.859144 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:21:06.859110    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:21:31.987008 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:21:31.986895    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:21:32.085541 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:21:32.085505    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:21:32.475874 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:21:32.475838    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:21:32.807001 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:21:32.806885    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:21:33.151674 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:21:33.151641    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:21:33.278203 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:21:33.278172    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:21:33.360553 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:21:33.360522    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-xf7pq"]
Jul 29 01:21:33.364109 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:21:33.364089    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-xf7pq"
Jul 29 01:21:33.367822 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:21:33.367803    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 29 01:21:33.367940 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:21:33.367868    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-9xr69\""
Jul 29 01:21:33.383042 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:21:33.383017    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-xf7pq"]
Jul 29 01:21:33.445484 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:21:33.445394    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db561615-d3c7-411d-8c05-e2cda634d700-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-xf7pq\" (UID: \"db561615-d3c7-411d-8c05-e2cda634d700\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-xf7pq"
Jul 29 01:21:33.445637 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:21:33.445536    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h89nk\" (UniqueName: \"kubernetes.io/projected/db561615-d3c7-411d-8c05-e2cda634d700-kube-api-access-h89nk\") pod \"payload-pre-processing-687dbb6cf6-xf7pq\" (UID: \"db561615-d3c7-411d-8c05-e2cda634d700\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-xf7pq"
Jul 29 01:21:33.462306 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:21:33.462273    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-dlvpn"]
Jul 29 01:21:33.465703 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:21:33.465686    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-dlvpn"
Jul 29 01:21:33.490514 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:21:33.490481    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-dlvpn"]
Jul 29 01:21:33.546471 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:21:33.546435    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6784b90f-c19a-4022-800b-825ecca592f8-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-dlvpn\" (UID: \"6784b90f-c19a-4022-800b-825ecca592f8\") " pod="openshift-ingress/payload-processing-5cc6cd444b-dlvpn"
Jul 29 01:21:33.546647 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:21:33.546488    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h89nk\" (UniqueName: \"kubernetes.io/projected/db561615-d3c7-411d-8c05-e2cda634d700-kube-api-access-h89nk\") pod \"payload-pre-processing-687dbb6cf6-xf7pq\" (UID: \"db561615-d3c7-411d-8c05-e2cda634d700\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-xf7pq"
Jul 29 01:21:33.546647 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:21:33.546563    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db561615-d3c7-411d-8c05-e2cda634d700-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-xf7pq\" (UID: \"db561615-d3c7-411d-8c05-e2cda634d700\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-xf7pq"
Jul 29 01:21:33.546647 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:21:33.546592    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6qh9\" (UniqueName: \"kubernetes.io/projected/6784b90f-c19a-4022-800b-825ecca592f8-kube-api-access-t6qh9\") pod \"payload-processing-5cc6cd444b-dlvpn\" (UID: \"6784b90f-c19a-4022-800b-825ecca592f8\") " pod="openshift-ingress/payload-processing-5cc6cd444b-dlvpn"
Jul 29 01:21:33.547398 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:21:33.547380    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db561615-d3c7-411d-8c05-e2cda634d700-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-xf7pq\" (UID: \"db561615-d3c7-411d-8c05-e2cda634d700\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-xf7pq"
Jul 29 01:21:33.558194 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:21:33.558154    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h89nk\" (UniqueName: \"kubernetes.io/projected/db561615-d3c7-411d-8c05-e2cda634d700-kube-api-access-h89nk\") pod \"payload-pre-processing-687dbb6cf6-xf7pq\" (UID: \"db561615-d3c7-411d-8c05-e2cda634d700\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-xf7pq"
Jul 29 01:21:33.647921 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:21:33.647880    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6qh9\" (UniqueName: \"kubernetes.io/projected/6784b90f-c19a-4022-800b-825ecca592f8-kube-api-access-t6qh9\") pod \"payload-processing-5cc6cd444b-dlvpn\" (UID: \"6784b90f-c19a-4022-800b-825ecca592f8\") " pod="openshift-ingress/payload-processing-5cc6cd444b-dlvpn"
Jul 29 01:21:33.648145 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:21:33.647977    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6784b90f-c19a-4022-800b-825ecca592f8-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-dlvpn\" (UID: \"6784b90f-c19a-4022-800b-825ecca592f8\") " pod="openshift-ingress/payload-processing-5cc6cd444b-dlvpn"
Jul 29 01:21:33.648658 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:21:33.648638    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6784b90f-c19a-4022-800b-825ecca592f8-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-dlvpn\" (UID: \"6784b90f-c19a-4022-800b-825ecca592f8\") " pod="openshift-ingress/payload-processing-5cc6cd444b-dlvpn"
Jul 29 01:21:33.659603 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:21:33.659578    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6qh9\" (UniqueName: \"kubernetes.io/projected/6784b90f-c19a-4022-800b-825ecca592f8-kube-api-access-t6qh9\") pod \"payload-processing-5cc6cd444b-dlvpn\" (UID: \"6784b90f-c19a-4022-800b-825ecca592f8\") " pod="openshift-ingress/payload-processing-5cc6cd444b-dlvpn"
Jul 29 01:21:33.674446 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:21:33.674409    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-xf7pq"
Jul 29 01:21:33.776359 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:21:33.776319    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-dlvpn"
Jul 29 01:21:33.836261 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:21:33.836216    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-xf7pq"]
Jul 29 01:21:33.931775 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:21:33.931712    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-dlvpn"]
Jul 29 01:21:33.933808 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:21:33.933776    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6784b90f_c19a_4022_800b_825ecca592f8.slice/crio-fe2c2a358e929ca112799b4ac311c11525d6ec6b0f2d750fbf217b3cc4894ee0 WatchSource:0}: Error finding container fe2c2a358e929ca112799b4ac311c11525d6ec6b0f2d750fbf217b3cc4894ee0: Status 404 returned error can't find the container with id fe2c2a358e929ca112799b4ac311c11525d6ec6b0f2d750fbf217b3cc4894ee0
Jul 29 01:21:34.554262 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:21:34.554217    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-dlvpn" event={"ID":"6784b90f-c19a-4022-800b-825ecca592f8","Type":"ContainerStarted","Data":"fe2c2a358e929ca112799b4ac311c11525d6ec6b0f2d750fbf217b3cc4894ee0"}
Jul 29 01:21:34.555860 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:21:34.555766    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-xf7pq" event={"ID":"db561615-d3c7-411d-8c05-e2cda634d700","Type":"ContainerStarted","Data":"5a17ebbb9bca494e2fb0c605f75f2f3c1649ad477a4e1e6fee4a73967c45026c"}
Jul 29 01:21:36.566906 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:21:36.566870    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-dlvpn" event={"ID":"6784b90f-c19a-4022-800b-825ecca592f8","Type":"ContainerStarted","Data":"2789e34700c1113eb533b5c6aaadd14c5f7571a833c93afc6d04c2ca5eb94d46"}
Jul 29 01:21:36.567425 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:21:36.567005    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-dlvpn"
Jul 29 01:21:36.568515 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:21:36.568488    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-xf7pq" event={"ID":"db561615-d3c7-411d-8c05-e2cda634d700","Type":"ContainerStarted","Data":"60269edd003f07220357b2c3660e4ed4d1cadd06838384f4d51de8ad63ca40ea"}
Jul 29 01:21:36.568628 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:21:36.568543    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-xf7pq"
Jul 29 01:21:36.585677 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:21:36.585623    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-dlvpn" podStartSLOduration=1.173921824 podStartE2EDuration="3.585606686s" totalImagesPullingTime="2.411684862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:21:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:21:36.583820463 +0000 UTC m=+546.896213172" watchObservedRunningTime="2026-07-29 01:21:36.585606686 +0000 UTC m=+546.897999394"
Jul 29 01:21:36.602235 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:21:36.602138    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-xf7pq" podStartSLOduration=1.099412792 podStartE2EDuration="3.602122756s" totalImagesPullingTime="2.502709964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:21:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:21:36.600812781 +0000 UTC m=+546.913205484" watchObservedRunningTime="2026-07-29 01:21:36.602122756 +0000 UTC m=+546.914515464"
Jul 29 01:21:43.008417 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:21:43.008378    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:21:43.106186 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:21:43.106154    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:21:47.576083 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:21:47.576055    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-xf7pq"
Jul 29 01:21:47.576495 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:21:47.576122    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-dlvpn"
Jul 29 01:21:54.685373 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:21:54.685332    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:22:13.930566 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:13.930521    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-cbgxt"]
Jul 29 01:22:13.935531 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:13.935510    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbgxt"
Jul 29 01:22:13.938273 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:13.938252    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 29 01:22:13.939587 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:13.939564    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 29 01:22:13.939687 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:13.939597    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 29 01:22:13.939687 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:13.939633    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-42t29\""
Jul 29 01:22:13.945554 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:13.945533    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-cbgxt"]
Jul 29 01:22:13.961418 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:13.961391    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:22:14.007040 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:14.007006    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c7c06c97-54ab-4ede-84f0-b0c41a66275c-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbgxt\" (UID: \"c7c06c97-54ab-4ede-84f0-b0c41a66275c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbgxt"
Jul 29 01:22:14.007203 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:14.007081    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7c06c97-54ab-4ede-84f0-b0c41a66275c-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbgxt\" (UID: \"c7c06c97-54ab-4ede-84f0-b0c41a66275c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbgxt"
Jul 29 01:22:14.007203 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:14.007146    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c7c06c97-54ab-4ede-84f0-b0c41a66275c-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbgxt\" (UID: \"c7c06c97-54ab-4ede-84f0-b0c41a66275c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbgxt"
Jul 29 01:22:14.007203 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:14.007186    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97brt\" (UniqueName: \"kubernetes.io/projected/c7c06c97-54ab-4ede-84f0-b0c41a66275c-kube-api-access-97brt\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbgxt\" (UID: \"c7c06c97-54ab-4ede-84f0-b0c41a66275c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbgxt"
Jul 29 01:22:14.007351 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:14.007208    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7c06c97-54ab-4ede-84f0-b0c41a66275c-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbgxt\" (UID: \"c7c06c97-54ab-4ede-84f0-b0c41a66275c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbgxt"
Jul 29 01:22:14.007351 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:14.007228    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c7c06c97-54ab-4ede-84f0-b0c41a66275c-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbgxt\" (UID: \"c7c06c97-54ab-4ede-84f0-b0c41a66275c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbgxt"
Jul 29 01:22:14.107930 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:14.107888    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c7c06c97-54ab-4ede-84f0-b0c41a66275c-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbgxt\" (UID: \"c7c06c97-54ab-4ede-84f0-b0c41a66275c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbgxt"
Jul 29 01:22:14.108144 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:14.107941    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97brt\" (UniqueName: \"kubernetes.io/projected/c7c06c97-54ab-4ede-84f0-b0c41a66275c-kube-api-access-97brt\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbgxt\" (UID: \"c7c06c97-54ab-4ede-84f0-b0c41a66275c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbgxt"
Jul 29 01:22:14.108144 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:14.107998    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7c06c97-54ab-4ede-84f0-b0c41a66275c-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbgxt\" (UID: \"c7c06c97-54ab-4ede-84f0-b0c41a66275c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbgxt"
Jul 29 01:22:14.108144 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:14.108025    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c7c06c97-54ab-4ede-84f0-b0c41a66275c-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbgxt\" (UID: \"c7c06c97-54ab-4ede-84f0-b0c41a66275c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbgxt"
Jul 29 01:22:14.108144 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:14.108061    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c7c06c97-54ab-4ede-84f0-b0c41a66275c-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbgxt\" (UID: \"c7c06c97-54ab-4ede-84f0-b0c41a66275c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbgxt"
Jul 29 01:22:14.108338 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:14.108164    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7c06c97-54ab-4ede-84f0-b0c41a66275c-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbgxt\" (UID: \"c7c06c97-54ab-4ede-84f0-b0c41a66275c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbgxt"
Jul 29 01:22:14.108391 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:14.108337    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c7c06c97-54ab-4ede-84f0-b0c41a66275c-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbgxt\" (UID: \"c7c06c97-54ab-4ede-84f0-b0c41a66275c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbgxt"
Jul 29 01:22:14.108391 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:14.108385    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c7c06c97-54ab-4ede-84f0-b0c41a66275c-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbgxt\" (UID: \"c7c06c97-54ab-4ede-84f0-b0c41a66275c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbgxt"
Jul 29 01:22:14.108557 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:14.108539    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7c06c97-54ab-4ede-84f0-b0c41a66275c-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbgxt\" (UID: \"c7c06c97-54ab-4ede-84f0-b0c41a66275c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbgxt"
Jul 29 01:22:14.110206 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:14.110177    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c7c06c97-54ab-4ede-84f0-b0c41a66275c-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbgxt\" (UID: \"c7c06c97-54ab-4ede-84f0-b0c41a66275c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbgxt"
Jul 29 01:22:14.110515 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:14.110498    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7c06c97-54ab-4ede-84f0-b0c41a66275c-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbgxt\" (UID: \"c7c06c97-54ab-4ede-84f0-b0c41a66275c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbgxt"
Jul 29 01:22:14.116457 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:14.116437    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97brt\" (UniqueName: \"kubernetes.io/projected/c7c06c97-54ab-4ede-84f0-b0c41a66275c-kube-api-access-97brt\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbgxt\" (UID: \"c7c06c97-54ab-4ede-84f0-b0c41a66275c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbgxt"
Jul 29 01:22:14.246794 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:14.246707    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbgxt"
Jul 29 01:22:14.377512 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:14.377449    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-cbgxt"]
Jul 29 01:22:14.379845 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:22:14.379818    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7c06c97_54ab_4ede_84f0_b0c41a66275c.slice/crio-03bc32a3352614b9bb7af60e7b3e041e9b13f12fa09be8190afcedb07a5b8a9d WatchSource:0}: Error finding container 03bc32a3352614b9bb7af60e7b3e041e9b13f12fa09be8190afcedb07a5b8a9d: Status 404 returned error can't find the container with id 03bc32a3352614b9bb7af60e7b3e041e9b13f12fa09be8190afcedb07a5b8a9d
Jul 29 01:22:14.742033 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:14.741988    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbgxt" event={"ID":"c7c06c97-54ab-4ede-84f0-b0c41a66275c","Type":"ContainerStarted","Data":"03bc32a3352614b9bb7af60e7b3e041e9b13f12fa09be8190afcedb07a5b8a9d"}
Jul 29 01:22:15.747527 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:15.747430    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbgxt" event={"ID":"c7c06c97-54ab-4ede-84f0-b0c41a66275c","Type":"ContainerStarted","Data":"f03398a64f091cbfd57f7dda920a761dc3e460191398c72eccd01bc9f03c8010"}
Jul 29 01:22:15.767461 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:15.767406    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbgxt" podStartSLOduration=1.757026043 podStartE2EDuration="2.76739041s" totalImagesPullingTime="1.010364367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:22:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:22:15.765169804 +0000 UTC m=+586.077562512" watchObservedRunningTime="2026-07-29 01:22:15.76739041 +0000 UTC m=+586.079783118"
Jul 29 01:22:24.247738 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:24.247699    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbgxt"
Jul 29 01:22:24.248299 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:24.247769    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbgxt"
Jul 29 01:22:24.260043 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:24.260018    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbgxt"
Jul 29 01:22:24.798967 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:24.798927    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbgxt"
Jul 29 01:22:27.465284 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:27.465238    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:22:27.520804 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:27.520773    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:22:30.421620 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:30.421582    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-qkqvx"]
Jul 29 01:22:30.428842 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:30.428812    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qkqvx"
Jul 29 01:22:30.431610 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:30.431589    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 29 01:22:30.435917 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:30.435893    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-qkqvx"]
Jul 29 01:22:30.452454 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:30.452423    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:22:30.559512 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:30.559476    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98f554f9-18f1-43ab-8b6d-dee3b26fca72-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qkqvx\" (UID: \"98f554f9-18f1-43ab-8b6d-dee3b26fca72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qkqvx"
Jul 29 01:22:30.559686 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:30.559537    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98f554f9-18f1-43ab-8b6d-dee3b26fca72-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qkqvx\" (UID: \"98f554f9-18f1-43ab-8b6d-dee3b26fca72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qkqvx"
Jul 29 01:22:30.559686 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:30.559611    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvqh4\" (UniqueName: \"kubernetes.io/projected/98f554f9-18f1-43ab-8b6d-dee3b26fca72-kube-api-access-mvqh4\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qkqvx\" (UID: \"98f554f9-18f1-43ab-8b6d-dee3b26fca72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qkqvx"
Jul 29 01:22:30.559686 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:30.559647    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98f554f9-18f1-43ab-8b6d-dee3b26fca72-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qkqvx\" (UID: \"98f554f9-18f1-43ab-8b6d-dee3b26fca72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qkqvx"
Jul 29 01:22:30.559807 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:30.559745    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98f554f9-18f1-43ab-8b6d-dee3b26fca72-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qkqvx\" (UID: \"98f554f9-18f1-43ab-8b6d-dee3b26fca72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qkqvx"
Jul 29 01:22:30.559807 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:30.559775    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98f554f9-18f1-43ab-8b6d-dee3b26fca72-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qkqvx\" (UID: \"98f554f9-18f1-43ab-8b6d-dee3b26fca72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qkqvx"
Jul 29 01:22:30.660528 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:30.660486    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98f554f9-18f1-43ab-8b6d-dee3b26fca72-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qkqvx\" (UID: \"98f554f9-18f1-43ab-8b6d-dee3b26fca72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qkqvx"
Jul 29 01:22:30.660685 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:30.660554    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvqh4\" (UniqueName: \"kubernetes.io/projected/98f554f9-18f1-43ab-8b6d-dee3b26fca72-kube-api-access-mvqh4\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qkqvx\" (UID: \"98f554f9-18f1-43ab-8b6d-dee3b26fca72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qkqvx"
Jul 29 01:22:30.660685 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:30.660589    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98f554f9-18f1-43ab-8b6d-dee3b26fca72-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qkqvx\" (UID: \"98f554f9-18f1-43ab-8b6d-dee3b26fca72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qkqvx"
Jul 29 01:22:30.660685 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:30.660666    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98f554f9-18f1-43ab-8b6d-dee3b26fca72-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qkqvx\" (UID: \"98f554f9-18f1-43ab-8b6d-dee3b26fca72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qkqvx"
Jul 29 01:22:30.660817 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:30.660686    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98f554f9-18f1-43ab-8b6d-dee3b26fca72-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qkqvx\" (UID: \"98f554f9-18f1-43ab-8b6d-dee3b26fca72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qkqvx"
Jul 29 01:22:30.660869 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:30.660837    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98f554f9-18f1-43ab-8b6d-dee3b26fca72-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qkqvx\" (UID: \"98f554f9-18f1-43ab-8b6d-dee3b26fca72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qkqvx"
Jul 29 01:22:30.661068 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:30.661044    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98f554f9-18f1-43ab-8b6d-dee3b26fca72-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qkqvx\" (UID: \"98f554f9-18f1-43ab-8b6d-dee3b26fca72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qkqvx"
Jul 29 01:22:30.661138 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:30.661087    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98f554f9-18f1-43ab-8b6d-dee3b26fca72-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qkqvx\" (UID: \"98f554f9-18f1-43ab-8b6d-dee3b26fca72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qkqvx"
Jul 29 01:22:30.661194 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:30.661160    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98f554f9-18f1-43ab-8b6d-dee3b26fca72-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qkqvx\" (UID: \"98f554f9-18f1-43ab-8b6d-dee3b26fca72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qkqvx"
Jul 29 01:22:30.662866 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:30.662844    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98f554f9-18f1-43ab-8b6d-dee3b26fca72-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qkqvx\" (UID: \"98f554f9-18f1-43ab-8b6d-dee3b26fca72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qkqvx"
Jul 29 01:22:30.663117 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:30.663101    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98f554f9-18f1-43ab-8b6d-dee3b26fca72-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qkqvx\" (UID: \"98f554f9-18f1-43ab-8b6d-dee3b26fca72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qkqvx"
Jul 29 01:22:30.669051 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:30.669028    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvqh4\" (UniqueName: \"kubernetes.io/projected/98f554f9-18f1-43ab-8b6d-dee3b26fca72-kube-api-access-mvqh4\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qkqvx\" (UID: \"98f554f9-18f1-43ab-8b6d-dee3b26fca72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qkqvx"
Jul 29 01:22:30.740693 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:30.740613    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qkqvx"
Jul 29 01:22:30.872566 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:30.872541    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-qkqvx"]
Jul 29 01:22:30.874883 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:22:30.874848    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98f554f9_18f1_43ab_8b6d_dee3b26fca72.slice/crio-70b165655a71b8d9f76cd26884d426e9eb8676da716ec08c9b49391e244a532b WatchSource:0}: Error finding container 70b165655a71b8d9f76cd26884d426e9eb8676da716ec08c9b49391e244a532b: Status 404 returned error can't find the container with id 70b165655a71b8d9f76cd26884d426e9eb8676da716ec08c9b49391e244a532b
Jul 29 01:22:31.553639 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:31.553526    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8g9fl_e044d9fa-39c8-49b8-94e1-550f3dbe7b26/ovn-acl-logging/0.log"
Jul 29 01:22:31.568077 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:31.553975    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8g9fl_e044d9fa-39c8-49b8-94e1-550f3dbe7b26/ovn-acl-logging/0.log"
Jul 29 01:22:31.819799 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:31.819710    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qkqvx" event={"ID":"98f554f9-18f1-43ab-8b6d-dee3b26fca72","Type":"ContainerStarted","Data":"32dd5eda40b7a4a6336ef8f49d0d8a154e6dc12c3c2a6d53f7c8eabbf3e4a5c5"}
Jul 29 01:22:31.819799 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:31.819787    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qkqvx" event={"ID":"98f554f9-18f1-43ab-8b6d-dee3b26fca72","Type":"ContainerStarted","Data":"70b165655a71b8d9f76cd26884d426e9eb8676da716ec08c9b49391e244a532b"}
Jul 29 01:22:31.838714 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:31.838661    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qkqvx" podStartSLOduration=1.6394053830000002 podStartE2EDuration="1.838645569s" totalImagesPullingTime="199.240186ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:22:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:22:31.837040465 +0000 UTC m=+602.149433182" watchObservedRunningTime="2026-07-29 01:22:31.838645569 +0000 UTC m=+602.151038277"
Jul 29 01:22:40.741543 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:40.741482    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qkqvx"
Jul 29 01:22:40.742125 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:40.741568    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qkqvx"
Jul 29 01:22:40.754412 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:40.754385    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qkqvx"
Jul 29 01:22:40.870378 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:40.870351    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qkqvx"
Jul 29 01:22:42.515519 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:42.515464    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:22:50.227181 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:22:50.227140    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:23:02.917898 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:23:02.917805    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s5bt"]
Jul 29 01:23:02.921502 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:23:02.921480    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s5bt"
Jul 29 01:23:02.924035 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:23:02.924011    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 29 01:23:02.932173 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:23:02.932152    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s5bt"]
Jul 29 01:23:02.941039 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:23:02.941014    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:23:02.963836 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:23:02.963817    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1e91449-e616-4332-bb31-999783be4311-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7s5bt\" (UID: \"f1e91449-e616-4332-bb31-999783be4311\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s5bt"
Jul 29 01:23:02.963934 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:23:02.963842    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1e91449-e616-4332-bb31-999783be4311-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7s5bt\" (UID: \"f1e91449-e616-4332-bb31-999783be4311\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s5bt"
Jul 29 01:23:02.963934 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:23:02.963868    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1e91449-e616-4332-bb31-999783be4311-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7s5bt\" (UID: \"f1e91449-e616-4332-bb31-999783be4311\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s5bt"
Jul 29 01:23:02.964052 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:23:02.963943    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckghw\" (UniqueName: \"kubernetes.io/projected/f1e91449-e616-4332-bb31-999783be4311-kube-api-access-ckghw\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7s5bt\" (UID: \"f1e91449-e616-4332-bb31-999783be4311\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s5bt"
Jul 29 01:23:02.964052 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:23:02.963995    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1e91449-e616-4332-bb31-999783be4311-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7s5bt\" (UID: \"f1e91449-e616-4332-bb31-999783be4311\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s5bt"
Jul 29 01:23:02.964052 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:23:02.964019    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1e91449-e616-4332-bb31-999783be4311-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7s5bt\" (UID: \"f1e91449-e616-4332-bb31-999783be4311\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s5bt"
Jul 29 01:23:03.064659 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:23:03.064624    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1e91449-e616-4332-bb31-999783be4311-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7s5bt\" (UID: \"f1e91449-e616-4332-bb31-999783be4311\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s5bt"
Jul 29 01:23:03.064659 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:23:03.064659    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1e91449-e616-4332-bb31-999783be4311-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7s5bt\" (UID: \"f1e91449-e616-4332-bb31-999783be4311\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s5bt"
Jul 29 01:23:03.064880 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:23:03.064699    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1e91449-e616-4332-bb31-999783be4311-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7s5bt\" (UID: \"f1e91449-e616-4332-bb31-999783be4311\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s5bt"
Jul 29 01:23:03.064880 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:23:03.064744    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckghw\" (UniqueName: \"kubernetes.io/projected/f1e91449-e616-4332-bb31-999783be4311-kube-api-access-ckghw\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7s5bt\" (UID: \"f1e91449-e616-4332-bb31-999783be4311\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s5bt"
Jul 29 01:23:03.064880 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:23:03.064791    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1e91449-e616-4332-bb31-999783be4311-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7s5bt\" (UID: \"f1e91449-e616-4332-bb31-999783be4311\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s5bt"
Jul 29 01:23:03.064880 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:23:03.064825    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1e91449-e616-4332-bb31-999783be4311-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7s5bt\" (UID: \"f1e91449-e616-4332-bb31-999783be4311\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s5bt"
Jul 29 01:23:03.065122 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:23:03.065065    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1e91449-e616-4332-bb31-999783be4311-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7s5bt\" (UID: \"f1e91449-e616-4332-bb31-999783be4311\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s5bt"
Jul 29 01:23:03.065214 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:23:03.065192    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1e91449-e616-4332-bb31-999783be4311-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7s5bt\" (UID: \"f1e91449-e616-4332-bb31-999783be4311\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s5bt"
Jul 29 01:23:03.065264 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:23:03.065231    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1e91449-e616-4332-bb31-999783be4311-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7s5bt\" (UID: \"f1e91449-e616-4332-bb31-999783be4311\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s5bt"
Jul 29 01:23:03.066877 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:23:03.066854    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1e91449-e616-4332-bb31-999783be4311-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7s5bt\" (UID: \"f1e91449-e616-4332-bb31-999783be4311\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s5bt"
Jul 29 01:23:03.067196 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:23:03.067178    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1e91449-e616-4332-bb31-999783be4311-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7s5bt\" (UID: \"f1e91449-e616-4332-bb31-999783be4311\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s5bt"
Jul 29 01:23:03.072965 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:23:03.072931    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckghw\" (UniqueName: \"kubernetes.io/projected/f1e91449-e616-4332-bb31-999783be4311-kube-api-access-ckghw\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7s5bt\" (UID: \"f1e91449-e616-4332-bb31-999783be4311\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s5bt"
Jul 29 01:23:03.231214 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:23:03.231134    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s5bt"
Jul 29 01:23:03.362890 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:23:03.362836    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s5bt"]
Jul 29 01:23:03.365142 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:23:03.365112    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf1e91449_e616_4332_bb31_999783be4311.slice/crio-a39fc4742f8a526d0ef7a5da774484a8b9b94ac3882d82392ed457e4bd892760 WatchSource:0}: Error finding container a39fc4742f8a526d0ef7a5da774484a8b9b94ac3882d82392ed457e4bd892760: Status 404 returned error can't find the container with id a39fc4742f8a526d0ef7a5da774484a8b9b94ac3882d82392ed457e4bd892760
Jul 29 01:23:03.366510 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:23:03.366488    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 01:23:03.963203 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:23:03.963166    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s5bt" event={"ID":"f1e91449-e616-4332-bb31-999783be4311","Type":"ContainerStarted","Data":"4754cff1803ec4e2d02a2eb6c7c990db19a175203d427508ad94be2b2e5c99a1"}
Jul 29 01:23:03.963203 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:23:03.963215    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s5bt" event={"ID":"f1e91449-e616-4332-bb31-999783be4311","Type":"ContainerStarted","Data":"a39fc4742f8a526d0ef7a5da774484a8b9b94ac3882d82392ed457e4bd892760"}
Jul 29 01:23:03.980615 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:23:03.980566    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s5bt" podStartSLOduration=1.770747038 podStartE2EDuration="1.980550351s" totalImagesPullingTime="209.803313ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:23:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:23:03.979225103 +0000 UTC m=+634.291617814" watchObservedRunningTime="2026-07-29 01:23:03.980550351 +0000 UTC m=+634.292943060"
Jul 29 01:23:13.231717 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:23:13.231675    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s5bt"
Jul 29 01:23:13.231717 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:23:13.231728    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s5bt"
Jul 29 01:23:13.244428 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:23:13.244401    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s5bt"
Jul 29 01:23:14.020106 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:23:14.020074    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s5bt"
Jul 29 01:24:01.729727 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:24:01.729692    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:24:01.794526 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:24:01.794491    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:24:02.105336 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:24:02.105251    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:24:02.206045 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:24:02.206005    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:24:03.266087 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:24:03.266049    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:24:03.423486 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:24:03.423455    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:25:23.793867 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:25:23.793827    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:26:00.998924 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:26:00.998841    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:26:01.523702 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:26:01.523664    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:26:01.625017 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:26:01.624974    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:26:09.665250 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:26:09.665209    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:26:10.869072 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:26:10.869034    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:26:17.294243 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:26:17.294192    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:26:17.347894 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:26:17.347852    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:26:45.145591 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:26:45.145552    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:26:45.243843 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:26:45.243808    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:26:45.345889 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:26:45.345847    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:26:51.061691 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:26:51.061643    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:26:51.166739 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:26:51.166705    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:26:51.264485 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:26:51.264455    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:26:51.413588 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:26:51.413555    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:26:57.026910 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:26:57.026874    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:26:57.127105 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:26:57.127070    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:27:31.581249 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:27:31.581136    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8g9fl_e044d9fa-39c8-49b8-94e1-550f3dbe7b26/ovn-acl-logging/0.log"
Jul 29 01:27:31.585375 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:27:31.584026    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8g9fl_e044d9fa-39c8-49b8-94e1-550f3dbe7b26/ovn-acl-logging/0.log"
Jul 29 01:29:31.393266 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:29:31.393172    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:31:13.389417 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:31:13.389383    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:31:13.444060 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:31:13.444026    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:32:31.610261 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:32:31.610241    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8g9fl_e044d9fa-39c8-49b8-94e1-550f3dbe7b26/ovn-acl-logging/0.log"
Jul 29 01:32:31.614320 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:32:31.613524    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8g9fl_e044d9fa-39c8-49b8-94e1-550f3dbe7b26/ovn-acl-logging/0.log"
Jul 29 01:33:52.079854 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:33:52.079818    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:35:05.433857 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:35:05.433771    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:35:32.584618 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:35:32.584585    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:35:34.285165 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:35:34.285132    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:36:22.077756 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:36:22.077675    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:36:22.773330 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:36:22.773293    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:36:49.519648 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:36:49.519595    2580 prober.go:120] "Probe failed" probeType="Liveness" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-238.ec2.internal" podUID="fc633d594ee9635d73371706219c2df2" containerName="haproxy" probeResult="failure" output="Get \"https://172.20.0.1:6443/version\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Jul 29 01:37:16.447635 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:37:16.447590    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:37:16.549583 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:37:16.549551    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:37:31.638104 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:37:31.637999    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8g9fl_e044d9fa-39c8-49b8-94e1-550f3dbe7b26/ovn-acl-logging/0.log"
Jul 29 01:37:31.642961 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:37:31.642935    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8g9fl_e044d9fa-39c8-49b8-94e1-550f3dbe7b26/ovn-acl-logging/0.log"
Jul 29 01:37:52.357204 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:37:52.357124    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:39:31.150434 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:39:31.150323    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:39:52.658007 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:39:52.657933    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:39:55.593567 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:39:55.593529    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:39:55.692001 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:39:55.691965    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:39:56.017140 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:39:56.017107    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:40:01.747673 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:01.747634    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:40:01.848294 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:01.848264    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:40:02.082470 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:02.082371    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:40:02.269652 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:02.269616    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:40:02.589123 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:02.589089    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:40:08.083820 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:08.083780    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:40:08.983807 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:08.983776    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ed6c6ab5-84b6dc585b-gv4r5"]
Jul 29 01:40:08.987171 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:08.987150    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ed6c6ab5-84b6dc585b-gv4r5"
Jul 29 01:40:08.990207 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:08.990181    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-ed6c6ab5-dockercfg-6c7w8\""
Jul 29 01:40:08.990427 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:08.990411    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-ed6c6ab5\""
Jul 29 01:40:08.996752 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:08.996726    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhq6t\" (UniqueName: \"kubernetes.io/projected/84ad418e-1d96-4687-8a4f-1bac2e4510f2-kube-api-access-bhq6t\") pod \"payload-pre-processing-e2e-ait-ed6c6ab5-84b6dc585b-gv4r5\" (UID: \"84ad418e-1d96-4687-8a4f-1bac2e4510f2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ed6c6ab5-84b6dc585b-gv4r5"
Jul 29 01:40:08.996981 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:08.996945    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84ad418e-1d96-4687-8a4f-1bac2e4510f2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-ed6c6ab5-84b6dc585b-gv4r5\" (UID: \"84ad418e-1d96-4687-8a4f-1bac2e4510f2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ed6c6ab5-84b6dc585b-gv4r5"
Jul 29 01:40:08.999416 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:08.999395    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ed6c6ab5-84b6dc585b-gv4r5"]
Jul 29 01:40:09.001627 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:09.001608    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ed6c6ab5-5d547768fb-7hbqr"]
Jul 29 01:40:09.004979 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:09.004962    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ed6c6ab5-5d547768fb-7hbqr"
Jul 29 01:40:09.016723 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:09.016703    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ed6c6ab5-5d547768fb-7hbqr"]
Jul 29 01:40:09.098029 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:09.097995    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/377ca589-cf7d-4f3e-9571-c839e7137328-plugins-config-volume\") pod \"payload-processing-e2e-ait-ed6c6ab5-5d547768fb-7hbqr\" (UID: \"377ca589-cf7d-4f3e-9571-c839e7137328\") " pod="openshift-ingress/payload-processing-e2e-ait-ed6c6ab5-5d547768fb-7hbqr"
Jul 29 01:40:09.098456 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:09.098108    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhq6t\" (UniqueName: \"kubernetes.io/projected/84ad418e-1d96-4687-8a4f-1bac2e4510f2-kube-api-access-bhq6t\") pod \"payload-pre-processing-e2e-ait-ed6c6ab5-84b6dc585b-gv4r5\" (UID: \"84ad418e-1d96-4687-8a4f-1bac2e4510f2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ed6c6ab5-84b6dc585b-gv4r5"
Jul 29 01:40:09.098456 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:09.098134    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5rqm\" (UniqueName: \"kubernetes.io/projected/377ca589-cf7d-4f3e-9571-c839e7137328-kube-api-access-b5rqm\") pod \"payload-processing-e2e-ait-ed6c6ab5-5d547768fb-7hbqr\" (UID: \"377ca589-cf7d-4f3e-9571-c839e7137328\") " pod="openshift-ingress/payload-processing-e2e-ait-ed6c6ab5-5d547768fb-7hbqr"
Jul 29 01:40:09.098456 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:09.098175    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84ad418e-1d96-4687-8a4f-1bac2e4510f2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-ed6c6ab5-84b6dc585b-gv4r5\" (UID: \"84ad418e-1d96-4687-8a4f-1bac2e4510f2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ed6c6ab5-84b6dc585b-gv4r5"
Jul 29 01:40:09.098825 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:09.098803    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84ad418e-1d96-4687-8a4f-1bac2e4510f2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-ed6c6ab5-84b6dc585b-gv4r5\" (UID: \"84ad418e-1d96-4687-8a4f-1bac2e4510f2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ed6c6ab5-84b6dc585b-gv4r5"
Jul 29 01:40:09.106392 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:09.106370    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhq6t\" (UniqueName: \"kubernetes.io/projected/84ad418e-1d96-4687-8a4f-1bac2e4510f2-kube-api-access-bhq6t\") pod \"payload-pre-processing-e2e-ait-ed6c6ab5-84b6dc585b-gv4r5\" (UID: \"84ad418e-1d96-4687-8a4f-1bac2e4510f2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ed6c6ab5-84b6dc585b-gv4r5"
Jul 29 01:40:09.199404 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:09.199360    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5rqm\" (UniqueName: \"kubernetes.io/projected/377ca589-cf7d-4f3e-9571-c839e7137328-kube-api-access-b5rqm\") pod \"payload-processing-e2e-ait-ed6c6ab5-5d547768fb-7hbqr\" (UID: \"377ca589-cf7d-4f3e-9571-c839e7137328\") " pod="openshift-ingress/payload-processing-e2e-ait-ed6c6ab5-5d547768fb-7hbqr"
Jul 29 01:40:09.199587 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:09.199480    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/377ca589-cf7d-4f3e-9571-c839e7137328-plugins-config-volume\") pod \"payload-processing-e2e-ait-ed6c6ab5-5d547768fb-7hbqr\" (UID: \"377ca589-cf7d-4f3e-9571-c839e7137328\") " pod="openshift-ingress/payload-processing-e2e-ait-ed6c6ab5-5d547768fb-7hbqr"
Jul 29 01:40:09.200207 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:09.200177    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/377ca589-cf7d-4f3e-9571-c839e7137328-plugins-config-volume\") pod \"payload-processing-e2e-ait-ed6c6ab5-5d547768fb-7hbqr\" (UID: \"377ca589-cf7d-4f3e-9571-c839e7137328\") " pod="openshift-ingress/payload-processing-e2e-ait-ed6c6ab5-5d547768fb-7hbqr"
Jul 29 01:40:09.212378 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:09.212357    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5rqm\" (UniqueName: \"kubernetes.io/projected/377ca589-cf7d-4f3e-9571-c839e7137328-kube-api-access-b5rqm\") pod \"payload-processing-e2e-ait-ed6c6ab5-5d547768fb-7hbqr\" (UID: \"377ca589-cf7d-4f3e-9571-c839e7137328\") " pod="openshift-ingress/payload-processing-e2e-ait-ed6c6ab5-5d547768fb-7hbqr"
Jul 29 01:40:09.299535 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:09.299445    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ed6c6ab5-84b6dc585b-gv4r5"
Jul 29 01:40:09.315510 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:09.315481    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ed6c6ab5-5d547768fb-7hbqr"
Jul 29 01:40:09.439007 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:09.438981    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ed6c6ab5-84b6dc585b-gv4r5"]
Jul 29 01:40:09.441654 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:40:09.441626    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84ad418e_1d96_4687_8a4f_1bac2e4510f2.slice/crio-711180b0841001abe11e94251f49627070a28bba156debf9cca24f7fed73ddb7 WatchSource:0}: Error finding container 711180b0841001abe11e94251f49627070a28bba156debf9cca24f7fed73ddb7: Status 404 returned error can't find the container with id 711180b0841001abe11e94251f49627070a28bba156debf9cca24f7fed73ddb7
Jul 29 01:40:09.469295 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:09.469272    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ed6c6ab5-5d547768fb-7hbqr"]
Jul 29 01:40:09.475078 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:40:09.475054    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod377ca589_cf7d_4f3e_9571_c839e7137328.slice/crio-4d456de2120e7bde111667983ba36ca9b773539e9fd9ff4433fa05656f32b8e4 WatchSource:0}: Error finding container 4d456de2120e7bde111667983ba36ca9b773539e9fd9ff4433fa05656f32b8e4: Status 404 returned error can't find the container with id 4d456de2120e7bde111667983ba36ca9b773539e9fd9ff4433fa05656f32b8e4
Jul 29 01:40:09.660927 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:09.660878    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ed6c6ab5-84b6dc585b-gv4r5" event={"ID":"84ad418e-1d96-4687-8a4f-1bac2e4510f2","Type":"ContainerStarted","Data":"d2a0298d68e0a0b443824513bb03f6470ef4fb7e9b59abd02c8c436ac6f306c5"}
Jul 29 01:40:09.661136 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:09.661053    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-ed6c6ab5-84b6dc585b-gv4r5"
Jul 29 01:40:09.661136 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:09.661085    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ed6c6ab5-84b6dc585b-gv4r5" event={"ID":"84ad418e-1d96-4687-8a4f-1bac2e4510f2","Type":"ContainerStarted","Data":"711180b0841001abe11e94251f49627070a28bba156debf9cca24f7fed73ddb7"}
Jul 29 01:40:09.662546 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:09.662513    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ed6c6ab5-5d547768fb-7hbqr" event={"ID":"377ca589-cf7d-4f3e-9571-c839e7137328","Type":"ContainerStarted","Data":"8c0452524b90f0a4a8786a47e312dabc6426c81d9ea3f976bceb805ad9910cdb"}
Jul 29 01:40:09.662678 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:09.662558    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ed6c6ab5-5d547768fb-7hbqr" event={"ID":"377ca589-cf7d-4f3e-9571-c839e7137328","Type":"ContainerStarted","Data":"4d456de2120e7bde111667983ba36ca9b773539e9fd9ff4433fa05656f32b8e4"}
Jul 29 01:40:09.662678 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:09.662599    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-ed6c6ab5-5d547768fb-7hbqr"
Jul 29 01:40:09.677790 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:09.677745    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-ed6c6ab5-84b6dc585b-gv4r5" podStartSLOduration=1.677731934 podStartE2EDuration="1.677731934s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:40:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:40:09.676620723 +0000 UTC m=+1659.989013433" watchObservedRunningTime="2026-07-29 01:40:09.677731934 +0000 UTC m=+1659.990124641"
Jul 29 01:40:09.701595 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:09.701550    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-ed6c6ab5-5d547768fb-7hbqr" podStartSLOduration=1.701536637 podStartE2EDuration="1.701536637s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:40:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:40:09.700377787 +0000 UTC m=+1660.012770508" watchObservedRunningTime="2026-07-29 01:40:09.701536637 +0000 UTC m=+1660.013929373"
Jul 29 01:40:09.707841 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:09.707806    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:40:20.669307 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:20.669278    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-ed6c6ab5-5d547768fb-7hbqr"
Jul 29 01:40:20.669713 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:20.669349    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-ed6c6ab5-84b6dc585b-gv4r5"
Jul 29 01:40:39.007050 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:39.007014    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:40:39.029118 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:39.029085    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ed6c6ab5-5d547768fb-7hbqr"]
Jul 29 01:40:39.029324 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:39.029298    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-ed6c6ab5-5d547768fb-7hbqr" podUID="377ca589-cf7d-4f3e-9571-c839e7137328" containerName="payload-processing" containerID="cri-o://8c0452524b90f0a4a8786a47e312dabc6426c81d9ea3f976bceb805ad9910cdb" gracePeriod=30
Jul 29 01:40:39.041351 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:39.041326    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ed6c6ab5-84b6dc585b-gv4r5"]
Jul 29 01:40:39.041564 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:39.041538    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-ed6c6ab5-84b6dc585b-gv4r5" podUID="84ad418e-1d96-4687-8a4f-1bac2e4510f2" containerName="payload-pre-processing" containerID="cri-o://d2a0298d68e0a0b443824513bb03f6470ef4fb7e9b59abd02c8c436ac6f306c5" gracePeriod=30
Jul 29 01:40:39.122324 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:39.122293    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:40:39.196014 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:39.195978    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:40:39.325407 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:39.325372    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ed6c6ab5-5d547768fb-7hbqr"
Jul 29 01:40:39.328322 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:39.328302    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ed6c6ab5-84b6dc585b-gv4r5"
Jul 29 01:40:39.359835 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:39.359799    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:40:39.469057 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:39.469024    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhq6t\" (UniqueName: \"kubernetes.io/projected/84ad418e-1d96-4687-8a4f-1bac2e4510f2-kube-api-access-bhq6t\") pod \"84ad418e-1d96-4687-8a4f-1bac2e4510f2\" (UID: \"84ad418e-1d96-4687-8a4f-1bac2e4510f2\") "
Jul 29 01:40:39.469237 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:39.469080    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84ad418e-1d96-4687-8a4f-1bac2e4510f2-plugins-config-volume\") pod \"84ad418e-1d96-4687-8a4f-1bac2e4510f2\" (UID: \"84ad418e-1d96-4687-8a4f-1bac2e4510f2\") "
Jul 29 01:40:39.469237 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:39.469118    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b5rqm\" (UniqueName: \"kubernetes.io/projected/377ca589-cf7d-4f3e-9571-c839e7137328-kube-api-access-b5rqm\") pod \"377ca589-cf7d-4f3e-9571-c839e7137328\" (UID: \"377ca589-cf7d-4f3e-9571-c839e7137328\") "
Jul 29 01:40:39.469237 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:39.469156    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/377ca589-cf7d-4f3e-9571-c839e7137328-plugins-config-volume\") pod \"377ca589-cf7d-4f3e-9571-c839e7137328\" (UID: \"377ca589-cf7d-4f3e-9571-c839e7137328\") "
Jul 29 01:40:39.469522 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:39.469498    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84ad418e-1d96-4687-8a4f-1bac2e4510f2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "84ad418e-1d96-4687-8a4f-1bac2e4510f2" (UID: "84ad418e-1d96-4687-8a4f-1bac2e4510f2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:40:39.469590 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:39.469514    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/377ca589-cf7d-4f3e-9571-c839e7137328-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "377ca589-cf7d-4f3e-9571-c839e7137328" (UID: "377ca589-cf7d-4f3e-9571-c839e7137328"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:40:39.471381 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:39.471356    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84ad418e-1d96-4687-8a4f-1bac2e4510f2-kube-api-access-bhq6t" (OuterVolumeSpecName: "kube-api-access-bhq6t") pod "84ad418e-1d96-4687-8a4f-1bac2e4510f2" (UID: "84ad418e-1d96-4687-8a4f-1bac2e4510f2"). InnerVolumeSpecName "kube-api-access-bhq6t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:40:39.471450 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:39.471390    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/377ca589-cf7d-4f3e-9571-c839e7137328-kube-api-access-b5rqm" (OuterVolumeSpecName: "kube-api-access-b5rqm") pod "377ca589-cf7d-4f3e-9571-c839e7137328" (UID: "377ca589-cf7d-4f3e-9571-c839e7137328"). InnerVolumeSpecName "kube-api-access-b5rqm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:40:39.570243 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:39.570149    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhq6t\" (UniqueName: \"kubernetes.io/projected/84ad418e-1d96-4687-8a4f-1bac2e4510f2-kube-api-access-bhq6t\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:40:39.570243 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:39.570188    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84ad418e-1d96-4687-8a4f-1bac2e4510f2-plugins-config-volume\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:40:39.570243 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:39.570203    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b5rqm\" (UniqueName: \"kubernetes.io/projected/377ca589-cf7d-4f3e-9571-c839e7137328-kube-api-access-b5rqm\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:40:39.570243 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:39.570216    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/377ca589-cf7d-4f3e-9571-c839e7137328-plugins-config-volume\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:40:39.573088 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:39.573051    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:40:39.806463 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:39.806427    2580 generic.go:356] "Generic (PLEG): container finished" podID="377ca589-cf7d-4f3e-9571-c839e7137328" containerID="8c0452524b90f0a4a8786a47e312dabc6426c81d9ea3f976bceb805ad9910cdb" exitCode=0
Jul 29 01:40:39.806714 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:39.806488    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ed6c6ab5-5d547768fb-7hbqr"
Jul 29 01:40:39.806714 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:39.806520    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ed6c6ab5-5d547768fb-7hbqr" event={"ID":"377ca589-cf7d-4f3e-9571-c839e7137328","Type":"ContainerDied","Data":"8c0452524b90f0a4a8786a47e312dabc6426c81d9ea3f976bceb805ad9910cdb"}
Jul 29 01:40:39.806714 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:39.806574    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ed6c6ab5-5d547768fb-7hbqr" event={"ID":"377ca589-cf7d-4f3e-9571-c839e7137328","Type":"ContainerDied","Data":"4d456de2120e7bde111667983ba36ca9b773539e9fd9ff4433fa05656f32b8e4"}
Jul 29 01:40:39.806714 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:39.806602    2580 scope.go:117] "RemoveContainer" containerID="8c0452524b90f0a4a8786a47e312dabc6426c81d9ea3f976bceb805ad9910cdb"
Jul 29 01:40:39.808024 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:39.807998    2580 generic.go:356] "Generic (PLEG): container finished" podID="84ad418e-1d96-4687-8a4f-1bac2e4510f2" containerID="d2a0298d68e0a0b443824513bb03f6470ef4fb7e9b59abd02c8c436ac6f306c5" exitCode=0
Jul 29 01:40:39.808147 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:39.808024    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ed6c6ab5-84b6dc585b-gv4r5" event={"ID":"84ad418e-1d96-4687-8a4f-1bac2e4510f2","Type":"ContainerDied","Data":"d2a0298d68e0a0b443824513bb03f6470ef4fb7e9b59abd02c8c436ac6f306c5"}
Jul 29 01:40:39.808147 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:39.808048    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ed6c6ab5-84b6dc585b-gv4r5"
Jul 29 01:40:39.808147 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:39.808064    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ed6c6ab5-84b6dc585b-gv4r5" event={"ID":"84ad418e-1d96-4687-8a4f-1bac2e4510f2","Type":"ContainerDied","Data":"711180b0841001abe11e94251f49627070a28bba156debf9cca24f7fed73ddb7"}
Jul 29 01:40:39.815726 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:39.815709    2580 scope.go:117] "RemoveContainer" containerID="8c0452524b90f0a4a8786a47e312dabc6426c81d9ea3f976bceb805ad9910cdb"
Jul 29 01:40:39.816013 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:40:39.815983    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c0452524b90f0a4a8786a47e312dabc6426c81d9ea3f976bceb805ad9910cdb\": container with ID starting with 8c0452524b90f0a4a8786a47e312dabc6426c81d9ea3f976bceb805ad9910cdb not found: ID does not exist" containerID="8c0452524b90f0a4a8786a47e312dabc6426c81d9ea3f976bceb805ad9910cdb"
Jul 29 01:40:39.816110 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:39.816020    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c0452524b90f0a4a8786a47e312dabc6426c81d9ea3f976bceb805ad9910cdb"} err="failed to get container status \"8c0452524b90f0a4a8786a47e312dabc6426c81d9ea3f976bceb805ad9910cdb\": rpc error: code = NotFound desc = could not find container \"8c0452524b90f0a4a8786a47e312dabc6426c81d9ea3f976bceb805ad9910cdb\": container with ID starting with 8c0452524b90f0a4a8786a47e312dabc6426c81d9ea3f976bceb805ad9910cdb not found: ID does not exist"
Jul 29 01:40:39.816110 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:39.816039    2580 scope.go:117] "RemoveContainer" containerID="d2a0298d68e0a0b443824513bb03f6470ef4fb7e9b59abd02c8c436ac6f306c5"
Jul 29 01:40:39.819891 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:39.819867    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:40:39.824155 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:39.824132    2580 scope.go:117] "RemoveContainer" containerID="d2a0298d68e0a0b443824513bb03f6470ef4fb7e9b59abd02c8c436ac6f306c5"
Jul 29 01:40:39.824413 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:40:39.824395    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2a0298d68e0a0b443824513bb03f6470ef4fb7e9b59abd02c8c436ac6f306c5\": container with ID starting with d2a0298d68e0a0b443824513bb03f6470ef4fb7e9b59abd02c8c436ac6f306c5 not found: ID does not exist" containerID="d2a0298d68e0a0b443824513bb03f6470ef4fb7e9b59abd02c8c436ac6f306c5"
Jul 29 01:40:39.824470 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:39.824421    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2a0298d68e0a0b443824513bb03f6470ef4fb7e9b59abd02c8c436ac6f306c5"} err="failed to get container status \"d2a0298d68e0a0b443824513bb03f6470ef4fb7e9b59abd02c8c436ac6f306c5\": rpc error: code = NotFound desc = could not find container \"d2a0298d68e0a0b443824513bb03f6470ef4fb7e9b59abd02c8c436ac6f306c5\": container with ID starting with d2a0298d68e0a0b443824513bb03f6470ef4fb7e9b59abd02c8c436ac6f306c5 not found: ID does not exist"
Jul 29 01:40:39.842139 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:39.842111    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ed6c6ab5-84b6dc585b-gv4r5"]
Jul 29 01:40:39.855176 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:39.855144    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ed6c6ab5-84b6dc585b-gv4r5"]
Jul 29 01:40:39.870169 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:39.870140    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ed6c6ab5-5d547768fb-7hbqr"]
Jul 29 01:40:39.878550 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:39.878522    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ed6c6ab5-5d547768fb-7hbqr"]
Jul 29 01:40:39.899733 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:39.899706    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:40:40.040974 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:40.040928    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:40:40.171310 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:40.171275    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="377ca589-cf7d-4f3e-9571-c839e7137328" path="/var/lib/kubelet/pods/377ca589-cf7d-4f3e-9571-c839e7137328/volumes"
Jul 29 01:40:40.172152 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:40.172130    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84ad418e-1d96-4687-8a4f-1bac2e4510f2" path="/var/lib/kubelet/pods/84ad418e-1d96-4687-8a4f-1bac2e4510f2/volumes"
Jul 29 01:40:40.384170 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:40.384124    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:40:40.684298 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:40.684262    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:40:43.381641 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:43.381594    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:40:43.494459 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:43.494425    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:40:43.785622 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:43.785521    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:40:44.006620 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:44.006578    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:40:44.107093 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:44.107009    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:40:44.145771 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:44.145740    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-6870a9be-75497db7d5-9mnzl"]
Jul 29 01:40:44.146144 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:44.146131    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="377ca589-cf7d-4f3e-9571-c839e7137328" containerName="payload-processing"
Jul 29 01:40:44.146200 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:44.146146    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="377ca589-cf7d-4f3e-9571-c839e7137328" containerName="payload-processing"
Jul 29 01:40:44.146200 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:44.146160    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84ad418e-1d96-4687-8a4f-1bac2e4510f2" containerName="payload-pre-processing"
Jul 29 01:40:44.146200 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:44.146166    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="84ad418e-1d96-4687-8a4f-1bac2e4510f2" containerName="payload-pre-processing"
Jul 29 01:40:44.146308 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:44.146224    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="377ca589-cf7d-4f3e-9571-c839e7137328" containerName="payload-processing"
Jul 29 01:40:44.146308 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:44.146233    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="84ad418e-1d96-4687-8a4f-1bac2e4510f2" containerName="payload-pre-processing"
Jul 29 01:40:44.150796 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:44.150777    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-6870a9be-75497db7d5-9mnzl"
Jul 29 01:40:44.153402 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:44.153377    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-6870a9be\""
Jul 29 01:40:44.153559 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:44.153541    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-6870a9be-dockercfg-rmc4w\""
Jul 29 01:40:44.171399 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:44.171378    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-6870a9be-75497db7d5-9mnzl"]
Jul 29 01:40:44.178972 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:44.178691    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-6870a9be-688959d88d-n7z7p"]
Jul 29 01:40:44.182077 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:44.182062    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6870a9be-688959d88d-n7z7p"
Jul 29 01:40:44.195825 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:44.195796    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-6870a9be-688959d88d-n7z7p"]
Jul 29 01:40:44.317324 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:44.317280    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j76dn\" (UniqueName: \"kubernetes.io/projected/82cff297-c9e2-4873-ac0f-449bccb541c6-kube-api-access-j76dn\") pod \"payload-pre-processing-e2e-migrate-6870a9be-688959d88d-n7z7p\" (UID: \"82cff297-c9e2-4873-ac0f-449bccb541c6\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-6870a9be-688959d88d-n7z7p"
Jul 29 01:40:44.317517 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:44.317413    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d852def2-ac32-4aff-8343-e1d76376eed1-plugins-config-volume\") pod \"payload-processing-e2e-migrate-6870a9be-75497db7d5-9mnzl\" (UID: \"d852def2-ac32-4aff-8343-e1d76376eed1\") " pod="openshift-ingress/payload-processing-e2e-migrate-6870a9be-75497db7d5-9mnzl"
Jul 29 01:40:44.317517 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:44.317452    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h54h\" (UniqueName: \"kubernetes.io/projected/d852def2-ac32-4aff-8343-e1d76376eed1-kube-api-access-5h54h\") pod \"payload-processing-e2e-migrate-6870a9be-75497db7d5-9mnzl\" (UID: \"d852def2-ac32-4aff-8343-e1d76376eed1\") " pod="openshift-ingress/payload-processing-e2e-migrate-6870a9be-75497db7d5-9mnzl"
Jul 29 01:40:44.317517 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:44.317487    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82cff297-c9e2-4873-ac0f-449bccb541c6-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-6870a9be-688959d88d-n7z7p\" (UID: \"82cff297-c9e2-4873-ac0f-449bccb541c6\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-6870a9be-688959d88d-n7z7p"
Jul 29 01:40:44.418639 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:44.418594    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d852def2-ac32-4aff-8343-e1d76376eed1-plugins-config-volume\") pod \"payload-processing-e2e-migrate-6870a9be-75497db7d5-9mnzl\" (UID: \"d852def2-ac32-4aff-8343-e1d76376eed1\") " pod="openshift-ingress/payload-processing-e2e-migrate-6870a9be-75497db7d5-9mnzl"
Jul 29 01:40:44.418639 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:44.418640    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h54h\" (UniqueName: \"kubernetes.io/projected/d852def2-ac32-4aff-8343-e1d76376eed1-kube-api-access-5h54h\") pod \"payload-processing-e2e-migrate-6870a9be-75497db7d5-9mnzl\" (UID: \"d852def2-ac32-4aff-8343-e1d76376eed1\") " pod="openshift-ingress/payload-processing-e2e-migrate-6870a9be-75497db7d5-9mnzl"
Jul 29 01:40:44.419271 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:44.418673    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82cff297-c9e2-4873-ac0f-449bccb541c6-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-6870a9be-688959d88d-n7z7p\" (UID: \"82cff297-c9e2-4873-ac0f-449bccb541c6\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-6870a9be-688959d88d-n7z7p"
Jul 29 01:40:44.419271 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:44.418718    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j76dn\" (UniqueName: \"kubernetes.io/projected/82cff297-c9e2-4873-ac0f-449bccb541c6-kube-api-access-j76dn\") pod \"payload-pre-processing-e2e-migrate-6870a9be-688959d88d-n7z7p\" (UID: \"82cff297-c9e2-4873-ac0f-449bccb541c6\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-6870a9be-688959d88d-n7z7p"
Jul 29 01:40:44.419536 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:44.419509    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82cff297-c9e2-4873-ac0f-449bccb541c6-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-6870a9be-688959d88d-n7z7p\" (UID: \"82cff297-c9e2-4873-ac0f-449bccb541c6\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-6870a9be-688959d88d-n7z7p"
Jul 29 01:40:44.419626 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:44.419603    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d852def2-ac32-4aff-8343-e1d76376eed1-plugins-config-volume\") pod \"payload-processing-e2e-migrate-6870a9be-75497db7d5-9mnzl\" (UID: \"d852def2-ac32-4aff-8343-e1d76376eed1\") " pod="openshift-ingress/payload-processing-e2e-migrate-6870a9be-75497db7d5-9mnzl"
Jul 29 01:40:44.426844 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:44.426816    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j76dn\" (UniqueName: \"kubernetes.io/projected/82cff297-c9e2-4873-ac0f-449bccb541c6-kube-api-access-j76dn\") pod \"payload-pre-processing-e2e-migrate-6870a9be-688959d88d-n7z7p\" (UID: \"82cff297-c9e2-4873-ac0f-449bccb541c6\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-6870a9be-688959d88d-n7z7p"
Jul 29 01:40:44.427041 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:44.426815    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h54h\" (UniqueName: \"kubernetes.io/projected/d852def2-ac32-4aff-8343-e1d76376eed1-kube-api-access-5h54h\") pod \"payload-processing-e2e-migrate-6870a9be-75497db7d5-9mnzl\" (UID: \"d852def2-ac32-4aff-8343-e1d76376eed1\") " pod="openshift-ingress/payload-processing-e2e-migrate-6870a9be-75497db7d5-9mnzl"
Jul 29 01:40:44.461042 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:44.461001    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-6870a9be-75497db7d5-9mnzl"
Jul 29 01:40:44.492104 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:44.492067    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6870a9be-688959d88d-n7z7p"
Jul 29 01:40:44.619315 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:44.619231    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-6870a9be-75497db7d5-9mnzl"]
Jul 29 01:40:44.621177 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:40:44.621148    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd852def2_ac32_4aff_8343_e1d76376eed1.slice/crio-a1bf12d7dd0b5841b35b636f6312486e5d503713987bc26f06b2be761376b23e WatchSource:0}: Error finding container a1bf12d7dd0b5841b35b636f6312486e5d503713987bc26f06b2be761376b23e: Status 404 returned error can't find the container with id a1bf12d7dd0b5841b35b636f6312486e5d503713987bc26f06b2be761376b23e
Jul 29 01:40:44.650752 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:44.650724    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-6870a9be-688959d88d-n7z7p"]
Jul 29 01:40:44.659457 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:40:44.659425    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82cff297_c9e2_4873_ac0f_449bccb541c6.slice/crio-970579f4c2ee9bd1db99f15779c46f016bf72a12ca3ac33c11eed0faa4e83541 WatchSource:0}: Error finding container 970579f4c2ee9bd1db99f15779c46f016bf72a12ca3ac33c11eed0faa4e83541: Status 404 returned error can't find the container with id 970579f4c2ee9bd1db99f15779c46f016bf72a12ca3ac33c11eed0faa4e83541
Jul 29 01:40:44.834346 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:44.834003    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-6870a9be-75497db7d5-9mnzl" event={"ID":"d852def2-ac32-4aff-8343-e1d76376eed1","Type":"ContainerStarted","Data":"1d4ad8a6bfd210595dcf73b79eaa773300716bd7bbe1b3e3f1ba007706d62207"}
Jul 29 01:40:44.834346 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:44.834080    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-6870a9be-75497db7d5-9mnzl" event={"ID":"d852def2-ac32-4aff-8343-e1d76376eed1","Type":"ContainerStarted","Data":"a1bf12d7dd0b5841b35b636f6312486e5d503713987bc26f06b2be761376b23e"}
Jul 29 01:40:44.834346 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:44.834114    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-6870a9be-75497db7d5-9mnzl"
Jul 29 01:40:44.836076 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:44.836044    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6870a9be-688959d88d-n7z7p" event={"ID":"82cff297-c9e2-4873-ac0f-449bccb541c6","Type":"ContainerStarted","Data":"b1a6e6dccc154685164f9301b79e6f663ea725b625d55cea0a97e30639c0a0e5"}
Jul 29 01:40:44.836222 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:44.836106    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6870a9be-688959d88d-n7z7p"
Jul 29 01:40:44.836222 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:44.836125    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6870a9be-688959d88d-n7z7p" event={"ID":"82cff297-c9e2-4873-ac0f-449bccb541c6","Type":"ContainerStarted","Data":"970579f4c2ee9bd1db99f15779c46f016bf72a12ca3ac33c11eed0faa4e83541"}
Jul 29 01:40:44.853198 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:44.853129    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-6870a9be-75497db7d5-9mnzl" podStartSLOduration=0.8531061 podStartE2EDuration="853.1061ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:40:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:40:44.850675163 +0000 UTC m=+1695.163067874" watchObservedRunningTime="2026-07-29 01:40:44.8531061 +0000 UTC m=+1695.165498811"
Jul 29 01:40:44.867278 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:44.867223    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6870a9be-688959d88d-n7z7p" podStartSLOduration=0.867205257 podStartE2EDuration="867.205257ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:40:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:40:44.866717418 +0000 UTC m=+1695.179110126" watchObservedRunningTime="2026-07-29 01:40:44.867205257 +0000 UTC m=+1695.179597964"
Jul 29 01:40:55.844196 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:55.844111    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-6870a9be-75497db7d5-9mnzl"
Jul 29 01:40:55.844715 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:40:55.844277    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6870a9be-688959d88d-n7z7p"
Jul 29 01:41:15.032659 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:15.032626    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:41:15.067602 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:15.067568    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-6870a9be-75497db7d5-9mnzl"]
Jul 29 01:41:15.067848 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:15.067817    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-6870a9be-75497db7d5-9mnzl" podUID="d852def2-ac32-4aff-8343-e1d76376eed1" containerName="payload-processing" containerID="cri-o://1d4ad8a6bfd210595dcf73b79eaa773300716bd7bbe1b3e3f1ba007706d62207" gracePeriod=30
Jul 29 01:41:15.074709 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:15.074680    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-6870a9be-688959d88d-n7z7p"]
Jul 29 01:41:15.074975 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:15.074902    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6870a9be-688959d88d-n7z7p" podUID="82cff297-c9e2-4873-ac0f-449bccb541c6" containerName="payload-pre-processing" containerID="cri-o://b1a6e6dccc154685164f9301b79e6f663ea725b625d55cea0a97e30639c0a0e5" gracePeriod=30
Jul 29 01:41:15.107092 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:15.107066    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:41:15.177696 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:15.177651    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:41:15.192184 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:41:15.192154    2580 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82cff297_c9e2_4873_ac0f_449bccb541c6.slice/crio-b1a6e6dccc154685164f9301b79e6f663ea725b625d55cea0a97e30639c0a0e5.scope\": RecentStats: unable to find data in memory cache]"
Jul 29 01:41:15.276219 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:15.276172    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:41:15.356397 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:15.356355    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-6870a9be-75497db7d5-9mnzl"
Jul 29 01:41:15.359170 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:15.359153    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6870a9be-688959d88d-n7z7p"
Jul 29 01:41:15.481776 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:15.481742    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:41:15.499978 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:15.499938    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82cff297-c9e2-4873-ac0f-449bccb541c6-plugins-config-volume\") pod \"82cff297-c9e2-4873-ac0f-449bccb541c6\" (UID: \"82cff297-c9e2-4873-ac0f-449bccb541c6\") "
Jul 29 01:41:15.500106 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:15.500010    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j76dn\" (UniqueName: \"kubernetes.io/projected/82cff297-c9e2-4873-ac0f-449bccb541c6-kube-api-access-j76dn\") pod \"82cff297-c9e2-4873-ac0f-449bccb541c6\" (UID: \"82cff297-c9e2-4873-ac0f-449bccb541c6\") "
Jul 29 01:41:15.500106 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:15.500086    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5h54h\" (UniqueName: \"kubernetes.io/projected/d852def2-ac32-4aff-8343-e1d76376eed1-kube-api-access-5h54h\") pod \"d852def2-ac32-4aff-8343-e1d76376eed1\" (UID: \"d852def2-ac32-4aff-8343-e1d76376eed1\") "
Jul 29 01:41:15.500227 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:15.500120    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d852def2-ac32-4aff-8343-e1d76376eed1-plugins-config-volume\") pod \"d852def2-ac32-4aff-8343-e1d76376eed1\" (UID: \"d852def2-ac32-4aff-8343-e1d76376eed1\") "
Jul 29 01:41:15.500324 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:15.500301    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82cff297-c9e2-4873-ac0f-449bccb541c6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "82cff297-c9e2-4873-ac0f-449bccb541c6" (UID: "82cff297-c9e2-4873-ac0f-449bccb541c6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:41:15.500508 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:15.500492    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82cff297-c9e2-4873-ac0f-449bccb541c6-plugins-config-volume\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:41:15.500567 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:15.500536    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d852def2-ac32-4aff-8343-e1d76376eed1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d852def2-ac32-4aff-8343-e1d76376eed1" (UID: "d852def2-ac32-4aff-8343-e1d76376eed1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:41:15.502078 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:15.502060    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82cff297-c9e2-4873-ac0f-449bccb541c6-kube-api-access-j76dn" (OuterVolumeSpecName: "kube-api-access-j76dn") pod "82cff297-c9e2-4873-ac0f-449bccb541c6" (UID: "82cff297-c9e2-4873-ac0f-449bccb541c6"). InnerVolumeSpecName "kube-api-access-j76dn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:41:15.502139 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:15.502079    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d852def2-ac32-4aff-8343-e1d76376eed1-kube-api-access-5h54h" (OuterVolumeSpecName: "kube-api-access-5h54h") pod "d852def2-ac32-4aff-8343-e1d76376eed1" (UID: "d852def2-ac32-4aff-8343-e1d76376eed1"). InnerVolumeSpecName "kube-api-access-5h54h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:41:15.589029 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:15.588930    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:41:15.601544 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:15.601521    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j76dn\" (UniqueName: \"kubernetes.io/projected/82cff297-c9e2-4873-ac0f-449bccb541c6-kube-api-access-j76dn\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:41:15.601544 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:15.601543    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5h54h\" (UniqueName: \"kubernetes.io/projected/d852def2-ac32-4aff-8343-e1d76376eed1-kube-api-access-5h54h\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:41:15.601688 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:15.601552    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d852def2-ac32-4aff-8343-e1d76376eed1-plugins-config-volume\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:41:15.799618 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:15.799587    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:41:15.986768 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:15.986737    2580 generic.go:356] "Generic (PLEG): container finished" podID="82cff297-c9e2-4873-ac0f-449bccb541c6" containerID="b1a6e6dccc154685164f9301b79e6f663ea725b625d55cea0a97e30639c0a0e5" exitCode=0
Jul 29 01:41:15.986942 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:15.986787    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6870a9be-688959d88d-n7z7p"
Jul 29 01:41:15.986942 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:15.986791    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6870a9be-688959d88d-n7z7p" event={"ID":"82cff297-c9e2-4873-ac0f-449bccb541c6","Type":"ContainerDied","Data":"b1a6e6dccc154685164f9301b79e6f663ea725b625d55cea0a97e30639c0a0e5"}
Jul 29 01:41:15.986942 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:15.986854    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6870a9be-688959d88d-n7z7p" event={"ID":"82cff297-c9e2-4873-ac0f-449bccb541c6","Type":"ContainerDied","Data":"970579f4c2ee9bd1db99f15779c46f016bf72a12ca3ac33c11eed0faa4e83541"}
Jul 29 01:41:15.986942 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:15.986885    2580 scope.go:117] "RemoveContainer" containerID="b1a6e6dccc154685164f9301b79e6f663ea725b625d55cea0a97e30639c0a0e5"
Jul 29 01:41:15.988139 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:15.988114    2580 generic.go:356] "Generic (PLEG): container finished" podID="d852def2-ac32-4aff-8343-e1d76376eed1" containerID="1d4ad8a6bfd210595dcf73b79eaa773300716bd7bbe1b3e3f1ba007706d62207" exitCode=0
Jul 29 01:41:15.988257 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:15.988150    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-6870a9be-75497db7d5-9mnzl" event={"ID":"d852def2-ac32-4aff-8343-e1d76376eed1","Type":"ContainerDied","Data":"1d4ad8a6bfd210595dcf73b79eaa773300716bd7bbe1b3e3f1ba007706d62207"}
Jul 29 01:41:15.988257 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:15.988192    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-6870a9be-75497db7d5-9mnzl" event={"ID":"d852def2-ac32-4aff-8343-e1d76376eed1","Type":"ContainerDied","Data":"a1bf12d7dd0b5841b35b636f6312486e5d503713987bc26f06b2be761376b23e"}
Jul 29 01:41:15.988257 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:15.988154    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-6870a9be-75497db7d5-9mnzl"
Jul 29 01:41:15.995094 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:15.995077    2580 scope.go:117] "RemoveContainer" containerID="b1a6e6dccc154685164f9301b79e6f663ea725b625d55cea0a97e30639c0a0e5"
Jul 29 01:41:15.995366 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:41:15.995348    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1a6e6dccc154685164f9301b79e6f663ea725b625d55cea0a97e30639c0a0e5\": container with ID starting with b1a6e6dccc154685164f9301b79e6f663ea725b625d55cea0a97e30639c0a0e5 not found: ID does not exist" containerID="b1a6e6dccc154685164f9301b79e6f663ea725b625d55cea0a97e30639c0a0e5"
Jul 29 01:41:15.995410 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:15.995373    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1a6e6dccc154685164f9301b79e6f663ea725b625d55cea0a97e30639c0a0e5"} err="failed to get container status \"b1a6e6dccc154685164f9301b79e6f663ea725b625d55cea0a97e30639c0a0e5\": rpc error: code = NotFound desc = could not find container \"b1a6e6dccc154685164f9301b79e6f663ea725b625d55cea0a97e30639c0a0e5\": container with ID starting with b1a6e6dccc154685164f9301b79e6f663ea725b625d55cea0a97e30639c0a0e5 not found: ID does not exist"
Jul 29 01:41:15.995410 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:15.995388    2580 scope.go:117] "RemoveContainer" containerID="1d4ad8a6bfd210595dcf73b79eaa773300716bd7bbe1b3e3f1ba007706d62207"
Jul 29 01:41:16.003551 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:16.003537    2580 scope.go:117] "RemoveContainer" containerID="1d4ad8a6bfd210595dcf73b79eaa773300716bd7bbe1b3e3f1ba007706d62207"
Jul 29 01:41:16.003773 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:41:16.003755    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d4ad8a6bfd210595dcf73b79eaa773300716bd7bbe1b3e3f1ba007706d62207\": container with ID starting with 1d4ad8a6bfd210595dcf73b79eaa773300716bd7bbe1b3e3f1ba007706d62207 not found: ID does not exist" containerID="1d4ad8a6bfd210595dcf73b79eaa773300716bd7bbe1b3e3f1ba007706d62207"
Jul 29 01:41:16.003815 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:16.003782    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d4ad8a6bfd210595dcf73b79eaa773300716bd7bbe1b3e3f1ba007706d62207"} err="failed to get container status \"1d4ad8a6bfd210595dcf73b79eaa773300716bd7bbe1b3e3f1ba007706d62207\": rpc error: code = NotFound desc = could not find container \"1d4ad8a6bfd210595dcf73b79eaa773300716bd7bbe1b3e3f1ba007706d62207\": container with ID starting with 1d4ad8a6bfd210595dcf73b79eaa773300716bd7bbe1b3e3f1ba007706d62207 not found: ID does not exist"
Jul 29 01:41:16.015312 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:16.015293    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-6870a9be-688959d88d-n7z7p"]
Jul 29 01:41:16.022008 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:16.021987    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-6870a9be-688959d88d-n7z7p"]
Jul 29 01:41:16.032617 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:16.032595    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-6870a9be-75497db7d5-9mnzl"]
Jul 29 01:41:16.034756 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:16.034733    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-6870a9be-75497db7d5-9mnzl"]
Jul 29 01:41:16.106396 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:16.106364    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:41:16.169994 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:16.169963    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82cff297-c9e2-4873-ac0f-449bccb541c6" path="/var/lib/kubelet/pods/82cff297-c9e2-4873-ac0f-449bccb541c6/volumes"
Jul 29 01:41:16.170349 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:16.170336    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d852def2-ac32-4aff-8343-e1d76376eed1" path="/var/lib/kubelet/pods/d852def2-ac32-4aff-8343-e1d76376eed1/volumes"
Jul 29 01:41:16.216967 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:16.216922    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:41:18.527130 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:18.527090    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:41:18.611505 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:18.611467    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:41:18.690739 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:18.690694    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:41:19.214985 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:19.214927    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:41:19.318060 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:19.318021    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:41:19.324202 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:19.324165    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a3670250-566c4484cb-2mjsv"]
Jul 29 01:41:19.324583 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:19.324570    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82cff297-c9e2-4873-ac0f-449bccb541c6" containerName="payload-pre-processing"
Jul 29 01:41:19.324631 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:19.324585    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="82cff297-c9e2-4873-ac0f-449bccb541c6" containerName="payload-pre-processing"
Jul 29 01:41:19.324631 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:19.324613    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d852def2-ac32-4aff-8343-e1d76376eed1" containerName="payload-processing"
Jul 29 01:41:19.324631 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:19.324621    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d852def2-ac32-4aff-8343-e1d76376eed1" containerName="payload-processing"
Jul 29 01:41:19.324739 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:19.324685    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d852def2-ac32-4aff-8343-e1d76376eed1" containerName="payload-processing"
Jul 29 01:41:19.324739 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:19.324694    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="82cff297-c9e2-4873-ac0f-449bccb541c6" containerName="payload-pre-processing"
Jul 29 01:41:19.329343 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:19.329324    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-a3670250-566c4484cb-2mjsv"
Jul 29 01:41:19.335714 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:19.335689    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-a3670250\""
Jul 29 01:41:19.335873 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:19.335695    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-a3670250-dockercfg-xfn2z\""
Jul 29 01:41:19.349510 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:19.349480    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a3670250-566c4484cb-2mjsv"]
Jul 29 01:41:19.365882 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:19.365851    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a3670250-64dfcf7fb4-vzjxw"]
Jul 29 01:41:19.369623 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:19.369598    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-a3670250-64dfcf7fb4-vzjxw"
Jul 29 01:41:19.386989 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:19.386944    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a3670250-64dfcf7fb4-vzjxw"]
Jul 29 01:41:19.425936 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:19.425902    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:41:19.436147 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:19.436108    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/700feacb-8263-466c-b868-c8a87d6843a8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-a3670250-566c4484cb-2mjsv\" (UID: \"700feacb-8263-466c-b868-c8a87d6843a8\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a3670250-566c4484cb-2mjsv"
Jul 29 01:41:19.436311 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:19.436169    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxfck\" (UniqueName: \"kubernetes.io/projected/2ecf2aaf-8293-4a44-b77a-17c43b6b33a3-kube-api-access-mxfck\") pod \"payload-processing-e2e-ait-a3670250-64dfcf7fb4-vzjxw\" (UID: \"2ecf2aaf-8293-4a44-b77a-17c43b6b33a3\") " pod="openshift-ingress/payload-processing-e2e-ait-a3670250-64dfcf7fb4-vzjxw"
Jul 29 01:41:19.436311 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:19.436226    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fjpj\" (UniqueName: \"kubernetes.io/projected/700feacb-8263-466c-b868-c8a87d6843a8-kube-api-access-5fjpj\") pod \"payload-pre-processing-e2e-ait-a3670250-566c4484cb-2mjsv\" (UID: \"700feacb-8263-466c-b868-c8a87d6843a8\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a3670250-566c4484cb-2mjsv"
Jul 29 01:41:19.436311 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:19.436274    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ecf2aaf-8293-4a44-b77a-17c43b6b33a3-plugins-config-volume\") pod \"payload-processing-e2e-ait-a3670250-64dfcf7fb4-vzjxw\" (UID: \"2ecf2aaf-8293-4a44-b77a-17c43b6b33a3\") " pod="openshift-ingress/payload-processing-e2e-ait-a3670250-64dfcf7fb4-vzjxw"
Jul 29 01:41:19.537337 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:19.537249    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ecf2aaf-8293-4a44-b77a-17c43b6b33a3-plugins-config-volume\") pod \"payload-processing-e2e-ait-a3670250-64dfcf7fb4-vzjxw\" (UID: \"2ecf2aaf-8293-4a44-b77a-17c43b6b33a3\") " pod="openshift-ingress/payload-processing-e2e-ait-a3670250-64dfcf7fb4-vzjxw"
Jul 29 01:41:19.537337 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:19.537328    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/700feacb-8263-466c-b868-c8a87d6843a8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-a3670250-566c4484cb-2mjsv\" (UID: \"700feacb-8263-466c-b868-c8a87d6843a8\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a3670250-566c4484cb-2mjsv"
Jul 29 01:41:19.537881 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:19.537360    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxfck\" (UniqueName: \"kubernetes.io/projected/2ecf2aaf-8293-4a44-b77a-17c43b6b33a3-kube-api-access-mxfck\") pod \"payload-processing-e2e-ait-a3670250-64dfcf7fb4-vzjxw\" (UID: \"2ecf2aaf-8293-4a44-b77a-17c43b6b33a3\") " pod="openshift-ingress/payload-processing-e2e-ait-a3670250-64dfcf7fb4-vzjxw"
Jul 29 01:41:19.537881 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:19.537395    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fjpj\" (UniqueName: \"kubernetes.io/projected/700feacb-8263-466c-b868-c8a87d6843a8-kube-api-access-5fjpj\") pod \"payload-pre-processing-e2e-ait-a3670250-566c4484cb-2mjsv\" (UID: \"700feacb-8263-466c-b868-c8a87d6843a8\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a3670250-566c4484cb-2mjsv"
Jul 29 01:41:19.538065 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:19.538043    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ecf2aaf-8293-4a44-b77a-17c43b6b33a3-plugins-config-volume\") pod \"payload-processing-e2e-ait-a3670250-64dfcf7fb4-vzjxw\" (UID: \"2ecf2aaf-8293-4a44-b77a-17c43b6b33a3\") " pod="openshift-ingress/payload-processing-e2e-ait-a3670250-64dfcf7fb4-vzjxw"
Jul 29 01:41:19.538219 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:19.538199    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/700feacb-8263-466c-b868-c8a87d6843a8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-a3670250-566c4484cb-2mjsv\" (UID: \"700feacb-8263-466c-b868-c8a87d6843a8\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a3670250-566c4484cb-2mjsv"
Jul 29 01:41:19.545590 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:19.545565    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxfck\" (UniqueName: \"kubernetes.io/projected/2ecf2aaf-8293-4a44-b77a-17c43b6b33a3-kube-api-access-mxfck\") pod \"payload-processing-e2e-ait-a3670250-64dfcf7fb4-vzjxw\" (UID: \"2ecf2aaf-8293-4a44-b77a-17c43b6b33a3\") " pod="openshift-ingress/payload-processing-e2e-ait-a3670250-64dfcf7fb4-vzjxw"
Jul 29 01:41:19.545778 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:19.545760    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fjpj\" (UniqueName: \"kubernetes.io/projected/700feacb-8263-466c-b868-c8a87d6843a8-kube-api-access-5fjpj\") pod \"payload-pre-processing-e2e-ait-a3670250-566c4484cb-2mjsv\" (UID: \"700feacb-8263-466c-b868-c8a87d6843a8\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a3670250-566c4484cb-2mjsv"
Jul 29 01:41:19.639871 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:19.639834    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-a3670250-566c4484cb-2mjsv"
Jul 29 01:41:19.679332 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:19.679292    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-a3670250-64dfcf7fb4-vzjxw"
Jul 29 01:41:19.783471 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:19.783440    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a3670250-566c4484cb-2mjsv"]
Jul 29 01:41:19.786124 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:41:19.786083    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod700feacb_8263_466c_b868_c8a87d6843a8.slice/crio-40c2052ea171f1c1ea8fb46d6e86a563a513cd2d2ff131e98ca40674c01aa4e1 WatchSource:0}: Error finding container 40c2052ea171f1c1ea8fb46d6e86a563a513cd2d2ff131e98ca40674c01aa4e1: Status 404 returned error can't find the container with id 40c2052ea171f1c1ea8fb46d6e86a563a513cd2d2ff131e98ca40674c01aa4e1
Jul 29 01:41:19.834746 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:19.834706    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a3670250-64dfcf7fb4-vzjxw"]
Jul 29 01:41:19.836787 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:41:19.836761    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ecf2aaf_8293_4a44_b77a_17c43b6b33a3.slice/crio-829d82839532a59bce715c2164e2ce347a5acf5e8560ebf085b9190da23fed86 WatchSource:0}: Error finding container 829d82839532a59bce715c2164e2ce347a5acf5e8560ebf085b9190da23fed86: Status 404 returned error can't find the container with id 829d82839532a59bce715c2164e2ce347a5acf5e8560ebf085b9190da23fed86
Jul 29 01:41:20.012343 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:20.012308    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-a3670250-566c4484cb-2mjsv" event={"ID":"700feacb-8263-466c-b868-c8a87d6843a8","Type":"ContainerStarted","Data":"81fa0fbf216b12b3f4ff58f53bf13ee3c275f558ad267e9ff911d3b3f5109bbe"}
Jul 29 01:41:20.012553 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:20.012364    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-a3670250-566c4484cb-2mjsv" event={"ID":"700feacb-8263-466c-b868-c8a87d6843a8","Type":"ContainerStarted","Data":"40c2052ea171f1c1ea8fb46d6e86a563a513cd2d2ff131e98ca40674c01aa4e1"}
Jul 29 01:41:20.012553 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:20.012458    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-a3670250-566c4484cb-2mjsv"
Jul 29 01:41:20.013780 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:20.013753    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-a3670250-64dfcf7fb4-vzjxw" event={"ID":"2ecf2aaf-8293-4a44-b77a-17c43b6b33a3","Type":"ContainerStarted","Data":"f743d3d58732d5b880eb457fab3fa9e4686eed3a93748ad05de05a5e963b9350"}
Jul 29 01:41:20.013899 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:20.013792    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-a3670250-64dfcf7fb4-vzjxw" event={"ID":"2ecf2aaf-8293-4a44-b77a-17c43b6b33a3","Type":"ContainerStarted","Data":"829d82839532a59bce715c2164e2ce347a5acf5e8560ebf085b9190da23fed86"}
Jul 29 01:41:20.013899 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:20.013812    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-a3670250-64dfcf7fb4-vzjxw"
Jul 29 01:41:20.029132 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:20.029085    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-a3670250-566c4484cb-2mjsv" podStartSLOduration=1.029069843 podStartE2EDuration="1.029069843s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:41:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:41:20.028815108 +0000 UTC m=+1730.341207820" watchObservedRunningTime="2026-07-29 01:41:20.029069843 +0000 UTC m=+1730.341462550"
Jul 29 01:41:20.045694 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:20.045611    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-a3670250-64dfcf7fb4-vzjxw" podStartSLOduration=1.045597367 podStartE2EDuration="1.045597367s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:41:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:41:20.044352603 +0000 UTC m=+1730.356745334" watchObservedRunningTime="2026-07-29 01:41:20.045597367 +0000 UTC m=+1730.357990074"
Jul 29 01:41:31.020551 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:31.020520    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-a3670250-64dfcf7fb4-vzjxw"
Jul 29 01:41:31.021005 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:31.020885    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-a3670250-566c4484cb-2mjsv"
Jul 29 01:41:49.244362 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:49.244316    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:41:49.275563 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:49.275531    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a3670250-64dfcf7fb4-vzjxw"]
Jul 29 01:41:49.275871 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:49.275845    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-a3670250-64dfcf7fb4-vzjxw" podUID="2ecf2aaf-8293-4a44-b77a-17c43b6b33a3" containerName="payload-processing" containerID="cri-o://f743d3d58732d5b880eb457fab3fa9e4686eed3a93748ad05de05a5e963b9350" gracePeriod=30
Jul 29 01:41:49.280502 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:49.280476    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a3670250-566c4484cb-2mjsv"]
Jul 29 01:41:49.280849 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:49.280821    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-a3670250-566c4484cb-2mjsv" podUID="700feacb-8263-466c-b868-c8a87d6843a8" containerName="payload-pre-processing" containerID="cri-o://81fa0fbf216b12b3f4ff58f53bf13ee3c275f558ad267e9ff911d3b3f5109bbe" gracePeriod=30
Jul 29 01:41:49.318695 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:49.318664    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:41:49.426972 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:49.426403    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:41:49.556937 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:49.556910    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:41:49.571487 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:49.571460    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-a3670250-64dfcf7fb4-vzjxw"
Jul 29 01:41:49.574064 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:49.574047    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-a3670250-566c4484cb-2mjsv"
Jul 29 01:41:49.614051 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:49.614026    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ecf2aaf-8293-4a44-b77a-17c43b6b33a3-plugins-config-volume\") pod \"2ecf2aaf-8293-4a44-b77a-17c43b6b33a3\" (UID: \"2ecf2aaf-8293-4a44-b77a-17c43b6b33a3\") "
Jul 29 01:41:49.614221 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:49.614123    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/700feacb-8263-466c-b868-c8a87d6843a8-plugins-config-volume\") pod \"700feacb-8263-466c-b868-c8a87d6843a8\" (UID: \"700feacb-8263-466c-b868-c8a87d6843a8\") "
Jul 29 01:41:49.614221 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:49.614140    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxfck\" (UniqueName: \"kubernetes.io/projected/2ecf2aaf-8293-4a44-b77a-17c43b6b33a3-kube-api-access-mxfck\") pod \"2ecf2aaf-8293-4a44-b77a-17c43b6b33a3\" (UID: \"2ecf2aaf-8293-4a44-b77a-17c43b6b33a3\") "
Jul 29 01:41:49.614221 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:49.614168    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5fjpj\" (UniqueName: \"kubernetes.io/projected/700feacb-8263-466c-b868-c8a87d6843a8-kube-api-access-5fjpj\") pod \"700feacb-8263-466c-b868-c8a87d6843a8\" (UID: \"700feacb-8263-466c-b868-c8a87d6843a8\") "
Jul 29 01:41:49.614533 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:49.614414    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ecf2aaf-8293-4a44-b77a-17c43b6b33a3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2ecf2aaf-8293-4a44-b77a-17c43b6b33a3" (UID: "2ecf2aaf-8293-4a44-b77a-17c43b6b33a3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:41:49.614660 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:49.614627    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ecf2aaf-8293-4a44-b77a-17c43b6b33a3-plugins-config-volume\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:41:49.615206 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:49.615117    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/700feacb-8263-466c-b868-c8a87d6843a8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "700feacb-8263-466c-b868-c8a87d6843a8" (UID: "700feacb-8263-466c-b868-c8a87d6843a8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:41:49.617186 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:49.617162    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ecf2aaf-8293-4a44-b77a-17c43b6b33a3-kube-api-access-mxfck" (OuterVolumeSpecName: "kube-api-access-mxfck") pod "2ecf2aaf-8293-4a44-b77a-17c43b6b33a3" (UID: "2ecf2aaf-8293-4a44-b77a-17c43b6b33a3"). InnerVolumeSpecName "kube-api-access-mxfck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:41:49.617672 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:49.617650    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/700feacb-8263-466c-b868-c8a87d6843a8-kube-api-access-5fjpj" (OuterVolumeSpecName: "kube-api-access-5fjpj") pod "700feacb-8263-466c-b868-c8a87d6843a8" (UID: "700feacb-8263-466c-b868-c8a87d6843a8"). InnerVolumeSpecName "kube-api-access-5fjpj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:41:49.715301 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:49.715268    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/700feacb-8263-466c-b868-c8a87d6843a8-plugins-config-volume\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:41:49.715301 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:49.715298    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxfck\" (UniqueName: \"kubernetes.io/projected/2ecf2aaf-8293-4a44-b77a-17c43b6b33a3-kube-api-access-mxfck\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:41:49.715486 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:49.715309    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5fjpj\" (UniqueName: \"kubernetes.io/projected/700feacb-8263-466c-b868-c8a87d6843a8-kube-api-access-5fjpj\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:41:50.159527 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:50.159492    2580 generic.go:356] "Generic (PLEG): container finished" podID="700feacb-8263-466c-b868-c8a87d6843a8" containerID="81fa0fbf216b12b3f4ff58f53bf13ee3c275f558ad267e9ff911d3b3f5109bbe" exitCode=0
Jul 29 01:41:50.159690 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:50.159533    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-a3670250-566c4484cb-2mjsv"
Jul 29 01:41:50.159690 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:50.159570    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-a3670250-566c4484cb-2mjsv" event={"ID":"700feacb-8263-466c-b868-c8a87d6843a8","Type":"ContainerDied","Data":"81fa0fbf216b12b3f4ff58f53bf13ee3c275f558ad267e9ff911d3b3f5109bbe"}
Jul 29 01:41:50.159690 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:50.159619    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-a3670250-566c4484cb-2mjsv" event={"ID":"700feacb-8263-466c-b868-c8a87d6843a8","Type":"ContainerDied","Data":"40c2052ea171f1c1ea8fb46d6e86a563a513cd2d2ff131e98ca40674c01aa4e1"}
Jul 29 01:41:50.159690 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:50.159652    2580 scope.go:117] "RemoveContainer" containerID="81fa0fbf216b12b3f4ff58f53bf13ee3c275f558ad267e9ff911d3b3f5109bbe"
Jul 29 01:41:50.160828 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:50.160795    2580 generic.go:356] "Generic (PLEG): container finished" podID="2ecf2aaf-8293-4a44-b77a-17c43b6b33a3" containerID="f743d3d58732d5b880eb457fab3fa9e4686eed3a93748ad05de05a5e963b9350" exitCode=0
Jul 29 01:41:50.160975 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:50.160825    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-a3670250-64dfcf7fb4-vzjxw" event={"ID":"2ecf2aaf-8293-4a44-b77a-17c43b6b33a3","Type":"ContainerDied","Data":"f743d3d58732d5b880eb457fab3fa9e4686eed3a93748ad05de05a5e963b9350"}
Jul 29 01:41:50.160975 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:50.160851    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-a3670250-64dfcf7fb4-vzjxw"
Jul 29 01:41:50.160975 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:50.160876    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-a3670250-64dfcf7fb4-vzjxw" event={"ID":"2ecf2aaf-8293-4a44-b77a-17c43b6b33a3","Type":"ContainerDied","Data":"829d82839532a59bce715c2164e2ce347a5acf5e8560ebf085b9190da23fed86"}
Jul 29 01:41:50.168790 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:50.168608    2580 scope.go:117] "RemoveContainer" containerID="81fa0fbf216b12b3f4ff58f53bf13ee3c275f558ad267e9ff911d3b3f5109bbe"
Jul 29 01:41:50.169010 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:41:50.168984    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81fa0fbf216b12b3f4ff58f53bf13ee3c275f558ad267e9ff911d3b3f5109bbe\": container with ID starting with 81fa0fbf216b12b3f4ff58f53bf13ee3c275f558ad267e9ff911d3b3f5109bbe not found: ID does not exist" containerID="81fa0fbf216b12b3f4ff58f53bf13ee3c275f558ad267e9ff911d3b3f5109bbe"
Jul 29 01:41:50.169126 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:50.169023    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81fa0fbf216b12b3f4ff58f53bf13ee3c275f558ad267e9ff911d3b3f5109bbe"} err="failed to get container status \"81fa0fbf216b12b3f4ff58f53bf13ee3c275f558ad267e9ff911d3b3f5109bbe\": rpc error: code = NotFound desc = could not find container \"81fa0fbf216b12b3f4ff58f53bf13ee3c275f558ad267e9ff911d3b3f5109bbe\": container with ID starting with 81fa0fbf216b12b3f4ff58f53bf13ee3c275f558ad267e9ff911d3b3f5109bbe not found: ID does not exist"
Jul 29 01:41:50.169126 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:50.169045    2580 scope.go:117] "RemoveContainer" containerID="f743d3d58732d5b880eb457fab3fa9e4686eed3a93748ad05de05a5e963b9350"
Jul 29 01:41:50.177788 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:50.177771    2580 scope.go:117] "RemoveContainer" containerID="f743d3d58732d5b880eb457fab3fa9e4686eed3a93748ad05de05a5e963b9350"
Jul 29 01:41:50.178040 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:41:50.178023    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f743d3d58732d5b880eb457fab3fa9e4686eed3a93748ad05de05a5e963b9350\": container with ID starting with f743d3d58732d5b880eb457fab3fa9e4686eed3a93748ad05de05a5e963b9350 not found: ID does not exist" containerID="f743d3d58732d5b880eb457fab3fa9e4686eed3a93748ad05de05a5e963b9350"
Jul 29 01:41:50.178094 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:50.178047    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f743d3d58732d5b880eb457fab3fa9e4686eed3a93748ad05de05a5e963b9350"} err="failed to get container status \"f743d3d58732d5b880eb457fab3fa9e4686eed3a93748ad05de05a5e963b9350\": rpc error: code = NotFound desc = could not find container \"f743d3d58732d5b880eb457fab3fa9e4686eed3a93748ad05de05a5e963b9350\": container with ID starting with f743d3d58732d5b880eb457fab3fa9e4686eed3a93748ad05de05a5e963b9350 not found: ID does not exist"
Jul 29 01:41:50.188709 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:50.188689    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a3670250-566c4484cb-2mjsv"]
Jul 29 01:41:50.191604 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:50.191584    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a3670250-566c4484cb-2mjsv"]
Jul 29 01:41:50.207974 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:50.207938    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a3670250-64dfcf7fb4-vzjxw"]
Jul 29 01:41:50.212115 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:50.212097    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a3670250-64dfcf7fb4-vzjxw"]
Jul 29 01:41:50.683867 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:50.683830    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:41:50.886988 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:50.886943    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:41:51.084078 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:51.084002    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:41:51.374059 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:51.374024    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:41:52.026509 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:52.026478    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:41:52.170607 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:52.170568    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ecf2aaf-8293-4a44-b77a-17c43b6b33a3" path="/var/lib/kubelet/pods/2ecf2aaf-8293-4a44-b77a-17c43b6b33a3/volumes"
Jul 29 01:41:52.171199 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:52.171178    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="700feacb-8263-466c-b868-c8a87d6843a8" path="/var/lib/kubelet/pods/700feacb-8263-466c-b868-c8a87d6843a8/volumes"
Jul 29 01:41:53.590676 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:53.590640    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:41:53.734157 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:53.734127    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:41:53.835925 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:53.835887    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:41:53.930499 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:53.930469    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:41:54.280518 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:54.280428    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:41:54.394820 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:54.394785    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-4cab099e-674497957b-6bhfj"]
Jul 29 01:41:54.395224 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:54.395207    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="700feacb-8263-466c-b868-c8a87d6843a8" containerName="payload-pre-processing"
Jul 29 01:41:54.395224 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:54.395224    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="700feacb-8263-466c-b868-c8a87d6843a8" containerName="payload-pre-processing"
Jul 29 01:41:54.395389 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:54.395242    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ecf2aaf-8293-4a44-b77a-17c43b6b33a3" containerName="payload-processing"
Jul 29 01:41:54.395389 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:54.395249    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ecf2aaf-8293-4a44-b77a-17c43b6b33a3" containerName="payload-processing"
Jul 29 01:41:54.395389 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:54.395314    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="700feacb-8263-466c-b868-c8a87d6843a8" containerName="payload-pre-processing"
Jul 29 01:41:54.395389 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:54.395328    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ecf2aaf-8293-4a44-b77a-17c43b6b33a3" containerName="payload-processing"
Jul 29 01:41:54.395820 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:54.395793    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:41:54.399483 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:54.399461    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-4cab099e-674497957b-6bhfj"
Jul 29 01:41:54.402679 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:54.402661    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-4cab099e-dockercfg-n2cb5\""
Jul 29 01:41:54.403139 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:54.403121    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-4cab099e\""
Jul 29 01:41:54.411267 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:54.411244    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-4cab099e-674497957b-6bhfj"]
Jul 29 01:41:54.432267 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:54.432239    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-4cab099e-fc5c68958-5qp49"]
Jul 29 01:41:54.435621 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:54.435602    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-4cab099e-fc5c68958-5qp49"
Jul 29 01:41:54.455873 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:54.455849    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mr9cs\" (UniqueName: \"kubernetes.io/projected/4d4f4c8f-c033-49ea-b01d-b68133508c00-kube-api-access-mr9cs\") pod \"payload-pre-processing-e2e-derive-4cab099e-674497957b-6bhfj\" (UID: \"4d4f4c8f-c033-49ea-b01d-b68133508c00\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-4cab099e-674497957b-6bhfj"
Jul 29 01:41:54.456036 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:54.455880    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d4f4c8f-c033-49ea-b01d-b68133508c00-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-4cab099e-674497957b-6bhfj\" (UID: \"4d4f4c8f-c033-49ea-b01d-b68133508c00\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-4cab099e-674497957b-6bhfj"
Jul 29 01:41:54.460747 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:54.460723    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-4cab099e-fc5c68958-5qp49"]
Jul 29 01:41:54.557106 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:54.557013    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mr9cs\" (UniqueName: \"kubernetes.io/projected/4d4f4c8f-c033-49ea-b01d-b68133508c00-kube-api-access-mr9cs\") pod \"payload-pre-processing-e2e-derive-4cab099e-674497957b-6bhfj\" (UID: \"4d4f4c8f-c033-49ea-b01d-b68133508c00\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-4cab099e-674497957b-6bhfj"
Jul 29 01:41:54.557106 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:54.557058    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p925p\" (UniqueName: \"kubernetes.io/projected/b45a417e-54db-4d29-9496-0598e82c836a-kube-api-access-p925p\") pod \"payload-processing-e2e-derive-4cab099e-fc5c68958-5qp49\" (UID: \"b45a417e-54db-4d29-9496-0598e82c836a\") " pod="openshift-ingress/payload-processing-e2e-derive-4cab099e-fc5c68958-5qp49"
Jul 29 01:41:54.557336 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:54.557182    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d4f4c8f-c033-49ea-b01d-b68133508c00-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-4cab099e-674497957b-6bhfj\" (UID: \"4d4f4c8f-c033-49ea-b01d-b68133508c00\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-4cab099e-674497957b-6bhfj"
Jul 29 01:41:54.557336 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:54.557223    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b45a417e-54db-4d29-9496-0598e82c836a-plugins-config-volume\") pod \"payload-processing-e2e-derive-4cab099e-fc5c68958-5qp49\" (UID: \"b45a417e-54db-4d29-9496-0598e82c836a\") " pod="openshift-ingress/payload-processing-e2e-derive-4cab099e-fc5c68958-5qp49"
Jul 29 01:41:54.557934 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:54.557910    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d4f4c8f-c033-49ea-b01d-b68133508c00-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-4cab099e-674497957b-6bhfj\" (UID: \"4d4f4c8f-c033-49ea-b01d-b68133508c00\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-4cab099e-674497957b-6bhfj"
Jul 29 01:41:54.565965 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:54.565926    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr9cs\" (UniqueName: \"kubernetes.io/projected/4d4f4c8f-c033-49ea-b01d-b68133508c00-kube-api-access-mr9cs\") pod \"payload-pre-processing-e2e-derive-4cab099e-674497957b-6bhfj\" (UID: \"4d4f4c8f-c033-49ea-b01d-b68133508c00\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-4cab099e-674497957b-6bhfj"
Jul 29 01:41:54.658653 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:54.658613    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p925p\" (UniqueName: \"kubernetes.io/projected/b45a417e-54db-4d29-9496-0598e82c836a-kube-api-access-p925p\") pod \"payload-processing-e2e-derive-4cab099e-fc5c68958-5qp49\" (UID: \"b45a417e-54db-4d29-9496-0598e82c836a\") " pod="openshift-ingress/payload-processing-e2e-derive-4cab099e-fc5c68958-5qp49"
Jul 29 01:41:54.658653 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:54.658657    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b45a417e-54db-4d29-9496-0598e82c836a-plugins-config-volume\") pod \"payload-processing-e2e-derive-4cab099e-fc5c68958-5qp49\" (UID: \"b45a417e-54db-4d29-9496-0598e82c836a\") " pod="openshift-ingress/payload-processing-e2e-derive-4cab099e-fc5c68958-5qp49"
Jul 29 01:41:54.659483 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:54.659448    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b45a417e-54db-4d29-9496-0598e82c836a-plugins-config-volume\") pod \"payload-processing-e2e-derive-4cab099e-fc5c68958-5qp49\" (UID: \"b45a417e-54db-4d29-9496-0598e82c836a\") " pod="openshift-ingress/payload-processing-e2e-derive-4cab099e-fc5c68958-5qp49"
Jul 29 01:41:54.669170 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:54.669146    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p925p\" (UniqueName: \"kubernetes.io/projected/b45a417e-54db-4d29-9496-0598e82c836a-kube-api-access-p925p\") pod \"payload-processing-e2e-derive-4cab099e-fc5c68958-5qp49\" (UID: \"b45a417e-54db-4d29-9496-0598e82c836a\") " pod="openshift-ingress/payload-processing-e2e-derive-4cab099e-fc5c68958-5qp49"
Jul 29 01:41:54.710122 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:54.710089    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-4cab099e-674497957b-6bhfj"
Jul 29 01:41:54.747166 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:54.747134    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-4cab099e-fc5c68958-5qp49"
Jul 29 01:41:54.854044 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:54.854017    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-4cab099e-674497957b-6bhfj"]
Jul 29 01:41:54.856233 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:41:54.856172    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d4f4c8f_c033_49ea_b01d_b68133508c00.slice/crio-ab2ae61e4ed8be612a81a54b2710a672c8e853d6ec0ba381c17f7db0f6eb1446 WatchSource:0}: Error finding container ab2ae61e4ed8be612a81a54b2710a672c8e853d6ec0ba381c17f7db0f6eb1446: Status 404 returned error can't find the container with id ab2ae61e4ed8be612a81a54b2710a672c8e853d6ec0ba381c17f7db0f6eb1446
Jul 29 01:41:55.100600 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:55.100574    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-4cab099e-fc5c68958-5qp49"]
Jul 29 01:41:55.102286 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:41:55.102260    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb45a417e_54db_4d29_9496_0598e82c836a.slice/crio-75ae6dead6289f32db87ed7ed0b84d51d8276711998f59699898b55c48007919 WatchSource:0}: Error finding container 75ae6dead6289f32db87ed7ed0b84d51d8276711998f59699898b55c48007919: Status 404 returned error can't find the container with id 75ae6dead6289f32db87ed7ed0b84d51d8276711998f59699898b55c48007919
Jul 29 01:41:55.188596 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:55.188555    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-4cab099e-674497957b-6bhfj" event={"ID":"4d4f4c8f-c033-49ea-b01d-b68133508c00","Type":"ContainerStarted","Data":"dd1c990cceb20d6408cd1908aa22d945227a36bd0a7199d57933fad15122fffd"}
Jul 29 01:41:55.188766 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:55.188616    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-4cab099e-674497957b-6bhfj" event={"ID":"4d4f4c8f-c033-49ea-b01d-b68133508c00","Type":"ContainerStarted","Data":"ab2ae61e4ed8be612a81a54b2710a672c8e853d6ec0ba381c17f7db0f6eb1446"}
Jul 29 01:41:55.188766 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:55.188648    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-4cab099e-674497957b-6bhfj"
Jul 29 01:41:55.190086 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:55.190061    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-4cab099e-fc5c68958-5qp49" event={"ID":"b45a417e-54db-4d29-9496-0598e82c836a","Type":"ContainerStarted","Data":"d8483df690e6355cf0c1c45dc050c50395fefa2bcbdb935bbecbf44813eb0aab"}
Jul 29 01:41:55.190178 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:55.190105    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-4cab099e-fc5c68958-5qp49" event={"ID":"b45a417e-54db-4d29-9496-0598e82c836a","Type":"ContainerStarted","Data":"75ae6dead6289f32db87ed7ed0b84d51d8276711998f59699898b55c48007919"}
Jul 29 01:41:55.190178 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:55.190127    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-4cab099e-fc5c68958-5qp49"
Jul 29 01:41:55.204985 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:55.204919    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-4cab099e-674497957b-6bhfj" podStartSLOduration=1.204906006 podStartE2EDuration="1.204906006s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:41:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:41:55.20382574 +0000 UTC m=+1765.516218448" watchObservedRunningTime="2026-07-29 01:41:55.204906006 +0000 UTC m=+1765.517298715"
Jul 29 01:41:55.220021 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:41:55.219975    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-4cab099e-fc5c68958-5qp49" podStartSLOduration=1.219944436 podStartE2EDuration="1.219944436s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:41:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:41:55.218761232 +0000 UTC m=+1765.531153940" watchObservedRunningTime="2026-07-29 01:41:55.219944436 +0000 UTC m=+1765.532337144"
Jul 29 01:42:06.196854 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:06.196825    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-4cab099e-674497957b-6bhfj"
Jul 29 01:42:06.197332 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:06.196896    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-4cab099e-fc5c68958-5qp49"
Jul 29 01:42:24.455586 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:24.455553    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:42:24.480632 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:24.480599    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-4cab099e-fc5c68958-5qp49"]
Jul 29 01:42:24.480891 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:24.480842    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-4cab099e-fc5c68958-5qp49" podUID="b45a417e-54db-4d29-9496-0598e82c836a" containerName="payload-processing" containerID="cri-o://d8483df690e6355cf0c1c45dc050c50395fefa2bcbdb935bbecbf44813eb0aab" gracePeriod=30
Jul 29 01:42:24.485830 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:24.485802    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-4cab099e-674497957b-6bhfj"]
Jul 29 01:42:24.486490 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:24.486441    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-4cab099e-674497957b-6bhfj" podUID="4d4f4c8f-c033-49ea-b01d-b68133508c00" containerName="payload-pre-processing" containerID="cri-o://dd1c990cceb20d6408cd1908aa22d945227a36bd0a7199d57933fad15122fffd" gracePeriod=30
Jul 29 01:42:24.527350 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:24.527316    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:42:24.591732 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:24.591704    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:42:24.692116 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:24.692090    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:42:24.771511 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:24.771490    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-4cab099e-fc5c68958-5qp49"
Jul 29 01:42:24.773535 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:24.773518    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-4cab099e-674497957b-6bhfj"
Jul 29 01:42:24.792499 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:24.792469    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:42:24.823368 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:24.823339    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d4f4c8f-c033-49ea-b01d-b68133508c00-plugins-config-volume\") pod \"4d4f4c8f-c033-49ea-b01d-b68133508c00\" (UID: \"4d4f4c8f-c033-49ea-b01d-b68133508c00\") "
Jul 29 01:42:24.823499 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:24.823396    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p925p\" (UniqueName: \"kubernetes.io/projected/b45a417e-54db-4d29-9496-0598e82c836a-kube-api-access-p925p\") pod \"b45a417e-54db-4d29-9496-0598e82c836a\" (UID: \"b45a417e-54db-4d29-9496-0598e82c836a\") "
Jul 29 01:42:24.823499 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:24.823425    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mr9cs\" (UniqueName: \"kubernetes.io/projected/4d4f4c8f-c033-49ea-b01d-b68133508c00-kube-api-access-mr9cs\") pod \"4d4f4c8f-c033-49ea-b01d-b68133508c00\" (UID: \"4d4f4c8f-c033-49ea-b01d-b68133508c00\") "
Jul 29 01:42:24.823609 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:24.823504    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b45a417e-54db-4d29-9496-0598e82c836a-plugins-config-volume\") pod \"b45a417e-54db-4d29-9496-0598e82c836a\" (UID: \"b45a417e-54db-4d29-9496-0598e82c836a\") "
Jul 29 01:42:24.823850 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:24.823805    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d4f4c8f-c033-49ea-b01d-b68133508c00-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4d4f4c8f-c033-49ea-b01d-b68133508c00" (UID: "4d4f4c8f-c033-49ea-b01d-b68133508c00"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:42:24.823993 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:24.823938    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b45a417e-54db-4d29-9496-0598e82c836a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b45a417e-54db-4d29-9496-0598e82c836a" (UID: "b45a417e-54db-4d29-9496-0598e82c836a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:42:24.825558 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:24.825538    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d4f4c8f-c033-49ea-b01d-b68133508c00-kube-api-access-mr9cs" (OuterVolumeSpecName: "kube-api-access-mr9cs") pod "4d4f4c8f-c033-49ea-b01d-b68133508c00" (UID: "4d4f4c8f-c033-49ea-b01d-b68133508c00"). InnerVolumeSpecName "kube-api-access-mr9cs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:42:24.825647 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:24.825603    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b45a417e-54db-4d29-9496-0598e82c836a-kube-api-access-p925p" (OuterVolumeSpecName: "kube-api-access-p925p") pod "b45a417e-54db-4d29-9496-0598e82c836a" (UID: "b45a417e-54db-4d29-9496-0598e82c836a"). InnerVolumeSpecName "kube-api-access-p925p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:42:24.925144 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:24.925116    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b45a417e-54db-4d29-9496-0598e82c836a-plugins-config-volume\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:42:24.925144 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:24.925138    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d4f4c8f-c033-49ea-b01d-b68133508c00-plugins-config-volume\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:42:24.925144 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:24.925149    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p925p\" (UniqueName: \"kubernetes.io/projected/b45a417e-54db-4d29-9496-0598e82c836a-kube-api-access-p925p\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:42:24.925364 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:24.925158    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mr9cs\" (UniqueName: \"kubernetes.io/projected/4d4f4c8f-c033-49ea-b01d-b68133508c00-kube-api-access-mr9cs\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:42:24.999844 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:24.999764    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:42:25.342586 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:25.342507    2580 generic.go:356] "Generic (PLEG): container finished" podID="4d4f4c8f-c033-49ea-b01d-b68133508c00" containerID="dd1c990cceb20d6408cd1908aa22d945227a36bd0a7199d57933fad15122fffd" exitCode=0
Jul 29 01:42:25.342586 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:25.342552    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-4cab099e-674497957b-6bhfj"
Jul 29 01:42:25.342797 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:25.342597    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-4cab099e-674497957b-6bhfj" event={"ID":"4d4f4c8f-c033-49ea-b01d-b68133508c00","Type":"ContainerDied","Data":"dd1c990cceb20d6408cd1908aa22d945227a36bd0a7199d57933fad15122fffd"}
Jul 29 01:42:25.342797 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:25.342658    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-4cab099e-674497957b-6bhfj" event={"ID":"4d4f4c8f-c033-49ea-b01d-b68133508c00","Type":"ContainerDied","Data":"ab2ae61e4ed8be612a81a54b2710a672c8e853d6ec0ba381c17f7db0f6eb1446"}
Jul 29 01:42:25.342797 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:25.342693    2580 scope.go:117] "RemoveContainer" containerID="dd1c990cceb20d6408cd1908aa22d945227a36bd0a7199d57933fad15122fffd"
Jul 29 01:42:25.343916 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:25.343897    2580 generic.go:356] "Generic (PLEG): container finished" podID="b45a417e-54db-4d29-9496-0598e82c836a" containerID="d8483df690e6355cf0c1c45dc050c50395fefa2bcbdb935bbecbf44813eb0aab" exitCode=0
Jul 29 01:42:25.344031 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:25.343937    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-4cab099e-fc5c68958-5qp49"
Jul 29 01:42:25.344031 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:25.343983    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-4cab099e-fc5c68958-5qp49" event={"ID":"b45a417e-54db-4d29-9496-0598e82c836a","Type":"ContainerDied","Data":"d8483df690e6355cf0c1c45dc050c50395fefa2bcbdb935bbecbf44813eb0aab"}
Jul 29 01:42:25.344146 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:25.344038    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-4cab099e-fc5c68958-5qp49" event={"ID":"b45a417e-54db-4d29-9496-0598e82c836a","Type":"ContainerDied","Data":"75ae6dead6289f32db87ed7ed0b84d51d8276711998f59699898b55c48007919"}
Jul 29 01:42:25.351695 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:25.351676    2580 scope.go:117] "RemoveContainer" containerID="dd1c990cceb20d6408cd1908aa22d945227a36bd0a7199d57933fad15122fffd"
Jul 29 01:42:25.351989 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:42:25.351970    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd1c990cceb20d6408cd1908aa22d945227a36bd0a7199d57933fad15122fffd\": container with ID starting with dd1c990cceb20d6408cd1908aa22d945227a36bd0a7199d57933fad15122fffd not found: ID does not exist" containerID="dd1c990cceb20d6408cd1908aa22d945227a36bd0a7199d57933fad15122fffd"
Jul 29 01:42:25.352072 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:25.351996    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd1c990cceb20d6408cd1908aa22d945227a36bd0a7199d57933fad15122fffd"} err="failed to get container status \"dd1c990cceb20d6408cd1908aa22d945227a36bd0a7199d57933fad15122fffd\": rpc error: code = NotFound desc = could not find container \"dd1c990cceb20d6408cd1908aa22d945227a36bd0a7199d57933fad15122fffd\": container with ID starting with dd1c990cceb20d6408cd1908aa22d945227a36bd0a7199d57933fad15122fffd not found: ID does not exist"
Jul 29 01:42:25.352072 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:25.352015    2580 scope.go:117] "RemoveContainer" containerID="d8483df690e6355cf0c1c45dc050c50395fefa2bcbdb935bbecbf44813eb0aab"
Jul 29 01:42:25.359816 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:25.359799    2580 scope.go:117] "RemoveContainer" containerID="d8483df690e6355cf0c1c45dc050c50395fefa2bcbdb935bbecbf44813eb0aab"
Jul 29 01:42:25.360054 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:42:25.360037    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8483df690e6355cf0c1c45dc050c50395fefa2bcbdb935bbecbf44813eb0aab\": container with ID starting with d8483df690e6355cf0c1c45dc050c50395fefa2bcbdb935bbecbf44813eb0aab not found: ID does not exist" containerID="d8483df690e6355cf0c1c45dc050c50395fefa2bcbdb935bbecbf44813eb0aab"
Jul 29 01:42:25.360106 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:25.360060    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8483df690e6355cf0c1c45dc050c50395fefa2bcbdb935bbecbf44813eb0aab"} err="failed to get container status \"d8483df690e6355cf0c1c45dc050c50395fefa2bcbdb935bbecbf44813eb0aab\": rpc error: code = NotFound desc = could not find container \"d8483df690e6355cf0c1c45dc050c50395fefa2bcbdb935bbecbf44813eb0aab\": container with ID starting with d8483df690e6355cf0c1c45dc050c50395fefa2bcbdb935bbecbf44813eb0aab not found: ID does not exist"
Jul 29 01:42:25.367865 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:25.367844    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-4cab099e-fc5c68958-5qp49"]
Jul 29 01:42:25.370393 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:25.370365    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-4cab099e-fc5c68958-5qp49"]
Jul 29 01:42:25.380509 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:25.380491    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-4cab099e-674497957b-6bhfj"]
Jul 29 01:42:25.384548 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:25.384529    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-4cab099e-674497957b-6bhfj"]
Jul 29 01:42:25.466146 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:25.466116    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:42:25.555620 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:25.555595    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:42:25.655110 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:25.655074    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:42:26.169732 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:26.169701    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d4f4c8f-c033-49ea-b01d-b68133508c00" path="/var/lib/kubelet/pods/4d4f4c8f-c033-49ea-b01d-b68133508c00/volumes"
Jul 29 01:42:26.170083 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:26.170071    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b45a417e-54db-4d29-9496-0598e82c836a" path="/var/lib/kubelet/pods/b45a417e-54db-4d29-9496-0598e82c836a/volumes"
Jul 29 01:42:27.010915 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:27.010883    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:42:30.117635 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:30.117597    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:42:30.218801 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:30.218773    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:42:31.669426 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:31.669324    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8g9fl_e044d9fa-39c8-49b8-94e1-550f3dbe7b26/ovn-acl-logging/0.log"
Jul 29 01:42:31.690870 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:31.675023    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8g9fl_e044d9fa-39c8-49b8-94e1-550f3dbe7b26/ovn-acl-logging/0.log"
Jul 29 01:42:33.839238 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:33.839200    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:42:33.953014 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:33.952979    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:42:34.067131 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:34.067099    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:42:34.166199 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:34.166172    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:42:34.545052 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:42:34.544940    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:43:00.491097 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:43:00.491061    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:43:06.741453 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:43:06.741418    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:43:06.868154 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:43:06.868122    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:43:07.002767 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:43:07.002673    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:43:12.690821 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:43:12.690779    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:43:22.834261 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:43:22.834208    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:43:28.661035 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:43:28.660992    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:43:28.724776 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:43:28.724751    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:43:28.819776 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:43:28.819753    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:43:28.919839 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:43:28.919770    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:43:39.381652 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:43:39.381615    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:43:40.141237 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:43:40.141204    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:43:46.509974 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:43:46.509916    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:43:46.621356 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:43:46.621308    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:43:46.712265 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:43:46.712224    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:43:46.811246 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:43:46.811158    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:43:58.190361 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:43:58.190270    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:43:58.295998 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:43:58.295966    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:43:58.396590 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:43:58.396546    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:00.130661 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:00.130618    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:05.806215 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:05.806177    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:05.907795 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:05.907765    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:06.457264 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:06.457225    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:12.447585 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:12.447547    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:12.540384 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:12.540336    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:12.660881 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:12.660855    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:12.982679 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:12.982642    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:13.068811 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:13.068761    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:15.749124 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:15.749083    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:15.986328 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:15.986291    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:16.059677 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:16.059577    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:16.156710 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:16.156678    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:16.622619 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:16.622576    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:16.709674 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:16.709645    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:16.714669 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:16.714647    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-bc25d452-d4d8d7d76-dv7cd"]
Jul 29 01:44:16.715027 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:16.715014    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d4f4c8f-c033-49ea-b01d-b68133508c00" containerName="payload-pre-processing"
Jul 29 01:44:16.715080 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:16.715029    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d4f4c8f-c033-49ea-b01d-b68133508c00" containerName="payload-pre-processing"
Jul 29 01:44:16.715080 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:16.715043    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b45a417e-54db-4d29-9496-0598e82c836a" containerName="payload-processing"
Jul 29 01:44:16.715080 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:16.715049    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b45a417e-54db-4d29-9496-0598e82c836a" containerName="payload-processing"
Jul 29 01:44:16.715186 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:16.715131    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d4f4c8f-c033-49ea-b01d-b68133508c00" containerName="payload-pre-processing"
Jul 29 01:44:16.715186 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:16.715140    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b45a417e-54db-4d29-9496-0598e82c836a" containerName="payload-processing"
Jul 29 01:44:16.718159 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:16.718141    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-bc25d452-d4d8d7d76-dv7cd"
Jul 29 01:44:16.720597 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:16.720580    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-bc25d452\""
Jul 29 01:44:16.728683 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:16.728661    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-bc25d452-d4d8d7d76-dv7cd"]
Jul 29 01:44:16.756132 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:16.756106    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-bc25d452-8545d8dbf4-896cz"]
Jul 29 01:44:16.759478 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:16.759462    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-bc25d452-8545d8dbf4-896cz"
Jul 29 01:44:16.762451 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:16.762436    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-bc25d452-dockercfg-s849g\""
Jul 29 01:44:16.775407 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:16.775387    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-bc25d452-8545d8dbf4-896cz"]
Jul 29 01:44:16.786428 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:16.786400    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zwll\" (UniqueName: \"kubernetes.io/projected/5bcd957a-a4cf-4d7d-9754-5952794bb4fd-kube-api-access-4zwll\") pod \"payload-processing-e2e-mt-bc25d452-8545d8dbf4-896cz\" (UID: \"5bcd957a-a4cf-4d7d-9754-5952794bb4fd\") " pod="openshift-ingress/payload-processing-e2e-mt-bc25d452-8545d8dbf4-896cz"
Jul 29 01:44:16.786532 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:16.786435    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5bcd957a-a4cf-4d7d-9754-5952794bb4fd-plugins-config-volume\") pod \"payload-processing-e2e-mt-bc25d452-8545d8dbf4-896cz\" (UID: \"5bcd957a-a4cf-4d7d-9754-5952794bb4fd\") " pod="openshift-ingress/payload-processing-e2e-mt-bc25d452-8545d8dbf4-896cz"
Jul 29 01:44:16.786532 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:16.786486    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-972s2\" (UniqueName: \"kubernetes.io/projected/8660a418-247f-4b68-85fa-58e5577302e4-kube-api-access-972s2\") pod \"payload-pre-processing-e2e-mt-bc25d452-d4d8d7d76-dv7cd\" (UID: \"8660a418-247f-4b68-85fa-58e5577302e4\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-bc25d452-d4d8d7d76-dv7cd"
Jul 29 01:44:16.786532 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:16.786529    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8660a418-247f-4b68-85fa-58e5577302e4-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-bc25d452-d4d8d7d76-dv7cd\" (UID: \"8660a418-247f-4b68-85fa-58e5577302e4\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-bc25d452-d4d8d7d76-dv7cd"
Jul 29 01:44:16.887814 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:16.887739    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zwll\" (UniqueName: \"kubernetes.io/projected/5bcd957a-a4cf-4d7d-9754-5952794bb4fd-kube-api-access-4zwll\") pod \"payload-processing-e2e-mt-bc25d452-8545d8dbf4-896cz\" (UID: \"5bcd957a-a4cf-4d7d-9754-5952794bb4fd\") " pod="openshift-ingress/payload-processing-e2e-mt-bc25d452-8545d8dbf4-896cz"
Jul 29 01:44:16.887814 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:16.887782    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5bcd957a-a4cf-4d7d-9754-5952794bb4fd-plugins-config-volume\") pod \"payload-processing-e2e-mt-bc25d452-8545d8dbf4-896cz\" (UID: \"5bcd957a-a4cf-4d7d-9754-5952794bb4fd\") " pod="openshift-ingress/payload-processing-e2e-mt-bc25d452-8545d8dbf4-896cz"
Jul 29 01:44:16.887814 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:16.887811    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-972s2\" (UniqueName: \"kubernetes.io/projected/8660a418-247f-4b68-85fa-58e5577302e4-kube-api-access-972s2\") pod \"payload-pre-processing-e2e-mt-bc25d452-d4d8d7d76-dv7cd\" (UID: \"8660a418-247f-4b68-85fa-58e5577302e4\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-bc25d452-d4d8d7d76-dv7cd"
Jul 29 01:44:16.888118 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:16.887847    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8660a418-247f-4b68-85fa-58e5577302e4-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-bc25d452-d4d8d7d76-dv7cd\" (UID: \"8660a418-247f-4b68-85fa-58e5577302e4\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-bc25d452-d4d8d7d76-dv7cd"
Jul 29 01:44:16.888636 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:16.888614    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5bcd957a-a4cf-4d7d-9754-5952794bb4fd-plugins-config-volume\") pod \"payload-processing-e2e-mt-bc25d452-8545d8dbf4-896cz\" (UID: \"5bcd957a-a4cf-4d7d-9754-5952794bb4fd\") " pod="openshift-ingress/payload-processing-e2e-mt-bc25d452-8545d8dbf4-896cz"
Jul 29 01:44:16.888748 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:16.888653    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8660a418-247f-4b68-85fa-58e5577302e4-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-bc25d452-d4d8d7d76-dv7cd\" (UID: \"8660a418-247f-4b68-85fa-58e5577302e4\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-bc25d452-d4d8d7d76-dv7cd"
Jul 29 01:44:16.898336 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:16.898308    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zwll\" (UniqueName: \"kubernetes.io/projected/5bcd957a-a4cf-4d7d-9754-5952794bb4fd-kube-api-access-4zwll\") pod \"payload-processing-e2e-mt-bc25d452-8545d8dbf4-896cz\" (UID: \"5bcd957a-a4cf-4d7d-9754-5952794bb4fd\") " pod="openshift-ingress/payload-processing-e2e-mt-bc25d452-8545d8dbf4-896cz"
Jul 29 01:44:16.898336 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:16.898315    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-972s2\" (UniqueName: \"kubernetes.io/projected/8660a418-247f-4b68-85fa-58e5577302e4-kube-api-access-972s2\") pod \"payload-pre-processing-e2e-mt-bc25d452-d4d8d7d76-dv7cd\" (UID: \"8660a418-247f-4b68-85fa-58e5577302e4\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-bc25d452-d4d8d7d76-dv7cd"
Jul 29 01:44:17.028482 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:17.028451    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-bc25d452-d4d8d7d76-dv7cd"
Jul 29 01:44:17.068862 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:17.068826    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-bc25d452-8545d8dbf4-896cz"
Jul 29 01:44:17.187667 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:17.186263    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-bc25d452-d4d8d7d76-dv7cd"]
Jul 29 01:44:17.189926 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:44:17.189897    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8660a418_247f_4b68_85fa_58e5577302e4.slice/crio-f96c63a80424ea88cc1bac9ecefeabe9db1be3f22bb50d46df19a0e139ada907 WatchSource:0}: Error finding container f96c63a80424ea88cc1bac9ecefeabe9db1be3f22bb50d46df19a0e139ada907: Status 404 returned error can't find the container with id f96c63a80424ea88cc1bac9ecefeabe9db1be3f22bb50d46df19a0e139ada907
Jul 29 01:44:17.218859 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:17.218828    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-bc25d452-8545d8dbf4-896cz"]
Jul 29 01:44:17.223227 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:44:17.223201    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bcd957a_a4cf_4d7d_9754_5952794bb4fd.slice/crio-0cea815f3bbe70688e007844ec007cd4553da9b188947e30c5b6d5e8a737f15d WatchSource:0}: Error finding container 0cea815f3bbe70688e007844ec007cd4553da9b188947e30c5b6d5e8a737f15d: Status 404 returned error can't find the container with id 0cea815f3bbe70688e007844ec007cd4553da9b188947e30c5b6d5e8a737f15d
Jul 29 01:44:17.850047 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:17.850001    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-bc25d452-8545d8dbf4-896cz" event={"ID":"5bcd957a-a4cf-4d7d-9754-5952794bb4fd","Type":"ContainerStarted","Data":"66a9af526f48aac363e6d189c93c6d31ec1c2bb25cef76562f2b9984d7961b15"}
Jul 29 01:44:17.850590 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:17.850103    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-bc25d452-8545d8dbf4-896cz" event={"ID":"5bcd957a-a4cf-4d7d-9754-5952794bb4fd","Type":"ContainerStarted","Data":"0cea815f3bbe70688e007844ec007cd4553da9b188947e30c5b6d5e8a737f15d"}
Jul 29 01:44:17.850590 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:17.850302    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-bc25d452-8545d8dbf4-896cz"
Jul 29 01:44:17.851687 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:17.851662    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-bc25d452-d4d8d7d76-dv7cd" event={"ID":"8660a418-247f-4b68-85fa-58e5577302e4","Type":"ContainerStarted","Data":"c76c26c098472fa8bed1b575f0970061cbd847c160a823c849304c53b8a7459a"}
Jul 29 01:44:17.851795 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:17.851707    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-bc25d452-d4d8d7d76-dv7cd" event={"ID":"8660a418-247f-4b68-85fa-58e5577302e4","Type":"ContainerStarted","Data":"f96c63a80424ea88cc1bac9ecefeabe9db1be3f22bb50d46df19a0e139ada907"}
Jul 29 01:44:17.851840 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:17.851828    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-bc25d452-d4d8d7d76-dv7cd"
Jul 29 01:44:17.865783 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:17.865740    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-bc25d452-8545d8dbf4-896cz" podStartSLOduration=1.8657280969999999 podStartE2EDuration="1.865728097s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:44:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:44:17.865151086 +0000 UTC m=+1908.177543795" watchObservedRunningTime="2026-07-29 01:44:17.865728097 +0000 UTC m=+1908.178120806"
Jul 29 01:44:17.882312 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:17.882274    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-bc25d452-d4d8d7d76-dv7cd" podStartSLOduration=1.882261924 podStartE2EDuration="1.882261924s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:44:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:44:17.880388426 +0000 UTC m=+1908.192781136" watchObservedRunningTime="2026-07-29 01:44:17.882261924 +0000 UTC m=+1908.194654631"
Jul 29 01:44:28.857893 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:28.857847    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-mt-bc25d452-d4d8d7d76-dv7cd" podUID="8660a418-247f-4b68-85fa-58e5577302e4" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.133.0.42:9004: connect: connection refused"
Jul 29 01:44:28.858459 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:28.858439    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-bc25d452-8545d8dbf4-896cz"
Jul 29 01:44:38.857139 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:38.857107    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-bc25d452-d4d8d7d76-dv7cd"
Jul 29 01:44:40.716236 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:40.716202    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:41.371291 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:41.371258    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:41.471310 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:41.471280    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:41.766469 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:41.766379    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:47.570354 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:47.570311    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:47.671092 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:47.671053    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:58.481162 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:58.481119    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:58.503159 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:58.503131    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-bc25d452-8545d8dbf4-896cz"]
Jul 29 01:44:58.503372 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:58.503348    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-bc25d452-8545d8dbf4-896cz" podUID="5bcd957a-a4cf-4d7d-9754-5952794bb4fd" containerName="payload-processing" containerID="cri-o://66a9af526f48aac363e6d189c93c6d31ec1c2bb25cef76562f2b9984d7961b15" gracePeriod=30
Jul 29 01:44:58.509520 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:58.509493    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-bc25d452-d4d8d7d76-dv7cd"]
Jul 29 01:44:58.509720 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:58.509695    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-bc25d452-d4d8d7d76-dv7cd" podUID="8660a418-247f-4b68-85fa-58e5577302e4" containerName="payload-pre-processing" containerID="cri-o://c76c26c098472fa8bed1b575f0970061cbd847c160a823c849304c53b8a7459a" gracePeriod=30
Jul 29 01:44:58.581008 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:58.580974    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:58.650071 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:58.650019    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:44:58.777929 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:58.777904    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-bc25d452-8545d8dbf4-896cz"
Jul 29 01:44:58.780899 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:58.780878    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-bc25d452-d4d8d7d76-dv7cd"
Jul 29 01:44:58.841374 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:58.841341    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5bcd957a-a4cf-4d7d-9754-5952794bb4fd-plugins-config-volume\") pod \"5bcd957a-a4cf-4d7d-9754-5952794bb4fd\" (UID: \"5bcd957a-a4cf-4d7d-9754-5952794bb4fd\") "
Jul 29 01:44:58.841374 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:58.841373    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8660a418-247f-4b68-85fa-58e5577302e4-plugins-config-volume\") pod \"8660a418-247f-4b68-85fa-58e5577302e4\" (UID: \"8660a418-247f-4b68-85fa-58e5577302e4\") "
Jul 29 01:44:58.841567 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:58.841413    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-972s2\" (UniqueName: \"kubernetes.io/projected/8660a418-247f-4b68-85fa-58e5577302e4-kube-api-access-972s2\") pod \"8660a418-247f-4b68-85fa-58e5577302e4\" (UID: \"8660a418-247f-4b68-85fa-58e5577302e4\") "
Jul 29 01:44:58.841618 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:58.841594    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zwll\" (UniqueName: \"kubernetes.io/projected/5bcd957a-a4cf-4d7d-9754-5952794bb4fd-kube-api-access-4zwll\") pod \"5bcd957a-a4cf-4d7d-9754-5952794bb4fd\" (UID: \"5bcd957a-a4cf-4d7d-9754-5952794bb4fd\") "
Jul 29 01:44:58.841795 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:58.841772    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bcd957a-a4cf-4d7d-9754-5952794bb4fd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5bcd957a-a4cf-4d7d-9754-5952794bb4fd" (UID: "5bcd957a-a4cf-4d7d-9754-5952794bb4fd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:44:58.841874 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:58.841848    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8660a418-247f-4b68-85fa-58e5577302e4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8660a418-247f-4b68-85fa-58e5577302e4" (UID: "8660a418-247f-4b68-85fa-58e5577302e4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:44:58.842028 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:58.842010    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5bcd957a-a4cf-4d7d-9754-5952794bb4fd-plugins-config-volume\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:44:58.842096 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:58.842031    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8660a418-247f-4b68-85fa-58e5577302e4-plugins-config-volume\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:44:58.843553 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:58.843529    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8660a418-247f-4b68-85fa-58e5577302e4-kube-api-access-972s2" (OuterVolumeSpecName: "kube-api-access-972s2") pod "8660a418-247f-4b68-85fa-58e5577302e4" (UID: "8660a418-247f-4b68-85fa-58e5577302e4"). InnerVolumeSpecName "kube-api-access-972s2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:44:58.843640 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:58.843556    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bcd957a-a4cf-4d7d-9754-5952794bb4fd-kube-api-access-4zwll" (OuterVolumeSpecName: "kube-api-access-4zwll") pod "5bcd957a-a4cf-4d7d-9754-5952794bb4fd" (UID: "5bcd957a-a4cf-4d7d-9754-5952794bb4fd"). InnerVolumeSpecName "kube-api-access-4zwll". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:44:58.943324 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:58.943290    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zwll\" (UniqueName: \"kubernetes.io/projected/5bcd957a-a4cf-4d7d-9754-5952794bb4fd-kube-api-access-4zwll\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:44:58.943324 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:58.943318    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-972s2\" (UniqueName: \"kubernetes.io/projected/8660a418-247f-4b68-85fa-58e5577302e4-kube-api-access-972s2\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:44:59.040700 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:59.040609    2580 generic.go:356] "Generic (PLEG): container finished" podID="8660a418-247f-4b68-85fa-58e5577302e4" containerID="c76c26c098472fa8bed1b575f0970061cbd847c160a823c849304c53b8a7459a" exitCode=0
Jul 29 01:44:59.040700 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:59.040657    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-bc25d452-d4d8d7d76-dv7cd"
Jul 29 01:44:59.040926 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:59.040695    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-bc25d452-d4d8d7d76-dv7cd" event={"ID":"8660a418-247f-4b68-85fa-58e5577302e4","Type":"ContainerDied","Data":"c76c26c098472fa8bed1b575f0970061cbd847c160a823c849304c53b8a7459a"}
Jul 29 01:44:59.040926 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:59.040759    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-bc25d452-d4d8d7d76-dv7cd" event={"ID":"8660a418-247f-4b68-85fa-58e5577302e4","Type":"ContainerDied","Data":"f96c63a80424ea88cc1bac9ecefeabe9db1be3f22bb50d46df19a0e139ada907"}
Jul 29 01:44:59.040926 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:59.040795    2580 scope.go:117] "RemoveContainer" containerID="c76c26c098472fa8bed1b575f0970061cbd847c160a823c849304c53b8a7459a"
Jul 29 01:44:59.042083 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:59.042063    2580 generic.go:356] "Generic (PLEG): container finished" podID="5bcd957a-a4cf-4d7d-9754-5952794bb4fd" containerID="66a9af526f48aac363e6d189c93c6d31ec1c2bb25cef76562f2b9984d7961b15" exitCode=0
Jul 29 01:44:59.042160 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:59.042091    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-bc25d452-8545d8dbf4-896cz" event={"ID":"5bcd957a-a4cf-4d7d-9754-5952794bb4fd","Type":"ContainerDied","Data":"66a9af526f48aac363e6d189c93c6d31ec1c2bb25cef76562f2b9984d7961b15"}
Jul 29 01:44:59.042160 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:59.042111    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-bc25d452-8545d8dbf4-896cz"
Jul 29 01:44:59.042160 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:59.042126    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-bc25d452-8545d8dbf4-896cz" event={"ID":"5bcd957a-a4cf-4d7d-9754-5952794bb4fd","Type":"ContainerDied","Data":"0cea815f3bbe70688e007844ec007cd4553da9b188947e30c5b6d5e8a737f15d"}
Jul 29 01:44:59.053161 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:59.053137    2580 scope.go:117] "RemoveContainer" containerID="c76c26c098472fa8bed1b575f0970061cbd847c160a823c849304c53b8a7459a"
Jul 29 01:44:59.053459 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:44:59.053434    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c76c26c098472fa8bed1b575f0970061cbd847c160a823c849304c53b8a7459a\": container with ID starting with c76c26c098472fa8bed1b575f0970061cbd847c160a823c849304c53b8a7459a not found: ID does not exist" containerID="c76c26c098472fa8bed1b575f0970061cbd847c160a823c849304c53b8a7459a"
Jul 29 01:44:59.053536 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:59.053464    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c76c26c098472fa8bed1b575f0970061cbd847c160a823c849304c53b8a7459a"} err="failed to get container status \"c76c26c098472fa8bed1b575f0970061cbd847c160a823c849304c53b8a7459a\": rpc error: code = NotFound desc = could not find container \"c76c26c098472fa8bed1b575f0970061cbd847c160a823c849304c53b8a7459a\": container with ID starting with c76c26c098472fa8bed1b575f0970061cbd847c160a823c849304c53b8a7459a not found: ID does not exist"
Jul 29 01:44:59.053536 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:59.053481    2580 scope.go:117] "RemoveContainer" containerID="66a9af526f48aac363e6d189c93c6d31ec1c2bb25cef76562f2b9984d7961b15"
Jul 29 01:44:59.061362 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:59.061347    2580 scope.go:117] "RemoveContainer" containerID="66a9af526f48aac363e6d189c93c6d31ec1c2bb25cef76562f2b9984d7961b15"
Jul 29 01:44:59.061616 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:44:59.061594    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66a9af526f48aac363e6d189c93c6d31ec1c2bb25cef76562f2b9984d7961b15\": container with ID starting with 66a9af526f48aac363e6d189c93c6d31ec1c2bb25cef76562f2b9984d7961b15 not found: ID does not exist" containerID="66a9af526f48aac363e6d189c93c6d31ec1c2bb25cef76562f2b9984d7961b15"
Jul 29 01:44:59.061677 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:59.061627    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66a9af526f48aac363e6d189c93c6d31ec1c2bb25cef76562f2b9984d7961b15"} err="failed to get container status \"66a9af526f48aac363e6d189c93c6d31ec1c2bb25cef76562f2b9984d7961b15\": rpc error: code = NotFound desc = could not find container \"66a9af526f48aac363e6d189c93c6d31ec1c2bb25cef76562f2b9984d7961b15\": container with ID starting with 66a9af526f48aac363e6d189c93c6d31ec1c2bb25cef76562f2b9984d7961b15 not found: ID does not exist"
Jul 29 01:44:59.067806 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:59.067786    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-bc25d452-d4d8d7d76-dv7cd"]
Jul 29 01:44:59.072044 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:59.072025    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-bc25d452-d4d8d7d76-dv7cd"]
Jul 29 01:44:59.084317 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:59.084299    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-bc25d452-8545d8dbf4-896cz"]
Jul 29 01:44:59.089597 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:59.089573    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-bc25d452-8545d8dbf4-896cz"]
Jul 29 01:44:59.412168 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:44:59.412125    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:45:00.170172 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:00.170134    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bcd957a-a4cf-4d7d-9754-5952794bb4fd" path="/var/lib/kubelet/pods/5bcd957a-a4cf-4d7d-9754-5952794bb4fd/volumes"
Jul 29 01:45:00.170679 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:00.170657    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8660a418-247f-4b68-85fa-58e5577302e4" path="/var/lib/kubelet/pods/8660a418-247f-4b68-85fa-58e5577302e4/volumes"
Jul 29 01:45:05.071159 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:05.071124    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:45:05.258368 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:05.258322    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:45:05.356384 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:05.356293    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:45:05.545632 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:05.545580    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:45:05.657225 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:05.657188    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:45:05.793175 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:05.793143    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:45:05.894980 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:05.894924    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:45:11.684942 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:11.684897    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:45:12.895321 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:12.895282    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:45:17.771685 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:17.771647    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:45:17.836757 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:17.836720    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:45:34.671772 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:34.671720    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:45:41.544271 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:41.544230    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:45:41.868909 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:41.868872    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:45:42.128521 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:42.128415    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:45:45.219312 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:45.219278    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:45:45.312789 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:45.312753    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:45:45.403381 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:45.403348    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:45:45.696108 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:45.696073    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:45:45.982361 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:45.982260    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:45:46.080398 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:46.080352    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:45:46.097272 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:46.097239    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e744ec49-fcc56ccd4-44vxr"]
Jul 29 01:45:46.097816 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:46.097798    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bcd957a-a4cf-4d7d-9754-5952794bb4fd" containerName="payload-processing"
Jul 29 01:45:46.097864 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:46.097820    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bcd957a-a4cf-4d7d-9754-5952794bb4fd" containerName="payload-processing"
Jul 29 01:45:46.097899 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:46.097860    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8660a418-247f-4b68-85fa-58e5577302e4" containerName="payload-pre-processing"
Jul 29 01:45:46.097899 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:46.097871    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8660a418-247f-4b68-85fa-58e5577302e4" containerName="payload-pre-processing"
Jul 29 01:45:46.097990 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:46.097980    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bcd957a-a4cf-4d7d-9754-5952794bb4fd" containerName="payload-processing"
Jul 29 01:45:46.098035 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:46.098001    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8660a418-247f-4b68-85fa-58e5577302e4" containerName="payload-pre-processing"
Jul 29 01:45:46.101534 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:46.101518    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-e744ec49-fcc56ccd4-44vxr"
Jul 29 01:45:46.104201 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:46.104182    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-e744ec49\""
Jul 29 01:45:46.104289 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:46.104215    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-e744ec49-dockercfg-2qn99\""
Jul 29 01:45:46.110310 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:46.110286    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e744ec49-fcc56ccd4-44vxr"]
Jul 29 01:45:46.119278 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:46.119257    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e744ec49-6677bd5fd-psc6r"]
Jul 29 01:45:46.122608 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:46.122587    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-e744ec49-6677bd5fd-psc6r"
Jul 29 01:45:46.132471 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:46.132448    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e744ec49-6677bd5fd-psc6r"]
Jul 29 01:45:46.145333 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:46.145312    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c40f13ed-3008-4732-86f8-dcc7be7ad03c-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-e744ec49-fcc56ccd4-44vxr\" (UID: \"c40f13ed-3008-4732-86f8-dcc7be7ad03c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e744ec49-fcc56ccd4-44vxr"
Jul 29 01:45:46.145440 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:46.145341    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqsdc\" (UniqueName: \"kubernetes.io/projected/c40f13ed-3008-4732-86f8-dcc7be7ad03c-kube-api-access-qqsdc\") pod \"payload-pre-processing-e2e-mt-e744ec49-fcc56ccd4-44vxr\" (UID: \"c40f13ed-3008-4732-86f8-dcc7be7ad03c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e744ec49-fcc56ccd4-44vxr"
Jul 29 01:45:46.145440 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:46.145375    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz2nb\" (UniqueName: \"kubernetes.io/projected/075e3deb-5166-47e0-a7f0-6bd51bb2ae66-kube-api-access-hz2nb\") pod \"payload-processing-e2e-mt-e744ec49-6677bd5fd-psc6r\" (UID: \"075e3deb-5166-47e0-a7f0-6bd51bb2ae66\") " pod="openshift-ingress/payload-processing-e2e-mt-e744ec49-6677bd5fd-psc6r"
Jul 29 01:45:46.145560 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:46.145537    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/075e3deb-5166-47e0-a7f0-6bd51bb2ae66-plugins-config-volume\") pod \"payload-processing-e2e-mt-e744ec49-6677bd5fd-psc6r\" (UID: \"075e3deb-5166-47e0-a7f0-6bd51bb2ae66\") " pod="openshift-ingress/payload-processing-e2e-mt-e744ec49-6677bd5fd-psc6r"
Jul 29 01:45:46.246429 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:46.246353    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/075e3deb-5166-47e0-a7f0-6bd51bb2ae66-plugins-config-volume\") pod \"payload-processing-e2e-mt-e744ec49-6677bd5fd-psc6r\" (UID: \"075e3deb-5166-47e0-a7f0-6bd51bb2ae66\") " pod="openshift-ingress/payload-processing-e2e-mt-e744ec49-6677bd5fd-psc6r"
Jul 29 01:45:46.246429 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:46.246396    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c40f13ed-3008-4732-86f8-dcc7be7ad03c-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-e744ec49-fcc56ccd4-44vxr\" (UID: \"c40f13ed-3008-4732-86f8-dcc7be7ad03c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e744ec49-fcc56ccd4-44vxr"
Jul 29 01:45:46.246429 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:46.246416    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqsdc\" (UniqueName: \"kubernetes.io/projected/c40f13ed-3008-4732-86f8-dcc7be7ad03c-kube-api-access-qqsdc\") pod \"payload-pre-processing-e2e-mt-e744ec49-fcc56ccd4-44vxr\" (UID: \"c40f13ed-3008-4732-86f8-dcc7be7ad03c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e744ec49-fcc56ccd4-44vxr"
Jul 29 01:45:46.246910 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:46.246454    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz2nb\" (UniqueName: \"kubernetes.io/projected/075e3deb-5166-47e0-a7f0-6bd51bb2ae66-kube-api-access-hz2nb\") pod \"payload-processing-e2e-mt-e744ec49-6677bd5fd-psc6r\" (UID: \"075e3deb-5166-47e0-a7f0-6bd51bb2ae66\") " pod="openshift-ingress/payload-processing-e2e-mt-e744ec49-6677bd5fd-psc6r"
Jul 29 01:45:46.247068 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:46.247049    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/075e3deb-5166-47e0-a7f0-6bd51bb2ae66-plugins-config-volume\") pod \"payload-processing-e2e-mt-e744ec49-6677bd5fd-psc6r\" (UID: \"075e3deb-5166-47e0-a7f0-6bd51bb2ae66\") " pod="openshift-ingress/payload-processing-e2e-mt-e744ec49-6677bd5fd-psc6r"
Jul 29 01:45:46.247203 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:46.247186    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c40f13ed-3008-4732-86f8-dcc7be7ad03c-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-e744ec49-fcc56ccd4-44vxr\" (UID: \"c40f13ed-3008-4732-86f8-dcc7be7ad03c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e744ec49-fcc56ccd4-44vxr"
Jul 29 01:45:46.254624 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:46.254593    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz2nb\" (UniqueName: \"kubernetes.io/projected/075e3deb-5166-47e0-a7f0-6bd51bb2ae66-kube-api-access-hz2nb\") pod \"payload-processing-e2e-mt-e744ec49-6677bd5fd-psc6r\" (UID: \"075e3deb-5166-47e0-a7f0-6bd51bb2ae66\") " pod="openshift-ingress/payload-processing-e2e-mt-e744ec49-6677bd5fd-psc6r"
Jul 29 01:45:46.254729 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:46.254596    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqsdc\" (UniqueName: \"kubernetes.io/projected/c40f13ed-3008-4732-86f8-dcc7be7ad03c-kube-api-access-qqsdc\") pod \"payload-pre-processing-e2e-mt-e744ec49-fcc56ccd4-44vxr\" (UID: \"c40f13ed-3008-4732-86f8-dcc7be7ad03c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e744ec49-fcc56ccd4-44vxr"
Jul 29 01:45:46.413372 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:46.413335    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-e744ec49-fcc56ccd4-44vxr"
Jul 29 01:45:46.432892 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:46.432865    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-e744ec49-6677bd5fd-psc6r"
Jul 29 01:45:46.555589 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:46.555562    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e744ec49-fcc56ccd4-44vxr"]
Jul 29 01:45:46.557794 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:45:46.557761    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc40f13ed_3008_4732_86f8_dcc7be7ad03c.slice/crio-952296f2d97e92bde2c73f23e382484b1026edf90af276b32b9ced435c177a2e WatchSource:0}: Error finding container 952296f2d97e92bde2c73f23e382484b1026edf90af276b32b9ced435c177a2e: Status 404 returned error can't find the container with id 952296f2d97e92bde2c73f23e382484b1026edf90af276b32b9ced435c177a2e
Jul 29 01:45:46.580124 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:46.580041    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e744ec49-6677bd5fd-psc6r"]
Jul 29 01:45:46.598043 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:45:46.598013    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod075e3deb_5166_47e0_a7f0_6bd51bb2ae66.slice/crio-54cef485c5c2c1790129b1acd6a4b5c500faa12ed7a721fadb35228a72d6073f WatchSource:0}: Error finding container 54cef485c5c2c1790129b1acd6a4b5c500faa12ed7a721fadb35228a72d6073f: Status 404 returned error can't find the container with id 54cef485c5c2c1790129b1acd6a4b5c500faa12ed7a721fadb35228a72d6073f
Jul 29 01:45:47.280098 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:47.280059    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-e744ec49-6677bd5fd-psc6r" event={"ID":"075e3deb-5166-47e0-a7f0-6bd51bb2ae66","Type":"ContainerStarted","Data":"157dacd735f7ca4811d09486390ea5f400dbfc24f2fd3881c8ed7918444c4bb3"}
Jul 29 01:45:47.280553 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:47.280122    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-e744ec49-6677bd5fd-psc6r" event={"ID":"075e3deb-5166-47e0-a7f0-6bd51bb2ae66","Type":"ContainerStarted","Data":"54cef485c5c2c1790129b1acd6a4b5c500faa12ed7a721fadb35228a72d6073f"}
Jul 29 01:45:47.280553 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:47.280165    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-e744ec49-6677bd5fd-psc6r"
Jul 29 01:45:47.281988 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:47.281941    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-e744ec49-fcc56ccd4-44vxr" event={"ID":"c40f13ed-3008-4732-86f8-dcc7be7ad03c","Type":"ContainerStarted","Data":"ace4f1b51247341766808510760cf253fd9d58345f154320b6916c439f559d38"}
Jul 29 01:45:47.282268 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:47.282009    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-e744ec49-fcc56ccd4-44vxr" event={"ID":"c40f13ed-3008-4732-86f8-dcc7be7ad03c","Type":"ContainerStarted","Data":"952296f2d97e92bde2c73f23e382484b1026edf90af276b32b9ced435c177a2e"}
Jul 29 01:45:47.282268 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:47.282032    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-e744ec49-fcc56ccd4-44vxr"
Jul 29 01:45:47.297881 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:47.297841    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-e744ec49-6677bd5fd-psc6r" podStartSLOduration=1.297829383 podStartE2EDuration="1.297829383s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:45:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:45:47.295124482 +0000 UTC m=+1997.607517247" watchObservedRunningTime="2026-07-29 01:45:47.297829383 +0000 UTC m=+1997.610222120"
Jul 29 01:45:47.312672 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:47.312635    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-e744ec49-fcc56ccd4-44vxr" podStartSLOduration=1.312623604 podStartE2EDuration="1.312623604s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:45:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:45:47.311806038 +0000 UTC m=+1997.624198745" watchObservedRunningTime="2026-07-29 01:45:47.312623604 +0000 UTC m=+1997.625016312"
Jul 29 01:45:58.288735 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:58.288689    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-e744ec49-6677bd5fd-psc6r"
Jul 29 01:45:58.289261 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:45:58.288778    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-e744ec49-fcc56ccd4-44vxr"
Jul 29 01:46:10.084941 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:46:10.084901    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:46:22.019805 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:46:22.019773    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-e744ec49/e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75"]
Jul 29 01:46:22.023405 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:46:22.023389    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e744ec49/e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75"
Jul 29 01:46:22.026960 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:46:22.026931    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-e744ec49\"/\"openshift-service-ca.crt\""
Jul 29 01:46:22.027101 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:46:22.026980    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-e744ec49\"/\"kube-root-ca.crt\""
Jul 29 01:46:22.027101 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:46:22.026945    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-e744ec49\"/\"e2e-lifecycle-model-e744ec49-kserve-self-signed-certs\""
Jul 29 01:46:22.029108 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:46:22.027495    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-e744ec49\"/\"default-dockercfg-hzrrq\""
Jul 29 01:46:22.037314 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:46:22.037291    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-e744ec49/e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75"]
Jul 29 01:46:22.047253 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:46:22.047218    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:46:22.147630 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:46:22.147599    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86a7795b-0bee-4155-b21c-9d2ef1cb420b-tmp-dir\") pod \"e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75\" (UID: \"86a7795b-0bee-4155-b21c-9d2ef1cb420b\") " pod="ai-tenant-e2e-mt-e744ec49/e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75"
Jul 29 01:46:22.147630 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:46:22.147633    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sf55c\" (UniqueName: \"kubernetes.io/projected/86a7795b-0bee-4155-b21c-9d2ef1cb420b-kube-api-access-sf55c\") pod \"e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75\" (UID: \"86a7795b-0bee-4155-b21c-9d2ef1cb420b\") " pod="ai-tenant-e2e-mt-e744ec49/e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75"
Jul 29 01:46:22.147853 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:46:22.147654    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86a7795b-0bee-4155-b21c-9d2ef1cb420b-home\") pod \"e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75\" (UID: \"86a7795b-0bee-4155-b21c-9d2ef1cb420b\") " pod="ai-tenant-e2e-mt-e744ec49/e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75"
Jul 29 01:46:22.147853 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:46:22.147684    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86a7795b-0bee-4155-b21c-9d2ef1cb420b-tls-certs\") pod \"e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75\" (UID: \"86a7795b-0bee-4155-b21c-9d2ef1cb420b\") " pod="ai-tenant-e2e-mt-e744ec49/e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75"
Jul 29 01:46:22.147853 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:46:22.147756    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86a7795b-0bee-4155-b21c-9d2ef1cb420b-model-cache\") pod \"e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75\" (UID: \"86a7795b-0bee-4155-b21c-9d2ef1cb420b\") " pod="ai-tenant-e2e-mt-e744ec49/e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75"
Jul 29 01:46:22.147853 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:46:22.147798    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86a7795b-0bee-4155-b21c-9d2ef1cb420b-dshm\") pod \"e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75\" (UID: \"86a7795b-0bee-4155-b21c-9d2ef1cb420b\") " pod="ai-tenant-e2e-mt-e744ec49/e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75"
Jul 29 01:46:22.248438 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:46:22.248403    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86a7795b-0bee-4155-b21c-9d2ef1cb420b-tmp-dir\") pod \"e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75\" (UID: \"86a7795b-0bee-4155-b21c-9d2ef1cb420b\") " pod="ai-tenant-e2e-mt-e744ec49/e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75"
Jul 29 01:46:22.248568 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:46:22.248444    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf55c\" (UniqueName: \"kubernetes.io/projected/86a7795b-0bee-4155-b21c-9d2ef1cb420b-kube-api-access-sf55c\") pod \"e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75\" (UID: \"86a7795b-0bee-4155-b21c-9d2ef1cb420b\") " pod="ai-tenant-e2e-mt-e744ec49/e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75"
Jul 29 01:46:22.248568 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:46:22.248469    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86a7795b-0bee-4155-b21c-9d2ef1cb420b-home\") pod \"e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75\" (UID: \"86a7795b-0bee-4155-b21c-9d2ef1cb420b\") " pod="ai-tenant-e2e-mt-e744ec49/e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75"
Jul 29 01:46:22.248568 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:46:22.248514    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86a7795b-0bee-4155-b21c-9d2ef1cb420b-tls-certs\") pod \"e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75\" (UID: \"86a7795b-0bee-4155-b21c-9d2ef1cb420b\") " pod="ai-tenant-e2e-mt-e744ec49/e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75"
Jul 29 01:46:22.248568 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:46:22.248548    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86a7795b-0bee-4155-b21c-9d2ef1cb420b-model-cache\") pod \"e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75\" (UID: \"86a7795b-0bee-4155-b21c-9d2ef1cb420b\") " pod="ai-tenant-e2e-mt-e744ec49/e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75"
Jul 29 01:46:22.248729 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:46:22.248576    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86a7795b-0bee-4155-b21c-9d2ef1cb420b-dshm\") pod \"e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75\" (UID: \"86a7795b-0bee-4155-b21c-9d2ef1cb420b\") " pod="ai-tenant-e2e-mt-e744ec49/e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75"
Jul 29 01:46:22.248889 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:46:22.248867    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86a7795b-0bee-4155-b21c-9d2ef1cb420b-tmp-dir\") pod \"e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75\" (UID: \"86a7795b-0bee-4155-b21c-9d2ef1cb420b\") " pod="ai-tenant-e2e-mt-e744ec49/e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75"
Jul 29 01:46:22.248931 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:46:22.248869    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86a7795b-0bee-4155-b21c-9d2ef1cb420b-home\") pod \"e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75\" (UID: \"86a7795b-0bee-4155-b21c-9d2ef1cb420b\") " pod="ai-tenant-e2e-mt-e744ec49/e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75"
Jul 29 01:46:22.248999 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:46:22.248922    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86a7795b-0bee-4155-b21c-9d2ef1cb420b-model-cache\") pod \"e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75\" (UID: \"86a7795b-0bee-4155-b21c-9d2ef1cb420b\") " pod="ai-tenant-e2e-mt-e744ec49/e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75"
Jul 29 01:46:22.250826 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:46:22.250809    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86a7795b-0bee-4155-b21c-9d2ef1cb420b-dshm\") pod \"e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75\" (UID: \"86a7795b-0bee-4155-b21c-9d2ef1cb420b\") " pod="ai-tenant-e2e-mt-e744ec49/e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75"
Jul 29 01:46:22.250935 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:46:22.250918    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86a7795b-0bee-4155-b21c-9d2ef1cb420b-tls-certs\") pod \"e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75\" (UID: \"86a7795b-0bee-4155-b21c-9d2ef1cb420b\") " pod="ai-tenant-e2e-mt-e744ec49/e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75"
Jul 29 01:46:22.256828 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:46:22.256803    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sf55c\" (UniqueName: \"kubernetes.io/projected/86a7795b-0bee-4155-b21c-9d2ef1cb420b-kube-api-access-sf55c\") pod \"e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75\" (UID: \"86a7795b-0bee-4155-b21c-9d2ef1cb420b\") " pod="ai-tenant-e2e-mt-e744ec49/e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75"
Jul 29 01:46:22.339861 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:46:22.339800    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e744ec49/e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75"
Jul 29 01:46:22.470490 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:46:22.470455    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-e744ec49/e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75"]
Jul 29 01:46:22.474507 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:46:22.474474    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod86a7795b_0bee_4155_b21c_9d2ef1cb420b.slice/crio-cf490183024cc63be0b46dc90bab914b4471927b3086d828588df4f2705b4185 WatchSource:0}: Error finding container cf490183024cc63be0b46dc90bab914b4471927b3086d828588df4f2705b4185: Status 404 returned error can't find the container with id cf490183024cc63be0b46dc90bab914b4471927b3086d828588df4f2705b4185
Jul 29 01:46:23.451738 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:46:23.451707    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e744ec49/e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75" event={"ID":"86a7795b-0bee-4155-b21c-9d2ef1cb420b","Type":"ContainerStarted","Data":"bb08a6ec8d7a3e9e5dc8fd09be903a81873e43b53c65492cf64d145c468a3662"}
Jul 29 01:46:23.451738 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:46:23.451747    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e744ec49/e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75" event={"ID":"86a7795b-0bee-4155-b21c-9d2ef1cb420b","Type":"ContainerStarted","Data":"cf490183024cc63be0b46dc90bab914b4471927b3086d828588df4f2705b4185"}
Jul 29 01:46:23.470319 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:46:23.470263    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-e744ec49/e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75" podStartSLOduration=1.470248386 podStartE2EDuration="1.470248386s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:46:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:46:23.468521739 +0000 UTC m=+2033.780914447" watchObservedRunningTime="2026-07-29 01:46:23.470248386 +0000 UTC m=+2033.782641093"
Jul 29 01:46:32.340991 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:46:32.340929    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-e744ec49/e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75"
Jul 29 01:46:32.341488 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:46:32.341010    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-e744ec49/e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75"
Jul 29 01:46:32.353460 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:46:32.353430    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-e744ec49/e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75"
Jul 29 01:46:32.504737 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:46:32.504709    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-e744ec49/e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75"
Jul 29 01:46:59.919350 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:46:59.919258    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:46:59.953179 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:46:59.953148    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e744ec49-6677bd5fd-psc6r"]
Jul 29 01:46:59.953423 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:46:59.953395    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-e744ec49-6677bd5fd-psc6r" podUID="075e3deb-5166-47e0-a7f0-6bd51bb2ae66" containerName="payload-processing" containerID="cri-o://157dacd735f7ca4811d09486390ea5f400dbfc24f2fd3881c8ed7918444c4bb3" gracePeriod=30
Jul 29 01:46:59.960725 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:46:59.960402    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e744ec49-fcc56ccd4-44vxr"]
Jul 29 01:46:59.960801 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:46:59.960715    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-e744ec49-fcc56ccd4-44vxr" podUID="c40f13ed-3008-4732-86f8-dcc7be7ad03c" containerName="payload-pre-processing" containerID="cri-o://ace4f1b51247341766808510760cf253fd9d58345f154320b6916c439f559d38" gracePeriod=30
Jul 29 01:46:59.997650 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:46:59.997623    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:00.060829 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:00.060758    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:00.128548 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:00.128460    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:00.208725 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:00.208697    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-e744ec49-6677bd5fd-psc6r"
Jul 29 01:47:00.238910 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:00.238887    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-e744ec49-fcc56ccd4-44vxr"
Jul 29 01:47:00.269075 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:00.269049    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hz2nb\" (UniqueName: \"kubernetes.io/projected/075e3deb-5166-47e0-a7f0-6bd51bb2ae66-kube-api-access-hz2nb\") pod \"075e3deb-5166-47e0-a7f0-6bd51bb2ae66\" (UID: \"075e3deb-5166-47e0-a7f0-6bd51bb2ae66\") "
Jul 29 01:47:00.269200 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:00.269139    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/075e3deb-5166-47e0-a7f0-6bd51bb2ae66-plugins-config-volume\") pod \"075e3deb-5166-47e0-a7f0-6bd51bb2ae66\" (UID: \"075e3deb-5166-47e0-a7f0-6bd51bb2ae66\") "
Jul 29 01:47:00.269537 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:00.269512    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/075e3deb-5166-47e0-a7f0-6bd51bb2ae66-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "075e3deb-5166-47e0-a7f0-6bd51bb2ae66" (UID: "075e3deb-5166-47e0-a7f0-6bd51bb2ae66"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:47:00.271086 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:00.271064    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/075e3deb-5166-47e0-a7f0-6bd51bb2ae66-kube-api-access-hz2nb" (OuterVolumeSpecName: "kube-api-access-hz2nb") pod "075e3deb-5166-47e0-a7f0-6bd51bb2ae66" (UID: "075e3deb-5166-47e0-a7f0-6bd51bb2ae66"). InnerVolumeSpecName "kube-api-access-hz2nb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:47:00.370673 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:00.370645    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c40f13ed-3008-4732-86f8-dcc7be7ad03c-plugins-config-volume\") pod \"c40f13ed-3008-4732-86f8-dcc7be7ad03c\" (UID: \"c40f13ed-3008-4732-86f8-dcc7be7ad03c\") "
Jul 29 01:47:00.370829 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:00.370705    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqsdc\" (UniqueName: \"kubernetes.io/projected/c40f13ed-3008-4732-86f8-dcc7be7ad03c-kube-api-access-qqsdc\") pod \"c40f13ed-3008-4732-86f8-dcc7be7ad03c\" (UID: \"c40f13ed-3008-4732-86f8-dcc7be7ad03c\") "
Jul 29 01:47:00.370921 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:00.370907    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/075e3deb-5166-47e0-a7f0-6bd51bb2ae66-plugins-config-volume\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:47:00.371012 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:00.370927    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hz2nb\" (UniqueName: \"kubernetes.io/projected/075e3deb-5166-47e0-a7f0-6bd51bb2ae66-kube-api-access-hz2nb\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:47:00.371103 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:00.371075    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c40f13ed-3008-4732-86f8-dcc7be7ad03c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c40f13ed-3008-4732-86f8-dcc7be7ad03c" (UID: "c40f13ed-3008-4732-86f8-dcc7be7ad03c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:47:00.372567 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:00.372547    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c40f13ed-3008-4732-86f8-dcc7be7ad03c-kube-api-access-qqsdc" (OuterVolumeSpecName: "kube-api-access-qqsdc") pod "c40f13ed-3008-4732-86f8-dcc7be7ad03c" (UID: "c40f13ed-3008-4732-86f8-dcc7be7ad03c"). InnerVolumeSpecName "kube-api-access-qqsdc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:47:00.472041 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:00.471971    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqsdc\" (UniqueName: \"kubernetes.io/projected/c40f13ed-3008-4732-86f8-dcc7be7ad03c-kube-api-access-qqsdc\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:47:00.472041 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:00.471997    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c40f13ed-3008-4732-86f8-dcc7be7ad03c-plugins-config-volume\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:47:00.623185 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:00.623151    2580 generic.go:356] "Generic (PLEG): container finished" podID="075e3deb-5166-47e0-a7f0-6bd51bb2ae66" containerID="157dacd735f7ca4811d09486390ea5f400dbfc24f2fd3881c8ed7918444c4bb3" exitCode=0
Jul 29 01:47:00.623365 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:00.623194    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-e744ec49-6677bd5fd-psc6r"
Jul 29 01:47:00.623365 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:00.623242    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-e744ec49-6677bd5fd-psc6r" event={"ID":"075e3deb-5166-47e0-a7f0-6bd51bb2ae66","Type":"ContainerDied","Data":"157dacd735f7ca4811d09486390ea5f400dbfc24f2fd3881c8ed7918444c4bb3"}
Jul 29 01:47:00.623365 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:00.623306    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-e744ec49-6677bd5fd-psc6r" event={"ID":"075e3deb-5166-47e0-a7f0-6bd51bb2ae66","Type":"ContainerDied","Data":"54cef485c5c2c1790129b1acd6a4b5c500faa12ed7a721fadb35228a72d6073f"}
Jul 29 01:47:00.623365 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:00.623338    2580 scope.go:117] "RemoveContainer" containerID="157dacd735f7ca4811d09486390ea5f400dbfc24f2fd3881c8ed7918444c4bb3"
Jul 29 01:47:00.624544 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:00.624520    2580 generic.go:356] "Generic (PLEG): container finished" podID="c40f13ed-3008-4732-86f8-dcc7be7ad03c" containerID="ace4f1b51247341766808510760cf253fd9d58345f154320b6916c439f559d38" exitCode=0
Jul 29 01:47:00.624687 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:00.624560    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-e744ec49-fcc56ccd4-44vxr"
Jul 29 01:47:00.624687 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:00.624586    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-e744ec49-fcc56ccd4-44vxr" event={"ID":"c40f13ed-3008-4732-86f8-dcc7be7ad03c","Type":"ContainerDied","Data":"ace4f1b51247341766808510760cf253fd9d58345f154320b6916c439f559d38"}
Jul 29 01:47:00.624687 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:00.624619    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-e744ec49-fcc56ccd4-44vxr" event={"ID":"c40f13ed-3008-4732-86f8-dcc7be7ad03c","Type":"ContainerDied","Data":"952296f2d97e92bde2c73f23e382484b1026edf90af276b32b9ced435c177a2e"}
Jul 29 01:47:00.633229 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:00.633213    2580 scope.go:117] "RemoveContainer" containerID="157dacd735f7ca4811d09486390ea5f400dbfc24f2fd3881c8ed7918444c4bb3"
Jul 29 01:47:00.633484 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:47:00.633460    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"157dacd735f7ca4811d09486390ea5f400dbfc24f2fd3881c8ed7918444c4bb3\": container with ID starting with 157dacd735f7ca4811d09486390ea5f400dbfc24f2fd3881c8ed7918444c4bb3 not found: ID does not exist" containerID="157dacd735f7ca4811d09486390ea5f400dbfc24f2fd3881c8ed7918444c4bb3"
Jul 29 01:47:00.633575 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:00.633491    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"157dacd735f7ca4811d09486390ea5f400dbfc24f2fd3881c8ed7918444c4bb3"} err="failed to get container status \"157dacd735f7ca4811d09486390ea5f400dbfc24f2fd3881c8ed7918444c4bb3\": rpc error: code = NotFound desc = could not find container \"157dacd735f7ca4811d09486390ea5f400dbfc24f2fd3881c8ed7918444c4bb3\": container with ID starting with 157dacd735f7ca4811d09486390ea5f400dbfc24f2fd3881c8ed7918444c4bb3 not found: ID does not exist"
Jul 29 01:47:00.633575 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:00.633508    2580 scope.go:117] "RemoveContainer" containerID="ace4f1b51247341766808510760cf253fd9d58345f154320b6916c439f559d38"
Jul 29 01:47:00.641188 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:00.641172    2580 scope.go:117] "RemoveContainer" containerID="ace4f1b51247341766808510760cf253fd9d58345f154320b6916c439f559d38"
Jul 29 01:47:00.641397 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:47:00.641379    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ace4f1b51247341766808510760cf253fd9d58345f154320b6916c439f559d38\": container with ID starting with ace4f1b51247341766808510760cf253fd9d58345f154320b6916c439f559d38 not found: ID does not exist" containerID="ace4f1b51247341766808510760cf253fd9d58345f154320b6916c439f559d38"
Jul 29 01:47:00.641439 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:00.641403    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ace4f1b51247341766808510760cf253fd9d58345f154320b6916c439f559d38"} err="failed to get container status \"ace4f1b51247341766808510760cf253fd9d58345f154320b6916c439f559d38\": rpc error: code = NotFound desc = could not find container \"ace4f1b51247341766808510760cf253fd9d58345f154320b6916c439f559d38\": container with ID starting with ace4f1b51247341766808510760cf253fd9d58345f154320b6916c439f559d38 not found: ID does not exist"
Jul 29 01:47:00.647615 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:00.647592    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e744ec49-fcc56ccd4-44vxr"]
Jul 29 01:47:00.651467 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:00.651446    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e744ec49-fcc56ccd4-44vxr"]
Jul 29 01:47:00.663299 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:00.663278    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e744ec49-6677bd5fd-psc6r"]
Jul 29 01:47:00.667283 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:00.667264    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e744ec49-6677bd5fd-psc6r"]
Jul 29 01:47:02.170226 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:02.170192    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="075e3deb-5166-47e0-a7f0-6bd51bb2ae66" path="/var/lib/kubelet/pods/075e3deb-5166-47e0-a7f0-6bd51bb2ae66/volumes"
Jul 29 01:47:02.170604 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:02.170529    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c40f13ed-3008-4732-86f8-dcc7be7ad03c" path="/var/lib/kubelet/pods/c40f13ed-3008-4732-86f8-dcc7be7ad03c/volumes"
Jul 29 01:47:03.699415 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:03.699387    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:08.226314 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:08.226277    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-e744ec49/e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75"]
Jul 29 01:47:08.269709 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:08.269665    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:13.368832 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:13.368802    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:23.245171 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:23.245081    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-e744ec49/e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75" podUID="86a7795b-0bee-4155-b21c-9d2ef1cb420b" containerName="main" containerID="cri-o://bb08a6ec8d7a3e9e5dc8fd09be903a81873e43b53c65492cf64d145c468a3662" gracePeriod=45
Jul 29 01:47:23.497055 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:23.496994    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e744ec49/e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75"
Jul 29 01:47:23.672822 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:23.672783    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86a7795b-0bee-4155-b21c-9d2ef1cb420b-tls-certs\") pod \"86a7795b-0bee-4155-b21c-9d2ef1cb420b\" (UID: \"86a7795b-0bee-4155-b21c-9d2ef1cb420b\") "
Jul 29 01:47:23.672822 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:23.672821    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86a7795b-0bee-4155-b21c-9d2ef1cb420b-home\") pod \"86a7795b-0bee-4155-b21c-9d2ef1cb420b\" (UID: \"86a7795b-0bee-4155-b21c-9d2ef1cb420b\") "
Jul 29 01:47:23.673100 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:23.672860    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sf55c\" (UniqueName: \"kubernetes.io/projected/86a7795b-0bee-4155-b21c-9d2ef1cb420b-kube-api-access-sf55c\") pod \"86a7795b-0bee-4155-b21c-9d2ef1cb420b\" (UID: \"86a7795b-0bee-4155-b21c-9d2ef1cb420b\") "
Jul 29 01:47:23.673100 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:23.672879    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86a7795b-0bee-4155-b21c-9d2ef1cb420b-dshm\") pod \"86a7795b-0bee-4155-b21c-9d2ef1cb420b\" (UID: \"86a7795b-0bee-4155-b21c-9d2ef1cb420b\") "
Jul 29 01:47:23.673100 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:23.672918    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86a7795b-0bee-4155-b21c-9d2ef1cb420b-tmp-dir\") pod \"86a7795b-0bee-4155-b21c-9d2ef1cb420b\" (UID: \"86a7795b-0bee-4155-b21c-9d2ef1cb420b\") "
Jul 29 01:47:23.673100 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:23.672997    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86a7795b-0bee-4155-b21c-9d2ef1cb420b-model-cache\") pod \"86a7795b-0bee-4155-b21c-9d2ef1cb420b\" (UID: \"86a7795b-0bee-4155-b21c-9d2ef1cb420b\") "
Jul 29 01:47:23.673333 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:23.673213    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86a7795b-0bee-4155-b21c-9d2ef1cb420b-home" (OuterVolumeSpecName: "home") pod "86a7795b-0bee-4155-b21c-9d2ef1cb420b" (UID: "86a7795b-0bee-4155-b21c-9d2ef1cb420b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:47:23.673333 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:23.673275    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86a7795b-0bee-4155-b21c-9d2ef1cb420b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "86a7795b-0bee-4155-b21c-9d2ef1cb420b" (UID: "86a7795b-0bee-4155-b21c-9d2ef1cb420b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:47:23.673443 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:23.673326    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86a7795b-0bee-4155-b21c-9d2ef1cb420b-model-cache" (OuterVolumeSpecName: "model-cache") pod "86a7795b-0bee-4155-b21c-9d2ef1cb420b" (UID: "86a7795b-0bee-4155-b21c-9d2ef1cb420b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:47:23.673443 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:23.673384    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86a7795b-0bee-4155-b21c-9d2ef1cb420b-tmp-dir\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:47:23.673443 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:23.673398    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86a7795b-0bee-4155-b21c-9d2ef1cb420b-home\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:47:23.675096 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:23.675069    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86a7795b-0bee-4155-b21c-9d2ef1cb420b-dshm" (OuterVolumeSpecName: "dshm") pod "86a7795b-0bee-4155-b21c-9d2ef1cb420b" (UID: "86a7795b-0bee-4155-b21c-9d2ef1cb420b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:47:23.675199 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:23.675167    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86a7795b-0bee-4155-b21c-9d2ef1cb420b-kube-api-access-sf55c" (OuterVolumeSpecName: "kube-api-access-sf55c") pod "86a7795b-0bee-4155-b21c-9d2ef1cb420b" (UID: "86a7795b-0bee-4155-b21c-9d2ef1cb420b"). InnerVolumeSpecName "kube-api-access-sf55c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:47:23.675199 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:23.675179    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86a7795b-0bee-4155-b21c-9d2ef1cb420b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "86a7795b-0bee-4155-b21c-9d2ef1cb420b" (UID: "86a7795b-0bee-4155-b21c-9d2ef1cb420b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:47:23.733099 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:23.733066    2580 generic.go:356] "Generic (PLEG): container finished" podID="86a7795b-0bee-4155-b21c-9d2ef1cb420b" containerID="bb08a6ec8d7a3e9e5dc8fd09be903a81873e43b53c65492cf64d145c468a3662" exitCode=0
Jul 29 01:47:23.733235 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:23.733110    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e744ec49/e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75"
Jul 29 01:47:23.733235 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:23.733156    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e744ec49/e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75" event={"ID":"86a7795b-0bee-4155-b21c-9d2ef1cb420b","Type":"ContainerDied","Data":"bb08a6ec8d7a3e9e5dc8fd09be903a81873e43b53c65492cf64d145c468a3662"}
Jul 29 01:47:23.733235 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:23.733193    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e744ec49/e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75" event={"ID":"86a7795b-0bee-4155-b21c-9d2ef1cb420b","Type":"ContainerDied","Data":"cf490183024cc63be0b46dc90bab914b4471927b3086d828588df4f2705b4185"}
Jul 29 01:47:23.733235 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:23.733215    2580 scope.go:117] "RemoveContainer" containerID="bb08a6ec8d7a3e9e5dc8fd09be903a81873e43b53c65492cf64d145c468a3662"
Jul 29 01:47:23.742119 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:23.742103    2580 scope.go:117] "RemoveContainer" containerID="bb08a6ec8d7a3e9e5dc8fd09be903a81873e43b53c65492cf64d145c468a3662"
Jul 29 01:47:23.742323 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:47:23.742307    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb08a6ec8d7a3e9e5dc8fd09be903a81873e43b53c65492cf64d145c468a3662\": container with ID starting with bb08a6ec8d7a3e9e5dc8fd09be903a81873e43b53c65492cf64d145c468a3662 not found: ID does not exist" containerID="bb08a6ec8d7a3e9e5dc8fd09be903a81873e43b53c65492cf64d145c468a3662"
Jul 29 01:47:23.742376 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:23.742330    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb08a6ec8d7a3e9e5dc8fd09be903a81873e43b53c65492cf64d145c468a3662"} err="failed to get container status \"bb08a6ec8d7a3e9e5dc8fd09be903a81873e43b53c65492cf64d145c468a3662\": rpc error: code = NotFound desc = could not find container \"bb08a6ec8d7a3e9e5dc8fd09be903a81873e43b53c65492cf64d145c468a3662\": container with ID starting with bb08a6ec8d7a3e9e5dc8fd09be903a81873e43b53c65492cf64d145c468a3662 not found: ID does not exist"
Jul 29 01:47:23.755359 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:23.755303    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-e744ec49/e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75"]
Jul 29 01:47:23.759138 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:23.759117    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-e744ec49/e2e-lifecycle-model-e744ec49-kserve-7dcf59b959-g4v75"]
Jul 29 01:47:23.774661 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:23.774642    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sf55c\" (UniqueName: \"kubernetes.io/projected/86a7795b-0bee-4155-b21c-9d2ef1cb420b-kube-api-access-sf55c\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:47:23.774728 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:23.774664    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86a7795b-0bee-4155-b21c-9d2ef1cb420b-dshm\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:47:23.774728 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:23.774674    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86a7795b-0bee-4155-b21c-9d2ef1cb420b-model-cache\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:47:23.774728 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:23.774682    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86a7795b-0bee-4155-b21c-9d2ef1cb420b-tls-certs\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:47:24.171167 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:24.171132    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86a7795b-0bee-4155-b21c-9d2ef1cb420b" path="/var/lib/kubelet/pods/86a7795b-0bee-4155-b21c-9d2ef1cb420b/volumes"
Jul 29 01:47:31.697453 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:31.697342    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8g9fl_e044d9fa-39c8-49b8-94e1-550f3dbe7b26/ovn-acl-logging/0.log"
Jul 29 01:47:31.702902 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:31.702881    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8g9fl_e044d9fa-39c8-49b8-94e1-550f3dbe7b26/ovn-acl-logging/0.log"
Jul 29 01:47:44.470354 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:44.470305    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:45.760230 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:45.760194    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:51.310517 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:51.310479    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:51.375668 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:51.375636    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:51.599255 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:51.599170    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:51.803801 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:51.803763    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:52.862902 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:52.862851    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:52.962026 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:52.961993    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:53.073799 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:53.073768    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:53.750123 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:53.750088    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:53.845206 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:53.845144    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:53.943848 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:53.943819    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:55.271540 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:47:55.271495    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:01.099533 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:01.099473    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:01.229937 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:01.229900    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:01.845870 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:01.845829    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:08.014989 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:08.014935    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:09.239556 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:09.239521    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:09.339226 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:09.339197    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:18.720341 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:18.720298    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:19.063803 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:19.063676    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:40.019711 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:40.019674    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:46.517721 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:46.517682    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:46.639622 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:46.639583    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:46.870044 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:46.870011    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:47.247176 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:47.247093    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:47.342203 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:47.342164    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:49.987725 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:49.987690    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:50.080567 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:50.080535    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:50.175368 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:50.175332    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:50.275460 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:50.275374    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:50.676528 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:50.676496    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:50.782420 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:50.782383    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:48:50.783492 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:50.783461    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-70bd38-5dc6f97764-65lk5"]
Jul 29 01:48:50.783884 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:50.783866    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c40f13ed-3008-4732-86f8-dcc7be7ad03c" containerName="payload-pre-processing"
Jul 29 01:48:50.783980 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:50.783886    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c40f13ed-3008-4732-86f8-dcc7be7ad03c" containerName="payload-pre-processing"
Jul 29 01:48:50.783980 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:50.783917    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86a7795b-0bee-4155-b21c-9d2ef1cb420b" containerName="main"
Jul 29 01:48:50.783980 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:50.783925    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="86a7795b-0bee-4155-b21c-9d2ef1cb420b" containerName="main"
Jul 29 01:48:50.783980 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:50.783966    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="075e3deb-5166-47e0-a7f0-6bd51bb2ae66" containerName="payload-processing"
Jul 29 01:48:50.783980 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:50.783976    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="075e3deb-5166-47e0-a7f0-6bd51bb2ae66" containerName="payload-processing"
Jul 29 01:48:50.784232 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:50.784073    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="86a7795b-0bee-4155-b21c-9d2ef1cb420b" containerName="main"
Jul 29 01:48:50.784232 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:50.784087    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c40f13ed-3008-4732-86f8-dcc7be7ad03c" containerName="payload-pre-processing"
Jul 29 01:48:50.784232 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:50.784098    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="075e3deb-5166-47e0-a7f0-6bd51bb2ae66" containerName="payload-processing"
Jul 29 01:48:50.787120 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:50.787101    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-70bd38-5dc6f97764-65lk5"
Jul 29 01:48:50.790440 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:50.790418    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-70bd38\""
Jul 29 01:48:50.796662 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:50.796641    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-70bd38-5dc6f97764-65lk5"]
Jul 29 01:48:50.816412 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:50.816384    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-70bd38-df994d56b-q8rmg"]
Jul 29 01:48:50.819616 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:50.819600    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-70bd38-df994d56b-q8rmg"
Jul 29 01:48:50.822382 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:50.822367    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-70bd38-dockercfg-6dtw5\""
Jul 29 01:48:50.830112 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:50.830093    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-70bd38-df994d56b-q8rmg"]
Jul 29 01:48:50.934386 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:50.934307    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9552c0bc-6652-47ec-8a4a-8e0e78a1dcb2-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-70bd38-5dc6f97764-65lk5\" (UID: \"9552c0bc-6652-47ec-8a4a-8e0e78a1dcb2\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-70bd38-5dc6f97764-65lk5"
Jul 29 01:48:50.934531 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:50.934437    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f7fea41-9c80-4629-beff-6d7cdab3e9a5-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-70bd38-df994d56b-q8rmg\" (UID: \"5f7fea41-9c80-4629-beff-6d7cdab3e9a5\") " pod="openshift-ingress/payload-processing-e2e-inf-a-70bd38-df994d56b-q8rmg"
Jul 29 01:48:50.934531 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:50.934479    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tfmn\" (UniqueName: \"kubernetes.io/projected/9552c0bc-6652-47ec-8a4a-8e0e78a1dcb2-kube-api-access-2tfmn\") pod \"payload-pre-processing-e2e-inf-a-70bd38-5dc6f97764-65lk5\" (UID: \"9552c0bc-6652-47ec-8a4a-8e0e78a1dcb2\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-70bd38-5dc6f97764-65lk5"
Jul 29 01:48:50.934531 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:50.934510    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pf65\" (UniqueName: \"kubernetes.io/projected/5f7fea41-9c80-4629-beff-6d7cdab3e9a5-kube-api-access-7pf65\") pod \"payload-processing-e2e-inf-a-70bd38-df994d56b-q8rmg\" (UID: \"5f7fea41-9c80-4629-beff-6d7cdab3e9a5\") " pod="openshift-ingress/payload-processing-e2e-inf-a-70bd38-df994d56b-q8rmg"
Jul 29 01:48:51.035705 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:51.035674    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9552c0bc-6652-47ec-8a4a-8e0e78a1dcb2-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-70bd38-5dc6f97764-65lk5\" (UID: \"9552c0bc-6652-47ec-8a4a-8e0e78a1dcb2\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-70bd38-5dc6f97764-65lk5"
Jul 29 01:48:51.036123 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:51.035800    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f7fea41-9c80-4629-beff-6d7cdab3e9a5-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-70bd38-df994d56b-q8rmg\" (UID: \"5f7fea41-9c80-4629-beff-6d7cdab3e9a5\") " pod="openshift-ingress/payload-processing-e2e-inf-a-70bd38-df994d56b-q8rmg"
Jul 29 01:48:51.036123 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:51.035833    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tfmn\" (UniqueName: \"kubernetes.io/projected/9552c0bc-6652-47ec-8a4a-8e0e78a1dcb2-kube-api-access-2tfmn\") pod \"payload-pre-processing-e2e-inf-a-70bd38-5dc6f97764-65lk5\" (UID: \"9552c0bc-6652-47ec-8a4a-8e0e78a1dcb2\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-70bd38-5dc6f97764-65lk5"
Jul 29 01:48:51.036123 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:51.035858    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pf65\" (UniqueName: \"kubernetes.io/projected/5f7fea41-9c80-4629-beff-6d7cdab3e9a5-kube-api-access-7pf65\") pod \"payload-processing-e2e-inf-a-70bd38-df994d56b-q8rmg\" (UID: \"5f7fea41-9c80-4629-beff-6d7cdab3e9a5\") " pod="openshift-ingress/payload-processing-e2e-inf-a-70bd38-df994d56b-q8rmg"
Jul 29 01:48:51.036567 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:51.036547    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9552c0bc-6652-47ec-8a4a-8e0e78a1dcb2-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-70bd38-5dc6f97764-65lk5\" (UID: \"9552c0bc-6652-47ec-8a4a-8e0e78a1dcb2\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-70bd38-5dc6f97764-65lk5"
Jul 29 01:48:51.036648 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:51.036589    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f7fea41-9c80-4629-beff-6d7cdab3e9a5-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-70bd38-df994d56b-q8rmg\" (UID: \"5f7fea41-9c80-4629-beff-6d7cdab3e9a5\") " pod="openshift-ingress/payload-processing-e2e-inf-a-70bd38-df994d56b-q8rmg"
Jul 29 01:48:51.044630 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:51.044610    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tfmn\" (UniqueName: \"kubernetes.io/projected/9552c0bc-6652-47ec-8a4a-8e0e78a1dcb2-kube-api-access-2tfmn\") pod \"payload-pre-processing-e2e-inf-a-70bd38-5dc6f97764-65lk5\" (UID: \"9552c0bc-6652-47ec-8a4a-8e0e78a1dcb2\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-70bd38-5dc6f97764-65lk5"
Jul 29 01:48:51.044834 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:51.044817    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pf65\" (UniqueName: \"kubernetes.io/projected/5f7fea41-9c80-4629-beff-6d7cdab3e9a5-kube-api-access-7pf65\") pod \"payload-processing-e2e-inf-a-70bd38-df994d56b-q8rmg\" (UID: \"5f7fea41-9c80-4629-beff-6d7cdab3e9a5\") " pod="openshift-ingress/payload-processing-e2e-inf-a-70bd38-df994d56b-q8rmg"
Jul 29 01:48:51.098258 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:51.098235    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-70bd38-5dc6f97764-65lk5"
Jul 29 01:48:51.129121 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:51.129092    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-70bd38-df994d56b-q8rmg"
Jul 29 01:48:51.242443 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:51.242414    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-70bd38-5dc6f97764-65lk5"]
Jul 29 01:48:51.250515 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:48:51.250481    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9552c0bc_6652_47ec_8a4a_8e0e78a1dcb2.slice/crio-adb3a90832cb071bfca21f6e8f815986d83931c562712f10c2be1a4b4a58807f WatchSource:0}: Error finding container adb3a90832cb071bfca21f6e8f815986d83931c562712f10c2be1a4b4a58807f: Status 404 returned error can't find the container with id adb3a90832cb071bfca21f6e8f815986d83931c562712f10c2be1a4b4a58807f
Jul 29 01:48:51.276220 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:51.276193    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-70bd38-df994d56b-q8rmg"]
Jul 29 01:48:51.280058 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:48:51.280033    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f7fea41_9c80_4629_beff_6d7cdab3e9a5.slice/crio-1c3a32dbb788a4e6e04c1b28d74ced3327b32c0728c07a6c8d5631a48cef81dd WatchSource:0}: Error finding container 1c3a32dbb788a4e6e04c1b28d74ced3327b32c0728c07a6c8d5631a48cef81dd: Status 404 returned error can't find the container with id 1c3a32dbb788a4e6e04c1b28d74ced3327b32c0728c07a6c8d5631a48cef81dd
Jul 29 01:48:52.142472 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:52.142437    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-70bd38-df994d56b-q8rmg" event={"ID":"5f7fea41-9c80-4629-beff-6d7cdab3e9a5","Type":"ContainerStarted","Data":"5218dd63bfc3d1b064154660defaf1a42c2aa6a461b711e4513a59100967a436"}
Jul 29 01:48:52.142933 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:52.142507    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-70bd38-df994d56b-q8rmg"
Jul 29 01:48:52.142933 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:52.142529    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-70bd38-df994d56b-q8rmg" event={"ID":"5f7fea41-9c80-4629-beff-6d7cdab3e9a5","Type":"ContainerStarted","Data":"1c3a32dbb788a4e6e04c1b28d74ced3327b32c0728c07a6c8d5631a48cef81dd"}
Jul 29 01:48:52.144154 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:52.144126    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-70bd38-5dc6f97764-65lk5" event={"ID":"9552c0bc-6652-47ec-8a4a-8e0e78a1dcb2","Type":"ContainerStarted","Data":"36a8a3d818a1c5e0ea1aebd441d2c07b1fe6e18c06a0e3c2c129ccc2f26de7d3"}
Jul 29 01:48:52.144267 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:52.144178    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-70bd38-5dc6f97764-65lk5" event={"ID":"9552c0bc-6652-47ec-8a4a-8e0e78a1dcb2","Type":"ContainerStarted","Data":"adb3a90832cb071bfca21f6e8f815986d83931c562712f10c2be1a4b4a58807f"}
Jul 29 01:48:52.144267 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:52.144204    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-70bd38-5dc6f97764-65lk5"
Jul 29 01:48:52.161283 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:52.161231    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-70bd38-df994d56b-q8rmg" podStartSLOduration=2.161218604 podStartE2EDuration="2.161218604s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:48:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:48:52.160104291 +0000 UTC m=+2182.472496999" watchObservedRunningTime="2026-07-29 01:48:52.161218604 +0000 UTC m=+2182.473611312"
Jul 29 01:48:52.180754 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:48:52.180707    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-70bd38-5dc6f97764-65lk5" podStartSLOduration=2.180693248 podStartE2EDuration="2.180693248s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:48:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:48:52.180045699 +0000 UTC m=+2182.492438406" watchObservedRunningTime="2026-07-29 01:48:52.180693248 +0000 UTC m=+2182.493085956"
Jul 29 01:49:03.151353 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:49:03.151318    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-70bd38-df994d56b-q8rmg"
Jul 29 01:49:03.151737 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:49:03.151432    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-70bd38-5dc6f97764-65lk5"
Jul 29 01:49:14.951712 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:49:14.951665    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:49:15.280287 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:49:15.280205    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:49:15.586160 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:49:15.586063    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:49:15.786418 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:49:15.786382    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:49:18.126834 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:49:18.126801    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:49:18.229291 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:49:18.229255    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:49:18.317512 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:49:18.317479    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:49:18.547285 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:49:18.547193    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:49:18.871646 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:49:18.871610    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:49:18.974924 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:49:18.974894    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:49:18.982046 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:49:18.982022    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-eb1fe1-55d797b64-g8wvp"]
Jul 29 01:49:18.985467 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:49:18.985449    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eb1fe1-55d797b64-g8wvp"
Jul 29 01:49:18.988291 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:49:18.988262    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-eb1fe1-dockercfg-44dql\""
Jul 29 01:49:18.988441 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:49:18.988424    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-eb1fe1\""
Jul 29 01:49:18.999881 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:49:18.999861    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-eb1fe1-55d797b64-g8wvp"]
Jul 29 01:49:19.006465 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:49:19.006444    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-eb1fe1-7f4bb9957b-v7s99"]
Jul 29 01:49:19.009788 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:49:19.009772    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-eb1fe1-7f4bb9957b-v7s99"
Jul 29 01:49:19.020307 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:49:19.020285    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-eb1fe1-7f4bb9957b-v7s99"]
Jul 29 01:49:19.081193 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:49:19.081165    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e04286a-408a-4a82-b265-1fc6edc7dd05-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-eb1fe1-55d797b64-g8wvp\" (UID: \"8e04286a-408a-4a82-b265-1fc6edc7dd05\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eb1fe1-55d797b64-g8wvp"
Jul 29 01:49:19.081303 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:49:19.081194    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91f07eab-b5c8-4d6a-bbd3-82234536c768-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-eb1fe1-7f4bb9957b-v7s99\" (UID: \"91f07eab-b5c8-4d6a-bbd3-82234536c768\") " pod="openshift-ingress/payload-processing-e2e-inf-b-eb1fe1-7f4bb9957b-v7s99"
Jul 29 01:49:19.081303 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:49:19.081216    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9n2pl\" (UniqueName: \"kubernetes.io/projected/8e04286a-408a-4a82-b265-1fc6edc7dd05-kube-api-access-9n2pl\") pod \"payload-pre-processing-e2e-inf-b-eb1fe1-55d797b64-g8wvp\" (UID: \"8e04286a-408a-4a82-b265-1fc6edc7dd05\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eb1fe1-55d797b64-g8wvp"
Jul 29 01:49:19.081303 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:49:19.081270    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbbbd\" (UniqueName: \"kubernetes.io/projected/91f07eab-b5c8-4d6a-bbd3-82234536c768-kube-api-access-wbbbd\") pod \"payload-processing-e2e-inf-b-eb1fe1-7f4bb9957b-v7s99\" (UID: \"91f07eab-b5c8-4d6a-bbd3-82234536c768\") " pod="openshift-ingress/payload-processing-e2e-inf-b-eb1fe1-7f4bb9957b-v7s99"
Jul 29 01:49:19.182710 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:49:19.182535    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e04286a-408a-4a82-b265-1fc6edc7dd05-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-eb1fe1-55d797b64-g8wvp\" (UID: \"8e04286a-408a-4a82-b265-1fc6edc7dd05\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eb1fe1-55d797b64-g8wvp"
Jul 29 01:49:19.182710 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:49:19.182578    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91f07eab-b5c8-4d6a-bbd3-82234536c768-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-eb1fe1-7f4bb9957b-v7s99\" (UID: \"91f07eab-b5c8-4d6a-bbd3-82234536c768\") " pod="openshift-ingress/payload-processing-e2e-inf-b-eb1fe1-7f4bb9957b-v7s99"
Jul 29 01:49:19.183297 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:49:19.182736    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9n2pl\" (UniqueName: \"kubernetes.io/projected/8e04286a-408a-4a82-b265-1fc6edc7dd05-kube-api-access-9n2pl\") pod \"payload-pre-processing-e2e-inf-b-eb1fe1-55d797b64-g8wvp\" (UID: \"8e04286a-408a-4a82-b265-1fc6edc7dd05\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eb1fe1-55d797b64-g8wvp"
Jul 29 01:49:19.183297 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:49:19.182811    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbbbd\" (UniqueName: \"kubernetes.io/projected/91f07eab-b5c8-4d6a-bbd3-82234536c768-kube-api-access-wbbbd\") pod \"payload-processing-e2e-inf-b-eb1fe1-7f4bb9957b-v7s99\" (UID: \"91f07eab-b5c8-4d6a-bbd3-82234536c768\") " pod="openshift-ingress/payload-processing-e2e-inf-b-eb1fe1-7f4bb9957b-v7s99"
Jul 29 01:49:19.183433 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:49:19.183416    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e04286a-408a-4a82-b265-1fc6edc7dd05-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-eb1fe1-55d797b64-g8wvp\" (UID: \"8e04286a-408a-4a82-b265-1fc6edc7dd05\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eb1fe1-55d797b64-g8wvp"
Jul 29 01:49:19.183501 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:49:19.183475    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91f07eab-b5c8-4d6a-bbd3-82234536c768-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-eb1fe1-7f4bb9957b-v7s99\" (UID: \"91f07eab-b5c8-4d6a-bbd3-82234536c768\") " pod="openshift-ingress/payload-processing-e2e-inf-b-eb1fe1-7f4bb9957b-v7s99"
Jul 29 01:49:19.191291 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:49:19.191264    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9n2pl\" (UniqueName: \"kubernetes.io/projected/8e04286a-408a-4a82-b265-1fc6edc7dd05-kube-api-access-9n2pl\") pod \"payload-pre-processing-e2e-inf-b-eb1fe1-55d797b64-g8wvp\" (UID: \"8e04286a-408a-4a82-b265-1fc6edc7dd05\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eb1fe1-55d797b64-g8wvp"
Jul 29 01:49:19.191551 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:49:19.191534    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbbbd\" (UniqueName: \"kubernetes.io/projected/91f07eab-b5c8-4d6a-bbd3-82234536c768-kube-api-access-wbbbd\") pod \"payload-processing-e2e-inf-b-eb1fe1-7f4bb9957b-v7s99\" (UID: \"91f07eab-b5c8-4d6a-bbd3-82234536c768\") " pod="openshift-ingress/payload-processing-e2e-inf-b-eb1fe1-7f4bb9957b-v7s99"
Jul 29 01:49:19.296268 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:49:19.296238    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eb1fe1-55d797b64-g8wvp"
Jul 29 01:49:19.320312 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:49:19.320287    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-eb1fe1-7f4bb9957b-v7s99"
Jul 29 01:49:19.440629 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:49:19.440597    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-eb1fe1-55d797b64-g8wvp"]
Jul 29 01:49:19.443564 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:49:19.443536    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e04286a_408a_4a82_b265_1fc6edc7dd05.slice/crio-20c0b799a47cd9fd8f321a2f04e23864ee36282b1b7630b368afd351d8c5c583 WatchSource:0}: Error finding container 20c0b799a47cd9fd8f321a2f04e23864ee36282b1b7630b368afd351d8c5c583: Status 404 returned error can't find the container with id 20c0b799a47cd9fd8f321a2f04e23864ee36282b1b7630b368afd351d8c5c583
Jul 29 01:49:19.686259 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:49:19.686234    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-eb1fe1-7f4bb9957b-v7s99"]
Jul 29 01:49:19.688285 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:49:19.688259    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91f07eab_b5c8_4d6a_bbd3_82234536c768.slice/crio-11b5765c2568ce40bc017c3a7a188209ee72b8328ed293e8e10610c115350084 WatchSource:0}: Error finding container 11b5765c2568ce40bc017c3a7a188209ee72b8328ed293e8e10610c115350084: Status 404 returned error can't find the container with id 11b5765c2568ce40bc017c3a7a188209ee72b8328ed293e8e10610c115350084
Jul 29 01:49:20.273812 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:49:20.273773    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eb1fe1-55d797b64-g8wvp" event={"ID":"8e04286a-408a-4a82-b265-1fc6edc7dd05","Type":"ContainerStarted","Data":"22ab62ccfbed15c3b0050440f97cee256fc14820d6490d5cb15b30a736cc5f2c"}
Jul 29 01:49:20.274315 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:49:20.273831    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eb1fe1-55d797b64-g8wvp" event={"ID":"8e04286a-408a-4a82-b265-1fc6edc7dd05","Type":"ContainerStarted","Data":"20c0b799a47cd9fd8f321a2f04e23864ee36282b1b7630b368afd351d8c5c583"}
Jul 29 01:49:20.274315 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:49:20.273857    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eb1fe1-55d797b64-g8wvp"
Jul 29 01:49:20.275309 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:49:20.275287    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-eb1fe1-7f4bb9957b-v7s99" event={"ID":"91f07eab-b5c8-4d6a-bbd3-82234536c768","Type":"ContainerStarted","Data":"af3f24c4ecbadb3c881edcf8383f3f39c52e791ee3fb88cc457ba32738ffd1f7"}
Jul 29 01:49:20.275376 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:49:20.275327    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-eb1fe1-7f4bb9957b-v7s99" event={"ID":"91f07eab-b5c8-4d6a-bbd3-82234536c768","Type":"ContainerStarted","Data":"11b5765c2568ce40bc017c3a7a188209ee72b8328ed293e8e10610c115350084"}
Jul 29 01:49:20.275376 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:49:20.275346    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-eb1fe1-7f4bb9957b-v7s99"
Jul 29 01:49:20.292617 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:49:20.292576    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eb1fe1-55d797b64-g8wvp" podStartSLOduration=2.292562785 podStartE2EDuration="2.292562785s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:49:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:49:20.291515751 +0000 UTC m=+2210.603908459" watchObservedRunningTime="2026-07-29 01:49:20.292562785 +0000 UTC m=+2210.604955492"
Jul 29 01:49:20.309964 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:49:20.309901    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-eb1fe1-7f4bb9957b-v7s99" podStartSLOduration=2.309887398 podStartE2EDuration="2.309887398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:49:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:49:20.308624952 +0000 UTC m=+2210.621017663" watchObservedRunningTime="2026-07-29 01:49:20.309887398 +0000 UTC m=+2210.622280106"
Jul 29 01:49:30.229806 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:49:30.229758    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:49:31.283260 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:49:31.283227    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eb1fe1-55d797b64-g8wvp"
Jul 29 01:49:31.283686 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:49:31.283377    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-eb1fe1-7f4bb9957b-v7s99"
Jul 29 01:49:37.217593 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:49:37.217554    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:49:43.070676 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:49:43.070636    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:49:48.903846 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:49:48.903808    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:50:33.311129 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:50:33.311097    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-eb1fe1/test-model-eb1fe1-kserve-7945b6f49c-b97l6"]
Jul 29 01:50:33.314792 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:50:33.314771    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-eb1fe1/test-model-eb1fe1-kserve-7945b6f49c-b97l6"
Jul 29 01:50:33.317556 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:50:33.317534    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-eb1fe1\"/\"test-model-eb1fe1-kserve-self-signed-certs\""
Jul 29 01:50:33.318848 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:50:33.318826    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-eb1fe1\"/\"kube-root-ca.crt\""
Jul 29 01:50:33.318990 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:50:33.318961    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-eb1fe1\"/\"default-dockercfg-8l4zc\""
Jul 29 01:50:33.319071 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:50:33.318971    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-eb1fe1\"/\"openshift-service-ca.crt\""
Jul 29 01:50:33.327566 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:50:33.327543    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-eb1fe1/test-model-eb1fe1-kserve-7945b6f49c-b97l6"]
Jul 29 01:50:33.352339 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:50:33.352299    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhh9b\" (UniqueName: \"kubernetes.io/projected/4d95d7e8-3893-4467-86a5-20f71308aec9-kube-api-access-hhh9b\") pod \"test-model-eb1fe1-kserve-7945b6f49c-b97l6\" (UID: \"4d95d7e8-3893-4467-86a5-20f71308aec9\") " pod="ai-tenant-e2e-inf-b-eb1fe1/test-model-eb1fe1-kserve-7945b6f49c-b97l6"
Jul 29 01:50:33.352339 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:50:33.352335    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4d95d7e8-3893-4467-86a5-20f71308aec9-model-cache\") pod \"test-model-eb1fe1-kserve-7945b6f49c-b97l6\" (UID: \"4d95d7e8-3893-4467-86a5-20f71308aec9\") " pod="ai-tenant-e2e-inf-b-eb1fe1/test-model-eb1fe1-kserve-7945b6f49c-b97l6"
Jul 29 01:50:33.352585 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:50:33.352355    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4d95d7e8-3893-4467-86a5-20f71308aec9-home\") pod \"test-model-eb1fe1-kserve-7945b6f49c-b97l6\" (UID: \"4d95d7e8-3893-4467-86a5-20f71308aec9\") " pod="ai-tenant-e2e-inf-b-eb1fe1/test-model-eb1fe1-kserve-7945b6f49c-b97l6"
Jul 29 01:50:33.352585 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:50:33.352396    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d95d7e8-3893-4467-86a5-20f71308aec9-tls-certs\") pod \"test-model-eb1fe1-kserve-7945b6f49c-b97l6\" (UID: \"4d95d7e8-3893-4467-86a5-20f71308aec9\") " pod="ai-tenant-e2e-inf-b-eb1fe1/test-model-eb1fe1-kserve-7945b6f49c-b97l6"
Jul 29 01:50:33.352585 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:50:33.352514    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d95d7e8-3893-4467-86a5-20f71308aec9-tmp-dir\") pod \"test-model-eb1fe1-kserve-7945b6f49c-b97l6\" (UID: \"4d95d7e8-3893-4467-86a5-20f71308aec9\") " pod="ai-tenant-e2e-inf-b-eb1fe1/test-model-eb1fe1-kserve-7945b6f49c-b97l6"
Jul 29 01:50:33.352768 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:50:33.352618    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4d95d7e8-3893-4467-86a5-20f71308aec9-dshm\") pod \"test-model-eb1fe1-kserve-7945b6f49c-b97l6\" (UID: \"4d95d7e8-3893-4467-86a5-20f71308aec9\") " pod="ai-tenant-e2e-inf-b-eb1fe1/test-model-eb1fe1-kserve-7945b6f49c-b97l6"
Jul 29 01:50:33.454095 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:50:33.454058    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d95d7e8-3893-4467-86a5-20f71308aec9-tmp-dir\") pod \"test-model-eb1fe1-kserve-7945b6f49c-b97l6\" (UID: \"4d95d7e8-3893-4467-86a5-20f71308aec9\") " pod="ai-tenant-e2e-inf-b-eb1fe1/test-model-eb1fe1-kserve-7945b6f49c-b97l6"
Jul 29 01:50:33.454268 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:50:33.454141    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4d95d7e8-3893-4467-86a5-20f71308aec9-dshm\") pod \"test-model-eb1fe1-kserve-7945b6f49c-b97l6\" (UID: \"4d95d7e8-3893-4467-86a5-20f71308aec9\") " pod="ai-tenant-e2e-inf-b-eb1fe1/test-model-eb1fe1-kserve-7945b6f49c-b97l6"
Jul 29 01:50:33.454268 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:50:33.454165    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhh9b\" (UniqueName: \"kubernetes.io/projected/4d95d7e8-3893-4467-86a5-20f71308aec9-kube-api-access-hhh9b\") pod \"test-model-eb1fe1-kserve-7945b6f49c-b97l6\" (UID: \"4d95d7e8-3893-4467-86a5-20f71308aec9\") " pod="ai-tenant-e2e-inf-b-eb1fe1/test-model-eb1fe1-kserve-7945b6f49c-b97l6"
Jul 29 01:50:33.454268 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:50:33.454187    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4d95d7e8-3893-4467-86a5-20f71308aec9-model-cache\") pod \"test-model-eb1fe1-kserve-7945b6f49c-b97l6\" (UID: \"4d95d7e8-3893-4467-86a5-20f71308aec9\") " pod="ai-tenant-e2e-inf-b-eb1fe1/test-model-eb1fe1-kserve-7945b6f49c-b97l6"
Jul 29 01:50:33.454268 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:50:33.454204    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4d95d7e8-3893-4467-86a5-20f71308aec9-home\") pod \"test-model-eb1fe1-kserve-7945b6f49c-b97l6\" (UID: \"4d95d7e8-3893-4467-86a5-20f71308aec9\") " pod="ai-tenant-e2e-inf-b-eb1fe1/test-model-eb1fe1-kserve-7945b6f49c-b97l6"
Jul 29 01:50:33.454268 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:50:33.454235    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d95d7e8-3893-4467-86a5-20f71308aec9-tls-certs\") pod \"test-model-eb1fe1-kserve-7945b6f49c-b97l6\" (UID: \"4d95d7e8-3893-4467-86a5-20f71308aec9\") " pod="ai-tenant-e2e-inf-b-eb1fe1/test-model-eb1fe1-kserve-7945b6f49c-b97l6"
Jul 29 01:50:33.454519 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:50:33.454459    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d95d7e8-3893-4467-86a5-20f71308aec9-tmp-dir\") pod \"test-model-eb1fe1-kserve-7945b6f49c-b97l6\" (UID: \"4d95d7e8-3893-4467-86a5-20f71308aec9\") " pod="ai-tenant-e2e-inf-b-eb1fe1/test-model-eb1fe1-kserve-7945b6f49c-b97l6"
Jul 29 01:50:33.454578 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:50:33.454555    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4d95d7e8-3893-4467-86a5-20f71308aec9-home\") pod \"test-model-eb1fe1-kserve-7945b6f49c-b97l6\" (UID: \"4d95d7e8-3893-4467-86a5-20f71308aec9\") " pod="ai-tenant-e2e-inf-b-eb1fe1/test-model-eb1fe1-kserve-7945b6f49c-b97l6"
Jul 29 01:50:33.454618 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:50:33.454597    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4d95d7e8-3893-4467-86a5-20f71308aec9-model-cache\") pod \"test-model-eb1fe1-kserve-7945b6f49c-b97l6\" (UID: \"4d95d7e8-3893-4467-86a5-20f71308aec9\") " pod="ai-tenant-e2e-inf-b-eb1fe1/test-model-eb1fe1-kserve-7945b6f49c-b97l6"
Jul 29 01:50:33.456446 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:50:33.456424    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4d95d7e8-3893-4467-86a5-20f71308aec9-dshm\") pod \"test-model-eb1fe1-kserve-7945b6f49c-b97l6\" (UID: \"4d95d7e8-3893-4467-86a5-20f71308aec9\") " pod="ai-tenant-e2e-inf-b-eb1fe1/test-model-eb1fe1-kserve-7945b6f49c-b97l6"
Jul 29 01:50:33.456686 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:50:33.456669    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d95d7e8-3893-4467-86a5-20f71308aec9-tls-certs\") pod \"test-model-eb1fe1-kserve-7945b6f49c-b97l6\" (UID: \"4d95d7e8-3893-4467-86a5-20f71308aec9\") " pod="ai-tenant-e2e-inf-b-eb1fe1/test-model-eb1fe1-kserve-7945b6f49c-b97l6"
Jul 29 01:50:33.462843 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:50:33.462824    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhh9b\" (UniqueName: \"kubernetes.io/projected/4d95d7e8-3893-4467-86a5-20f71308aec9-kube-api-access-hhh9b\") pod \"test-model-eb1fe1-kserve-7945b6f49c-b97l6\" (UID: \"4d95d7e8-3893-4467-86a5-20f71308aec9\") " pod="ai-tenant-e2e-inf-b-eb1fe1/test-model-eb1fe1-kserve-7945b6f49c-b97l6"
Jul 29 01:50:33.624388 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:50:33.624358    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-eb1fe1/test-model-eb1fe1-kserve-7945b6f49c-b97l6"
Jul 29 01:50:33.765293 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:50:33.765246    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-eb1fe1/test-model-eb1fe1-kserve-7945b6f49c-b97l6"]
Jul 29 01:50:33.767748 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:50:33.767720    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4d95d7e8_3893_4467_86a5_20f71308aec9.slice/crio-38b5a3cae5e5b65778781090cb02c8caabd63f734cacdab8d619964d059a5bc9 WatchSource:0}: Error finding container 38b5a3cae5e5b65778781090cb02c8caabd63f734cacdab8d619964d059a5bc9: Status 404 returned error can't find the container with id 38b5a3cae5e5b65778781090cb02c8caabd63f734cacdab8d619964d059a5bc9
Jul 29 01:50:34.024710 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:50:34.024621    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:50:34.627297 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:50:34.627257    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-eb1fe1/test-model-eb1fe1-kserve-7945b6f49c-b97l6" event={"ID":"4d95d7e8-3893-4467-86a5-20f71308aec9","Type":"ContainerStarted","Data":"f98f90b2a8e7097354f0c066622e6f80ce2edb111fb60f0b86e34e7ce145aeaf"}
Jul 29 01:50:34.627297 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:50:34.627302    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-eb1fe1/test-model-eb1fe1-kserve-7945b6f49c-b97l6" event={"ID":"4d95d7e8-3893-4467-86a5-20f71308aec9","Type":"ContainerStarted","Data":"38b5a3cae5e5b65778781090cb02c8caabd63f734cacdab8d619964d059a5bc9"}
Jul 29 01:50:34.646063 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:50:34.646006    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-eb1fe1/test-model-eb1fe1-kserve-7945b6f49c-b97l6" podStartSLOduration=1.645984377 podStartE2EDuration="1.645984377s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:50:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:50:34.645437057 +0000 UTC m=+2284.957829772" watchObservedRunningTime="2026-07-29 01:50:34.645984377 +0000 UTC m=+2284.958377088"
Jul 29 01:50:43.624604 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:50:43.624560    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-eb1fe1/test-model-eb1fe1-kserve-7945b6f49c-b97l6"
Jul 29 01:50:43.625013 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:50:43.624634    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-eb1fe1/test-model-eb1fe1-kserve-7945b6f49c-b97l6"
Jul 29 01:50:43.642184 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:50:43.642161    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-eb1fe1/test-model-eb1fe1-kserve-7945b6f49c-b97l6"
Jul 29 01:50:43.680443 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:50:43.680416    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-eb1fe1/test-model-eb1fe1-kserve-7945b6f49c-b97l6"
Jul 29 01:51:13.026151 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:13.026083    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:13.875497 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:13.875456    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-eb1fe1/test-model-eb1fe1-kserve-7945b6f49c-b97l6"]
Jul 29 01:51:13.901452 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:13.901422    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:24.503824 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:24.503791    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:24.543310 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:24.542510    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-70bd38-df994d56b-q8rmg"]
Jul 29 01:51:24.543310 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:24.542818    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-70bd38-df994d56b-q8rmg" podUID="5f7fea41-9c80-4629-beff-6d7cdab3e9a5" containerName="payload-processing" containerID="cri-o://5218dd63bfc3d1b064154660defaf1a42c2aa6a461b711e4513a59100967a436" gracePeriod=30
Jul 29 01:51:24.554315 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:24.554279    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-70bd38-5dc6f97764-65lk5"]
Jul 29 01:51:24.554606 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:24.554559    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-70bd38-5dc6f97764-65lk5" podUID="9552c0bc-6652-47ec-8a4a-8e0e78a1dcb2" containerName="payload-pre-processing" containerID="cri-o://36a8a3d818a1c5e0ea1aebd441d2c07b1fe6e18c06a0e3c2c129ccc2f26de7d3" gracePeriod=30
Jul 29 01:51:24.589453 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:24.589424    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:24.660407 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:24.660373    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:24.726345 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:24.726302    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:24.836299 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:24.836278    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-70bd38-df994d56b-q8rmg"
Jul 29 01:51:24.839262 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:24.839240    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-70bd38-5dc6f97764-65lk5"
Jul 29 01:51:24.867365 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:24.867333    2580 generic.go:356] "Generic (PLEG): container finished" podID="9552c0bc-6652-47ec-8a4a-8e0e78a1dcb2" containerID="36a8a3d818a1c5e0ea1aebd441d2c07b1fe6e18c06a0e3c2c129ccc2f26de7d3" exitCode=0
Jul 29 01:51:24.867541 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:24.867378    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-70bd38-5dc6f97764-65lk5"
Jul 29 01:51:24.867541 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:24.867443    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-70bd38-5dc6f97764-65lk5" event={"ID":"9552c0bc-6652-47ec-8a4a-8e0e78a1dcb2","Type":"ContainerDied","Data":"36a8a3d818a1c5e0ea1aebd441d2c07b1fe6e18c06a0e3c2c129ccc2f26de7d3"}
Jul 29 01:51:24.867541 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:24.867499    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-70bd38-5dc6f97764-65lk5" event={"ID":"9552c0bc-6652-47ec-8a4a-8e0e78a1dcb2","Type":"ContainerDied","Data":"adb3a90832cb071bfca21f6e8f815986d83931c562712f10c2be1a4b4a58807f"}
Jul 29 01:51:24.867541 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:24.867527    2580 scope.go:117] "RemoveContainer" containerID="36a8a3d818a1c5e0ea1aebd441d2c07b1fe6e18c06a0e3c2c129ccc2f26de7d3"
Jul 29 01:51:24.868817 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:24.868793    2580 generic.go:356] "Generic (PLEG): container finished" podID="5f7fea41-9c80-4629-beff-6d7cdab3e9a5" containerID="5218dd63bfc3d1b064154660defaf1a42c2aa6a461b711e4513a59100967a436" exitCode=0
Jul 29 01:51:24.868979 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:24.868820    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-70bd38-df994d56b-q8rmg" event={"ID":"5f7fea41-9c80-4629-beff-6d7cdab3e9a5","Type":"ContainerDied","Data":"5218dd63bfc3d1b064154660defaf1a42c2aa6a461b711e4513a59100967a436"}
Jul 29 01:51:24.868979 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:24.868835    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-70bd38-df994d56b-q8rmg"
Jul 29 01:51:24.868979 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:24.868864    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-70bd38-df994d56b-q8rmg" event={"ID":"5f7fea41-9c80-4629-beff-6d7cdab3e9a5","Type":"ContainerDied","Data":"1c3a32dbb788a4e6e04c1b28d74ced3327b32c0728c07a6c8d5631a48cef81dd"}
Jul 29 01:51:24.877790 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:24.877766    2580 scope.go:117] "RemoveContainer" containerID="36a8a3d818a1c5e0ea1aebd441d2c07b1fe6e18c06a0e3c2c129ccc2f26de7d3"
Jul 29 01:51:24.878123 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:51:24.878092    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36a8a3d818a1c5e0ea1aebd441d2c07b1fe6e18c06a0e3c2c129ccc2f26de7d3\": container with ID starting with 36a8a3d818a1c5e0ea1aebd441d2c07b1fe6e18c06a0e3c2c129ccc2f26de7d3 not found: ID does not exist" containerID="36a8a3d818a1c5e0ea1aebd441d2c07b1fe6e18c06a0e3c2c129ccc2f26de7d3"
Jul 29 01:51:24.878220 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:24.878131    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36a8a3d818a1c5e0ea1aebd441d2c07b1fe6e18c06a0e3c2c129ccc2f26de7d3"} err="failed to get container status \"36a8a3d818a1c5e0ea1aebd441d2c07b1fe6e18c06a0e3c2c129ccc2f26de7d3\": rpc error: code = NotFound desc = could not find container \"36a8a3d818a1c5e0ea1aebd441d2c07b1fe6e18c06a0e3c2c129ccc2f26de7d3\": container with ID starting with 36a8a3d818a1c5e0ea1aebd441d2c07b1fe6e18c06a0e3c2c129ccc2f26de7d3 not found: ID does not exist"
Jul 29 01:51:24.878220 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:24.878149    2580 scope.go:117] "RemoveContainer" containerID="5218dd63bfc3d1b064154660defaf1a42c2aa6a461b711e4513a59100967a436"
Jul 29 01:51:24.885753 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:24.885735    2580 scope.go:117] "RemoveContainer" containerID="5218dd63bfc3d1b064154660defaf1a42c2aa6a461b711e4513a59100967a436"
Jul 29 01:51:24.886027 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:51:24.886006    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5218dd63bfc3d1b064154660defaf1a42c2aa6a461b711e4513a59100967a436\": container with ID starting with 5218dd63bfc3d1b064154660defaf1a42c2aa6a461b711e4513a59100967a436 not found: ID does not exist" containerID="5218dd63bfc3d1b064154660defaf1a42c2aa6a461b711e4513a59100967a436"
Jul 29 01:51:24.886114 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:24.886033    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5218dd63bfc3d1b064154660defaf1a42c2aa6a461b711e4513a59100967a436"} err="failed to get container status \"5218dd63bfc3d1b064154660defaf1a42c2aa6a461b711e4513a59100967a436\": rpc error: code = NotFound desc = could not find container \"5218dd63bfc3d1b064154660defaf1a42c2aa6a461b711e4513a59100967a436\": container with ID starting with 5218dd63bfc3d1b064154660defaf1a42c2aa6a461b711e4513a59100967a436 not found: ID does not exist"
Jul 29 01:51:24.935853 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:24.935825    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2tfmn\" (UniqueName: \"kubernetes.io/projected/9552c0bc-6652-47ec-8a4a-8e0e78a1dcb2-kube-api-access-2tfmn\") pod \"9552c0bc-6652-47ec-8a4a-8e0e78a1dcb2\" (UID: \"9552c0bc-6652-47ec-8a4a-8e0e78a1dcb2\") "
Jul 29 01:51:24.936038 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:24.935946    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9552c0bc-6652-47ec-8a4a-8e0e78a1dcb2-plugins-config-volume\") pod \"9552c0bc-6652-47ec-8a4a-8e0e78a1dcb2\" (UID: \"9552c0bc-6652-47ec-8a4a-8e0e78a1dcb2\") "
Jul 29 01:51:24.936038 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:24.935996    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7pf65\" (UniqueName: \"kubernetes.io/projected/5f7fea41-9c80-4629-beff-6d7cdab3e9a5-kube-api-access-7pf65\") pod \"5f7fea41-9c80-4629-beff-6d7cdab3e9a5\" (UID: \"5f7fea41-9c80-4629-beff-6d7cdab3e9a5\") "
Jul 29 01:51:24.936038 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:24.936019    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f7fea41-9c80-4629-beff-6d7cdab3e9a5-plugins-config-volume\") pod \"5f7fea41-9c80-4629-beff-6d7cdab3e9a5\" (UID: \"5f7fea41-9c80-4629-beff-6d7cdab3e9a5\") "
Jul 29 01:51:24.936346 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:24.936321    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9552c0bc-6652-47ec-8a4a-8e0e78a1dcb2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9552c0bc-6652-47ec-8a4a-8e0e78a1dcb2" (UID: "9552c0bc-6652-47ec-8a4a-8e0e78a1dcb2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:51:24.936446 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:24.936426    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f7fea41-9c80-4629-beff-6d7cdab3e9a5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5f7fea41-9c80-4629-beff-6d7cdab3e9a5" (UID: "5f7fea41-9c80-4629-beff-6d7cdab3e9a5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:51:24.938017 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:24.937984    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f7fea41-9c80-4629-beff-6d7cdab3e9a5-kube-api-access-7pf65" (OuterVolumeSpecName: "kube-api-access-7pf65") pod "5f7fea41-9c80-4629-beff-6d7cdab3e9a5" (UID: "5f7fea41-9c80-4629-beff-6d7cdab3e9a5"). InnerVolumeSpecName "kube-api-access-7pf65". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:51:24.938104 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:24.938017    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9552c0bc-6652-47ec-8a4a-8e0e78a1dcb2-kube-api-access-2tfmn" (OuterVolumeSpecName: "kube-api-access-2tfmn") pod "9552c0bc-6652-47ec-8a4a-8e0e78a1dcb2" (UID: "9552c0bc-6652-47ec-8a4a-8e0e78a1dcb2"). InnerVolumeSpecName "kube-api-access-2tfmn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:51:25.037221 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:25.037136    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2tfmn\" (UniqueName: \"kubernetes.io/projected/9552c0bc-6652-47ec-8a4a-8e0e78a1dcb2-kube-api-access-2tfmn\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:51:25.037221 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:25.037170    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9552c0bc-6652-47ec-8a4a-8e0e78a1dcb2-plugins-config-volume\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:51:25.037221 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:25.037180    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7pf65\" (UniqueName: \"kubernetes.io/projected/5f7fea41-9c80-4629-beff-6d7cdab3e9a5-kube-api-access-7pf65\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:51:25.037221 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:25.037188    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f7fea41-9c80-4629-beff-6d7cdab3e9a5-plugins-config-volume\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:51:25.076002 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:25.075940    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:25.190690 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:25.190656    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-70bd38-5dc6f97764-65lk5"]
Jul 29 01:51:25.195098 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:25.195070    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-70bd38-5dc6f97764-65lk5"]
Jul 29 01:51:25.205533 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:25.205501    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-70bd38-df994d56b-q8rmg"]
Jul 29 01:51:25.210421 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:25.210394    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-70bd38-df994d56b-q8rmg"]
Jul 29 01:51:26.169896 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:26.169852    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f7fea41-9c80-4629-beff-6d7cdab3e9a5" path="/var/lib/kubelet/pods/5f7fea41-9c80-4629-beff-6d7cdab3e9a5/volumes"
Jul 29 01:51:26.170421 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:26.170405    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9552c0bc-6652-47ec-8a4a-8e0e78a1dcb2" path="/var/lib/kubelet/pods/9552c0bc-6652-47ec-8a4a-8e0e78a1dcb2/volumes"
Jul 29 01:51:28.894278 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:28.894240    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-eb1fe1/test-model-eb1fe1-kserve-7945b6f49c-b97l6" podUID="4d95d7e8-3893-4467-86a5-20f71308aec9" containerName="main" containerID="cri-o://f98f90b2a8e7097354f0c066622e6f80ce2edb111fb60f0b86e34e7ce145aeaf" gracePeriod=45
Jul 29 01:51:29.149859 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:29.149799    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-eb1fe1/test-model-eb1fe1-kserve-7945b6f49c-b97l6"
Jul 29 01:51:29.277522 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:29.277492    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d95d7e8-3893-4467-86a5-20f71308aec9-tmp-dir\") pod \"4d95d7e8-3893-4467-86a5-20f71308aec9\" (UID: \"4d95d7e8-3893-4467-86a5-20f71308aec9\") "
Jul 29 01:51:29.277701 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:29.277579    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4d95d7e8-3893-4467-86a5-20f71308aec9-dshm\") pod \"4d95d7e8-3893-4467-86a5-20f71308aec9\" (UID: \"4d95d7e8-3893-4467-86a5-20f71308aec9\") "
Jul 29 01:51:29.277701 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:29.277610    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4d95d7e8-3893-4467-86a5-20f71308aec9-model-cache\") pod \"4d95d7e8-3893-4467-86a5-20f71308aec9\" (UID: \"4d95d7e8-3893-4467-86a5-20f71308aec9\") "
Jul 29 01:51:29.277701 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:29.277650    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4d95d7e8-3893-4467-86a5-20f71308aec9-home\") pod \"4d95d7e8-3893-4467-86a5-20f71308aec9\" (UID: \"4d95d7e8-3893-4467-86a5-20f71308aec9\") "
Jul 29 01:51:29.277854 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:29.277714    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d95d7e8-3893-4467-86a5-20f71308aec9-tls-certs\") pod \"4d95d7e8-3893-4467-86a5-20f71308aec9\" (UID: \"4d95d7e8-3893-4467-86a5-20f71308aec9\") "
Jul 29 01:51:29.277854 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:29.277738    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhh9b\" (UniqueName: \"kubernetes.io/projected/4d95d7e8-3893-4467-86a5-20f71308aec9-kube-api-access-hhh9b\") pod \"4d95d7e8-3893-4467-86a5-20f71308aec9\" (UID: \"4d95d7e8-3893-4467-86a5-20f71308aec9\") "
Jul 29 01:51:29.277854 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:29.277772    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d95d7e8-3893-4467-86a5-20f71308aec9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4d95d7e8-3893-4467-86a5-20f71308aec9" (UID: "4d95d7e8-3893-4467-86a5-20f71308aec9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:51:29.278048 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:29.277889    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d95d7e8-3893-4467-86a5-20f71308aec9-model-cache" (OuterVolumeSpecName: "model-cache") pod "4d95d7e8-3893-4467-86a5-20f71308aec9" (UID: "4d95d7e8-3893-4467-86a5-20f71308aec9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:51:29.278048 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:29.277929    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d95d7e8-3893-4467-86a5-20f71308aec9-home" (OuterVolumeSpecName: "home") pod "4d95d7e8-3893-4467-86a5-20f71308aec9" (UID: "4d95d7e8-3893-4467-86a5-20f71308aec9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:51:29.278144 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:29.278082    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4d95d7e8-3893-4467-86a5-20f71308aec9-model-cache\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:51:29.278144 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:29.278095    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4d95d7e8-3893-4467-86a5-20f71308aec9-home\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:51:29.278144 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:29.278104    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d95d7e8-3893-4467-86a5-20f71308aec9-tmp-dir\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:51:29.279842 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:29.279820    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d95d7e8-3893-4467-86a5-20f71308aec9-kube-api-access-hhh9b" (OuterVolumeSpecName: "kube-api-access-hhh9b") pod "4d95d7e8-3893-4467-86a5-20f71308aec9" (UID: "4d95d7e8-3893-4467-86a5-20f71308aec9"). InnerVolumeSpecName "kube-api-access-hhh9b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:51:29.279842 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:29.279831    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d95d7e8-3893-4467-86a5-20f71308aec9-dshm" (OuterVolumeSpecName: "dshm") pod "4d95d7e8-3893-4467-86a5-20f71308aec9" (UID: "4d95d7e8-3893-4467-86a5-20f71308aec9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:51:29.279974 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:29.279818    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d95d7e8-3893-4467-86a5-20f71308aec9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4d95d7e8-3893-4467-86a5-20f71308aec9" (UID: "4d95d7e8-3893-4467-86a5-20f71308aec9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:51:29.379326 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:29.379281    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4d95d7e8-3893-4467-86a5-20f71308aec9-dshm\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:51:29.379326 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:29.379318    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d95d7e8-3893-4467-86a5-20f71308aec9-tls-certs\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:51:29.379326 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:29.379331    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhh9b\" (UniqueName: \"kubernetes.io/projected/4d95d7e8-3893-4467-86a5-20f71308aec9-kube-api-access-hhh9b\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:51:29.895112 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:29.895077    2580 generic.go:356] "Generic (PLEG): container finished" podID="4d95d7e8-3893-4467-86a5-20f71308aec9" containerID="f98f90b2a8e7097354f0c066622e6f80ce2edb111fb60f0b86e34e7ce145aeaf" exitCode=0
Jul 29 01:51:29.895591 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:29.895116    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-eb1fe1/test-model-eb1fe1-kserve-7945b6f49c-b97l6"
Jul 29 01:51:29.895591 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:29.895158    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-eb1fe1/test-model-eb1fe1-kserve-7945b6f49c-b97l6" event={"ID":"4d95d7e8-3893-4467-86a5-20f71308aec9","Type":"ContainerDied","Data":"f98f90b2a8e7097354f0c066622e6f80ce2edb111fb60f0b86e34e7ce145aeaf"}
Jul 29 01:51:29.895591 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:29.895200    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-eb1fe1/test-model-eb1fe1-kserve-7945b6f49c-b97l6" event={"ID":"4d95d7e8-3893-4467-86a5-20f71308aec9","Type":"ContainerDied","Data":"38b5a3cae5e5b65778781090cb02c8caabd63f734cacdab8d619964d059a5bc9"}
Jul 29 01:51:29.895591 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:29.895217    2580 scope.go:117] "RemoveContainer" containerID="f98f90b2a8e7097354f0c066622e6f80ce2edb111fb60f0b86e34e7ce145aeaf"
Jul 29 01:51:29.904478 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:29.904463    2580 scope.go:117] "RemoveContainer" containerID="f98f90b2a8e7097354f0c066622e6f80ce2edb111fb60f0b86e34e7ce145aeaf"
Jul 29 01:51:29.904724 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:51:29.904706    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f98f90b2a8e7097354f0c066622e6f80ce2edb111fb60f0b86e34e7ce145aeaf\": container with ID starting with f98f90b2a8e7097354f0c066622e6f80ce2edb111fb60f0b86e34e7ce145aeaf not found: ID does not exist" containerID="f98f90b2a8e7097354f0c066622e6f80ce2edb111fb60f0b86e34e7ce145aeaf"
Jul 29 01:51:29.904768 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:29.904732    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f98f90b2a8e7097354f0c066622e6f80ce2edb111fb60f0b86e34e7ce145aeaf"} err="failed to get container status \"f98f90b2a8e7097354f0c066622e6f80ce2edb111fb60f0b86e34e7ce145aeaf\": rpc error: code = NotFound desc = could not find container \"f98f90b2a8e7097354f0c066622e6f80ce2edb111fb60f0b86e34e7ce145aeaf\": container with ID starting with f98f90b2a8e7097354f0c066622e6f80ce2edb111fb60f0b86e34e7ce145aeaf not found: ID does not exist"
Jul 29 01:51:29.916209 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:29.916187    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-eb1fe1/test-model-eb1fe1-kserve-7945b6f49c-b97l6"]
Jul 29 01:51:29.920326 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:29.920304    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-eb1fe1/test-model-eb1fe1-kserve-7945b6f49c-b97l6"]
Jul 29 01:51:30.170731 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:30.170633    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d95d7e8-3893-4467-86a5-20f71308aec9" path="/var/lib/kubelet/pods/4d95d7e8-3893-4467-86a5-20f71308aec9/volumes"
Jul 29 01:51:31.190534 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:31.190504    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:31.313390 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:31.313357    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:31.456440 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:31.456333    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:31.675328 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:31.675295    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:37.366605 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:37.366551    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:37.393577 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:37.393543    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-eb1fe1-7f4bb9957b-v7s99"]
Jul 29 01:51:37.393859 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:37.393832    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-eb1fe1-7f4bb9957b-v7s99" podUID="91f07eab-b5c8-4d6a-bbd3-82234536c768" containerName="payload-processing" containerID="cri-o://af3f24c4ecbadb3c881edcf8383f3f39c52e791ee3fb88cc457ba32738ffd1f7" gracePeriod=30
Jul 29 01:51:37.402808 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:37.402778    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-eb1fe1-55d797b64-g8wvp"]
Jul 29 01:51:37.403114 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:37.403050    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eb1fe1-55d797b64-g8wvp" podUID="8e04286a-408a-4a82-b265-1fc6edc7dd05" containerName="payload-pre-processing" containerID="cri-o://22ab62ccfbed15c3b0050440f97cee256fc14820d6490d5cb15b30a736cc5f2c" gracePeriod=30
Jul 29 01:51:37.436844 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:37.436811    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:37.535993 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:37.535933    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:37.629449 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:37.629359    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:37.679453 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:37.679205    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-eb1fe1-7f4bb9957b-v7s99"
Jul 29 01:51:37.706148 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:37.706125    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eb1fe1-55d797b64-g8wvp"
Jul 29 01:51:37.754974 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:37.754916    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9n2pl\" (UniqueName: \"kubernetes.io/projected/8e04286a-408a-4a82-b265-1fc6edc7dd05-kube-api-access-9n2pl\") pod \"8e04286a-408a-4a82-b265-1fc6edc7dd05\" (UID: \"8e04286a-408a-4a82-b265-1fc6edc7dd05\") "
Jul 29 01:51:37.755166 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:37.754987    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbbbd\" (UniqueName: \"kubernetes.io/projected/91f07eab-b5c8-4d6a-bbd3-82234536c768-kube-api-access-wbbbd\") pod \"91f07eab-b5c8-4d6a-bbd3-82234536c768\" (UID: \"91f07eab-b5c8-4d6a-bbd3-82234536c768\") "
Jul 29 01:51:37.755166 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:37.755026    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e04286a-408a-4a82-b265-1fc6edc7dd05-plugins-config-volume\") pod \"8e04286a-408a-4a82-b265-1fc6edc7dd05\" (UID: \"8e04286a-408a-4a82-b265-1fc6edc7dd05\") "
Jul 29 01:51:37.755166 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:37.755042    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91f07eab-b5c8-4d6a-bbd3-82234536c768-plugins-config-volume\") pod \"91f07eab-b5c8-4d6a-bbd3-82234536c768\" (UID: \"91f07eab-b5c8-4d6a-bbd3-82234536c768\") "
Jul 29 01:51:37.755435 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:37.755410    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91f07eab-b5c8-4d6a-bbd3-82234536c768-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "91f07eab-b5c8-4d6a-bbd3-82234536c768" (UID: "91f07eab-b5c8-4d6a-bbd3-82234536c768"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:51:37.755513 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:37.755441    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e04286a-408a-4a82-b265-1fc6edc7dd05-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8e04286a-408a-4a82-b265-1fc6edc7dd05" (UID: "8e04286a-408a-4a82-b265-1fc6edc7dd05"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:51:37.757101 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:37.757080    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e04286a-408a-4a82-b265-1fc6edc7dd05-kube-api-access-9n2pl" (OuterVolumeSpecName: "kube-api-access-9n2pl") pod "8e04286a-408a-4a82-b265-1fc6edc7dd05" (UID: "8e04286a-408a-4a82-b265-1fc6edc7dd05"). InnerVolumeSpecName "kube-api-access-9n2pl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:51:37.757202 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:37.757182    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91f07eab-b5c8-4d6a-bbd3-82234536c768-kube-api-access-wbbbd" (OuterVolumeSpecName: "kube-api-access-wbbbd") pod "91f07eab-b5c8-4d6a-bbd3-82234536c768" (UID: "91f07eab-b5c8-4d6a-bbd3-82234536c768"). InnerVolumeSpecName "kube-api-access-wbbbd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:51:37.856248 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:37.856206    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9n2pl\" (UniqueName: \"kubernetes.io/projected/8e04286a-408a-4a82-b265-1fc6edc7dd05-kube-api-access-9n2pl\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:51:37.856248 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:37.856242    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbbbd\" (UniqueName: \"kubernetes.io/projected/91f07eab-b5c8-4d6a-bbd3-82234536c768-kube-api-access-wbbbd\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:51:37.856248 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:37.856256    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e04286a-408a-4a82-b265-1fc6edc7dd05-plugins-config-volume\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:51:37.856484 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:37.856268    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91f07eab-b5c8-4d6a-bbd3-82234536c768-plugins-config-volume\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:51:37.907746 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:37.907656    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:37.932963 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:37.932921    2580 generic.go:356] "Generic (PLEG): container finished" podID="91f07eab-b5c8-4d6a-bbd3-82234536c768" containerID="af3f24c4ecbadb3c881edcf8383f3f39c52e791ee3fb88cc457ba32738ffd1f7" exitCode=0
Jul 29 01:51:37.933205 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:37.932983    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-eb1fe1-7f4bb9957b-v7s99"
Jul 29 01:51:37.933205 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:37.932986    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-eb1fe1-7f4bb9957b-v7s99" event={"ID":"91f07eab-b5c8-4d6a-bbd3-82234536c768","Type":"ContainerDied","Data":"af3f24c4ecbadb3c881edcf8383f3f39c52e791ee3fb88cc457ba32738ffd1f7"}
Jul 29 01:51:37.933205 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:37.933055    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-eb1fe1-7f4bb9957b-v7s99" event={"ID":"91f07eab-b5c8-4d6a-bbd3-82234536c768","Type":"ContainerDied","Data":"11b5765c2568ce40bc017c3a7a188209ee72b8328ed293e8e10610c115350084"}
Jul 29 01:51:37.933205 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:37.933087    2580 scope.go:117] "RemoveContainer" containerID="af3f24c4ecbadb3c881edcf8383f3f39c52e791ee3fb88cc457ba32738ffd1f7"
Jul 29 01:51:37.934620 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:37.934594    2580 generic.go:356] "Generic (PLEG): container finished" podID="8e04286a-408a-4a82-b265-1fc6edc7dd05" containerID="22ab62ccfbed15c3b0050440f97cee256fc14820d6490d5cb15b30a736cc5f2c" exitCode=0
Jul 29 01:51:37.934723 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:37.934636    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eb1fe1-55d797b64-g8wvp" event={"ID":"8e04286a-408a-4a82-b265-1fc6edc7dd05","Type":"ContainerDied","Data":"22ab62ccfbed15c3b0050440f97cee256fc14820d6490d5cb15b30a736cc5f2c"}
Jul 29 01:51:37.934723 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:37.934681    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eb1fe1-55d797b64-g8wvp"
Jul 29 01:51:37.934723 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:37.934681    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eb1fe1-55d797b64-g8wvp" event={"ID":"8e04286a-408a-4a82-b265-1fc6edc7dd05","Type":"ContainerDied","Data":"20c0b799a47cd9fd8f321a2f04e23864ee36282b1b7630b368afd351d8c5c583"}
Jul 29 01:51:37.943438 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:37.943421    2580 scope.go:117] "RemoveContainer" containerID="af3f24c4ecbadb3c881edcf8383f3f39c52e791ee3fb88cc457ba32738ffd1f7"
Jul 29 01:51:37.943726 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:51:37.943699    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af3f24c4ecbadb3c881edcf8383f3f39c52e791ee3fb88cc457ba32738ffd1f7\": container with ID starting with af3f24c4ecbadb3c881edcf8383f3f39c52e791ee3fb88cc457ba32738ffd1f7 not found: ID does not exist" containerID="af3f24c4ecbadb3c881edcf8383f3f39c52e791ee3fb88cc457ba32738ffd1f7"
Jul 29 01:51:37.943774 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:37.943741    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af3f24c4ecbadb3c881edcf8383f3f39c52e791ee3fb88cc457ba32738ffd1f7"} err="failed to get container status \"af3f24c4ecbadb3c881edcf8383f3f39c52e791ee3fb88cc457ba32738ffd1f7\": rpc error: code = NotFound desc = could not find container \"af3f24c4ecbadb3c881edcf8383f3f39c52e791ee3fb88cc457ba32738ffd1f7\": container with ID starting with af3f24c4ecbadb3c881edcf8383f3f39c52e791ee3fb88cc457ba32738ffd1f7 not found: ID does not exist"
Jul 29 01:51:37.943774 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:37.943760    2580 scope.go:117] "RemoveContainer" containerID="22ab62ccfbed15c3b0050440f97cee256fc14820d6490d5cb15b30a736cc5f2c"
Jul 29 01:51:37.951986 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:37.951968    2580 scope.go:117] "RemoveContainer" containerID="22ab62ccfbed15c3b0050440f97cee256fc14820d6490d5cb15b30a736cc5f2c"
Jul 29 01:51:37.952224 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:51:37.952206    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22ab62ccfbed15c3b0050440f97cee256fc14820d6490d5cb15b30a736cc5f2c\": container with ID starting with 22ab62ccfbed15c3b0050440f97cee256fc14820d6490d5cb15b30a736cc5f2c not found: ID does not exist" containerID="22ab62ccfbed15c3b0050440f97cee256fc14820d6490d5cb15b30a736cc5f2c"
Jul 29 01:51:37.952276 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:37.952230    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22ab62ccfbed15c3b0050440f97cee256fc14820d6490d5cb15b30a736cc5f2c"} err="failed to get container status \"22ab62ccfbed15c3b0050440f97cee256fc14820d6490d5cb15b30a736cc5f2c\": rpc error: code = NotFound desc = could not find container \"22ab62ccfbed15c3b0050440f97cee256fc14820d6490d5cb15b30a736cc5f2c\": container with ID starting with 22ab62ccfbed15c3b0050440f97cee256fc14820d6490d5cb15b30a736cc5f2c not found: ID does not exist"
Jul 29 01:51:37.955317 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:37.955296    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-eb1fe1-7f4bb9957b-v7s99"]
Jul 29 01:51:37.959741 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:37.959720    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-eb1fe1-7f4bb9957b-v7s99"]
Jul 29 01:51:37.970027 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:37.970005    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-eb1fe1-55d797b64-g8wvp"]
Jul 29 01:51:37.974407 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:37.974388    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-eb1fe1-55d797b64-g8wvp"]
Jul 29 01:51:38.170716 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:38.170633    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e04286a-408a-4a82-b265-1fc6edc7dd05" path="/var/lib/kubelet/pods/8e04286a-408a-4a82-b265-1fc6edc7dd05/volumes"
Jul 29 01:51:38.171011 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:38.170998    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91f07eab-b5c8-4d6a-bbd3-82234536c768" path="/var/lib/kubelet/pods/91f07eab-b5c8-4d6a-bbd3-82234536c768/volumes"
Jul 29 01:51:43.910796 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:43.910758    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:44.011367 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:44.011327    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:44.098316 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:44.098284    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:44.277835 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:44.277753    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:44.621020 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:44.620970    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:44.960942 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:44.960855    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:45.127006 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:45.126963    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:47.744211 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:47.744175    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:47.839081 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:47.839049    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:47.997057 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:47.996976    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:48.361823 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:48.361786    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:48.659362 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:48.659274    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:48.760196 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:48.760148    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:51:48.761049 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:48.761028    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-6127b1-fb47f5b9b-wc8z7"]
Jul 29 01:51:48.761438 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:48.761416    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e04286a-408a-4a82-b265-1fc6edc7dd05" containerName="payload-pre-processing"
Jul 29 01:51:48.761438 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:48.761434    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e04286a-408a-4a82-b265-1fc6edc7dd05" containerName="payload-pre-processing"
Jul 29 01:51:48.761612 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:48.761445    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d95d7e8-3893-4467-86a5-20f71308aec9" containerName="main"
Jul 29 01:51:48.761612 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:48.761454    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d95d7e8-3893-4467-86a5-20f71308aec9" containerName="main"
Jul 29 01:51:48.761612 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:48.761467    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9552c0bc-6652-47ec-8a4a-8e0e78a1dcb2" containerName="payload-pre-processing"
Jul 29 01:51:48.761612 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:48.761474    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9552c0bc-6652-47ec-8a4a-8e0e78a1dcb2" containerName="payload-pre-processing"
Jul 29 01:51:48.761612 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:48.761482    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f7fea41-9c80-4629-beff-6d7cdab3e9a5" containerName="payload-processing"
Jul 29 01:51:48.761612 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:48.761488    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f7fea41-9c80-4629-beff-6d7cdab3e9a5" containerName="payload-processing"
Jul 29 01:51:48.761612 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:48.761506    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91f07eab-b5c8-4d6a-bbd3-82234536c768" containerName="payload-processing"
Jul 29 01:51:48.761612 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:48.761511    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="91f07eab-b5c8-4d6a-bbd3-82234536c768" containerName="payload-processing"
Jul 29 01:51:48.761612 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:48.761574    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9552c0bc-6652-47ec-8a4a-8e0e78a1dcb2" containerName="payload-pre-processing"
Jul 29 01:51:48.761612 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:48.761583    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d95d7e8-3893-4467-86a5-20f71308aec9" containerName="main"
Jul 29 01:51:48.761612 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:48.761590    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f7fea41-9c80-4629-beff-6d7cdab3e9a5" containerName="payload-processing"
Jul 29 01:51:48.761612 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:48.761596    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e04286a-408a-4a82-b265-1fc6edc7dd05" containerName="payload-pre-processing"
Jul 29 01:51:48.761612 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:48.761602    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="91f07eab-b5c8-4d6a-bbd3-82234536c768" containerName="payload-processing"
Jul 29 01:51:48.766406 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:48.766390    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-6127b1-fb47f5b9b-wc8z7"
Jul 29 01:51:48.768925 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:48.768906    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-6127b1-dockercfg-5hjtw\""
Jul 29 01:51:48.769035 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:48.769022    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-6127b1\""
Jul 29 01:51:48.775318 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:48.775293    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-6127b1-fb47f5b9b-wc8z7"]
Jul 29 01:51:48.788554 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:48.788532    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-6127b1-7fc58f4446-rl9xs"]
Jul 29 01:51:48.792446 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:48.792430    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-6127b1-7fc58f4446-rl9xs"
Jul 29 01:51:48.805682 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:48.805662    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-6127b1-7fc58f4446-rl9xs"]
Jul 29 01:51:48.853340 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:48.853313    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee54f335-a04a-44e6-922a-ca4129f31904-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-6127b1-fb47f5b9b-wc8z7\" (UID: \"ee54f335-a04a-44e6-922a-ca4129f31904\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-6127b1-fb47f5b9b-wc8z7"
Jul 29 01:51:48.853462 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:48.853382    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/69d55ecf-6865-4354-865f-0ad83e6d664e-plugins-config-volume\") pod \"payload-processing-e2e-api-a-6127b1-7fc58f4446-rl9xs\" (UID: \"69d55ecf-6865-4354-865f-0ad83e6d664e\") " pod="openshift-ingress/payload-processing-e2e-api-a-6127b1-7fc58f4446-rl9xs"
Jul 29 01:51:48.853462 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:48.853402    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54vjq\" (UniqueName: \"kubernetes.io/projected/69d55ecf-6865-4354-865f-0ad83e6d664e-kube-api-access-54vjq\") pod \"payload-processing-e2e-api-a-6127b1-7fc58f4446-rl9xs\" (UID: \"69d55ecf-6865-4354-865f-0ad83e6d664e\") " pod="openshift-ingress/payload-processing-e2e-api-a-6127b1-7fc58f4446-rl9xs"
Jul 29 01:51:48.853462 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:48.853434    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2fb4\" (UniqueName: \"kubernetes.io/projected/ee54f335-a04a-44e6-922a-ca4129f31904-kube-api-access-g2fb4\") pod \"payload-pre-processing-e2e-api-a-6127b1-fb47f5b9b-wc8z7\" (UID: \"ee54f335-a04a-44e6-922a-ca4129f31904\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-6127b1-fb47f5b9b-wc8z7"
Jul 29 01:51:48.954771 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:48.954699    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/69d55ecf-6865-4354-865f-0ad83e6d664e-plugins-config-volume\") pod \"payload-processing-e2e-api-a-6127b1-7fc58f4446-rl9xs\" (UID: \"69d55ecf-6865-4354-865f-0ad83e6d664e\") " pod="openshift-ingress/payload-processing-e2e-api-a-6127b1-7fc58f4446-rl9xs"
Jul 29 01:51:48.954771 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:48.954737    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54vjq\" (UniqueName: \"kubernetes.io/projected/69d55ecf-6865-4354-865f-0ad83e6d664e-kube-api-access-54vjq\") pod \"payload-processing-e2e-api-a-6127b1-7fc58f4446-rl9xs\" (UID: \"69d55ecf-6865-4354-865f-0ad83e6d664e\") " pod="openshift-ingress/payload-processing-e2e-api-a-6127b1-7fc58f4446-rl9xs"
Jul 29 01:51:48.954988 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:48.954791    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2fb4\" (UniqueName: \"kubernetes.io/projected/ee54f335-a04a-44e6-922a-ca4129f31904-kube-api-access-g2fb4\") pod \"payload-pre-processing-e2e-api-a-6127b1-fb47f5b9b-wc8z7\" (UID: \"ee54f335-a04a-44e6-922a-ca4129f31904\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-6127b1-fb47f5b9b-wc8z7"
Jul 29 01:51:48.954988 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:48.954834    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee54f335-a04a-44e6-922a-ca4129f31904-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-6127b1-fb47f5b9b-wc8z7\" (UID: \"ee54f335-a04a-44e6-922a-ca4129f31904\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-6127b1-fb47f5b9b-wc8z7"
Jul 29 01:51:48.955477 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:48.955454    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/69d55ecf-6865-4354-865f-0ad83e6d664e-plugins-config-volume\") pod \"payload-processing-e2e-api-a-6127b1-7fc58f4446-rl9xs\" (UID: \"69d55ecf-6865-4354-865f-0ad83e6d664e\") " pod="openshift-ingress/payload-processing-e2e-api-a-6127b1-7fc58f4446-rl9xs"
Jul 29 01:51:48.955576 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:48.955541    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee54f335-a04a-44e6-922a-ca4129f31904-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-6127b1-fb47f5b9b-wc8z7\" (UID: \"ee54f335-a04a-44e6-922a-ca4129f31904\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-6127b1-fb47f5b9b-wc8z7"
Jul 29 01:51:48.962611 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:48.962585    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2fb4\" (UniqueName: \"kubernetes.io/projected/ee54f335-a04a-44e6-922a-ca4129f31904-kube-api-access-g2fb4\") pod \"payload-pre-processing-e2e-api-a-6127b1-fb47f5b9b-wc8z7\" (UID: \"ee54f335-a04a-44e6-922a-ca4129f31904\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-6127b1-fb47f5b9b-wc8z7"
Jul 29 01:51:48.962985 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:48.962968    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54vjq\" (UniqueName: \"kubernetes.io/projected/69d55ecf-6865-4354-865f-0ad83e6d664e-kube-api-access-54vjq\") pod \"payload-processing-e2e-api-a-6127b1-7fc58f4446-rl9xs\" (UID: \"69d55ecf-6865-4354-865f-0ad83e6d664e\") " pod="openshift-ingress/payload-processing-e2e-api-a-6127b1-7fc58f4446-rl9xs"
Jul 29 01:51:49.077399 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:49.077373    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-6127b1-fb47f5b9b-wc8z7"
Jul 29 01:51:49.101583 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:49.101561    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-6127b1-7fc58f4446-rl9xs"
Jul 29 01:51:49.220127 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:49.220098    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-6127b1-fb47f5b9b-wc8z7"]
Jul 29 01:51:49.222212 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:51:49.222189    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee54f335_a04a_44e6_922a_ca4129f31904.slice/crio-a1738aa75e1c8f8ee9531f032eabfd042d9e25741617f14c0fcbdeff760f2ed0 WatchSource:0}: Error finding container a1738aa75e1c8f8ee9531f032eabfd042d9e25741617f14c0fcbdeff760f2ed0: Status 404 returned error can't find the container with id a1738aa75e1c8f8ee9531f032eabfd042d9e25741617f14c0fcbdeff760f2ed0
Jul 29 01:51:49.459669 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:49.459643    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-6127b1-7fc58f4446-rl9xs"]
Jul 29 01:51:49.461618 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:51:49.461595    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69d55ecf_6865_4354_865f_0ad83e6d664e.slice/crio-2a7ec245a9ff30bbe472c4c696b15795735fa7a8d4da037a546d5383fe1089e6 WatchSource:0}: Error finding container 2a7ec245a9ff30bbe472c4c696b15795735fa7a8d4da037a546d5383fe1089e6: Status 404 returned error can't find the container with id 2a7ec245a9ff30bbe472c4c696b15795735fa7a8d4da037a546d5383fe1089e6
Jul 29 01:51:49.996183 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:49.996148    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-6127b1-7fc58f4446-rl9xs" event={"ID":"69d55ecf-6865-4354-865f-0ad83e6d664e","Type":"ContainerStarted","Data":"0087c452e20cbd9b711c02aa193fa0b3bf00c44552f95c18a89408a8d1e520b7"}
Jul 29 01:51:49.996631 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:49.996198    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-6127b1-7fc58f4446-rl9xs" event={"ID":"69d55ecf-6865-4354-865f-0ad83e6d664e","Type":"ContainerStarted","Data":"2a7ec245a9ff30bbe472c4c696b15795735fa7a8d4da037a546d5383fe1089e6"}
Jul 29 01:51:49.996631 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:49.996270    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-6127b1-7fc58f4446-rl9xs"
Jul 29 01:51:49.997652 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:49.997628    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-6127b1-fb47f5b9b-wc8z7" event={"ID":"ee54f335-a04a-44e6-922a-ca4129f31904","Type":"ContainerStarted","Data":"41cb98a9d27fc465686aeec32447c42acbcf437c4f5ccee5b69ee96541e24072"}
Jul 29 01:51:49.997773 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:49.997669    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-6127b1-fb47f5b9b-wc8z7" event={"ID":"ee54f335-a04a-44e6-922a-ca4129f31904","Type":"ContainerStarted","Data":"a1738aa75e1c8f8ee9531f032eabfd042d9e25741617f14c0fcbdeff760f2ed0"}
Jul 29 01:51:49.997773 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:49.997701    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-6127b1-fb47f5b9b-wc8z7"
Jul 29 01:51:50.015969 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:50.015899    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-6127b1-7fc58f4446-rl9xs" podStartSLOduration=2.01588693 podStartE2EDuration="2.01588693s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:51:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:51:50.014715051 +0000 UTC m=+2360.327107759" watchObservedRunningTime="2026-07-29 01:51:50.01588693 +0000 UTC m=+2360.328279638"
Jul 29 01:51:50.036568 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:51:50.036518    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-6127b1-fb47f5b9b-wc8z7" podStartSLOduration=2.036501231 podStartE2EDuration="2.036501231s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:51:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:51:50.035089156 +0000 UTC m=+2360.347481865" watchObservedRunningTime="2026-07-29 01:51:50.036501231 +0000 UTC m=+2360.348893940"
Jul 29 01:52:01.004722 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:01.004690    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-6127b1-7fc58f4446-rl9xs"
Jul 29 01:52:01.005121 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:01.004757    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-6127b1-fb47f5b9b-wc8z7"
Jul 29 01:52:12.728167 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:12.728126    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:52:13.179697 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:13.179658    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:52:13.500470 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:13.500380    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:52:13.871578 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:13.871542    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:52:16.075510 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:16.075462    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:52:16.167532 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:16.167498    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:52:16.262781 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:16.262749    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:52:16.493143 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:16.493108    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:52:16.803395 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:16.803306    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:52:16.905924 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:16.905884    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:52:16.909935 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:16.909911    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-66baf8-6c965bbbd-fkwbs"]
Jul 29 01:52:16.913592 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:16.913574    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-66baf8-6c965bbbd-fkwbs"
Jul 29 01:52:16.916206 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:16.916187    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-66baf8\""
Jul 29 01:52:16.916319 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:16.916191    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-66baf8-dockercfg-x5jj5\""
Jul 29 01:52:16.924830 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:16.924806    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-66baf8-6c965bbbd-fkwbs"]
Jul 29 01:52:16.930191 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:16.930169    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-66baf8-56965b89bd-8xwrc"]
Jul 29 01:52:16.933642 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:16.933619    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-66baf8-56965b89bd-8xwrc"
Jul 29 01:52:16.944728 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:16.944704    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-66baf8-56965b89bd-8xwrc"]
Jul 29 01:52:17.003789 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:17.003751    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7fa0e78f-804d-4952-bfd7-3a7c08d5a9b1-plugins-config-volume\") pod \"payload-processing-e2e-api-b-66baf8-56965b89bd-8xwrc\" (UID: \"7fa0e78f-804d-4952-bfd7-3a7c08d5a9b1\") " pod="openshift-ingress/payload-processing-e2e-api-b-66baf8-56965b89bd-8xwrc"
Jul 29 01:52:17.003979 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:17.003824    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncqxx\" (UniqueName: \"kubernetes.io/projected/6d420784-22d1-41ea-96fb-96cd9a8ef9b7-kube-api-access-ncqxx\") pod \"payload-pre-processing-e2e-api-b-66baf8-6c965bbbd-fkwbs\" (UID: \"6d420784-22d1-41ea-96fb-96cd9a8ef9b7\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-66baf8-6c965bbbd-fkwbs"
Jul 29 01:52:17.003979 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:17.003869    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h98m5\" (UniqueName: \"kubernetes.io/projected/7fa0e78f-804d-4952-bfd7-3a7c08d5a9b1-kube-api-access-h98m5\") pod \"payload-processing-e2e-api-b-66baf8-56965b89bd-8xwrc\" (UID: \"7fa0e78f-804d-4952-bfd7-3a7c08d5a9b1\") " pod="openshift-ingress/payload-processing-e2e-api-b-66baf8-56965b89bd-8xwrc"
Jul 29 01:52:17.003979 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:17.003902    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d420784-22d1-41ea-96fb-96cd9a8ef9b7-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-66baf8-6c965bbbd-fkwbs\" (UID: \"6d420784-22d1-41ea-96fb-96cd9a8ef9b7\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-66baf8-6c965bbbd-fkwbs"
Jul 29 01:52:17.105127 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:17.105023    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncqxx\" (UniqueName: \"kubernetes.io/projected/6d420784-22d1-41ea-96fb-96cd9a8ef9b7-kube-api-access-ncqxx\") pod \"payload-pre-processing-e2e-api-b-66baf8-6c965bbbd-fkwbs\" (UID: \"6d420784-22d1-41ea-96fb-96cd9a8ef9b7\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-66baf8-6c965bbbd-fkwbs"
Jul 29 01:52:17.105127 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:17.105068    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h98m5\" (UniqueName: \"kubernetes.io/projected/7fa0e78f-804d-4952-bfd7-3a7c08d5a9b1-kube-api-access-h98m5\") pod \"payload-processing-e2e-api-b-66baf8-56965b89bd-8xwrc\" (UID: \"7fa0e78f-804d-4952-bfd7-3a7c08d5a9b1\") " pod="openshift-ingress/payload-processing-e2e-api-b-66baf8-56965b89bd-8xwrc"
Jul 29 01:52:17.105127 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:17.105094    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d420784-22d1-41ea-96fb-96cd9a8ef9b7-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-66baf8-6c965bbbd-fkwbs\" (UID: \"6d420784-22d1-41ea-96fb-96cd9a8ef9b7\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-66baf8-6c965bbbd-fkwbs"
Jul 29 01:52:17.105622 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:17.105158    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7fa0e78f-804d-4952-bfd7-3a7c08d5a9b1-plugins-config-volume\") pod \"payload-processing-e2e-api-b-66baf8-56965b89bd-8xwrc\" (UID: \"7fa0e78f-804d-4952-bfd7-3a7c08d5a9b1\") " pod="openshift-ingress/payload-processing-e2e-api-b-66baf8-56965b89bd-8xwrc"
Jul 29 01:52:17.106116 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:17.106092    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7fa0e78f-804d-4952-bfd7-3a7c08d5a9b1-plugins-config-volume\") pod \"payload-processing-e2e-api-b-66baf8-56965b89bd-8xwrc\" (UID: \"7fa0e78f-804d-4952-bfd7-3a7c08d5a9b1\") " pod="openshift-ingress/payload-processing-e2e-api-b-66baf8-56965b89bd-8xwrc"
Jul 29 01:52:17.106165 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:17.106092    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d420784-22d1-41ea-96fb-96cd9a8ef9b7-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-66baf8-6c965bbbd-fkwbs\" (UID: \"6d420784-22d1-41ea-96fb-96cd9a8ef9b7\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-66baf8-6c965bbbd-fkwbs"
Jul 29 01:52:17.114013 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:17.113989    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h98m5\" (UniqueName: \"kubernetes.io/projected/7fa0e78f-804d-4952-bfd7-3a7c08d5a9b1-kube-api-access-h98m5\") pod \"payload-processing-e2e-api-b-66baf8-56965b89bd-8xwrc\" (UID: \"7fa0e78f-804d-4952-bfd7-3a7c08d5a9b1\") " pod="openshift-ingress/payload-processing-e2e-api-b-66baf8-56965b89bd-8xwrc"
Jul 29 01:52:17.114179 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:17.114029    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncqxx\" (UniqueName: \"kubernetes.io/projected/6d420784-22d1-41ea-96fb-96cd9a8ef9b7-kube-api-access-ncqxx\") pod \"payload-pre-processing-e2e-api-b-66baf8-6c965bbbd-fkwbs\" (UID: \"6d420784-22d1-41ea-96fb-96cd9a8ef9b7\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-66baf8-6c965bbbd-fkwbs"
Jul 29 01:52:17.224578 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:17.224543    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-66baf8-6c965bbbd-fkwbs"
Jul 29 01:52:17.245448 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:17.245406    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-66baf8-56965b89bd-8xwrc"
Jul 29 01:52:17.382226 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:17.382199    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-66baf8-6c965bbbd-fkwbs"]
Jul 29 01:52:17.383768 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:52:17.383740    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d420784_22d1_41ea_96fb_96cd9a8ef9b7.slice/crio-3ee1200cc1c50ad7d07a8ba702023bce1b9a635d47ad008e26d476f538c06d20 WatchSource:0}: Error finding container 3ee1200cc1c50ad7d07a8ba702023bce1b9a635d47ad008e26d476f538c06d20: Status 404 returned error can't find the container with id 3ee1200cc1c50ad7d07a8ba702023bce1b9a635d47ad008e26d476f538c06d20
Jul 29 01:52:17.395394 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:17.395372    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-66baf8-56965b89bd-8xwrc"]
Jul 29 01:52:17.398550 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:52:17.398526    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fa0e78f_804d_4952_bfd7_3a7c08d5a9b1.slice/crio-847b4c5d81f750145796ea98ad7b9762e3a195352bcdcf340adfc47aa4dcc31d WatchSource:0}: Error finding container 847b4c5d81f750145796ea98ad7b9762e3a195352bcdcf340adfc47aa4dcc31d: Status 404 returned error can't find the container with id 847b4c5d81f750145796ea98ad7b9762e3a195352bcdcf340adfc47aa4dcc31d
Jul 29 01:52:18.131011 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:18.130932    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-66baf8-56965b89bd-8xwrc" event={"ID":"7fa0e78f-804d-4952-bfd7-3a7c08d5a9b1","Type":"ContainerStarted","Data":"2cb7886b97354c3c2c513c0ef2d22c72ba6fcd43d5c2cfb95290bfa4e54b5325"}
Jul 29 01:52:18.131465 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:18.131038    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-66baf8-56965b89bd-8xwrc" event={"ID":"7fa0e78f-804d-4952-bfd7-3a7c08d5a9b1","Type":"ContainerStarted","Data":"847b4c5d81f750145796ea98ad7b9762e3a195352bcdcf340adfc47aa4dcc31d"}
Jul 29 01:52:18.131465 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:18.131073    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-66baf8-56965b89bd-8xwrc"
Jul 29 01:52:18.132689 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:18.132664    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-66baf8-6c965bbbd-fkwbs" event={"ID":"6d420784-22d1-41ea-96fb-96cd9a8ef9b7","Type":"ContainerStarted","Data":"6f2a32fbd8bc323fc179c3f92a752f727cf4999d4e8619ae3c225b8c99836dc0"}
Jul 29 01:52:18.132816 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:18.132707    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-66baf8-6c965bbbd-fkwbs"
Jul 29 01:52:18.132816 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:18.132723    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-66baf8-6c965bbbd-fkwbs" event={"ID":"6d420784-22d1-41ea-96fb-96cd9a8ef9b7","Type":"ContainerStarted","Data":"3ee1200cc1c50ad7d07a8ba702023bce1b9a635d47ad008e26d476f538c06d20"}
Jul 29 01:52:18.147864 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:18.147818    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-66baf8-56965b89bd-8xwrc" podStartSLOduration=2.147804105 podStartE2EDuration="2.147804105s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:52:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:52:18.147258563 +0000 UTC m=+2388.459651272" watchObservedRunningTime="2026-07-29 01:52:18.147804105 +0000 UTC m=+2388.460196813"
Jul 29 01:52:18.166506 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:18.166452    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-66baf8-6c965bbbd-fkwbs" podStartSLOduration=2.166430308 podStartE2EDuration="2.166430308s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:52:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:52:18.165486396 +0000 UTC m=+2388.477879095" watchObservedRunningTime="2026-07-29 01:52:18.166430308 +0000 UTC m=+2388.478823020"
Jul 29 01:52:29.139517 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:29.139475    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-66baf8-6c965bbbd-fkwbs"
Jul 29 01:52:29.139973 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:29.139568    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-66baf8-56965b89bd-8xwrc"
Jul 29 01:52:31.727119 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:31.727005    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8g9fl_e044d9fa-39c8-49b8-94e1-550f3dbe7b26/ovn-acl-logging/0.log"
Jul 29 01:52:31.745931 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:31.733807    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8g9fl_e044d9fa-39c8-49b8-94e1-550f3dbe7b26/ovn-acl-logging/0.log"
Jul 29 01:52:35.381201 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:35.381165    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:52:41.007619 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:41.007578    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:52:59.333828 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:59.333710    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:52:59.339603 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:59.339572    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-6127b1-7fc58f4446-rl9xs"]
Jul 29 01:52:59.339852 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:59.339828    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-6127b1-7fc58f4446-rl9xs" podUID="69d55ecf-6865-4354-865f-0ad83e6d664e" containerName="payload-processing" containerID="cri-o://0087c452e20cbd9b711c02aa193fa0b3bf00c44552f95c18a89408a8d1e520b7" gracePeriod=30
Jul 29 01:52:59.346228 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:59.346202    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-6127b1-fb47f5b9b-wc8z7"]
Jul 29 01:52:59.346609 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:59.346581    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-6127b1-fb47f5b9b-wc8z7" podUID="ee54f335-a04a-44e6-922a-ca4129f31904" containerName="payload-pre-processing" containerID="cri-o://41cb98a9d27fc465686aeec32447c42acbcf437c4f5ccee5b69ee96541e24072" gracePeriod=30
Jul 29 01:52:59.433134 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:59.433097    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:52:59.500206 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:59.500126    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:52:59.625115 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:59.625089    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-6127b1-7fc58f4446-rl9xs"
Jul 29 01:52:59.627889 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:59.627868    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-6127b1-fb47f5b9b-wc8z7"
Jul 29 01:52:59.807692 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:59.807652    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/69d55ecf-6865-4354-865f-0ad83e6d664e-plugins-config-volume\") pod \"69d55ecf-6865-4354-865f-0ad83e6d664e\" (UID: \"69d55ecf-6865-4354-865f-0ad83e6d664e\") "
Jul 29 01:52:59.807692 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:59.807695    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2fb4\" (UniqueName: \"kubernetes.io/projected/ee54f335-a04a-44e6-922a-ca4129f31904-kube-api-access-g2fb4\") pod \"ee54f335-a04a-44e6-922a-ca4129f31904\" (UID: \"ee54f335-a04a-44e6-922a-ca4129f31904\") "
Jul 29 01:52:59.807986 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:59.807729    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee54f335-a04a-44e6-922a-ca4129f31904-plugins-config-volume\") pod \"ee54f335-a04a-44e6-922a-ca4129f31904\" (UID: \"ee54f335-a04a-44e6-922a-ca4129f31904\") "
Jul 29 01:52:59.807986 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:59.807751    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54vjq\" (UniqueName: \"kubernetes.io/projected/69d55ecf-6865-4354-865f-0ad83e6d664e-kube-api-access-54vjq\") pod \"69d55ecf-6865-4354-865f-0ad83e6d664e\" (UID: \"69d55ecf-6865-4354-865f-0ad83e6d664e\") "
Jul 29 01:52:59.808376 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:59.808179    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee54f335-a04a-44e6-922a-ca4129f31904-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ee54f335-a04a-44e6-922a-ca4129f31904" (UID: "ee54f335-a04a-44e6-922a-ca4129f31904"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:52:59.808376 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:59.808226    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69d55ecf-6865-4354-865f-0ad83e6d664e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "69d55ecf-6865-4354-865f-0ad83e6d664e" (UID: "69d55ecf-6865-4354-865f-0ad83e6d664e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:52:59.808376 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:59.808288    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee54f335-a04a-44e6-922a-ca4129f31904-plugins-config-volume\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:52:59.810578 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:59.810550    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee54f335-a04a-44e6-922a-ca4129f31904-kube-api-access-g2fb4" (OuterVolumeSpecName: "kube-api-access-g2fb4") pod "ee54f335-a04a-44e6-922a-ca4129f31904" (UID: "ee54f335-a04a-44e6-922a-ca4129f31904"). InnerVolumeSpecName "kube-api-access-g2fb4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:52:59.810682 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:59.810578    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69d55ecf-6865-4354-865f-0ad83e6d664e-kube-api-access-54vjq" (OuterVolumeSpecName: "kube-api-access-54vjq") pod "69d55ecf-6865-4354-865f-0ad83e6d664e" (UID: "69d55ecf-6865-4354-865f-0ad83e6d664e"). InnerVolumeSpecName "kube-api-access-54vjq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:52:59.848889 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:59.848776    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:52:59.909548 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:59.909511    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/69d55ecf-6865-4354-865f-0ad83e6d664e-plugins-config-volume\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:52:59.909548 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:59.909541    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2fb4\" (UniqueName: \"kubernetes.io/projected/ee54f335-a04a-44e6-922a-ca4129f31904-kube-api-access-g2fb4\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:52:59.909548 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:52:59.909550    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54vjq\" (UniqueName: \"kubernetes.io/projected/69d55ecf-6865-4354-865f-0ad83e6d664e-kube-api-access-54vjq\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:53:00.338392 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:00.338357    2580 generic.go:356] "Generic (PLEG): container finished" podID="69d55ecf-6865-4354-865f-0ad83e6d664e" containerID="0087c452e20cbd9b711c02aa193fa0b3bf00c44552f95c18a89408a8d1e520b7" exitCode=0
Jul 29 01:53:00.338870 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:00.338396    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-6127b1-7fc58f4446-rl9xs"
Jul 29 01:53:00.338870 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:00.338442    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-6127b1-7fc58f4446-rl9xs" event={"ID":"69d55ecf-6865-4354-865f-0ad83e6d664e","Type":"ContainerDied","Data":"0087c452e20cbd9b711c02aa193fa0b3bf00c44552f95c18a89408a8d1e520b7"}
Jul 29 01:53:00.338870 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:00.338494    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-6127b1-7fc58f4446-rl9xs" event={"ID":"69d55ecf-6865-4354-865f-0ad83e6d664e","Type":"ContainerDied","Data":"2a7ec245a9ff30bbe472c4c696b15795735fa7a8d4da037a546d5383fe1089e6"}
Jul 29 01:53:00.338870 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:00.338527    2580 scope.go:117] "RemoveContainer" containerID="0087c452e20cbd9b711c02aa193fa0b3bf00c44552f95c18a89408a8d1e520b7"
Jul 29 01:53:00.339845 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:00.339825    2580 generic.go:356] "Generic (PLEG): container finished" podID="ee54f335-a04a-44e6-922a-ca4129f31904" containerID="41cb98a9d27fc465686aeec32447c42acbcf437c4f5ccee5b69ee96541e24072" exitCode=0
Jul 29 01:53:00.339922 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:00.339856    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-6127b1-fb47f5b9b-wc8z7"
Jul 29 01:53:00.339922 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:00.339895    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-6127b1-fb47f5b9b-wc8z7" event={"ID":"ee54f335-a04a-44e6-922a-ca4129f31904","Type":"ContainerDied","Data":"41cb98a9d27fc465686aeec32447c42acbcf437c4f5ccee5b69ee96541e24072"}
Jul 29 01:53:00.340036 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:00.339944    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-6127b1-fb47f5b9b-wc8z7" event={"ID":"ee54f335-a04a-44e6-922a-ca4129f31904","Type":"ContainerDied","Data":"a1738aa75e1c8f8ee9531f032eabfd042d9e25741617f14c0fcbdeff760f2ed0"}
Jul 29 01:53:00.348200 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:00.348008    2580 scope.go:117] "RemoveContainer" containerID="0087c452e20cbd9b711c02aa193fa0b3bf00c44552f95c18a89408a8d1e520b7"
Jul 29 01:53:00.348273 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:53:00.348254    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0087c452e20cbd9b711c02aa193fa0b3bf00c44552f95c18a89408a8d1e520b7\": container with ID starting with 0087c452e20cbd9b711c02aa193fa0b3bf00c44552f95c18a89408a8d1e520b7 not found: ID does not exist" containerID="0087c452e20cbd9b711c02aa193fa0b3bf00c44552f95c18a89408a8d1e520b7"
Jul 29 01:53:00.348363 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:00.348281    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0087c452e20cbd9b711c02aa193fa0b3bf00c44552f95c18a89408a8d1e520b7"} err="failed to get container status \"0087c452e20cbd9b711c02aa193fa0b3bf00c44552f95c18a89408a8d1e520b7\": rpc error: code = NotFound desc = could not find container \"0087c452e20cbd9b711c02aa193fa0b3bf00c44552f95c18a89408a8d1e520b7\": container with ID starting with 0087c452e20cbd9b711c02aa193fa0b3bf00c44552f95c18a89408a8d1e520b7 not found: ID does not exist"
Jul 29 01:53:00.348363 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:00.348299    2580 scope.go:117] "RemoveContainer" containerID="41cb98a9d27fc465686aeec32447c42acbcf437c4f5ccee5b69ee96541e24072"
Jul 29 01:53:00.360913 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:00.360889    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-6127b1-7fc58f4446-rl9xs"]
Jul 29 01:53:00.362916 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:00.362900    2580 scope.go:117] "RemoveContainer" containerID="41cb98a9d27fc465686aeec32447c42acbcf437c4f5ccee5b69ee96541e24072"
Jul 29 01:53:00.363252 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:53:00.363234    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41cb98a9d27fc465686aeec32447c42acbcf437c4f5ccee5b69ee96541e24072\": container with ID starting with 41cb98a9d27fc465686aeec32447c42acbcf437c4f5ccee5b69ee96541e24072 not found: ID does not exist" containerID="41cb98a9d27fc465686aeec32447c42acbcf437c4f5ccee5b69ee96541e24072"
Jul 29 01:53:00.363315 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:00.363259    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41cb98a9d27fc465686aeec32447c42acbcf437c4f5ccee5b69ee96541e24072"} err="failed to get container status \"41cb98a9d27fc465686aeec32447c42acbcf437c4f5ccee5b69ee96541e24072\": rpc error: code = NotFound desc = could not find container \"41cb98a9d27fc465686aeec32447c42acbcf437c4f5ccee5b69ee96541e24072\": container with ID starting with 41cb98a9d27fc465686aeec32447c42acbcf437c4f5ccee5b69ee96541e24072 not found: ID does not exist"
Jul 29 01:53:00.364313 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:00.364295    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-6127b1-7fc58f4446-rl9xs"]
Jul 29 01:53:00.376731 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:00.376705    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-6127b1-fb47f5b9b-wc8z7"]
Jul 29 01:53:00.378775 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:00.378754    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-6127b1-fb47f5b9b-wc8z7"]
Jul 29 01:53:02.170022 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:02.169984    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69d55ecf-6865-4354-865f-0ad83e6d664e" path="/var/lib/kubelet/pods/69d55ecf-6865-4354-865f-0ad83e6d664e/volumes"
Jul 29 01:53:02.170421 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:02.170368    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee54f335-a04a-44e6-922a-ca4129f31904" path="/var/lib/kubelet/pods/ee54f335-a04a-44e6-922a-ca4129f31904/volumes"
Jul 29 01:53:04.265643 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:04.265601    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:53:05.563842 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:05.563812    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:53:05.623924 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:05.623884    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:53:05.825852 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:05.825763    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:53:06.037678 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:06.037645    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:53:21.609938 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:21.609899    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:53:21.637021 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:21.636981    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-66baf8-56965b89bd-8xwrc"]
Jul 29 01:53:21.637740 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:21.637687    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-66baf8-56965b89bd-8xwrc" podUID="7fa0e78f-804d-4952-bfd7-3a7c08d5a9b1" containerName="payload-processing" containerID="cri-o://2cb7886b97354c3c2c513c0ef2d22c72ba6fcd43d5c2cfb95290bfa4e54b5325" gracePeriod=30
Jul 29 01:53:21.647054 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:21.647015    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-66baf8-6c965bbbd-fkwbs"]
Jul 29 01:53:21.647320 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:21.647270    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-66baf8-6c965bbbd-fkwbs" podUID="6d420784-22d1-41ea-96fb-96cd9a8ef9b7" containerName="payload-pre-processing" containerID="cri-o://6f2a32fbd8bc323fc179c3f92a752f727cf4999d4e8619ae3c225b8c99836dc0" gracePeriod=30
Jul 29 01:53:21.710381 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:21.710339    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:53:21.787533 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:21.787450    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:53:21.859851 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:21.859815    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:53:21.918590 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:21.918566    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-66baf8-56965b89bd-8xwrc"
Jul 29 01:53:21.921642 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:21.921620    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-66baf8-6c965bbbd-fkwbs"
Jul 29 01:53:21.999237 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:21.999203    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d420784-22d1-41ea-96fb-96cd9a8ef9b7-plugins-config-volume\") pod \"6d420784-22d1-41ea-96fb-96cd9a8ef9b7\" (UID: \"6d420784-22d1-41ea-96fb-96cd9a8ef9b7\") "
Jul 29 01:53:21.999422 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:21.999266    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ncqxx\" (UniqueName: \"kubernetes.io/projected/6d420784-22d1-41ea-96fb-96cd9a8ef9b7-kube-api-access-ncqxx\") pod \"6d420784-22d1-41ea-96fb-96cd9a8ef9b7\" (UID: \"6d420784-22d1-41ea-96fb-96cd9a8ef9b7\") "
Jul 29 01:53:21.999422 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:21.999381    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h98m5\" (UniqueName: \"kubernetes.io/projected/7fa0e78f-804d-4952-bfd7-3a7c08d5a9b1-kube-api-access-h98m5\") pod \"7fa0e78f-804d-4952-bfd7-3a7c08d5a9b1\" (UID: \"7fa0e78f-804d-4952-bfd7-3a7c08d5a9b1\") "
Jul 29 01:53:21.999555 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:21.999463    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7fa0e78f-804d-4952-bfd7-3a7c08d5a9b1-plugins-config-volume\") pod \"7fa0e78f-804d-4952-bfd7-3a7c08d5a9b1\" (UID: \"7fa0e78f-804d-4952-bfd7-3a7c08d5a9b1\") "
Jul 29 01:53:21.999674 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:21.999646    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d420784-22d1-41ea-96fb-96cd9a8ef9b7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6d420784-22d1-41ea-96fb-96cd9a8ef9b7" (UID: "6d420784-22d1-41ea-96fb-96cd9a8ef9b7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:53:21.999841 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:21.999824    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d420784-22d1-41ea-96fb-96cd9a8ef9b7-plugins-config-volume\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:53:21.999933 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:21.999857    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7fa0e78f-804d-4952-bfd7-3a7c08d5a9b1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7fa0e78f-804d-4952-bfd7-3a7c08d5a9b1" (UID: "7fa0e78f-804d-4952-bfd7-3a7c08d5a9b1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:53:22.001413 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:22.001389    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d420784-22d1-41ea-96fb-96cd9a8ef9b7-kube-api-access-ncqxx" (OuterVolumeSpecName: "kube-api-access-ncqxx") pod "6d420784-22d1-41ea-96fb-96cd9a8ef9b7" (UID: "6d420784-22d1-41ea-96fb-96cd9a8ef9b7"). InnerVolumeSpecName "kube-api-access-ncqxx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:53:22.001591 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:22.001572    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fa0e78f-804d-4952-bfd7-3a7c08d5a9b1-kube-api-access-h98m5" (OuterVolumeSpecName: "kube-api-access-h98m5") pod "7fa0e78f-804d-4952-bfd7-3a7c08d5a9b1" (UID: "7fa0e78f-804d-4952-bfd7-3a7c08d5a9b1"). InnerVolumeSpecName "kube-api-access-h98m5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:53:22.101077 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:22.101041    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ncqxx\" (UniqueName: \"kubernetes.io/projected/6d420784-22d1-41ea-96fb-96cd9a8ef9b7-kube-api-access-ncqxx\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:53:22.101077 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:22.101072    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h98m5\" (UniqueName: \"kubernetes.io/projected/7fa0e78f-804d-4952-bfd7-3a7c08d5a9b1-kube-api-access-h98m5\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:53:22.101077 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:22.101085    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7fa0e78f-804d-4952-bfd7-3a7c08d5a9b1-plugins-config-volume\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:53:22.155510 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:22.155399    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:53:22.451882 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:22.451785    2580 generic.go:356] "Generic (PLEG): container finished" podID="6d420784-22d1-41ea-96fb-96cd9a8ef9b7" containerID="6f2a32fbd8bc323fc179c3f92a752f727cf4999d4e8619ae3c225b8c99836dc0" exitCode=0
Jul 29 01:53:22.451882 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:22.451830    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-66baf8-6c965bbbd-fkwbs"
Jul 29 01:53:22.451882 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:22.451874    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-66baf8-6c965bbbd-fkwbs" event={"ID":"6d420784-22d1-41ea-96fb-96cd9a8ef9b7","Type":"ContainerDied","Data":"6f2a32fbd8bc323fc179c3f92a752f727cf4999d4e8619ae3c225b8c99836dc0"}
Jul 29 01:53:22.452185 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:22.451919    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-66baf8-6c965bbbd-fkwbs" event={"ID":"6d420784-22d1-41ea-96fb-96cd9a8ef9b7","Type":"ContainerDied","Data":"3ee1200cc1c50ad7d07a8ba702023bce1b9a635d47ad008e26d476f538c06d20"}
Jul 29 01:53:22.452185 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:22.451942    2580 scope.go:117] "RemoveContainer" containerID="6f2a32fbd8bc323fc179c3f92a752f727cf4999d4e8619ae3c225b8c99836dc0"
Jul 29 01:53:22.453264 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:22.453241    2580 generic.go:356] "Generic (PLEG): container finished" podID="7fa0e78f-804d-4952-bfd7-3a7c08d5a9b1" containerID="2cb7886b97354c3c2c513c0ef2d22c72ba6fcd43d5c2cfb95290bfa4e54b5325" exitCode=0
Jul 29 01:53:22.453350 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:22.453278    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-66baf8-56965b89bd-8xwrc"
Jul 29 01:53:22.453350 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:22.453301    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-66baf8-56965b89bd-8xwrc" event={"ID":"7fa0e78f-804d-4952-bfd7-3a7c08d5a9b1","Type":"ContainerDied","Data":"2cb7886b97354c3c2c513c0ef2d22c72ba6fcd43d5c2cfb95290bfa4e54b5325"}
Jul 29 01:53:22.453422 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:22.453350    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-66baf8-56965b89bd-8xwrc" event={"ID":"7fa0e78f-804d-4952-bfd7-3a7c08d5a9b1","Type":"ContainerDied","Data":"847b4c5d81f750145796ea98ad7b9762e3a195352bcdcf340adfc47aa4dcc31d"}
Jul 29 01:53:22.460934 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:22.460919    2580 scope.go:117] "RemoveContainer" containerID="6f2a32fbd8bc323fc179c3f92a752f727cf4999d4e8619ae3c225b8c99836dc0"
Jul 29 01:53:22.461285 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:53:22.461264    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f2a32fbd8bc323fc179c3f92a752f727cf4999d4e8619ae3c225b8c99836dc0\": container with ID starting with 6f2a32fbd8bc323fc179c3f92a752f727cf4999d4e8619ae3c225b8c99836dc0 not found: ID does not exist" containerID="6f2a32fbd8bc323fc179c3f92a752f727cf4999d4e8619ae3c225b8c99836dc0"
Jul 29 01:53:22.461368 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:22.461292    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f2a32fbd8bc323fc179c3f92a752f727cf4999d4e8619ae3c225b8c99836dc0"} err="failed to get container status \"6f2a32fbd8bc323fc179c3f92a752f727cf4999d4e8619ae3c225b8c99836dc0\": rpc error: code = NotFound desc = could not find container \"6f2a32fbd8bc323fc179c3f92a752f727cf4999d4e8619ae3c225b8c99836dc0\": container with ID starting with 6f2a32fbd8bc323fc179c3f92a752f727cf4999d4e8619ae3c225b8c99836dc0 not found: ID does not exist"
Jul 29 01:53:22.461368 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:22.461310    2580 scope.go:117] "RemoveContainer" containerID="2cb7886b97354c3c2c513c0ef2d22c72ba6fcd43d5c2cfb95290bfa4e54b5325"
Jul 29 01:53:22.468889 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:22.468869    2580 scope.go:117] "RemoveContainer" containerID="2cb7886b97354c3c2c513c0ef2d22c72ba6fcd43d5c2cfb95290bfa4e54b5325"
Jul 29 01:53:22.469308 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:53:22.469238    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cb7886b97354c3c2c513c0ef2d22c72ba6fcd43d5c2cfb95290bfa4e54b5325\": container with ID starting with 2cb7886b97354c3c2c513c0ef2d22c72ba6fcd43d5c2cfb95290bfa4e54b5325 not found: ID does not exist" containerID="2cb7886b97354c3c2c513c0ef2d22c72ba6fcd43d5c2cfb95290bfa4e54b5325"
Jul 29 01:53:22.469440 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:22.469321    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cb7886b97354c3c2c513c0ef2d22c72ba6fcd43d5c2cfb95290bfa4e54b5325"} err="failed to get container status \"2cb7886b97354c3c2c513c0ef2d22c72ba6fcd43d5c2cfb95290bfa4e54b5325\": rpc error: code = NotFound desc = could not find container \"2cb7886b97354c3c2c513c0ef2d22c72ba6fcd43d5c2cfb95290bfa4e54b5325\": container with ID starting with 2cb7886b97354c3c2c513c0ef2d22c72ba6fcd43d5c2cfb95290bfa4e54b5325 not found: ID does not exist"
Jul 29 01:53:22.469532 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:22.469508    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-66baf8-6c965bbbd-fkwbs"]
Jul 29 01:53:22.471701 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:22.471681    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-66baf8-6c965bbbd-fkwbs"]
Jul 29 01:53:22.482738 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:22.482717    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-66baf8-56965b89bd-8xwrc"]
Jul 29 01:53:22.487671 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:22.487648    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-66baf8-56965b89bd-8xwrc"]
Jul 29 01:53:24.169740 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:24.169694    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d420784-22d1-41ea-96fb-96cd9a8ef9b7" path="/var/lib/kubelet/pods/6d420784-22d1-41ea-96fb-96cd9a8ef9b7/volumes"
Jul 29 01:53:24.170286 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:24.170264    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7fa0e78f-804d-4952-bfd7-3a7c08d5a9b1" path="/var/lib/kubelet/pods/7fa0e78f-804d-4952-bfd7-3a7c08d5a9b1/volumes"
Jul 29 01:53:27.906814 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:27.906777    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:53:27.966764 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:27.966719    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:53:28.170990 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:28.170885    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:53:28.387181 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:28.387139    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:53:28.709455 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:28.709415    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:53:29.006277 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:29.006187    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:53:29.131598 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:29.131559    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:53:32.260708 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:32.260675    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:53:32.354555 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:32.354521    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:53:32.429185 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:32.429146    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:53:32.553013 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:32.552901    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:53:33.030416 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:33.030381    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:53:33.128891 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:33.128853    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:53:33.156236 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:33.156202    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-c798cc-59df596976-gjzrh"]
Jul 29 01:53:33.156664 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:33.156647    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d420784-22d1-41ea-96fb-96cd9a8ef9b7" containerName="payload-pre-processing"
Jul 29 01:53:33.156742 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:33.156665    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d420784-22d1-41ea-96fb-96cd9a8ef9b7" containerName="payload-pre-processing"
Jul 29 01:53:33.156742 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:33.156690    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69d55ecf-6865-4354-865f-0ad83e6d664e" containerName="payload-processing"
Jul 29 01:53:33.156742 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:33.156697    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="69d55ecf-6865-4354-865f-0ad83e6d664e" containerName="payload-processing"
Jul 29 01:53:33.156742 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:33.156704    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fa0e78f-804d-4952-bfd7-3a7c08d5a9b1" containerName="payload-processing"
Jul 29 01:53:33.156742 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:33.156710    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fa0e78f-804d-4952-bfd7-3a7c08d5a9b1" containerName="payload-processing"
Jul 29 01:53:33.156742 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:33.156718    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee54f335-a04a-44e6-922a-ca4129f31904" containerName="payload-pre-processing"
Jul 29 01:53:33.156742 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:33.156724    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee54f335-a04a-44e6-922a-ca4129f31904" containerName="payload-pre-processing"
Jul 29 01:53:33.157003 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:33.156781    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fa0e78f-804d-4952-bfd7-3a7c08d5a9b1" containerName="payload-processing"
Jul 29 01:53:33.157003 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:33.156789    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee54f335-a04a-44e6-922a-ca4129f31904" containerName="payload-pre-processing"
Jul 29 01:53:33.157003 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:33.156796    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="69d55ecf-6865-4354-865f-0ad83e6d664e" containerName="payload-processing"
Jul 29 01:53:33.157003 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:33.156802    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d420784-22d1-41ea-96fb-96cd9a8ef9b7" containerName="payload-pre-processing"
Jul 29 01:53:33.161400 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:33.161380    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-c798cc-59df596976-gjzrh"
Jul 29 01:53:33.164631 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:33.164612    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-c798cc\""
Jul 29 01:53:33.164801 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:33.164784    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-c798cc-dockercfg-85mqk\""
Jul 29 01:53:33.172717 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:33.172697    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-c798cc-59df596976-gjzrh"]
Jul 29 01:53:33.181886 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:33.181860    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-c798cc-54654f7966-42jrq"]
Jul 29 01:53:33.185319 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:33.185303    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-c798cc-54654f7966-42jrq"
Jul 29 01:53:33.196377 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:33.196353    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-c798cc-54654f7966-42jrq"]
Jul 29 01:53:33.309464 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:33.309382    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fd226\" (UniqueName: \"kubernetes.io/projected/9ebe2f84-0839-42ff-8a8e-ca07386a0c79-kube-api-access-fd226\") pod \"payload-pre-processing-e2e-shared-a-c798cc-59df596976-gjzrh\" (UID: \"9ebe2f84-0839-42ff-8a8e-ca07386a0c79\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-c798cc-59df596976-gjzrh"
Jul 29 01:53:33.309464 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:33.309439    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7588k\" (UniqueName: \"kubernetes.io/projected/782ac4c8-ad3d-44e3-8196-71d77a705863-kube-api-access-7588k\") pod \"payload-processing-e2e-shared-a-c798cc-54654f7966-42jrq\" (UID: \"782ac4c8-ad3d-44e3-8196-71d77a705863\") " pod="openshift-ingress/payload-processing-e2e-shared-a-c798cc-54654f7966-42jrq"
Jul 29 01:53:33.309934 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:33.309651    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ebe2f84-0839-42ff-8a8e-ca07386a0c79-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-c798cc-59df596976-gjzrh\" (UID: \"9ebe2f84-0839-42ff-8a8e-ca07386a0c79\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-c798cc-59df596976-gjzrh"
Jul 29 01:53:33.309934 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:33.309696    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/782ac4c8-ad3d-44e3-8196-71d77a705863-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-c798cc-54654f7966-42jrq\" (UID: \"782ac4c8-ad3d-44e3-8196-71d77a705863\") " pod="openshift-ingress/payload-processing-e2e-shared-a-c798cc-54654f7966-42jrq"
Jul 29 01:53:33.411080 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:33.411046    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ebe2f84-0839-42ff-8a8e-ca07386a0c79-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-c798cc-59df596976-gjzrh\" (UID: \"9ebe2f84-0839-42ff-8a8e-ca07386a0c79\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-c798cc-59df596976-gjzrh"
Jul 29 01:53:33.411080 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:33.411081    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/782ac4c8-ad3d-44e3-8196-71d77a705863-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-c798cc-54654f7966-42jrq\" (UID: \"782ac4c8-ad3d-44e3-8196-71d77a705863\") " pod="openshift-ingress/payload-processing-e2e-shared-a-c798cc-54654f7966-42jrq"
Jul 29 01:53:33.411287 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:33.411106    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fd226\" (UniqueName: \"kubernetes.io/projected/9ebe2f84-0839-42ff-8a8e-ca07386a0c79-kube-api-access-fd226\") pod \"payload-pre-processing-e2e-shared-a-c798cc-59df596976-gjzrh\" (UID: \"9ebe2f84-0839-42ff-8a8e-ca07386a0c79\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-c798cc-59df596976-gjzrh"
Jul 29 01:53:33.411287 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:33.411154    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7588k\" (UniqueName: \"kubernetes.io/projected/782ac4c8-ad3d-44e3-8196-71d77a705863-kube-api-access-7588k\") pod \"payload-processing-e2e-shared-a-c798cc-54654f7966-42jrq\" (UID: \"782ac4c8-ad3d-44e3-8196-71d77a705863\") " pod="openshift-ingress/payload-processing-e2e-shared-a-c798cc-54654f7966-42jrq"
Jul 29 01:53:33.411806 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:33.411787    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/782ac4c8-ad3d-44e3-8196-71d77a705863-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-c798cc-54654f7966-42jrq\" (UID: \"782ac4c8-ad3d-44e3-8196-71d77a705863\") " pod="openshift-ingress/payload-processing-e2e-shared-a-c798cc-54654f7966-42jrq"
Jul 29 01:53:33.411848 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:33.411794    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ebe2f84-0839-42ff-8a8e-ca07386a0c79-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-c798cc-59df596976-gjzrh\" (UID: \"9ebe2f84-0839-42ff-8a8e-ca07386a0c79\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-c798cc-59df596976-gjzrh"
Jul 29 01:53:33.421540 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:33.421513    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7588k\" (UniqueName: \"kubernetes.io/projected/782ac4c8-ad3d-44e3-8196-71d77a705863-kube-api-access-7588k\") pod \"payload-processing-e2e-shared-a-c798cc-54654f7966-42jrq\" (UID: \"782ac4c8-ad3d-44e3-8196-71d77a705863\") " pod="openshift-ingress/payload-processing-e2e-shared-a-c798cc-54654f7966-42jrq"
Jul 29 01:53:33.425856 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:33.425825    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fd226\" (UniqueName: \"kubernetes.io/projected/9ebe2f84-0839-42ff-8a8e-ca07386a0c79-kube-api-access-fd226\") pod \"payload-pre-processing-e2e-shared-a-c798cc-59df596976-gjzrh\" (UID: \"9ebe2f84-0839-42ff-8a8e-ca07386a0c79\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-c798cc-59df596976-gjzrh"
Jul 29 01:53:33.471471 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:33.471439    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-c798cc-59df596976-gjzrh"
Jul 29 01:53:33.496844 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:33.496819    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-c798cc-54654f7966-42jrq"
Jul 29 01:53:33.613584 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:33.613542    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-c798cc-59df596976-gjzrh"]
Jul 29 01:53:33.616653 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:53:33.616615    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ebe2f84_0839_42ff_8a8e_ca07386a0c79.slice/crio-84c5165a559b699225d02153cb43d78dfa956c7e4457160a35ebd6ead13f4207 WatchSource:0}: Error finding container 84c5165a559b699225d02153cb43d78dfa956c7e4457160a35ebd6ead13f4207: Status 404 returned error can't find the container with id 84c5165a559b699225d02153cb43d78dfa956c7e4457160a35ebd6ead13f4207
Jul 29 01:53:33.642535 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:33.642512    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-c798cc-54654f7966-42jrq"]
Jul 29 01:53:33.649000 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:53:33.648975    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod782ac4c8_ad3d_44e3_8196_71d77a705863.slice/crio-128a58604aeefe2cf72f7f4f7f3554231ffe1f6b6297f850d0ce918bd1d43434 WatchSource:0}: Error finding container 128a58604aeefe2cf72f7f4f7f3554231ffe1f6b6297f850d0ce918bd1d43434: Status 404 returned error can't find the container with id 128a58604aeefe2cf72f7f4f7f3554231ffe1f6b6297f850d0ce918bd1d43434
Jul 29 01:53:34.509700 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:34.509663    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-c798cc-59df596976-gjzrh" event={"ID":"9ebe2f84-0839-42ff-8a8e-ca07386a0c79","Type":"ContainerStarted","Data":"7ff4fc16eeb3474b9030b608775f0a2144ea7faf236113874db21112a5a47552"}
Jul 29 01:53:34.510166 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:34.509727    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-c798cc-59df596976-gjzrh" event={"ID":"9ebe2f84-0839-42ff-8a8e-ca07386a0c79","Type":"ContainerStarted","Data":"84c5165a559b699225d02153cb43d78dfa956c7e4457160a35ebd6ead13f4207"}
Jul 29 01:53:34.510166 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:34.509777    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-c798cc-59df596976-gjzrh"
Jul 29 01:53:34.511287 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:34.511262    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-c798cc-54654f7966-42jrq" event={"ID":"782ac4c8-ad3d-44e3-8196-71d77a705863","Type":"ContainerStarted","Data":"cfd8e0c4e5558e2f66385b87388a2a593c3ef59c4596704010ec148a70825e70"}
Jul 29 01:53:34.511410 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:34.511302    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-c798cc-54654f7966-42jrq" event={"ID":"782ac4c8-ad3d-44e3-8196-71d77a705863","Type":"ContainerStarted","Data":"128a58604aeefe2cf72f7f4f7f3554231ffe1f6b6297f850d0ce918bd1d43434"}
Jul 29 01:53:34.511410 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:34.511339    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-c798cc-54654f7966-42jrq"
Jul 29 01:53:34.529750 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:34.529707    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-c798cc-59df596976-gjzrh" podStartSLOduration=1.5296953800000002 podStartE2EDuration="1.52969538s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:53:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:53:34.528628962 +0000 UTC m=+2464.841021671" watchObservedRunningTime="2026-07-29 01:53:34.52969538 +0000 UTC m=+2464.842088087"
Jul 29 01:53:34.548737 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:34.548685    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-c798cc-54654f7966-42jrq" podStartSLOduration=1.5486718339999999 podStartE2EDuration="1.548671834s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:53:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:53:34.546562492 +0000 UTC m=+2464.858955200" watchObservedRunningTime="2026-07-29 01:53:34.548671834 +0000 UTC m=+2464.861064541"
Jul 29 01:53:45.517013 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:45.516981    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-c798cc-54654f7966-42jrq"
Jul 29 01:53:45.517508 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:45.517069    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-c798cc-59df596976-gjzrh"
Jul 29 01:53:57.245266 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:57.245224    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:53:57.568775 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:57.568673    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:53:57.872793 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:57.872749    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:53:58.137263 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:53:58.137163    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:00.444051 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:00.444016    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:00.530934 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:00.530900    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:00.607305 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:00.607272    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:00.841707 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:00.841618    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:01.215932 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:01.215896    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:01.313521 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:01.313489    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:01.318080 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:01.318057    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-0d32f5-85657f46fb-r5lvh"]
Jul 29 01:54:01.321841 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:01.321825    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0d32f5-85657f46fb-r5lvh"
Jul 29 01:54:01.331306 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:01.331285    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-0d32f5\""
Jul 29 01:54:01.331409 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:01.331393    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-0d32f5-dockercfg-qjmqm\""
Jul 29 01:54:01.344906 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:01.344873    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-0d32f5-85657f46fb-r5lvh"]
Jul 29 01:54:01.361506 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:01.361472    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs5mm\" (UniqueName: \"kubernetes.io/projected/af5b6bd6-d863-480c-93b7-e18ed0bfcbf1-kube-api-access-cs5mm\") pod \"payload-pre-processing-e2e-shared-b-0d32f5-85657f46fb-r5lvh\" (UID: \"af5b6bd6-d863-480c-93b7-e18ed0bfcbf1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0d32f5-85657f46fb-r5lvh"
Jul 29 01:54:01.361627 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:01.361579    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af5b6bd6-d863-480c-93b7-e18ed0bfcbf1-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-0d32f5-85657f46fb-r5lvh\" (UID: \"af5b6bd6-d863-480c-93b7-e18ed0bfcbf1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0d32f5-85657f46fb-r5lvh"
Jul 29 01:54:01.369244 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:01.369218    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-0d32f5-65c56bbfc4-8zw2x"]
Jul 29 01:54:01.373398 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:01.373380    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-0d32f5-65c56bbfc4-8zw2x"
Jul 29 01:54:01.390818 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:01.390795    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-0d32f5-65c56bbfc4-8zw2x"]
Jul 29 01:54:01.462460 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:01.462425    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc2ffbcb-98fe-474d-895f-a6fee4c48001-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-0d32f5-65c56bbfc4-8zw2x\" (UID: \"bc2ffbcb-98fe-474d-895f-a6fee4c48001\") " pod="openshift-ingress/payload-processing-e2e-shared-b-0d32f5-65c56bbfc4-8zw2x"
Jul 29 01:54:01.462460 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:01.462463    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqbc7\" (UniqueName: \"kubernetes.io/projected/bc2ffbcb-98fe-474d-895f-a6fee4c48001-kube-api-access-sqbc7\") pod \"payload-processing-e2e-shared-b-0d32f5-65c56bbfc4-8zw2x\" (UID: \"bc2ffbcb-98fe-474d-895f-a6fee4c48001\") " pod="openshift-ingress/payload-processing-e2e-shared-b-0d32f5-65c56bbfc4-8zw2x"
Jul 29 01:54:01.462858 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:01.462520    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs5mm\" (UniqueName: \"kubernetes.io/projected/af5b6bd6-d863-480c-93b7-e18ed0bfcbf1-kube-api-access-cs5mm\") pod \"payload-pre-processing-e2e-shared-b-0d32f5-85657f46fb-r5lvh\" (UID: \"af5b6bd6-d863-480c-93b7-e18ed0bfcbf1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0d32f5-85657f46fb-r5lvh"
Jul 29 01:54:01.462858 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:01.462586    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af5b6bd6-d863-480c-93b7-e18ed0bfcbf1-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-0d32f5-85657f46fb-r5lvh\" (UID: \"af5b6bd6-d863-480c-93b7-e18ed0bfcbf1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0d32f5-85657f46fb-r5lvh"
Jul 29 01:54:01.463280 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:01.463261    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af5b6bd6-d863-480c-93b7-e18ed0bfcbf1-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-0d32f5-85657f46fb-r5lvh\" (UID: \"af5b6bd6-d863-480c-93b7-e18ed0bfcbf1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0d32f5-85657f46fb-r5lvh"
Jul 29 01:54:01.477900 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:01.477830    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs5mm\" (UniqueName: \"kubernetes.io/projected/af5b6bd6-d863-480c-93b7-e18ed0bfcbf1-kube-api-access-cs5mm\") pod \"payload-pre-processing-e2e-shared-b-0d32f5-85657f46fb-r5lvh\" (UID: \"af5b6bd6-d863-480c-93b7-e18ed0bfcbf1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0d32f5-85657f46fb-r5lvh"
Jul 29 01:54:01.563658 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:01.563629    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc2ffbcb-98fe-474d-895f-a6fee4c48001-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-0d32f5-65c56bbfc4-8zw2x\" (UID: \"bc2ffbcb-98fe-474d-895f-a6fee4c48001\") " pod="openshift-ingress/payload-processing-e2e-shared-b-0d32f5-65c56bbfc4-8zw2x"
Jul 29 01:54:01.563825 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:01.563665    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqbc7\" (UniqueName: \"kubernetes.io/projected/bc2ffbcb-98fe-474d-895f-a6fee4c48001-kube-api-access-sqbc7\") pod \"payload-processing-e2e-shared-b-0d32f5-65c56bbfc4-8zw2x\" (UID: \"bc2ffbcb-98fe-474d-895f-a6fee4c48001\") " pod="openshift-ingress/payload-processing-e2e-shared-b-0d32f5-65c56bbfc4-8zw2x"
Jul 29 01:54:01.564369 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:01.564348    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc2ffbcb-98fe-474d-895f-a6fee4c48001-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-0d32f5-65c56bbfc4-8zw2x\" (UID: \"bc2ffbcb-98fe-474d-895f-a6fee4c48001\") " pod="openshift-ingress/payload-processing-e2e-shared-b-0d32f5-65c56bbfc4-8zw2x"
Jul 29 01:54:01.571847 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:01.571818    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqbc7\" (UniqueName: \"kubernetes.io/projected/bc2ffbcb-98fe-474d-895f-a6fee4c48001-kube-api-access-sqbc7\") pod \"payload-processing-e2e-shared-b-0d32f5-65c56bbfc4-8zw2x\" (UID: \"bc2ffbcb-98fe-474d-895f-a6fee4c48001\") " pod="openshift-ingress/payload-processing-e2e-shared-b-0d32f5-65c56bbfc4-8zw2x"
Jul 29 01:54:01.632295 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:01.632269    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0d32f5-85657f46fb-r5lvh"
Jul 29 01:54:01.683152 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:01.683106    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-0d32f5-65c56bbfc4-8zw2x"
Jul 29 01:54:01.779204 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:01.779131    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-0d32f5-85657f46fb-r5lvh"]
Jul 29 01:54:01.782236 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:54:01.782149    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf5b6bd6_d863_480c_93b7_e18ed0bfcbf1.slice/crio-9dccef1ce6dbdf3a399224e51254a17dc7cc12cb6081cb3393f51b621806cb9c WatchSource:0}: Error finding container 9dccef1ce6dbdf3a399224e51254a17dc7cc12cb6081cb3393f51b621806cb9c: Status 404 returned error can't find the container with id 9dccef1ce6dbdf3a399224e51254a17dc7cc12cb6081cb3393f51b621806cb9c
Jul 29 01:54:01.830164 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:01.830138    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-0d32f5-65c56bbfc4-8zw2x"]
Jul 29 01:54:01.832741 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:54:01.832717    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc2ffbcb_98fe_474d_895f_a6fee4c48001.slice/crio-f0c7c1e43ca9b407e0a3b92949e41a3d7de3af1fde3f6e7952f657fc095c267f WatchSource:0}: Error finding container f0c7c1e43ca9b407e0a3b92949e41a3d7de3af1fde3f6e7952f657fc095c267f: Status 404 returned error can't find the container with id f0c7c1e43ca9b407e0a3b92949e41a3d7de3af1fde3f6e7952f657fc095c267f
Jul 29 01:54:02.648840 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:02.648804    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-0d32f5-65c56bbfc4-8zw2x" event={"ID":"bc2ffbcb-98fe-474d-895f-a6fee4c48001","Type":"ContainerStarted","Data":"f336a51f5fdbde55a4c957645bc950f6e2115bf312fc5a0cc4545c0bad3284a3"}
Jul 29 01:54:02.649359 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:02.648872    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-0d32f5-65c56bbfc4-8zw2x"
Jul 29 01:54:02.649359 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:02.648898    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-0d32f5-65c56bbfc4-8zw2x" event={"ID":"bc2ffbcb-98fe-474d-895f-a6fee4c48001","Type":"ContainerStarted","Data":"f0c7c1e43ca9b407e0a3b92949e41a3d7de3af1fde3f6e7952f657fc095c267f"}
Jul 29 01:54:02.650582 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:02.650550    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0d32f5-85657f46fb-r5lvh" event={"ID":"af5b6bd6-d863-480c-93b7-e18ed0bfcbf1","Type":"ContainerStarted","Data":"325881d02efdf5019fe170bc9f2a59cc7c8362677d700e30f41b20bc7fa46b7e"}
Jul 29 01:54:02.650710 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:02.650612    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0d32f5-85657f46fb-r5lvh" event={"ID":"af5b6bd6-d863-480c-93b7-e18ed0bfcbf1","Type":"ContainerStarted","Data":"9dccef1ce6dbdf3a399224e51254a17dc7cc12cb6081cb3393f51b621806cb9c"}
Jul 29 01:54:02.650710 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:02.650640    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0d32f5-85657f46fb-r5lvh"
Jul 29 01:54:02.666356 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:02.666307    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-0d32f5-65c56bbfc4-8zw2x" podStartSLOduration=1.666290182 podStartE2EDuration="1.666290182s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:54:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:54:02.666245196 +0000 UTC m=+2492.978637905" watchObservedRunningTime="2026-07-29 01:54:02.666290182 +0000 UTC m=+2492.978682888"
Jul 29 01:54:02.685100 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:02.685058    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0d32f5-85657f46fb-r5lvh" podStartSLOduration=1.6850436850000001 podStartE2EDuration="1.685043685s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:54:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:54:02.684003919 +0000 UTC m=+2492.996396627" watchObservedRunningTime="2026-07-29 01:54:02.685043685 +0000 UTC m=+2492.997436392"
Jul 29 01:54:13.658378 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:13.658346    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-0d32f5-65c56bbfc4-8zw2x"
Jul 29 01:54:13.658897 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:13.658417    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0d32f5-85657f46fb-r5lvh"
Jul 29 01:54:25.402232 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:25.402186    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:39.133274 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:39.133232    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-c798cc/auth-test-model-c798cc-kserve-599bc59567-mgm22"]
Jul 29 01:54:39.136796 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:39.136774    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c798cc/auth-test-model-c798cc-kserve-599bc59567-mgm22"
Jul 29 01:54:39.140679 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:39.140644    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-c798cc\"/\"auth-test-model-c798cc-kserve-self-signed-certs\""
Jul 29 01:54:39.140679 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:39.140676    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-c798cc\"/\"default-dockercfg-9rf4t\""
Jul 29 01:54:39.140850 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:39.140775    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-c798cc\"/\"kube-root-ca.crt\""
Jul 29 01:54:39.140850 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:39.140781    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-c798cc\"/\"openshift-service-ca.crt\""
Jul 29 01:54:39.151211 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:39.151187    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-c798cc/auth-test-model-c798cc-kserve-599bc59567-mgm22"]
Jul 29 01:54:39.174246 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:39.174219    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:39.213448 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:39.213416    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a2e7f30-33d9-47a9-81de-cdc7cff1a88c-home\") pod \"auth-test-model-c798cc-kserve-599bc59567-mgm22\" (UID: \"0a2e7f30-33d9-47a9-81de-cdc7cff1a88c\") " pod="ai-tenant-e2e-shared-a-c798cc/auth-test-model-c798cc-kserve-599bc59567-mgm22"
Jul 29 01:54:39.213583 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:39.213450    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a2e7f30-33d9-47a9-81de-cdc7cff1a88c-tmp-dir\") pod \"auth-test-model-c798cc-kserve-599bc59567-mgm22\" (UID: \"0a2e7f30-33d9-47a9-81de-cdc7cff1a88c\") " pod="ai-tenant-e2e-shared-a-c798cc/auth-test-model-c798cc-kserve-599bc59567-mgm22"
Jul 29 01:54:39.213583 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:39.213507    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a2e7f30-33d9-47a9-81de-cdc7cff1a88c-tls-certs\") pod \"auth-test-model-c798cc-kserve-599bc59567-mgm22\" (UID: \"0a2e7f30-33d9-47a9-81de-cdc7cff1a88c\") " pod="ai-tenant-e2e-shared-a-c798cc/auth-test-model-c798cc-kserve-599bc59567-mgm22"
Jul 29 01:54:39.213583 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:39.213534    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a2e7f30-33d9-47a9-81de-cdc7cff1a88c-dshm\") pod \"auth-test-model-c798cc-kserve-599bc59567-mgm22\" (UID: \"0a2e7f30-33d9-47a9-81de-cdc7cff1a88c\") " pod="ai-tenant-e2e-shared-a-c798cc/auth-test-model-c798cc-kserve-599bc59567-mgm22"
Jul 29 01:54:39.213698 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:39.213638    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9npg\" (UniqueName: \"kubernetes.io/projected/0a2e7f30-33d9-47a9-81de-cdc7cff1a88c-kube-api-access-m9npg\") pod \"auth-test-model-c798cc-kserve-599bc59567-mgm22\" (UID: \"0a2e7f30-33d9-47a9-81de-cdc7cff1a88c\") " pod="ai-tenant-e2e-shared-a-c798cc/auth-test-model-c798cc-kserve-599bc59567-mgm22"
Jul 29 01:54:39.213698 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:39.213663    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a2e7f30-33d9-47a9-81de-cdc7cff1a88c-model-cache\") pod \"auth-test-model-c798cc-kserve-599bc59567-mgm22\" (UID: \"0a2e7f30-33d9-47a9-81de-cdc7cff1a88c\") " pod="ai-tenant-e2e-shared-a-c798cc/auth-test-model-c798cc-kserve-599bc59567-mgm22"
Jul 29 01:54:39.314940 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:39.314902    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a2e7f30-33d9-47a9-81de-cdc7cff1a88c-tls-certs\") pod \"auth-test-model-c798cc-kserve-599bc59567-mgm22\" (UID: \"0a2e7f30-33d9-47a9-81de-cdc7cff1a88c\") " pod="ai-tenant-e2e-shared-a-c798cc/auth-test-model-c798cc-kserve-599bc59567-mgm22"
Jul 29 01:54:39.314940 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:39.314944    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a2e7f30-33d9-47a9-81de-cdc7cff1a88c-dshm\") pod \"auth-test-model-c798cc-kserve-599bc59567-mgm22\" (UID: \"0a2e7f30-33d9-47a9-81de-cdc7cff1a88c\") " pod="ai-tenant-e2e-shared-a-c798cc/auth-test-model-c798cc-kserve-599bc59567-mgm22"
Jul 29 01:54:39.315230 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:39.315069    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9npg\" (UniqueName: \"kubernetes.io/projected/0a2e7f30-33d9-47a9-81de-cdc7cff1a88c-kube-api-access-m9npg\") pod \"auth-test-model-c798cc-kserve-599bc59567-mgm22\" (UID: \"0a2e7f30-33d9-47a9-81de-cdc7cff1a88c\") " pod="ai-tenant-e2e-shared-a-c798cc/auth-test-model-c798cc-kserve-599bc59567-mgm22"
Jul 29 01:54:39.315230 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:39.315096    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a2e7f30-33d9-47a9-81de-cdc7cff1a88c-model-cache\") pod \"auth-test-model-c798cc-kserve-599bc59567-mgm22\" (UID: \"0a2e7f30-33d9-47a9-81de-cdc7cff1a88c\") " pod="ai-tenant-e2e-shared-a-c798cc/auth-test-model-c798cc-kserve-599bc59567-mgm22"
Jul 29 01:54:39.315230 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:39.315142    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a2e7f30-33d9-47a9-81de-cdc7cff1a88c-home\") pod \"auth-test-model-c798cc-kserve-599bc59567-mgm22\" (UID: \"0a2e7f30-33d9-47a9-81de-cdc7cff1a88c\") " pod="ai-tenant-e2e-shared-a-c798cc/auth-test-model-c798cc-kserve-599bc59567-mgm22"
Jul 29 01:54:39.315230 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:39.315165    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a2e7f30-33d9-47a9-81de-cdc7cff1a88c-tmp-dir\") pod \"auth-test-model-c798cc-kserve-599bc59567-mgm22\" (UID: \"0a2e7f30-33d9-47a9-81de-cdc7cff1a88c\") " pod="ai-tenant-e2e-shared-a-c798cc/auth-test-model-c798cc-kserve-599bc59567-mgm22"
Jul 29 01:54:39.315569 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:39.315548    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a2e7f30-33d9-47a9-81de-cdc7cff1a88c-model-cache\") pod \"auth-test-model-c798cc-kserve-599bc59567-mgm22\" (UID: \"0a2e7f30-33d9-47a9-81de-cdc7cff1a88c\") " pod="ai-tenant-e2e-shared-a-c798cc/auth-test-model-c798cc-kserve-599bc59567-mgm22"
Jul 29 01:54:39.315644 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:39.315591    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a2e7f30-33d9-47a9-81de-cdc7cff1a88c-home\") pod \"auth-test-model-c798cc-kserve-599bc59567-mgm22\" (UID: \"0a2e7f30-33d9-47a9-81de-cdc7cff1a88c\") " pod="ai-tenant-e2e-shared-a-c798cc/auth-test-model-c798cc-kserve-599bc59567-mgm22"
Jul 29 01:54:39.315644 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:39.315611    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a2e7f30-33d9-47a9-81de-cdc7cff1a88c-tmp-dir\") pod \"auth-test-model-c798cc-kserve-599bc59567-mgm22\" (UID: \"0a2e7f30-33d9-47a9-81de-cdc7cff1a88c\") " pod="ai-tenant-e2e-shared-a-c798cc/auth-test-model-c798cc-kserve-599bc59567-mgm22"
Jul 29 01:54:39.317278 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:39.317258    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a2e7f30-33d9-47a9-81de-cdc7cff1a88c-dshm\") pod \"auth-test-model-c798cc-kserve-599bc59567-mgm22\" (UID: \"0a2e7f30-33d9-47a9-81de-cdc7cff1a88c\") " pod="ai-tenant-e2e-shared-a-c798cc/auth-test-model-c798cc-kserve-599bc59567-mgm22"
Jul 29 01:54:39.317563 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:39.317544    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a2e7f30-33d9-47a9-81de-cdc7cff1a88c-tls-certs\") pod \"auth-test-model-c798cc-kserve-599bc59567-mgm22\" (UID: \"0a2e7f30-33d9-47a9-81de-cdc7cff1a88c\") " pod="ai-tenant-e2e-shared-a-c798cc/auth-test-model-c798cc-kserve-599bc59567-mgm22"
Jul 29 01:54:39.323267 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:39.323244    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9npg\" (UniqueName: \"kubernetes.io/projected/0a2e7f30-33d9-47a9-81de-cdc7cff1a88c-kube-api-access-m9npg\") pod \"auth-test-model-c798cc-kserve-599bc59567-mgm22\" (UID: \"0a2e7f30-33d9-47a9-81de-cdc7cff1a88c\") " pod="ai-tenant-e2e-shared-a-c798cc/auth-test-model-c798cc-kserve-599bc59567-mgm22"
Jul 29 01:54:39.446857 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:39.446772    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c798cc/auth-test-model-c798cc-kserve-599bc59567-mgm22"
Jul 29 01:54:39.580399 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:39.580374    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-c798cc/auth-test-model-c798cc-kserve-599bc59567-mgm22"]
Jul 29 01:54:39.582294 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:54:39.582265    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0a2e7f30_33d9_47a9_81de_cdc7cff1a88c.slice/crio-a162f8cbe673ae260485c164abcb790fbfdcffcfe73acab72cef979d15952fde WatchSource:0}: Error finding container a162f8cbe673ae260485c164abcb790fbfdcffcfe73acab72cef979d15952fde: Status 404 returned error can't find the container with id a162f8cbe673ae260485c164abcb790fbfdcffcfe73acab72cef979d15952fde
Jul 29 01:54:39.836331 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:39.836237    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c798cc/auth-test-model-c798cc-kserve-599bc59567-mgm22" event={"ID":"0a2e7f30-33d9-47a9-81de-cdc7cff1a88c","Type":"ContainerStarted","Data":"fd201b722d197679c7470494d0b18e941cbb2e8777539a3650f8b598738ec155"}
Jul 29 01:54:39.836331 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:39.836281    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c798cc/auth-test-model-c798cc-kserve-599bc59567-mgm22" event={"ID":"0a2e7f30-33d9-47a9-81de-cdc7cff1a88c","Type":"ContainerStarted","Data":"a162f8cbe673ae260485c164abcb790fbfdcffcfe73acab72cef979d15952fde"}
Jul 29 01:54:39.855119 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:39.855075    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-c798cc/auth-test-model-c798cc-kserve-599bc59567-mgm22" podStartSLOduration=0.855061077 podStartE2EDuration="855.061077ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:54:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:54:39.853069695 +0000 UTC m=+2530.165462414" watchObservedRunningTime="2026-07-29 01:54:39.855061077 +0000 UTC m=+2530.167453785"
Jul 29 01:54:49.447122 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:49.447080    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-c798cc/auth-test-model-c798cc-kserve-599bc59567-mgm22"
Jul 29 01:54:49.447599 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:49.447140    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-c798cc/auth-test-model-c798cc-kserve-599bc59567-mgm22"
Jul 29 01:54:49.459727 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:49.459697    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-c798cc/auth-test-model-c798cc-kserve-599bc59567-mgm22"
Jul 29 01:54:49.896689 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:54:49.896661    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-c798cc/auth-test-model-c798cc-kserve-599bc59567-mgm22"
Jul 29 01:55:14.504532 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:55:14.504496    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:55:17.579653 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:55:17.579616    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:56:40.213028 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:56:40.212993    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:57:31.756783 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:57:31.756679    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8g9fl_e044d9fa-39c8-49b8-94e1-550f3dbe7b26/ovn-acl-logging/0.log"
Jul 29 01:57:31.764587 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:57:31.764566    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8g9fl_e044d9fa-39c8-49b8-94e1-550f3dbe7b26/ovn-acl-logging/0.log"
Jul 29 01:59:26.800800 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:26.800723    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-c798cc/auth-test-model-c798cc-kserve-599bc59567-mgm22"]
Jul 29 01:59:26.838251 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:26.838220    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:59:27.718987 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:27.718940    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:59:39.124845 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:39.124802    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-c798cc/sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb"]
Jul 29 01:59:39.128536 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:39.128513    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c798cc/sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb"
Jul 29 01:59:39.131035 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:39.131011    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-c798cc\"/\"sub-test-model-c798cc-kserve-self-signed-certs\""
Jul 29 01:59:39.137434 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:39.137413    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-c798cc/sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb"]
Jul 29 01:59:39.212411 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:39.212382    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 01:59:39.244935 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:39.244912    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33739496-52f9-43e4-b311-4925307d43e9-dshm\") pod \"sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb\" (UID: \"33739496-52f9-43e4-b311-4925307d43e9\") " pod="ai-tenant-e2e-shared-a-c798cc/sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb"
Jul 29 01:59:39.245100 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:39.244945    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33739496-52f9-43e4-b311-4925307d43e9-tls-certs\") pod \"sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb\" (UID: \"33739496-52f9-43e4-b311-4925307d43e9\") " pod="ai-tenant-e2e-shared-a-c798cc/sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb"
Jul 29 01:59:39.245100 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:39.244985    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33739496-52f9-43e4-b311-4925307d43e9-model-cache\") pod \"sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb\" (UID: \"33739496-52f9-43e4-b311-4925307d43e9\") " pod="ai-tenant-e2e-shared-a-c798cc/sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb"
Jul 29 01:59:39.245212 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:39.245095    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5k9s\" (UniqueName: \"kubernetes.io/projected/33739496-52f9-43e4-b311-4925307d43e9-kube-api-access-n5k9s\") pod \"sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb\" (UID: \"33739496-52f9-43e4-b311-4925307d43e9\") " pod="ai-tenant-e2e-shared-a-c798cc/sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb"
Jul 29 01:59:39.245212 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:39.245171    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33739496-52f9-43e4-b311-4925307d43e9-tmp-dir\") pod \"sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb\" (UID: \"33739496-52f9-43e4-b311-4925307d43e9\") " pod="ai-tenant-e2e-shared-a-c798cc/sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb"
Jul 29 01:59:39.245286 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:39.245216    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33739496-52f9-43e4-b311-4925307d43e9-home\") pod \"sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb\" (UID: \"33739496-52f9-43e4-b311-4925307d43e9\") " pod="ai-tenant-e2e-shared-a-c798cc/sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb"
Jul 29 01:59:39.346178 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:39.346149    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33739496-52f9-43e4-b311-4925307d43e9-dshm\") pod \"sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb\" (UID: \"33739496-52f9-43e4-b311-4925307d43e9\") " pod="ai-tenant-e2e-shared-a-c798cc/sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb"
Jul 29 01:59:39.346317 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:39.346186    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33739496-52f9-43e4-b311-4925307d43e9-tls-certs\") pod \"sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb\" (UID: \"33739496-52f9-43e4-b311-4925307d43e9\") " pod="ai-tenant-e2e-shared-a-c798cc/sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb"
Jul 29 01:59:39.346317 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:39.346210    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33739496-52f9-43e4-b311-4925307d43e9-model-cache\") pod \"sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb\" (UID: \"33739496-52f9-43e4-b311-4925307d43e9\") " pod="ai-tenant-e2e-shared-a-c798cc/sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb"
Jul 29 01:59:39.346317 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:39.346274    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5k9s\" (UniqueName: \"kubernetes.io/projected/33739496-52f9-43e4-b311-4925307d43e9-kube-api-access-n5k9s\") pod \"sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb\" (UID: \"33739496-52f9-43e4-b311-4925307d43e9\") " pod="ai-tenant-e2e-shared-a-c798cc/sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb"
Jul 29 01:59:39.346441 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:39.346332    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33739496-52f9-43e4-b311-4925307d43e9-tmp-dir\") pod \"sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb\" (UID: \"33739496-52f9-43e4-b311-4925307d43e9\") " pod="ai-tenant-e2e-shared-a-c798cc/sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb"
Jul 29 01:59:39.346441 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:39.346359    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33739496-52f9-43e4-b311-4925307d43e9-home\") pod \"sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb\" (UID: \"33739496-52f9-43e4-b311-4925307d43e9\") " pod="ai-tenant-e2e-shared-a-c798cc/sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb"
Jul 29 01:59:39.346692 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:39.346666    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33739496-52f9-43e4-b311-4925307d43e9-model-cache\") pod \"sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb\" (UID: \"33739496-52f9-43e4-b311-4925307d43e9\") " pod="ai-tenant-e2e-shared-a-c798cc/sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb"
Jul 29 01:59:39.346799 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:39.346704    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33739496-52f9-43e4-b311-4925307d43e9-tmp-dir\") pod \"sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb\" (UID: \"33739496-52f9-43e4-b311-4925307d43e9\") " pod="ai-tenant-e2e-shared-a-c798cc/sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb"
Jul 29 01:59:39.346865 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:39.346800    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33739496-52f9-43e4-b311-4925307d43e9-home\") pod \"sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb\" (UID: \"33739496-52f9-43e4-b311-4925307d43e9\") " pod="ai-tenant-e2e-shared-a-c798cc/sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb"
Jul 29 01:59:39.348467 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:39.348444    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33739496-52f9-43e4-b311-4925307d43e9-dshm\") pod \"sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb\" (UID: \"33739496-52f9-43e4-b311-4925307d43e9\") " pod="ai-tenant-e2e-shared-a-c798cc/sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb"
Jul 29 01:59:39.348796 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:39.348775    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33739496-52f9-43e4-b311-4925307d43e9-tls-certs\") pod \"sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb\" (UID: \"33739496-52f9-43e4-b311-4925307d43e9\") " pod="ai-tenant-e2e-shared-a-c798cc/sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb"
Jul 29 01:59:39.354698 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:39.354677    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5k9s\" (UniqueName: \"kubernetes.io/projected/33739496-52f9-43e4-b311-4925307d43e9-kube-api-access-n5k9s\") pod \"sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb\" (UID: \"33739496-52f9-43e4-b311-4925307d43e9\") " pod="ai-tenant-e2e-shared-a-c798cc/sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb"
Jul 29 01:59:39.438547 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:39.438454    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c798cc/sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb"
Jul 29 01:59:39.572918 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:39.572892    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-c798cc/sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb"]
Jul 29 01:59:39.574876 ip-10-0-142-238 kubenswrapper[2580]: W0729 01:59:39.574852    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod33739496_52f9_43e4_b311_4925307d43e9.slice/crio-d3214ecc5fe5c5204443a69b0da4f24b7a978acc858ec14a9e31d5a930f92f6b WatchSource:0}: Error finding container d3214ecc5fe5c5204443a69b0da4f24b7a978acc858ec14a9e31d5a930f92f6b: Status 404 returned error can't find the container with id d3214ecc5fe5c5204443a69b0da4f24b7a978acc858ec14a9e31d5a930f92f6b
Jul 29 01:59:40.261435 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:40.261396    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c798cc/sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb" event={"ID":"33739496-52f9-43e4-b311-4925307d43e9","Type":"ContainerStarted","Data":"a75a61a83c664704e558a06c6906540c563679ef6ab2ba4bc3422ba44b5e8acb"}
Jul 29 01:59:40.261795 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:40.261443    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c798cc/sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb" event={"ID":"33739496-52f9-43e4-b311-4925307d43e9","Type":"ContainerStarted","Data":"d3214ecc5fe5c5204443a69b0da4f24b7a978acc858ec14a9e31d5a930f92f6b"}
Jul 29 01:59:40.281880 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:40.281831    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-c798cc/sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb" podStartSLOduration=1.28181592 podStartE2EDuration="1.28181592s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:59:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:59:40.280178239 +0000 UTC m=+2830.592570949" watchObservedRunningTime="2026-07-29 01:59:40.28181592 +0000 UTC m=+2830.594208627"
Jul 29 01:59:41.819548 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:41.819507    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-c798cc/auth-test-model-c798cc-kserve-599bc59567-mgm22" podUID="0a2e7f30-33d9-47a9-81de-cdc7cff1a88c" containerName="main" containerID="cri-o://fd201b722d197679c7470494d0b18e941cbb2e8777539a3650f8b598738ec155" gracePeriod=45
Jul 29 01:59:42.085822 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:42.085760    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c798cc/auth-test-model-c798cc-kserve-599bc59567-mgm22"
Jul 29 01:59:42.171454 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:42.171431    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a2e7f30-33d9-47a9-81de-cdc7cff1a88c-dshm\") pod \"0a2e7f30-33d9-47a9-81de-cdc7cff1a88c\" (UID: \"0a2e7f30-33d9-47a9-81de-cdc7cff1a88c\") "
Jul 29 01:59:42.171622 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:42.171464    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a2e7f30-33d9-47a9-81de-cdc7cff1a88c-tmp-dir\") pod \"0a2e7f30-33d9-47a9-81de-cdc7cff1a88c\" (UID: \"0a2e7f30-33d9-47a9-81de-cdc7cff1a88c\") "
Jul 29 01:59:42.171622 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:42.171510    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a2e7f30-33d9-47a9-81de-cdc7cff1a88c-model-cache\") pod \"0a2e7f30-33d9-47a9-81de-cdc7cff1a88c\" (UID: \"0a2e7f30-33d9-47a9-81de-cdc7cff1a88c\") "
Jul 29 01:59:42.171622 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:42.171532    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9npg\" (UniqueName: \"kubernetes.io/projected/0a2e7f30-33d9-47a9-81de-cdc7cff1a88c-kube-api-access-m9npg\") pod \"0a2e7f30-33d9-47a9-81de-cdc7cff1a88c\" (UID: \"0a2e7f30-33d9-47a9-81de-cdc7cff1a88c\") "
Jul 29 01:59:42.171622 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:42.171575    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a2e7f30-33d9-47a9-81de-cdc7cff1a88c-tls-certs\") pod \"0a2e7f30-33d9-47a9-81de-cdc7cff1a88c\" (UID: \"0a2e7f30-33d9-47a9-81de-cdc7cff1a88c\") "
Jul 29 01:59:42.171843 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:42.171700    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a2e7f30-33d9-47a9-81de-cdc7cff1a88c-home\") pod \"0a2e7f30-33d9-47a9-81de-cdc7cff1a88c\" (UID: \"0a2e7f30-33d9-47a9-81de-cdc7cff1a88c\") "
Jul 29 01:59:42.171843 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:42.171784    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a2e7f30-33d9-47a9-81de-cdc7cff1a88c-model-cache" (OuterVolumeSpecName: "model-cache") pod "0a2e7f30-33d9-47a9-81de-cdc7cff1a88c" (UID: "0a2e7f30-33d9-47a9-81de-cdc7cff1a88c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:59:42.171843 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:42.171797    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a2e7f30-33d9-47a9-81de-cdc7cff1a88c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0a2e7f30-33d9-47a9-81de-cdc7cff1a88c" (UID: "0a2e7f30-33d9-47a9-81de-cdc7cff1a88c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:59:42.172065 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:42.172002    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a2e7f30-33d9-47a9-81de-cdc7cff1a88c-home" (OuterVolumeSpecName: "home") pod "0a2e7f30-33d9-47a9-81de-cdc7cff1a88c" (UID: "0a2e7f30-33d9-47a9-81de-cdc7cff1a88c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:59:42.172108 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:42.172090    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a2e7f30-33d9-47a9-81de-cdc7cff1a88c-home\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:59:42.172108 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:42.172105    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a2e7f30-33d9-47a9-81de-cdc7cff1a88c-tmp-dir\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:59:42.172188 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:42.172115    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a2e7f30-33d9-47a9-81de-cdc7cff1a88c-model-cache\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:59:42.173724 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:42.173702    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a2e7f30-33d9-47a9-81de-cdc7cff1a88c-kube-api-access-m9npg" (OuterVolumeSpecName: "kube-api-access-m9npg") pod "0a2e7f30-33d9-47a9-81de-cdc7cff1a88c" (UID: "0a2e7f30-33d9-47a9-81de-cdc7cff1a88c"). InnerVolumeSpecName "kube-api-access-m9npg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:59:42.173990 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:42.173971    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a2e7f30-33d9-47a9-81de-cdc7cff1a88c-dshm" (OuterVolumeSpecName: "dshm") pod "0a2e7f30-33d9-47a9-81de-cdc7cff1a88c" (UID: "0a2e7f30-33d9-47a9-81de-cdc7cff1a88c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:59:42.174050 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:42.173971    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a2e7f30-33d9-47a9-81de-cdc7cff1a88c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0a2e7f30-33d9-47a9-81de-cdc7cff1a88c" (UID: "0a2e7f30-33d9-47a9-81de-cdc7cff1a88c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:59:42.271630 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:42.271602    2580 generic.go:356] "Generic (PLEG): container finished" podID="0a2e7f30-33d9-47a9-81de-cdc7cff1a88c" containerID="fd201b722d197679c7470494d0b18e941cbb2e8777539a3650f8b598738ec155" exitCode=0
Jul 29 01:59:42.271748 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:42.271639    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c798cc/auth-test-model-c798cc-kserve-599bc59567-mgm22"
Jul 29 01:59:42.271748 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:42.271661    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c798cc/auth-test-model-c798cc-kserve-599bc59567-mgm22" event={"ID":"0a2e7f30-33d9-47a9-81de-cdc7cff1a88c","Type":"ContainerDied","Data":"fd201b722d197679c7470494d0b18e941cbb2e8777539a3650f8b598738ec155"}
Jul 29 01:59:42.271748 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:42.271702    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c798cc/auth-test-model-c798cc-kserve-599bc59567-mgm22" event={"ID":"0a2e7f30-33d9-47a9-81de-cdc7cff1a88c","Type":"ContainerDied","Data":"a162f8cbe673ae260485c164abcb790fbfdcffcfe73acab72cef979d15952fde"}
Jul 29 01:59:42.271748 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:42.271725    2580 scope.go:117] "RemoveContainer" containerID="fd201b722d197679c7470494d0b18e941cbb2e8777539a3650f8b598738ec155"
Jul 29 01:59:42.272527 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:42.272502    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a2e7f30-33d9-47a9-81de-cdc7cff1a88c-dshm\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:59:42.272646 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:42.272530    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9npg\" (UniqueName: \"kubernetes.io/projected/0a2e7f30-33d9-47a9-81de-cdc7cff1a88c-kube-api-access-m9npg\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:59:42.272646 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:42.272545    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a2e7f30-33d9-47a9-81de-cdc7cff1a88c-tls-certs\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 01:59:42.281095 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:42.281077    2580 scope.go:117] "RemoveContainer" containerID="fd201b722d197679c7470494d0b18e941cbb2e8777539a3650f8b598738ec155"
Jul 29 01:59:42.281341 ip-10-0-142-238 kubenswrapper[2580]: E0729 01:59:42.281325    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd201b722d197679c7470494d0b18e941cbb2e8777539a3650f8b598738ec155\": container with ID starting with fd201b722d197679c7470494d0b18e941cbb2e8777539a3650f8b598738ec155 not found: ID does not exist" containerID="fd201b722d197679c7470494d0b18e941cbb2e8777539a3650f8b598738ec155"
Jul 29 01:59:42.281390 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:42.281350    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd201b722d197679c7470494d0b18e941cbb2e8777539a3650f8b598738ec155"} err="failed to get container status \"fd201b722d197679c7470494d0b18e941cbb2e8777539a3650f8b598738ec155\": rpc error: code = NotFound desc = could not find container \"fd201b722d197679c7470494d0b18e941cbb2e8777539a3650f8b598738ec155\": container with ID starting with fd201b722d197679c7470494d0b18e941cbb2e8777539a3650f8b598738ec155 not found: ID does not exist"
Jul 29 01:59:42.293303 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:42.293273    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-c798cc/auth-test-model-c798cc-kserve-599bc59567-mgm22"]
Jul 29 01:59:42.296419 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:42.296393    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-c798cc/auth-test-model-c798cc-kserve-599bc59567-mgm22"]
Jul 29 01:59:44.170200 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:44.170169    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a2e7f30-33d9-47a9-81de-cdc7cff1a88c" path="/var/lib/kubelet/pods/0a2e7f30-33d9-47a9-81de-cdc7cff1a88c/volumes"
Jul 29 01:59:49.438989 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:49.438929    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-c798cc/sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb"
Jul 29 01:59:49.439409 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:49.439002    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-c798cc/sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb"
Jul 29 01:59:49.451453 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:49.451424    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-c798cc/sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb"
Jul 29 01:59:50.328498 ip-10-0-142-238 kubenswrapper[2580]: I0729 01:59:50.328458    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-c798cc/sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb"
Jul 29 02:00:03.931330 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:00:03.931295    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:00:11.567332 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:00:11.567284    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:00:14.841542 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:00:14.841500    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:00:28.667663 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:00:28.667580    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:01:01.091729 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:01.091694    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-c798cc/sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb"]
Jul 29 02:01:01.109469 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:01.109432    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:01:02.248763 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:02.248729    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:01:04.123724 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:04.123680    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-c798cc/rate-test-model-c798cc-kserve-69b5f887cf-8hstg"]
Jul 29 02:01:04.124303 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:04.124282    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a2e7f30-33d9-47a9-81de-cdc7cff1a88c" containerName="main"
Jul 29 02:01:04.124303 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:04.124303    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a2e7f30-33d9-47a9-81de-cdc7cff1a88c" containerName="main"
Jul 29 02:01:04.124460 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:04.124377    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a2e7f30-33d9-47a9-81de-cdc7cff1a88c" containerName="main"
Jul 29 02:01:04.128062 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:04.128040    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c798cc/rate-test-model-c798cc-kserve-69b5f887cf-8hstg"
Jul 29 02:01:04.130670 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:04.130646    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-c798cc\"/\"rate-test-model-c798cc-kserve-self-signed-certs\""
Jul 29 02:01:04.134859 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:04.134832    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-c798cc/rate-test-model-c798cc-kserve-69b5f887cf-8hstg"]
Jul 29 02:01:04.149784 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:04.149759    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:01:04.152020 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:04.151999    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43be21c1-41ce-46c9-ade7-677b9f887ab6-tls-certs\") pod \"rate-test-model-c798cc-kserve-69b5f887cf-8hstg\" (UID: \"43be21c1-41ce-46c9-ade7-677b9f887ab6\") " pod="ai-tenant-e2e-shared-a-c798cc/rate-test-model-c798cc-kserve-69b5f887cf-8hstg"
Jul 29 02:01:04.152100 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:04.152037    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/43be21c1-41ce-46c9-ade7-677b9f887ab6-home\") pod \"rate-test-model-c798cc-kserve-69b5f887cf-8hstg\" (UID: \"43be21c1-41ce-46c9-ade7-677b9f887ab6\") " pod="ai-tenant-e2e-shared-a-c798cc/rate-test-model-c798cc-kserve-69b5f887cf-8hstg"
Jul 29 02:01:04.152100 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:04.152064    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/43be21c1-41ce-46c9-ade7-677b9f887ab6-model-cache\") pod \"rate-test-model-c798cc-kserve-69b5f887cf-8hstg\" (UID: \"43be21c1-41ce-46c9-ade7-677b9f887ab6\") " pod="ai-tenant-e2e-shared-a-c798cc/rate-test-model-c798cc-kserve-69b5f887cf-8hstg"
Jul 29 02:01:04.152100 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:04.152091    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43be21c1-41ce-46c9-ade7-677b9f887ab6-tmp-dir\") pod \"rate-test-model-c798cc-kserve-69b5f887cf-8hstg\" (UID: \"43be21c1-41ce-46c9-ade7-677b9f887ab6\") " pod="ai-tenant-e2e-shared-a-c798cc/rate-test-model-c798cc-kserve-69b5f887cf-8hstg"
Jul 29 02:01:04.152230 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:04.152108    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/43be21c1-41ce-46c9-ade7-677b9f887ab6-dshm\") pod \"rate-test-model-c798cc-kserve-69b5f887cf-8hstg\" (UID: \"43be21c1-41ce-46c9-ade7-677b9f887ab6\") " pod="ai-tenant-e2e-shared-a-c798cc/rate-test-model-c798cc-kserve-69b5f887cf-8hstg"
Jul 29 02:01:04.152230 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:04.152124    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zltm2\" (UniqueName: \"kubernetes.io/projected/43be21c1-41ce-46c9-ade7-677b9f887ab6-kube-api-access-zltm2\") pod \"rate-test-model-c798cc-kserve-69b5f887cf-8hstg\" (UID: \"43be21c1-41ce-46c9-ade7-677b9f887ab6\") " pod="ai-tenant-e2e-shared-a-c798cc/rate-test-model-c798cc-kserve-69b5f887cf-8hstg"
Jul 29 02:01:04.252963 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:04.252925    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43be21c1-41ce-46c9-ade7-677b9f887ab6-tls-certs\") pod \"rate-test-model-c798cc-kserve-69b5f887cf-8hstg\" (UID: \"43be21c1-41ce-46c9-ade7-677b9f887ab6\") " pod="ai-tenant-e2e-shared-a-c798cc/rate-test-model-c798cc-kserve-69b5f887cf-8hstg"
Jul 29 02:01:04.253112 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:04.252996    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/43be21c1-41ce-46c9-ade7-677b9f887ab6-home\") pod \"rate-test-model-c798cc-kserve-69b5f887cf-8hstg\" (UID: \"43be21c1-41ce-46c9-ade7-677b9f887ab6\") " pod="ai-tenant-e2e-shared-a-c798cc/rate-test-model-c798cc-kserve-69b5f887cf-8hstg"
Jul 29 02:01:04.253112 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:04.253033    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/43be21c1-41ce-46c9-ade7-677b9f887ab6-model-cache\") pod \"rate-test-model-c798cc-kserve-69b5f887cf-8hstg\" (UID: \"43be21c1-41ce-46c9-ade7-677b9f887ab6\") " pod="ai-tenant-e2e-shared-a-c798cc/rate-test-model-c798cc-kserve-69b5f887cf-8hstg"
Jul 29 02:01:04.253112 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:04.253074    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43be21c1-41ce-46c9-ade7-677b9f887ab6-tmp-dir\") pod \"rate-test-model-c798cc-kserve-69b5f887cf-8hstg\" (UID: \"43be21c1-41ce-46c9-ade7-677b9f887ab6\") " pod="ai-tenant-e2e-shared-a-c798cc/rate-test-model-c798cc-kserve-69b5f887cf-8hstg"
Jul 29 02:01:04.253265 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:04.253119    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/43be21c1-41ce-46c9-ade7-677b9f887ab6-dshm\") pod \"rate-test-model-c798cc-kserve-69b5f887cf-8hstg\" (UID: \"43be21c1-41ce-46c9-ade7-677b9f887ab6\") " pod="ai-tenant-e2e-shared-a-c798cc/rate-test-model-c798cc-kserve-69b5f887cf-8hstg"
Jul 29 02:01:04.253265 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:04.253158    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zltm2\" (UniqueName: \"kubernetes.io/projected/43be21c1-41ce-46c9-ade7-677b9f887ab6-kube-api-access-zltm2\") pod \"rate-test-model-c798cc-kserve-69b5f887cf-8hstg\" (UID: \"43be21c1-41ce-46c9-ade7-677b9f887ab6\") " pod="ai-tenant-e2e-shared-a-c798cc/rate-test-model-c798cc-kserve-69b5f887cf-8hstg"
Jul 29 02:01:04.253557 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:04.253515    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/43be21c1-41ce-46c9-ade7-677b9f887ab6-model-cache\") pod \"rate-test-model-c798cc-kserve-69b5f887cf-8hstg\" (UID: \"43be21c1-41ce-46c9-ade7-677b9f887ab6\") " pod="ai-tenant-e2e-shared-a-c798cc/rate-test-model-c798cc-kserve-69b5f887cf-8hstg"
Jul 29 02:01:04.253692 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:04.253574    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43be21c1-41ce-46c9-ade7-677b9f887ab6-tmp-dir\") pod \"rate-test-model-c798cc-kserve-69b5f887cf-8hstg\" (UID: \"43be21c1-41ce-46c9-ade7-677b9f887ab6\") " pod="ai-tenant-e2e-shared-a-c798cc/rate-test-model-c798cc-kserve-69b5f887cf-8hstg"
Jul 29 02:01:04.253692 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:04.253614    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/43be21c1-41ce-46c9-ade7-677b9f887ab6-home\") pod \"rate-test-model-c798cc-kserve-69b5f887cf-8hstg\" (UID: \"43be21c1-41ce-46c9-ade7-677b9f887ab6\") " pod="ai-tenant-e2e-shared-a-c798cc/rate-test-model-c798cc-kserve-69b5f887cf-8hstg"
Jul 29 02:01:04.255284 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:04.255261    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/43be21c1-41ce-46c9-ade7-677b9f887ab6-dshm\") pod \"rate-test-model-c798cc-kserve-69b5f887cf-8hstg\" (UID: \"43be21c1-41ce-46c9-ade7-677b9f887ab6\") " pod="ai-tenant-e2e-shared-a-c798cc/rate-test-model-c798cc-kserve-69b5f887cf-8hstg"
Jul 29 02:01:04.255641 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:04.255623    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43be21c1-41ce-46c9-ade7-677b9f887ab6-tls-certs\") pod \"rate-test-model-c798cc-kserve-69b5f887cf-8hstg\" (UID: \"43be21c1-41ce-46c9-ade7-677b9f887ab6\") " pod="ai-tenant-e2e-shared-a-c798cc/rate-test-model-c798cc-kserve-69b5f887cf-8hstg"
Jul 29 02:01:04.261376 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:04.261356    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zltm2\" (UniqueName: \"kubernetes.io/projected/43be21c1-41ce-46c9-ade7-677b9f887ab6-kube-api-access-zltm2\") pod \"rate-test-model-c798cc-kserve-69b5f887cf-8hstg\" (UID: \"43be21c1-41ce-46c9-ade7-677b9f887ab6\") " pod="ai-tenant-e2e-shared-a-c798cc/rate-test-model-c798cc-kserve-69b5f887cf-8hstg"
Jul 29 02:01:04.439466 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:04.439371    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c798cc/rate-test-model-c798cc-kserve-69b5f887cf-8hstg"
Jul 29 02:01:04.573312 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:04.573288    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-c798cc/rate-test-model-c798cc-kserve-69b5f887cf-8hstg"]
Jul 29 02:01:04.575578 ip-10-0-142-238 kubenswrapper[2580]: W0729 02:01:04.575545    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod43be21c1_41ce_46c9_ade7_677b9f887ab6.slice/crio-2e96f375c01d1d90e75a93357d4516cfa1a59c724e7a4180dedc537fa2d9ae1d WatchSource:0}: Error finding container 2e96f375c01d1d90e75a93357d4516cfa1a59c724e7a4180dedc537fa2d9ae1d: Status 404 returned error can't find the container with id 2e96f375c01d1d90e75a93357d4516cfa1a59c724e7a4180dedc537fa2d9ae1d
Jul 29 02:01:04.678252 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:04.678214    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c798cc/rate-test-model-c798cc-kserve-69b5f887cf-8hstg" event={"ID":"43be21c1-41ce-46c9-ade7-677b9f887ab6","Type":"ContainerStarted","Data":"4f4826fa34098abab2b925fc579db6741c224ecfeca737bbae05c6587a3c7e3f"}
Jul 29 02:01:04.678252 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:04.678262    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c798cc/rate-test-model-c798cc-kserve-69b5f887cf-8hstg" event={"ID":"43be21c1-41ce-46c9-ade7-677b9f887ab6","Type":"ContainerStarted","Data":"2e96f375c01d1d90e75a93357d4516cfa1a59c724e7a4180dedc537fa2d9ae1d"}
Jul 29 02:01:04.695703 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:04.695596    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-c798cc/rate-test-model-c798cc-kserve-69b5f887cf-8hstg" podStartSLOduration=0.69557784 podStartE2EDuration="695.57784ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:01:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:01:04.695015943 +0000 UTC m=+2915.007408653" watchObservedRunningTime="2026-07-29 02:01:04.69557784 +0000 UTC m=+2915.007970549"
Jul 29 02:01:14.440119 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:14.440065    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-c798cc/rate-test-model-c798cc-kserve-69b5f887cf-8hstg"
Jul 29 02:01:14.440119 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:14.440129    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-c798cc/rate-test-model-c798cc-kserve-69b5f887cf-8hstg"
Jul 29 02:01:14.452693 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:14.452659    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-c798cc/rate-test-model-c798cc-kserve-69b5f887cf-8hstg"
Jul 29 02:01:14.742384 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:14.742297    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-c798cc/rate-test-model-c798cc-kserve-69b5f887cf-8hstg"
Jul 29 02:01:16.110716 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:16.110678    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-c798cc/sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb" podUID="33739496-52f9-43e4-b311-4925307d43e9" containerName="main" containerID="cri-o://a75a61a83c664704e558a06c6906540c563679ef6ab2ba4bc3422ba44b5e8acb" gracePeriod=45
Jul 29 02:01:16.371407 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:16.371347    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c798cc/sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb"
Jul 29 02:01:16.471232 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:16.471195    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33739496-52f9-43e4-b311-4925307d43e9-model-cache\") pod \"33739496-52f9-43e4-b311-4925307d43e9\" (UID: \"33739496-52f9-43e4-b311-4925307d43e9\") "
Jul 29 02:01:16.471232 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:16.471241    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33739496-52f9-43e4-b311-4925307d43e9-tmp-dir\") pod \"33739496-52f9-43e4-b311-4925307d43e9\" (UID: \"33739496-52f9-43e4-b311-4925307d43e9\") "
Jul 29 02:01:16.471494 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:16.471328    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33739496-52f9-43e4-b311-4925307d43e9-dshm\") pod \"33739496-52f9-43e4-b311-4925307d43e9\" (UID: \"33739496-52f9-43e4-b311-4925307d43e9\") "
Jul 29 02:01:16.471494 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:16.471362    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33739496-52f9-43e4-b311-4925307d43e9-home\") pod \"33739496-52f9-43e4-b311-4925307d43e9\" (UID: \"33739496-52f9-43e4-b311-4925307d43e9\") "
Jul 29 02:01:16.471494 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:16.471383    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33739496-52f9-43e4-b311-4925307d43e9-tls-certs\") pod \"33739496-52f9-43e4-b311-4925307d43e9\" (UID: \"33739496-52f9-43e4-b311-4925307d43e9\") "
Jul 29 02:01:16.471494 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:16.471410    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5k9s\" (UniqueName: \"kubernetes.io/projected/33739496-52f9-43e4-b311-4925307d43e9-kube-api-access-n5k9s\") pod \"33739496-52f9-43e4-b311-4925307d43e9\" (UID: \"33739496-52f9-43e4-b311-4925307d43e9\") "
Jul 29 02:01:16.471694 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:16.471539    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33739496-52f9-43e4-b311-4925307d43e9-model-cache" (OuterVolumeSpecName: "model-cache") pod "33739496-52f9-43e4-b311-4925307d43e9" (UID: "33739496-52f9-43e4-b311-4925307d43e9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:01:16.471694 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:16.471555    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33739496-52f9-43e4-b311-4925307d43e9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "33739496-52f9-43e4-b311-4925307d43e9" (UID: "33739496-52f9-43e4-b311-4925307d43e9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:01:16.471694 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:16.471656    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33739496-52f9-43e4-b311-4925307d43e9-home" (OuterVolumeSpecName: "home") pod "33739496-52f9-43e4-b311-4925307d43e9" (UID: "33739496-52f9-43e4-b311-4925307d43e9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:01:16.471835 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:16.471818    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33739496-52f9-43e4-b311-4925307d43e9-home\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 02:01:16.471870 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:16.471841    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33739496-52f9-43e4-b311-4925307d43e9-model-cache\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 02:01:16.471870 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:16.471856    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33739496-52f9-43e4-b311-4925307d43e9-tmp-dir\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 02:01:16.473554 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:16.473526    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33739496-52f9-43e4-b311-4925307d43e9-kube-api-access-n5k9s" (OuterVolumeSpecName: "kube-api-access-n5k9s") pod "33739496-52f9-43e4-b311-4925307d43e9" (UID: "33739496-52f9-43e4-b311-4925307d43e9"). InnerVolumeSpecName "kube-api-access-n5k9s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:01:16.473654 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:16.473559    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33739496-52f9-43e4-b311-4925307d43e9-dshm" (OuterVolumeSpecName: "dshm") pod "33739496-52f9-43e4-b311-4925307d43e9" (UID: "33739496-52f9-43e4-b311-4925307d43e9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:01:16.473654 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:16.473571    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33739496-52f9-43e4-b311-4925307d43e9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "33739496-52f9-43e4-b311-4925307d43e9" (UID: "33739496-52f9-43e4-b311-4925307d43e9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 02:01:16.573008 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:16.572935    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33739496-52f9-43e4-b311-4925307d43e9-dshm\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 02:01:16.573008 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:16.573002    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33739496-52f9-43e4-b311-4925307d43e9-tls-certs\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 02:01:16.573229 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:16.573024    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5k9s\" (UniqueName: \"kubernetes.io/projected/33739496-52f9-43e4-b311-4925307d43e9-kube-api-access-n5k9s\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 02:01:16.741981 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:16.741871    2580 generic.go:356] "Generic (PLEG): container finished" podID="33739496-52f9-43e4-b311-4925307d43e9" containerID="a75a61a83c664704e558a06c6906540c563679ef6ab2ba4bc3422ba44b5e8acb" exitCode=0
Jul 29 02:01:16.741981 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:16.741912    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c798cc/sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb"
Jul 29 02:01:16.742169 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:16.741986    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c798cc/sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb" event={"ID":"33739496-52f9-43e4-b311-4925307d43e9","Type":"ContainerDied","Data":"a75a61a83c664704e558a06c6906540c563679ef6ab2ba4bc3422ba44b5e8acb"}
Jul 29 02:01:16.742169 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:16.742026    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c798cc/sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb" event={"ID":"33739496-52f9-43e4-b311-4925307d43e9","Type":"ContainerDied","Data":"d3214ecc5fe5c5204443a69b0da4f24b7a978acc858ec14a9e31d5a930f92f6b"}
Jul 29 02:01:16.742169 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:16.742044    2580 scope.go:117] "RemoveContainer" containerID="a75a61a83c664704e558a06c6906540c563679ef6ab2ba4bc3422ba44b5e8acb"
Jul 29 02:01:16.751506 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:16.751489    2580 scope.go:117] "RemoveContainer" containerID="a75a61a83c664704e558a06c6906540c563679ef6ab2ba4bc3422ba44b5e8acb"
Jul 29 02:01:16.751767 ip-10-0-142-238 kubenswrapper[2580]: E0729 02:01:16.751749    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a75a61a83c664704e558a06c6906540c563679ef6ab2ba4bc3422ba44b5e8acb\": container with ID starting with a75a61a83c664704e558a06c6906540c563679ef6ab2ba4bc3422ba44b5e8acb not found: ID does not exist" containerID="a75a61a83c664704e558a06c6906540c563679ef6ab2ba4bc3422ba44b5e8acb"
Jul 29 02:01:16.751840 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:16.751772    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a75a61a83c664704e558a06c6906540c563679ef6ab2ba4bc3422ba44b5e8acb"} err="failed to get container status \"a75a61a83c664704e558a06c6906540c563679ef6ab2ba4bc3422ba44b5e8acb\": rpc error: code = NotFound desc = could not find container \"a75a61a83c664704e558a06c6906540c563679ef6ab2ba4bc3422ba44b5e8acb\": container with ID starting with a75a61a83c664704e558a06c6906540c563679ef6ab2ba4bc3422ba44b5e8acb not found: ID does not exist"
Jul 29 02:01:16.764413 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:16.764367    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-c798cc/sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb"]
Jul 29 02:01:16.766399 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:16.766377    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-c798cc/sub-test-model-c798cc-kserve-7847b9b7b5-ffcmb"]
Jul 29 02:01:18.170883 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:18.170851    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33739496-52f9-43e4-b311-4925307d43e9" path="/var/lib/kubelet/pods/33739496-52f9-43e4-b311-4925307d43e9/volumes"
Jul 29 02:01:24.524442 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:01:24.524404    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:02:31.704966 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:31.704919    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-c798cc/rate-test-model-c798cc-kserve-69b5f887cf-8hstg"]
Jul 29 02:02:31.727402 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:31.727357    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:02:31.789458 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:31.789351    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8g9fl_e044d9fa-39c8-49b8-94e1-550f3dbe7b26/ovn-acl-logging/0.log"
Jul 29 02:02:31.797973 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:31.797796    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8g9fl_e044d9fa-39c8-49b8-94e1-550f3dbe7b26/ovn-acl-logging/0.log"
Jul 29 02:02:33.863140 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:33.863108    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:02:39.423852 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:39.423804    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:02:46.724321 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:46.724275    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-c798cc/rate-test-model-c798cc-kserve-69b5f887cf-8hstg" podUID="43be21c1-41ce-46c9-ade7-677b9f887ab6" containerName="main" containerID="cri-o://4f4826fa34098abab2b925fc579db6741c224ecfeca737bbae05c6587a3c7e3f" gracePeriod=45
Jul 29 02:02:46.979574 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:46.979504    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c798cc/rate-test-model-c798cc-kserve-69b5f887cf-8hstg"
Jul 29 02:02:47.139162 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:47.139129    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43be21c1-41ce-46c9-ade7-677b9f887ab6-tls-certs\") pod \"43be21c1-41ce-46c9-ade7-677b9f887ab6\" (UID: \"43be21c1-41ce-46c9-ade7-677b9f887ab6\") "
Jul 29 02:02:47.139162 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:47.139166    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/43be21c1-41ce-46c9-ade7-677b9f887ab6-home\") pod \"43be21c1-41ce-46c9-ade7-677b9f887ab6\" (UID: \"43be21c1-41ce-46c9-ade7-677b9f887ab6\") "
Jul 29 02:02:47.139397 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:47.139226    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43be21c1-41ce-46c9-ade7-677b9f887ab6-tmp-dir\") pod \"43be21c1-41ce-46c9-ade7-677b9f887ab6\" (UID: \"43be21c1-41ce-46c9-ade7-677b9f887ab6\") "
Jul 29 02:02:47.139397 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:47.139265    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/43be21c1-41ce-46c9-ade7-677b9f887ab6-model-cache\") pod \"43be21c1-41ce-46c9-ade7-677b9f887ab6\" (UID: \"43be21c1-41ce-46c9-ade7-677b9f887ab6\") "
Jul 29 02:02:47.139397 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:47.139290    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zltm2\" (UniqueName: \"kubernetes.io/projected/43be21c1-41ce-46c9-ade7-677b9f887ab6-kube-api-access-zltm2\") pod \"43be21c1-41ce-46c9-ade7-677b9f887ab6\" (UID: \"43be21c1-41ce-46c9-ade7-677b9f887ab6\") "
Jul 29 02:02:47.139397 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:47.139335    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/43be21c1-41ce-46c9-ade7-677b9f887ab6-dshm\") pod \"43be21c1-41ce-46c9-ade7-677b9f887ab6\" (UID: \"43be21c1-41ce-46c9-ade7-677b9f887ab6\") "
Jul 29 02:02:47.139619 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:47.139595    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43be21c1-41ce-46c9-ade7-677b9f887ab6-home" (OuterVolumeSpecName: "home") pod "43be21c1-41ce-46c9-ade7-677b9f887ab6" (UID: "43be21c1-41ce-46c9-ade7-677b9f887ab6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:02:47.139685 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:47.139612    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43be21c1-41ce-46c9-ade7-677b9f887ab6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "43be21c1-41ce-46c9-ade7-677b9f887ab6" (UID: "43be21c1-41ce-46c9-ade7-677b9f887ab6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:02:47.139685 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:47.139632    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43be21c1-41ce-46c9-ade7-677b9f887ab6-model-cache" (OuterVolumeSpecName: "model-cache") pod "43be21c1-41ce-46c9-ade7-677b9f887ab6" (UID: "43be21c1-41ce-46c9-ade7-677b9f887ab6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:02:47.139797 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:47.139714    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/43be21c1-41ce-46c9-ade7-677b9f887ab6-home\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 02:02:47.139797 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:47.139739    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43be21c1-41ce-46c9-ade7-677b9f887ab6-tmp-dir\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 02:02:47.139797 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:47.139757    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/43be21c1-41ce-46c9-ade7-677b9f887ab6-model-cache\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 02:02:47.141544 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:47.141502    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43be21c1-41ce-46c9-ade7-677b9f887ab6-dshm" (OuterVolumeSpecName: "dshm") pod "43be21c1-41ce-46c9-ade7-677b9f887ab6" (UID: "43be21c1-41ce-46c9-ade7-677b9f887ab6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:02:47.141672 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:47.141572    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43be21c1-41ce-46c9-ade7-677b9f887ab6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "43be21c1-41ce-46c9-ade7-677b9f887ab6" (UID: "43be21c1-41ce-46c9-ade7-677b9f887ab6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 02:02:47.141672 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:47.141569    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43be21c1-41ce-46c9-ade7-677b9f887ab6-kube-api-access-zltm2" (OuterVolumeSpecName: "kube-api-access-zltm2") pod "43be21c1-41ce-46c9-ade7-677b9f887ab6" (UID: "43be21c1-41ce-46c9-ade7-677b9f887ab6"). InnerVolumeSpecName "kube-api-access-zltm2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:02:47.187697 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:47.187659    2580 generic.go:356] "Generic (PLEG): container finished" podID="43be21c1-41ce-46c9-ade7-677b9f887ab6" containerID="4f4826fa34098abab2b925fc579db6741c224ecfeca737bbae05c6587a3c7e3f" exitCode=0
Jul 29 02:02:47.187879 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:47.187705    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c798cc/rate-test-model-c798cc-kserve-69b5f887cf-8hstg"
Jul 29 02:02:47.187879 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:47.187749    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c798cc/rate-test-model-c798cc-kserve-69b5f887cf-8hstg" event={"ID":"43be21c1-41ce-46c9-ade7-677b9f887ab6","Type":"ContainerDied","Data":"4f4826fa34098abab2b925fc579db6741c224ecfeca737bbae05c6587a3c7e3f"}
Jul 29 02:02:47.187879 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:47.187800    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c798cc/rate-test-model-c798cc-kserve-69b5f887cf-8hstg" event={"ID":"43be21c1-41ce-46c9-ade7-677b9f887ab6","Type":"ContainerDied","Data":"2e96f375c01d1d90e75a93357d4516cfa1a59c724e7a4180dedc537fa2d9ae1d"}
Jul 29 02:02:47.187879 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:47.187823    2580 scope.go:117] "RemoveContainer" containerID="4f4826fa34098abab2b925fc579db6741c224ecfeca737bbae05c6587a3c7e3f"
Jul 29 02:02:47.196849 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:47.196831    2580 scope.go:117] "RemoveContainer" containerID="4f4826fa34098abab2b925fc579db6741c224ecfeca737bbae05c6587a3c7e3f"
Jul 29 02:02:47.197161 ip-10-0-142-238 kubenswrapper[2580]: E0729 02:02:47.197141    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f4826fa34098abab2b925fc579db6741c224ecfeca737bbae05c6587a3c7e3f\": container with ID starting with 4f4826fa34098abab2b925fc579db6741c224ecfeca737bbae05c6587a3c7e3f not found: ID does not exist" containerID="4f4826fa34098abab2b925fc579db6741c224ecfeca737bbae05c6587a3c7e3f"
Jul 29 02:02:47.197217 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:47.197172    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f4826fa34098abab2b925fc579db6741c224ecfeca737bbae05c6587a3c7e3f"} err="failed to get container status \"4f4826fa34098abab2b925fc579db6741c224ecfeca737bbae05c6587a3c7e3f\": rpc error: code = NotFound desc = could not find container \"4f4826fa34098abab2b925fc579db6741c224ecfeca737bbae05c6587a3c7e3f\": container with ID starting with 4f4826fa34098abab2b925fc579db6741c224ecfeca737bbae05c6587a3c7e3f not found: ID does not exist"
Jul 29 02:02:47.209312 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:47.209276    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-c798cc/rate-test-model-c798cc-kserve-69b5f887cf-8hstg"]
Jul 29 02:02:47.212892 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:47.212861    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-c798cc/rate-test-model-c798cc-kserve-69b5f887cf-8hstg"]
Jul 29 02:02:47.240490 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:47.240398    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43be21c1-41ce-46c9-ade7-677b9f887ab6-tls-certs\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 02:02:47.240490 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:47.240428    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zltm2\" (UniqueName: \"kubernetes.io/projected/43be21c1-41ce-46c9-ade7-677b9f887ab6-kube-api-access-zltm2\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 02:02:47.240490 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:47.240438    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/43be21c1-41ce-46c9-ade7-677b9f887ab6-dshm\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 02:02:48.170048 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:48.170017    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43be21c1-41ce-46c9-ade7-677b9f887ab6" path="/var/lib/kubelet/pods/43be21c1-41ce-46c9-ade7-677b9f887ab6/volumes"
Jul 29 02:02:51.692569 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:51.692533    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:02:51.983086 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:51.983002    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:02:52.151422 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:52.151385    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:02:54.808885 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:54.808825    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:02:54.894035 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:54.893992    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:02:54.973827 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:54.973788    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:02:55.073030 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:55.072905    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:02:55.619628 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:55.619593    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:02:55.714929 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:55.714895    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:02:55.719130 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:55.719105    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-59f277-648c7bd95b-p64wx"]
Jul 29 02:02:55.719536 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:55.719523    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33739496-52f9-43e4-b311-4925307d43e9" containerName="main"
Jul 29 02:02:55.719581 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:55.719538    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="33739496-52f9-43e4-b311-4925307d43e9" containerName="main"
Jul 29 02:02:55.719581 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:55.719553    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43be21c1-41ce-46c9-ade7-677b9f887ab6" containerName="main"
Jul 29 02:02:55.719581 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:55.719558    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="43be21c1-41ce-46c9-ade7-677b9f887ab6" containerName="main"
Jul 29 02:02:55.719683 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:55.719624    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="33739496-52f9-43e4-b311-4925307d43e9" containerName="main"
Jul 29 02:02:55.719683 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:55.719635    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="43be21c1-41ce-46c9-ade7-677b9f887ab6" containerName="main"
Jul 29 02:02:55.724038 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:55.724023    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-59f277-648c7bd95b-p64wx"
Jul 29 02:02:55.726625 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:55.726609    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-59f277\""
Jul 29 02:02:55.726863 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:55.726843    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-59f277-dockercfg-bc84h\""
Jul 29 02:02:55.733589 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:55.733565    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-59f277-648c7bd95b-p64wx"]
Jul 29 02:02:55.750410 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:55.750377    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-59f277-b6886fbc4-7cj98"]
Jul 29 02:02:55.753934 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:55.753911    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-59f277-b6886fbc4-7cj98"
Jul 29 02:02:55.763389 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:55.763363    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-59f277-b6886fbc4-7cj98"]
Jul 29 02:02:55.815248 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:55.815214    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpgvb\" (UniqueName: \"kubernetes.io/projected/a783f4fa-3ed2-43bf-b3e9-470dad50168b-kube-api-access-hpgvb\") pod \"payload-pre-processing-e2e-ipp-a-59f277-648c7bd95b-p64wx\" (UID: \"a783f4fa-3ed2-43bf-b3e9-470dad50168b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-59f277-648c7bd95b-p64wx"
Jul 29 02:02:55.815647 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:55.815320    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d191f5bc-af68-477e-8495-6eef7c999a50-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-59f277-b6886fbc4-7cj98\" (UID: \"d191f5bc-af68-477e-8495-6eef7c999a50\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-59f277-b6886fbc4-7cj98"
Jul 29 02:02:55.815647 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:55.815341    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpcrj\" (UniqueName: \"kubernetes.io/projected/d191f5bc-af68-477e-8495-6eef7c999a50-kube-api-access-bpcrj\") pod \"payload-processing-e2e-ipp-a-59f277-b6886fbc4-7cj98\" (UID: \"d191f5bc-af68-477e-8495-6eef7c999a50\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-59f277-b6886fbc4-7cj98"
Jul 29 02:02:55.815647 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:55.815384    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a783f4fa-3ed2-43bf-b3e9-470dad50168b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-59f277-648c7bd95b-p64wx\" (UID: \"a783f4fa-3ed2-43bf-b3e9-470dad50168b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-59f277-648c7bd95b-p64wx"
Jul 29 02:02:55.916507 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:55.916417    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d191f5bc-af68-477e-8495-6eef7c999a50-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-59f277-b6886fbc4-7cj98\" (UID: \"d191f5bc-af68-477e-8495-6eef7c999a50\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-59f277-b6886fbc4-7cj98"
Jul 29 02:02:55.916507 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:55.916458    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpcrj\" (UniqueName: \"kubernetes.io/projected/d191f5bc-af68-477e-8495-6eef7c999a50-kube-api-access-bpcrj\") pod \"payload-processing-e2e-ipp-a-59f277-b6886fbc4-7cj98\" (UID: \"d191f5bc-af68-477e-8495-6eef7c999a50\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-59f277-b6886fbc4-7cj98"
Jul 29 02:02:55.916507 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:55.916493    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a783f4fa-3ed2-43bf-b3e9-470dad50168b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-59f277-648c7bd95b-p64wx\" (UID: \"a783f4fa-3ed2-43bf-b3e9-470dad50168b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-59f277-648c7bd95b-p64wx"
Jul 29 02:02:55.916733 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:55.916545    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpgvb\" (UniqueName: \"kubernetes.io/projected/a783f4fa-3ed2-43bf-b3e9-470dad50168b-kube-api-access-hpgvb\") pod \"payload-pre-processing-e2e-ipp-a-59f277-648c7bd95b-p64wx\" (UID: \"a783f4fa-3ed2-43bf-b3e9-470dad50168b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-59f277-648c7bd95b-p64wx"
Jul 29 02:02:55.917297 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:55.917276    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a783f4fa-3ed2-43bf-b3e9-470dad50168b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-59f277-648c7bd95b-p64wx\" (UID: \"a783f4fa-3ed2-43bf-b3e9-470dad50168b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-59f277-648c7bd95b-p64wx"
Jul 29 02:02:55.917348 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:55.917280    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d191f5bc-af68-477e-8495-6eef7c999a50-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-59f277-b6886fbc4-7cj98\" (UID: \"d191f5bc-af68-477e-8495-6eef7c999a50\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-59f277-b6886fbc4-7cj98"
Jul 29 02:02:55.924587 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:55.924558    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpcrj\" (UniqueName: \"kubernetes.io/projected/d191f5bc-af68-477e-8495-6eef7c999a50-kube-api-access-bpcrj\") pod \"payload-processing-e2e-ipp-a-59f277-b6886fbc4-7cj98\" (UID: \"d191f5bc-af68-477e-8495-6eef7c999a50\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-59f277-b6886fbc4-7cj98"
Jul 29 02:02:55.924717 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:55.924604    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpgvb\" (UniqueName: \"kubernetes.io/projected/a783f4fa-3ed2-43bf-b3e9-470dad50168b-kube-api-access-hpgvb\") pod \"payload-pre-processing-e2e-ipp-a-59f277-648c7bd95b-p64wx\" (UID: \"a783f4fa-3ed2-43bf-b3e9-470dad50168b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-59f277-648c7bd95b-p64wx"
Jul 29 02:02:56.035582 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:56.035542    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-59f277-648c7bd95b-p64wx"
Jul 29 02:02:56.064854 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:56.064819    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-59f277-b6886fbc4-7cj98"
Jul 29 02:02:56.188640 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:56.188607    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-59f277-648c7bd95b-p64wx"]
Jul 29 02:02:56.189784 ip-10-0-142-238 kubenswrapper[2580]: W0729 02:02:56.189742    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda783f4fa_3ed2_43bf_b3e9_470dad50168b.slice/crio-4fa97e2c1125ba3cbcbddbf34144c5e9509b4e2dd84f2647ca34ab9795901e80 WatchSource:0}: Error finding container 4fa97e2c1125ba3cbcbddbf34144c5e9509b4e2dd84f2647ca34ab9795901e80: Status 404 returned error can't find the container with id 4fa97e2c1125ba3cbcbddbf34144c5e9509b4e2dd84f2647ca34ab9795901e80
Jul 29 02:02:56.244423 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:56.244385    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-59f277-648c7bd95b-p64wx" event={"ID":"a783f4fa-3ed2-43bf-b3e9-470dad50168b","Type":"ContainerStarted","Data":"4fa97e2c1125ba3cbcbddbf34144c5e9509b4e2dd84f2647ca34ab9795901e80"}
Jul 29 02:02:56.428180 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:56.428157    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-59f277-b6886fbc4-7cj98"]
Jul 29 02:02:56.432393 ip-10-0-142-238 kubenswrapper[2580]: W0729 02:02:56.432358    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd191f5bc_af68_477e_8495_6eef7c999a50.slice/crio-52378d582677de37e2733a292ca7253d0cf6e01001452d7ccd56aca9785f10ce WatchSource:0}: Error finding container 52378d582677de37e2733a292ca7253d0cf6e01001452d7ccd56aca9785f10ce: Status 404 returned error can't find the container with id 52378d582677de37e2733a292ca7253d0cf6e01001452d7ccd56aca9785f10ce
Jul 29 02:02:57.251821 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:57.251781    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-59f277-648c7bd95b-p64wx" event={"ID":"a783f4fa-3ed2-43bf-b3e9-470dad50168b","Type":"ContainerStarted","Data":"fce3768ec89d287c6807553baf72c3892780802b98cdbb4ab344888f8993cf43"}
Jul 29 02:02:57.252367 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:57.251908    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-59f277-648c7bd95b-p64wx"
Jul 29 02:02:57.253435 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:57.253408    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-59f277-b6886fbc4-7cj98" event={"ID":"d191f5bc-af68-477e-8495-6eef7c999a50","Type":"ContainerStarted","Data":"1d40f9d0223e0097ed36cf24c3fcac1067d3d3f0e633152fe12f8b6102c030f5"}
Jul 29 02:02:57.253526 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:57.253458    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-59f277-b6886fbc4-7cj98" event={"ID":"d191f5bc-af68-477e-8495-6eef7c999a50","Type":"ContainerStarted","Data":"52378d582677de37e2733a292ca7253d0cf6e01001452d7ccd56aca9785f10ce"}
Jul 29 02:02:57.253526 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:57.253491    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-59f277-b6886fbc4-7cj98"
Jul 29 02:02:57.269135 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:57.269084    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-59f277-648c7bd95b-p64wx" podStartSLOduration=2.269068478 podStartE2EDuration="2.269068478s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:02:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:02:57.267003238 +0000 UTC m=+3027.579395948" watchObservedRunningTime="2026-07-29 02:02:57.269068478 +0000 UTC m=+3027.581461203"
Jul 29 02:02:57.283302 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:02:57.283260    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-59f277-b6886fbc4-7cj98" podStartSLOduration=2.283243601 podStartE2EDuration="2.283243601s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:02:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:02:57.282144444 +0000 UTC m=+3027.594537152" watchObservedRunningTime="2026-07-29 02:02:57.283243601 +0000 UTC m=+3027.595636308"
Jul 29 02:03:08.262034 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:03:08.261997    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-59f277-648c7bd95b-p64wx"
Jul 29 02:03:08.262590 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:03:08.262089    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-59f277-b6886fbc4-7cj98"
Jul 29 02:03:19.774249 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:03:19.774204    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:03:20.433902 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:03:20.433865    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:03:20.738417 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:03:20.738335    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:03:21.048642 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:03:21.048544    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:03:23.976221 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:03:23.976134    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:03:24.056102 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:03:24.056069    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:03:24.117980 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:03:24.117924    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:03:24.249616 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:03:24.249529    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:03:24.636122 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:03:24.636092    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:03:24.733041 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:03:24.733002    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-7f1f73-7bf98f676d-68z8b"]
Jul 29 02:03:24.735289 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:03:24.735262    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:03:24.736587 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:03:24.736567    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-7f1f73-7bf98f676d-68z8b"
Jul 29 02:03:24.739243 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:03:24.739224    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-7f1f73\""
Jul 29 02:03:24.739325 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:03:24.739226    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-7f1f73-dockercfg-k2zg5\""
Jul 29 02:03:24.747063 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:03:24.747039    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-7f1f73-7bf98f676d-68z8b"]
Jul 29 02:03:24.760642 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:03:24.760598    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-7f1f73-65497477d8-44rps"]
Jul 29 02:03:24.765732 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:03:24.765713    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-7f1f73-65497477d8-44rps"
Jul 29 02:03:24.774726 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:03:24.774704    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-7f1f73-65497477d8-44rps"]
Jul 29 02:03:24.894100 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:03:24.894012    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5db19143-9af6-4824-a06f-190036e1ff0a-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-7f1f73-65497477d8-44rps\" (UID: \"5db19143-9af6-4824-a06f-190036e1ff0a\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-7f1f73-65497477d8-44rps"
Jul 29 02:03:24.894100 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:03:24.894082    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rmf2\" (UniqueName: \"kubernetes.io/projected/5db19143-9af6-4824-a06f-190036e1ff0a-kube-api-access-9rmf2\") pod \"payload-processing-e2e-ipp-b-7f1f73-65497477d8-44rps\" (UID: \"5db19143-9af6-4824-a06f-190036e1ff0a\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-7f1f73-65497477d8-44rps"
Jul 29 02:03:24.894286 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:03:24.894145    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6s9l\" (UniqueName: \"kubernetes.io/projected/3c57d23a-240c-4391-a201-0905e6b54ea6-kube-api-access-f6s9l\") pod \"payload-pre-processing-e2e-ipp-b-7f1f73-7bf98f676d-68z8b\" (UID: \"3c57d23a-240c-4391-a201-0905e6b54ea6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-7f1f73-7bf98f676d-68z8b"
Jul 29 02:03:24.894286 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:03:24.894248    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3c57d23a-240c-4391-a201-0905e6b54ea6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-7f1f73-7bf98f676d-68z8b\" (UID: \"3c57d23a-240c-4391-a201-0905e6b54ea6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-7f1f73-7bf98f676d-68z8b"
Jul 29 02:03:24.995582 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:03:24.995543    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3c57d23a-240c-4391-a201-0905e6b54ea6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-7f1f73-7bf98f676d-68z8b\" (UID: \"3c57d23a-240c-4391-a201-0905e6b54ea6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-7f1f73-7bf98f676d-68z8b"
Jul 29 02:03:24.996076 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:03:24.995595    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5db19143-9af6-4824-a06f-190036e1ff0a-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-7f1f73-65497477d8-44rps\" (UID: \"5db19143-9af6-4824-a06f-190036e1ff0a\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-7f1f73-65497477d8-44rps"
Jul 29 02:03:24.996076 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:03:24.995657    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rmf2\" (UniqueName: \"kubernetes.io/projected/5db19143-9af6-4824-a06f-190036e1ff0a-kube-api-access-9rmf2\") pod \"payload-processing-e2e-ipp-b-7f1f73-65497477d8-44rps\" (UID: \"5db19143-9af6-4824-a06f-190036e1ff0a\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-7f1f73-65497477d8-44rps"
Jul 29 02:03:24.996076 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:03:24.995689    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6s9l\" (UniqueName: \"kubernetes.io/projected/3c57d23a-240c-4391-a201-0905e6b54ea6-kube-api-access-f6s9l\") pod \"payload-pre-processing-e2e-ipp-b-7f1f73-7bf98f676d-68z8b\" (UID: \"3c57d23a-240c-4391-a201-0905e6b54ea6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-7f1f73-7bf98f676d-68z8b"
Jul 29 02:03:24.996405 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:03:24.996382    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5db19143-9af6-4824-a06f-190036e1ff0a-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-7f1f73-65497477d8-44rps\" (UID: \"5db19143-9af6-4824-a06f-190036e1ff0a\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-7f1f73-65497477d8-44rps"
Jul 29 02:03:24.996447 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:03:24.996383    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3c57d23a-240c-4391-a201-0905e6b54ea6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-7f1f73-7bf98f676d-68z8b\" (UID: \"3c57d23a-240c-4391-a201-0905e6b54ea6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-7f1f73-7bf98f676d-68z8b"
Jul 29 02:03:25.006597 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:03:25.006565    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6s9l\" (UniqueName: \"kubernetes.io/projected/3c57d23a-240c-4391-a201-0905e6b54ea6-kube-api-access-f6s9l\") pod \"payload-pre-processing-e2e-ipp-b-7f1f73-7bf98f676d-68z8b\" (UID: \"3c57d23a-240c-4391-a201-0905e6b54ea6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-7f1f73-7bf98f676d-68z8b"
Jul 29 02:03:25.006712 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:03:25.006613    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rmf2\" (UniqueName: \"kubernetes.io/projected/5db19143-9af6-4824-a06f-190036e1ff0a-kube-api-access-9rmf2\") pod \"payload-processing-e2e-ipp-b-7f1f73-65497477d8-44rps\" (UID: \"5db19143-9af6-4824-a06f-190036e1ff0a\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-7f1f73-65497477d8-44rps"
Jul 29 02:03:25.048264 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:03:25.048231    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-7f1f73-7bf98f676d-68z8b"
Jul 29 02:03:25.076519 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:03:25.076490    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-7f1f73-65497477d8-44rps"
Jul 29 02:03:25.206758 ip-10-0-142-238 kubenswrapper[2580]: W0729 02:03:25.200265    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c57d23a_240c_4391_a201_0905e6b54ea6.slice/crio-593b36a0709ff692483119a7c3ec170ecf3307cbe83528079238f3c273dfc8ac WatchSource:0}: Error finding container 593b36a0709ff692483119a7c3ec170ecf3307cbe83528079238f3c273dfc8ac: Status 404 returned error can't find the container with id 593b36a0709ff692483119a7c3ec170ecf3307cbe83528079238f3c273dfc8ac
Jul 29 02:03:25.206758 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:03:25.200689    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-7f1f73-7bf98f676d-68z8b"]
Jul 29 02:03:25.395446 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:03:25.395407    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-7f1f73-7bf98f676d-68z8b" event={"ID":"3c57d23a-240c-4391-a201-0905e6b54ea6","Type":"ContainerStarted","Data":"2bda8351e8a9a6e49330b9716deb061d018b029efdadf1b90e667b2bea2956cd"}
Jul 29 02:03:25.395652 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:03:25.395457    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-7f1f73-7bf98f676d-68z8b" event={"ID":"3c57d23a-240c-4391-a201-0905e6b54ea6","Type":"ContainerStarted","Data":"593b36a0709ff692483119a7c3ec170ecf3307cbe83528079238f3c273dfc8ac"}
Jul 29 02:03:25.395652 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:03:25.395491    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-7f1f73-7bf98f676d-68z8b"
Jul 29 02:03:25.412426 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:03:25.412376    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-7f1f73-7bf98f676d-68z8b" podStartSLOduration=1.4123598529999999 podStartE2EDuration="1.412359853s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:03:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:03:25.410672202 +0000 UTC m=+3055.723064913" watchObservedRunningTime="2026-07-29 02:03:25.412359853 +0000 UTC m=+3055.724752560"
Jul 29 02:03:25.430347 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:03:25.430324    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-7f1f73-65497477d8-44rps"]
Jul 29 02:03:25.432601 ip-10-0-142-238 kubenswrapper[2580]: W0729 02:03:25.432574    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5db19143_9af6_4824_a06f_190036e1ff0a.slice/crio-6ac5827ba464b9a831c22e04a1b5390108713371f655ff45ff4774df94a5a7ba WatchSource:0}: Error finding container 6ac5827ba464b9a831c22e04a1b5390108713371f655ff45ff4774df94a5a7ba: Status 404 returned error can't find the container with id 6ac5827ba464b9a831c22e04a1b5390108713371f655ff45ff4774df94a5a7ba
Jul 29 02:03:26.401681 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:03:26.401632    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-7f1f73-65497477d8-44rps" event={"ID":"5db19143-9af6-4824-a06f-190036e1ff0a","Type":"ContainerStarted","Data":"1d1922a7716010b3f456f3ffd7e22dbe9089481c6208cf486a54608204a551d5"}
Jul 29 02:03:26.402097 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:03:26.401701    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-7f1f73-65497477d8-44rps" event={"ID":"5db19143-9af6-4824-a06f-190036e1ff0a","Type":"ContainerStarted","Data":"6ac5827ba464b9a831c22e04a1b5390108713371f655ff45ff4774df94a5a7ba"}
Jul 29 02:03:26.402097 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:03:26.401821    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-7f1f73-65497477d8-44rps"
Jul 29 02:03:26.428470 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:03:26.428421    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-7f1f73-65497477d8-44rps" podStartSLOduration=2.42840097 podStartE2EDuration="2.42840097s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:03:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:03:26.427220695 +0000 UTC m=+3056.739613404" watchObservedRunningTime="2026-07-29 02:03:26.42840097 +0000 UTC m=+3056.740793679"
Jul 29 02:03:36.404134 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:03:36.404102    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-7f1f73-7bf98f676d-68z8b"
Jul 29 02:03:37.408467 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:03:37.408426    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-7f1f73-65497477d8-44rps"
Jul 29 02:03:48.947796 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:03:48.947744    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:03:55.861327 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:03:55.861280    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-dlvpn_6784b90f-c19a-4022-800b-825ecca592f8/payload-processing/0.log"
Jul 29 02:03:55.980869 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:03:55.980837    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-7f1f73-65497477d8-44rps_5db19143-9af6-4824-a06f-190036e1ff0a/payload-processing/0.log"
Jul 29 02:04:05.513547 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:05.513503    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-59f277/ipp-route-59f277-kserve-9f85bc499-vjxcn"]
Jul 29 02:04:05.517656 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:05.517631    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-59f277/ipp-route-59f277-kserve-9f85bc499-vjxcn"
Jul 29 02:04:05.520120 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:05.520094    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-59f277\"/\"openshift-service-ca.crt\""
Jul 29 02:04:05.521145 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:05.521122    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-59f277\"/\"ipp-route-59f277-kserve-self-signed-certs\""
Jul 29 02:04:05.521200 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:05.521133    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-59f277\"/\"kube-root-ca.crt\""
Jul 29 02:04:05.521200 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:05.521135    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-59f277\"/\"default-dockercfg-q44xd\""
Jul 29 02:04:05.526518 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:05.526491    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-59f277/ipp-route-59f277-kserve-9f85bc499-vjxcn"]
Jul 29 02:04:05.618800 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:05.618759    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:04:05.678464 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:05.678428    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9775586d-f6a9-45aa-9133-d391be890e16-tmp-dir\") pod \"ipp-route-59f277-kserve-9f85bc499-vjxcn\" (UID: \"9775586d-f6a9-45aa-9133-d391be890e16\") " pod="ai-tenant-e2e-ipp-a-59f277/ipp-route-59f277-kserve-9f85bc499-vjxcn"
Jul 29 02:04:05.678662 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:05.678475    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9775586d-f6a9-45aa-9133-d391be890e16-tls-certs\") pod \"ipp-route-59f277-kserve-9f85bc499-vjxcn\" (UID: \"9775586d-f6a9-45aa-9133-d391be890e16\") " pod="ai-tenant-e2e-ipp-a-59f277/ipp-route-59f277-kserve-9f85bc499-vjxcn"
Jul 29 02:04:05.678662 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:05.678547    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9775586d-f6a9-45aa-9133-d391be890e16-home\") pod \"ipp-route-59f277-kserve-9f85bc499-vjxcn\" (UID: \"9775586d-f6a9-45aa-9133-d391be890e16\") " pod="ai-tenant-e2e-ipp-a-59f277/ipp-route-59f277-kserve-9f85bc499-vjxcn"
Jul 29 02:04:05.678662 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:05.678581    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9775586d-f6a9-45aa-9133-d391be890e16-dshm\") pod \"ipp-route-59f277-kserve-9f85bc499-vjxcn\" (UID: \"9775586d-f6a9-45aa-9133-d391be890e16\") " pod="ai-tenant-e2e-ipp-a-59f277/ipp-route-59f277-kserve-9f85bc499-vjxcn"
Jul 29 02:04:05.678662 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:05.678614    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmzsl\" (UniqueName: \"kubernetes.io/projected/9775586d-f6a9-45aa-9133-d391be890e16-kube-api-access-lmzsl\") pod \"ipp-route-59f277-kserve-9f85bc499-vjxcn\" (UID: \"9775586d-f6a9-45aa-9133-d391be890e16\") " pod="ai-tenant-e2e-ipp-a-59f277/ipp-route-59f277-kserve-9f85bc499-vjxcn"
Jul 29 02:04:05.678803 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:05.678714    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9775586d-f6a9-45aa-9133-d391be890e16-model-cache\") pod \"ipp-route-59f277-kserve-9f85bc499-vjxcn\" (UID: \"9775586d-f6a9-45aa-9133-d391be890e16\") " pod="ai-tenant-e2e-ipp-a-59f277/ipp-route-59f277-kserve-9f85bc499-vjxcn"
Jul 29 02:04:05.780329 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:05.780238    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9775586d-f6a9-45aa-9133-d391be890e16-model-cache\") pod \"ipp-route-59f277-kserve-9f85bc499-vjxcn\" (UID: \"9775586d-f6a9-45aa-9133-d391be890e16\") " pod="ai-tenant-e2e-ipp-a-59f277/ipp-route-59f277-kserve-9f85bc499-vjxcn"
Jul 29 02:04:05.780329 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:05.780288    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9775586d-f6a9-45aa-9133-d391be890e16-tmp-dir\") pod \"ipp-route-59f277-kserve-9f85bc499-vjxcn\" (UID: \"9775586d-f6a9-45aa-9133-d391be890e16\") " pod="ai-tenant-e2e-ipp-a-59f277/ipp-route-59f277-kserve-9f85bc499-vjxcn"
Jul 29 02:04:05.780329 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:05.780309    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9775586d-f6a9-45aa-9133-d391be890e16-tls-certs\") pod \"ipp-route-59f277-kserve-9f85bc499-vjxcn\" (UID: \"9775586d-f6a9-45aa-9133-d391be890e16\") " pod="ai-tenant-e2e-ipp-a-59f277/ipp-route-59f277-kserve-9f85bc499-vjxcn"
Jul 29 02:04:05.780585 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:05.780492    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9775586d-f6a9-45aa-9133-d391be890e16-home\") pod \"ipp-route-59f277-kserve-9f85bc499-vjxcn\" (UID: \"9775586d-f6a9-45aa-9133-d391be890e16\") " pod="ai-tenant-e2e-ipp-a-59f277/ipp-route-59f277-kserve-9f85bc499-vjxcn"
Jul 29 02:04:05.780585 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:05.780547    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9775586d-f6a9-45aa-9133-d391be890e16-dshm\") pod \"ipp-route-59f277-kserve-9f85bc499-vjxcn\" (UID: \"9775586d-f6a9-45aa-9133-d391be890e16\") " pod="ai-tenant-e2e-ipp-a-59f277/ipp-route-59f277-kserve-9f85bc499-vjxcn"
Jul 29 02:04:05.780675 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:05.780591    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmzsl\" (UniqueName: \"kubernetes.io/projected/9775586d-f6a9-45aa-9133-d391be890e16-kube-api-access-lmzsl\") pod \"ipp-route-59f277-kserve-9f85bc499-vjxcn\" (UID: \"9775586d-f6a9-45aa-9133-d391be890e16\") " pod="ai-tenant-e2e-ipp-a-59f277/ipp-route-59f277-kserve-9f85bc499-vjxcn"
Jul 29 02:04:05.780769 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:05.780739    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9775586d-f6a9-45aa-9133-d391be890e16-tmp-dir\") pod \"ipp-route-59f277-kserve-9f85bc499-vjxcn\" (UID: \"9775586d-f6a9-45aa-9133-d391be890e16\") " pod="ai-tenant-e2e-ipp-a-59f277/ipp-route-59f277-kserve-9f85bc499-vjxcn"
Jul 29 02:04:05.780833 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:05.780762    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9775586d-f6a9-45aa-9133-d391be890e16-model-cache\") pod \"ipp-route-59f277-kserve-9f85bc499-vjxcn\" (UID: \"9775586d-f6a9-45aa-9133-d391be890e16\") " pod="ai-tenant-e2e-ipp-a-59f277/ipp-route-59f277-kserve-9f85bc499-vjxcn"
Jul 29 02:04:05.780890 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:05.780841    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9775586d-f6a9-45aa-9133-d391be890e16-home\") pod \"ipp-route-59f277-kserve-9f85bc499-vjxcn\" (UID: \"9775586d-f6a9-45aa-9133-d391be890e16\") " pod="ai-tenant-e2e-ipp-a-59f277/ipp-route-59f277-kserve-9f85bc499-vjxcn"
Jul 29 02:04:05.782753 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:05.782724    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9775586d-f6a9-45aa-9133-d391be890e16-dshm\") pod \"ipp-route-59f277-kserve-9f85bc499-vjxcn\" (UID: \"9775586d-f6a9-45aa-9133-d391be890e16\") " pod="ai-tenant-e2e-ipp-a-59f277/ipp-route-59f277-kserve-9f85bc499-vjxcn"
Jul 29 02:04:05.782932 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:05.782909    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9775586d-f6a9-45aa-9133-d391be890e16-tls-certs\") pod \"ipp-route-59f277-kserve-9f85bc499-vjxcn\" (UID: \"9775586d-f6a9-45aa-9133-d391be890e16\") " pod="ai-tenant-e2e-ipp-a-59f277/ipp-route-59f277-kserve-9f85bc499-vjxcn"
Jul 29 02:04:05.789693 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:05.789653    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmzsl\" (UniqueName: \"kubernetes.io/projected/9775586d-f6a9-45aa-9133-d391be890e16-kube-api-access-lmzsl\") pod \"ipp-route-59f277-kserve-9f85bc499-vjxcn\" (UID: \"9775586d-f6a9-45aa-9133-d391be890e16\") " pod="ai-tenant-e2e-ipp-a-59f277/ipp-route-59f277-kserve-9f85bc499-vjxcn"
Jul 29 02:04:05.827649 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:05.827601    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-59f277/ipp-route-59f277-kserve-9f85bc499-vjxcn"
Jul 29 02:04:05.973394 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:05.973368    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-59f277/ipp-route-59f277-kserve-9f85bc499-vjxcn"]
Jul 29 02:04:05.979023 ip-10-0-142-238 kubenswrapper[2580]: W0729 02:04:05.978985    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9775586d_f6a9_45aa_9133_d391be890e16.slice/crio-00ea6813d16b48a97184b4b8ec270d340e8a71cb86e9001f7cfb10de6d488c5c WatchSource:0}: Error finding container 00ea6813d16b48a97184b4b8ec270d340e8a71cb86e9001f7cfb10de6d488c5c: Status 404 returned error can't find the container with id 00ea6813d16b48a97184b4b8ec270d340e8a71cb86e9001f7cfb10de6d488c5c
Jul 29 02:04:06.600891 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:06.600852    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-59f277/ipp-route-59f277-kserve-9f85bc499-vjxcn" event={"ID":"9775586d-f6a9-45aa-9133-d391be890e16","Type":"ContainerStarted","Data":"5c54f34503306c12fefd6f1ed9f8293cd8183db7deddd9d3f4759bab7756d8fe"}
Jul 29 02:04:06.600891 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:06.600905    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-59f277/ipp-route-59f277-kserve-9f85bc499-vjxcn" event={"ID":"9775586d-f6a9-45aa-9133-d391be890e16","Type":"ContainerStarted","Data":"00ea6813d16b48a97184b4b8ec270d340e8a71cb86e9001f7cfb10de6d488c5c"}
Jul 29 02:04:06.618436 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:06.618374    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-59f277/ipp-route-59f277-kserve-9f85bc499-vjxcn" podStartSLOduration=1.6183566489999999 podStartE2EDuration="1.618356649s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:04:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:04:06.616188431 +0000 UTC m=+3096.928581142" watchObservedRunningTime="2026-07-29 02:04:06.618356649 +0000 UTC m=+3096.930749405"
Jul 29 02:04:15.828358 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:15.828302    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-59f277/ipp-route-59f277-kserve-9f85bc499-vjxcn"
Jul 29 02:04:15.828358 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:15.828372    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-59f277/ipp-route-59f277-kserve-9f85bc499-vjxcn"
Jul 29 02:04:15.841143 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:15.841112    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-59f277/ipp-route-59f277-kserve-9f85bc499-vjxcn"
Jul 29 02:04:16.661837 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:16.661799    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-59f277/ipp-route-59f277-kserve-9f85bc499-vjxcn"
Jul 29 02:04:49.603198 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:49.603144    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:04:53.159514 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:53.159387    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-59f277-b6886fbc4-7cj98_d191f5bc-af68-477e-8495-6eef7c999a50/payload-processing/0.log"
Jul 29 02:04:53.274391 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:53.274354    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-dlvpn_6784b90f-c19a-4022-800b-825ecca592f8/payload-processing/0.log"
Jul 29 02:04:53.412172 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:53.412096    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-7f1f73-65497477d8-44rps_5db19143-9af6-4824-a06f-190036e1ff0a/payload-processing/0.log"
Jul 29 02:04:53.679676 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:53.679577    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:04:53.991305 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:53.991184    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:04:54.200623 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:54.200575    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:04:57.445211 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:57.445164    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:04:57.539778 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:57.539710    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:04:58.263379 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:58.263338    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:04:58.314710 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:58.314674    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-382dad-6f4c48c9c6-vs59b"]
Jul 29 02:04:58.318561 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:58.318537    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-382dad-6f4c48c9c6-vs59b"
Jul 29 02:04:58.321415 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:58.321393    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-382dad\""
Jul 29 02:04:58.321539 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:58.321464    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-382dad-dockercfg-x8j2x\""
Jul 29 02:04:58.328208 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:58.328183    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-382dad-6f4c48c9c6-vs59b"]
Jul 29 02:04:58.383115 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:58.383075    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl7bh\" (UniqueName: \"kubernetes.io/projected/2fcfd967-20e0-4820-accd-07918347dabf-kube-api-access-jl7bh\") pod \"payload-processing-e2e-ipp-cleanup-382dad-6f4c48c9c6-vs59b\" (UID: \"2fcfd967-20e0-4820-accd-07918347dabf\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-382dad-6f4c48c9c6-vs59b"
Jul 29 02:04:58.383290 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:58.383127    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2fcfd967-20e0-4820-accd-07918347dabf-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-382dad-6f4c48c9c6-vs59b\" (UID: \"2fcfd967-20e0-4820-accd-07918347dabf\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-382dad-6f4c48c9c6-vs59b"
Jul 29 02:04:58.389076 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:58.389036    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:04:58.484200 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:58.484161    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl7bh\" (UniqueName: \"kubernetes.io/projected/2fcfd967-20e0-4820-accd-07918347dabf-kube-api-access-jl7bh\") pod \"payload-processing-e2e-ipp-cleanup-382dad-6f4c48c9c6-vs59b\" (UID: \"2fcfd967-20e0-4820-accd-07918347dabf\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-382dad-6f4c48c9c6-vs59b"
Jul 29 02:04:58.484627 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:58.484232    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2fcfd967-20e0-4820-accd-07918347dabf-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-382dad-6f4c48c9c6-vs59b\" (UID: \"2fcfd967-20e0-4820-accd-07918347dabf\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-382dad-6f4c48c9c6-vs59b"
Jul 29 02:04:58.484978 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:58.484932    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2fcfd967-20e0-4820-accd-07918347dabf-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-382dad-6f4c48c9c6-vs59b\" (UID: \"2fcfd967-20e0-4820-accd-07918347dabf\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-382dad-6f4c48c9c6-vs59b"
Jul 29 02:04:58.493458 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:58.493438    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl7bh\" (UniqueName: \"kubernetes.io/projected/2fcfd967-20e0-4820-accd-07918347dabf-kube-api-access-jl7bh\") pod \"payload-processing-e2e-ipp-cleanup-382dad-6f4c48c9c6-vs59b\" (UID: \"2fcfd967-20e0-4820-accd-07918347dabf\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-382dad-6f4c48c9c6-vs59b"
Jul 29 02:04:58.630702 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:58.630673    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-382dad-6f4c48c9c6-vs59b"
Jul 29 02:04:58.767793 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:58.767767    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-382dad-6f4c48c9c6-vs59b"]
Jul 29 02:04:58.769774 ip-10-0-142-238 kubenswrapper[2580]: W0729 02:04:58.769745    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fcfd967_20e0_4820_accd_07918347dabf.slice/crio-6aff7816cd27edb8d2402398042500baecb0a495e25146a27861cbc40d25f87f WatchSource:0}: Error finding container 6aff7816cd27edb8d2402398042500baecb0a495e25146a27861cbc40d25f87f: Status 404 returned error can't find the container with id 6aff7816cd27edb8d2402398042500baecb0a495e25146a27861cbc40d25f87f
Jul 29 02:04:58.855527 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:58.855491    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-382dad-6f4c48c9c6-vs59b" event={"ID":"2fcfd967-20e0-4820-accd-07918347dabf","Type":"ContainerStarted","Data":"5b864b09a567d32fdf879b0b44d1031c83152c454e0dac368069ad9a67605c43"}
Jul 29 02:04:58.855713 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:58.855553    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-382dad-6f4c48c9c6-vs59b"
Jul 29 02:04:58.855713 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:58.855570    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-382dad-6f4c48c9c6-vs59b" event={"ID":"2fcfd967-20e0-4820-accd-07918347dabf","Type":"ContainerStarted","Data":"6aff7816cd27edb8d2402398042500baecb0a495e25146a27861cbc40d25f87f"}
Jul 29 02:04:58.874830 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:04:58.874778    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-382dad-6f4c48c9c6-vs59b" podStartSLOduration=0.87476131 podStartE2EDuration="874.76131ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:04:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:04:58.871960732 +0000 UTC m=+3149.184353431" watchObservedRunningTime="2026-07-29 02:04:58.87476131 +0000 UTC m=+3149.187154017"
Jul 29 02:05:09.863711 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:09.863670    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-382dad-6f4c48c9c6-vs59b"
Jul 29 02:05:22.448123 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:22.448083    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:05:28.263386 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:28.263348    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:05:28.304652 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:28.304617    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-382dad-6f4c48c9c6-vs59b"]
Jul 29 02:05:28.304901 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:28.304874    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-382dad-6f4c48c9c6-vs59b" podUID="2fcfd967-20e0-4820-accd-07918347dabf" containerName="payload-processing" containerID="cri-o://5b864b09a567d32fdf879b0b44d1031c83152c454e0dac368069ad9a67605c43" gracePeriod=30
Jul 29 02:05:28.341270 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:28.341234    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:05:28.414160 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:28.414130    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:05:28.485350 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:28.485313    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:05:28.548845 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:28.548819    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-382dad-6f4c48c9c6-vs59b"
Jul 29 02:05:28.683663 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:28.683630    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jl7bh\" (UniqueName: \"kubernetes.io/projected/2fcfd967-20e0-4820-accd-07918347dabf-kube-api-access-jl7bh\") pod \"2fcfd967-20e0-4820-accd-07918347dabf\" (UID: \"2fcfd967-20e0-4820-accd-07918347dabf\") "
Jul 29 02:05:28.683846 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:28.683725    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2fcfd967-20e0-4820-accd-07918347dabf-plugins-config-volume\") pod \"2fcfd967-20e0-4820-accd-07918347dabf\" (UID: \"2fcfd967-20e0-4820-accd-07918347dabf\") "
Jul 29 02:05:28.684124 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:28.684100    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fcfd967-20e0-4820-accd-07918347dabf-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2fcfd967-20e0-4820-accd-07918347dabf" (UID: "2fcfd967-20e0-4820-accd-07918347dabf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 02:05:28.685761 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:28.685741    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fcfd967-20e0-4820-accd-07918347dabf-kube-api-access-jl7bh" (OuterVolumeSpecName: "kube-api-access-jl7bh") pod "2fcfd967-20e0-4820-accd-07918347dabf" (UID: "2fcfd967-20e0-4820-accd-07918347dabf"). InnerVolumeSpecName "kube-api-access-jl7bh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:05:28.785224 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:28.785139    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2fcfd967-20e0-4820-accd-07918347dabf-plugins-config-volume\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 02:05:28.785224 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:28.785173    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jl7bh\" (UniqueName: \"kubernetes.io/projected/2fcfd967-20e0-4820-accd-07918347dabf-kube-api-access-jl7bh\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 02:05:28.862311 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:28.862280    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:05:29.017074 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:29.017037    2580 generic.go:356] "Generic (PLEG): container finished" podID="2fcfd967-20e0-4820-accd-07918347dabf" containerID="5b864b09a567d32fdf879b0b44d1031c83152c454e0dac368069ad9a67605c43" exitCode=0
Jul 29 02:05:29.017242 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:29.017083    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-382dad-6f4c48c9c6-vs59b"
Jul 29 02:05:29.017242 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:29.017082    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-382dad-6f4c48c9c6-vs59b" event={"ID":"2fcfd967-20e0-4820-accd-07918347dabf","Type":"ContainerDied","Data":"5b864b09a567d32fdf879b0b44d1031c83152c454e0dac368069ad9a67605c43"}
Jul 29 02:05:29.017242 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:29.017212    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-382dad-6f4c48c9c6-vs59b" event={"ID":"2fcfd967-20e0-4820-accd-07918347dabf","Type":"ContainerDied","Data":"6aff7816cd27edb8d2402398042500baecb0a495e25146a27861cbc40d25f87f"}
Jul 29 02:05:29.017242 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:29.017239    2580 scope.go:117] "RemoveContainer" containerID="5b864b09a567d32fdf879b0b44d1031c83152c454e0dac368069ad9a67605c43"
Jul 29 02:05:29.026090 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:29.026067    2580 scope.go:117] "RemoveContainer" containerID="5b864b09a567d32fdf879b0b44d1031c83152c454e0dac368069ad9a67605c43"
Jul 29 02:05:29.026338 ip-10-0-142-238 kubenswrapper[2580]: E0729 02:05:29.026317    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b864b09a567d32fdf879b0b44d1031c83152c454e0dac368069ad9a67605c43\": container with ID starting with 5b864b09a567d32fdf879b0b44d1031c83152c454e0dac368069ad9a67605c43 not found: ID does not exist" containerID="5b864b09a567d32fdf879b0b44d1031c83152c454e0dac368069ad9a67605c43"
Jul 29 02:05:29.026442 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:29.026346    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b864b09a567d32fdf879b0b44d1031c83152c454e0dac368069ad9a67605c43"} err="failed to get container status \"5b864b09a567d32fdf879b0b44d1031c83152c454e0dac368069ad9a67605c43\": rpc error: code = NotFound desc = could not find container \"5b864b09a567d32fdf879b0b44d1031c83152c454e0dac368069ad9a67605c43\": container with ID starting with 5b864b09a567d32fdf879b0b44d1031c83152c454e0dac368069ad9a67605c43 not found: ID does not exist"
Jul 29 02:05:29.040631 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:29.040577    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-382dad-6f4c48c9c6-vs59b"]
Jul 29 02:05:29.046352 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:29.046331    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-382dad-6f4c48c9c6-vs59b"]
Jul 29 02:05:30.170693 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:30.170655    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fcfd967-20e0-4820-accd-07918347dabf" path="/var/lib/kubelet/pods/2fcfd967-20e0-4820-accd-07918347dabf/volumes"
Jul 29 02:05:34.884354 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:34.884305    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:05:34.987148 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:34.987114    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:05:35.206408 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:35.206278    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:05:35.423107 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:35.423064    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:05:54.602905 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:54.602866    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-59f277-b6886fbc4-7cj98"]
Jul 29 02:05:54.603425 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:54.603094    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-59f277-b6886fbc4-7cj98" podUID="d191f5bc-af68-477e-8495-6eef7c999a50" containerName="payload-processing" containerID="cri-o://1d40f9d0223e0097ed36cf24c3fcac1067d3d3f0e633152fe12f8b6102c030f5" gracePeriod=30
Jul 29 02:05:54.612999 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:54.612740    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-59f277-648c7bd95b-p64wx"]
Jul 29 02:05:54.613128 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:54.613026    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-59f277-648c7bd95b-p64wx" podUID="a783f4fa-3ed2-43bf-b3e9-470dad50168b" containerName="payload-pre-processing" containerID="cri-o://fce3768ec89d287c6807553baf72c3892780802b98cdbb4ab344888f8993cf43" gracePeriod=30
Jul 29 02:05:54.655538 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:54.655503    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:05:54.752717 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:54.752681    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:05:54.843284 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:54.843246    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:05:54.902147 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:54.902118    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-59f277-b6886fbc4-7cj98"
Jul 29 02:05:54.905072 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:54.905052    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-59f277-648c7bd95b-p64wx"
Jul 29 02:05:55.041017 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:55.040980    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hpgvb\" (UniqueName: \"kubernetes.io/projected/a783f4fa-3ed2-43bf-b3e9-470dad50168b-kube-api-access-hpgvb\") pod \"a783f4fa-3ed2-43bf-b3e9-470dad50168b\" (UID: \"a783f4fa-3ed2-43bf-b3e9-470dad50168b\") "
Jul 29 02:05:55.041017 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:55.041016    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a783f4fa-3ed2-43bf-b3e9-470dad50168b-plugins-config-volume\") pod \"a783f4fa-3ed2-43bf-b3e9-470dad50168b\" (UID: \"a783f4fa-3ed2-43bf-b3e9-470dad50168b\") "
Jul 29 02:05:55.041261 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:55.041068    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d191f5bc-af68-477e-8495-6eef7c999a50-plugins-config-volume\") pod \"d191f5bc-af68-477e-8495-6eef7c999a50\" (UID: \"d191f5bc-af68-477e-8495-6eef7c999a50\") "
Jul 29 02:05:55.041261 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:55.041113    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bpcrj\" (UniqueName: \"kubernetes.io/projected/d191f5bc-af68-477e-8495-6eef7c999a50-kube-api-access-bpcrj\") pod \"d191f5bc-af68-477e-8495-6eef7c999a50\" (UID: \"d191f5bc-af68-477e-8495-6eef7c999a50\") "
Jul 29 02:05:55.041510 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:55.041483    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d191f5bc-af68-477e-8495-6eef7c999a50-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d191f5bc-af68-477e-8495-6eef7c999a50" (UID: "d191f5bc-af68-477e-8495-6eef7c999a50"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 02:05:55.041596 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:55.041515    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a783f4fa-3ed2-43bf-b3e9-470dad50168b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a783f4fa-3ed2-43bf-b3e9-470dad50168b" (UID: "a783f4fa-3ed2-43bf-b3e9-470dad50168b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 02:05:55.043177 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:55.043148    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d191f5bc-af68-477e-8495-6eef7c999a50-kube-api-access-bpcrj" (OuterVolumeSpecName: "kube-api-access-bpcrj") pod "d191f5bc-af68-477e-8495-6eef7c999a50" (UID: "d191f5bc-af68-477e-8495-6eef7c999a50"). InnerVolumeSpecName "kube-api-access-bpcrj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:05:55.043279 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:55.043202    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a783f4fa-3ed2-43bf-b3e9-470dad50168b-kube-api-access-hpgvb" (OuterVolumeSpecName: "kube-api-access-hpgvb") pod "a783f4fa-3ed2-43bf-b3e9-470dad50168b" (UID: "a783f4fa-3ed2-43bf-b3e9-470dad50168b"). InnerVolumeSpecName "kube-api-access-hpgvb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:05:55.142282 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:55.142193    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d191f5bc-af68-477e-8495-6eef7c999a50-plugins-config-volume\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 02:05:55.142282 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:55.142223    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bpcrj\" (UniqueName: \"kubernetes.io/projected/d191f5bc-af68-477e-8495-6eef7c999a50-kube-api-access-bpcrj\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 02:05:55.142282 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:55.142232    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpgvb\" (UniqueName: \"kubernetes.io/projected/a783f4fa-3ed2-43bf-b3e9-470dad50168b-kube-api-access-hpgvb\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 02:05:55.142282 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:55.142242    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a783f4fa-3ed2-43bf-b3e9-470dad50168b-plugins-config-volume\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 02:05:55.147346 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:55.147313    2580 generic.go:356] "Generic (PLEG): container finished" podID="a783f4fa-3ed2-43bf-b3e9-470dad50168b" containerID="fce3768ec89d287c6807553baf72c3892780802b98cdbb4ab344888f8993cf43" exitCode=0
Jul 29 02:05:55.147511 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:55.147362    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-59f277-648c7bd95b-p64wx"
Jul 29 02:05:55.147511 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:55.147405    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-59f277-648c7bd95b-p64wx" event={"ID":"a783f4fa-3ed2-43bf-b3e9-470dad50168b","Type":"ContainerDied","Data":"fce3768ec89d287c6807553baf72c3892780802b98cdbb4ab344888f8993cf43"}
Jul 29 02:05:55.147606 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:55.147515    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-59f277-648c7bd95b-p64wx" event={"ID":"a783f4fa-3ed2-43bf-b3e9-470dad50168b","Type":"ContainerDied","Data":"4fa97e2c1125ba3cbcbddbf34144c5e9509b4e2dd84f2647ca34ab9795901e80"}
Jul 29 02:05:55.147606 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:55.147553    2580 scope.go:117] "RemoveContainer" containerID="fce3768ec89d287c6807553baf72c3892780802b98cdbb4ab344888f8993cf43"
Jul 29 02:05:55.148862 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:55.148835    2580 generic.go:356] "Generic (PLEG): container finished" podID="d191f5bc-af68-477e-8495-6eef7c999a50" containerID="1d40f9d0223e0097ed36cf24c3fcac1067d3d3f0e633152fe12f8b6102c030f5" exitCode=0
Jul 29 02:05:55.149002 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:55.148875    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-59f277-b6886fbc4-7cj98" event={"ID":"d191f5bc-af68-477e-8495-6eef7c999a50","Type":"ContainerDied","Data":"1d40f9d0223e0097ed36cf24c3fcac1067d3d3f0e633152fe12f8b6102c030f5"}
Jul 29 02:05:55.149002 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:55.148971    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-59f277-b6886fbc4-7cj98" event={"ID":"d191f5bc-af68-477e-8495-6eef7c999a50","Type":"ContainerDied","Data":"52378d582677de37e2733a292ca7253d0cf6e01001452d7ccd56aca9785f10ce"}
Jul 29 02:05:55.149002 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:55.148899    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-59f277-b6886fbc4-7cj98"
Jul 29 02:05:55.157112 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:55.157094    2580 scope.go:117] "RemoveContainer" containerID="fce3768ec89d287c6807553baf72c3892780802b98cdbb4ab344888f8993cf43"
Jul 29 02:05:55.157368 ip-10-0-142-238 kubenswrapper[2580]: E0729 02:05:55.157352    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fce3768ec89d287c6807553baf72c3892780802b98cdbb4ab344888f8993cf43\": container with ID starting with fce3768ec89d287c6807553baf72c3892780802b98cdbb4ab344888f8993cf43 not found: ID does not exist" containerID="fce3768ec89d287c6807553baf72c3892780802b98cdbb4ab344888f8993cf43"
Jul 29 02:05:55.157423 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:55.157376    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fce3768ec89d287c6807553baf72c3892780802b98cdbb4ab344888f8993cf43"} err="failed to get container status \"fce3768ec89d287c6807553baf72c3892780802b98cdbb4ab344888f8993cf43\": rpc error: code = NotFound desc = could not find container \"fce3768ec89d287c6807553baf72c3892780802b98cdbb4ab344888f8993cf43\": container with ID starting with fce3768ec89d287c6807553baf72c3892780802b98cdbb4ab344888f8993cf43 not found: ID does not exist"
Jul 29 02:05:55.157423 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:55.157391    2580 scope.go:117] "RemoveContainer" containerID="1d40f9d0223e0097ed36cf24c3fcac1067d3d3f0e633152fe12f8b6102c030f5"
Jul 29 02:05:55.165829 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:55.165809    2580 scope.go:117] "RemoveContainer" containerID="1d40f9d0223e0097ed36cf24c3fcac1067d3d3f0e633152fe12f8b6102c030f5"
Jul 29 02:05:55.166101 ip-10-0-142-238 kubenswrapper[2580]: E0729 02:05:55.166082    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d40f9d0223e0097ed36cf24c3fcac1067d3d3f0e633152fe12f8b6102c030f5\": container with ID starting with 1d40f9d0223e0097ed36cf24c3fcac1067d3d3f0e633152fe12f8b6102c030f5 not found: ID does not exist" containerID="1d40f9d0223e0097ed36cf24c3fcac1067d3d3f0e633152fe12f8b6102c030f5"
Jul 29 02:05:55.166155 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:55.166109    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d40f9d0223e0097ed36cf24c3fcac1067d3d3f0e633152fe12f8b6102c030f5"} err="failed to get container status \"1d40f9d0223e0097ed36cf24c3fcac1067d3d3f0e633152fe12f8b6102c030f5\": rpc error: code = NotFound desc = could not find container \"1d40f9d0223e0097ed36cf24c3fcac1067d3d3f0e633152fe12f8b6102c030f5\": container with ID starting with 1d40f9d0223e0097ed36cf24c3fcac1067d3d3f0e633152fe12f8b6102c030f5 not found: ID does not exist"
Jul 29 02:05:55.172591 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:55.172563    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:05:55.173632 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:55.173613    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-59f277-b6886fbc4-7cj98"]
Jul 29 02:05:55.179569 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:55.179548    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-59f277-b6886fbc4-7cj98"]
Jul 29 02:05:55.189921 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:55.189895    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-59f277-648c7bd95b-p64wx"]
Jul 29 02:05:55.193850 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:55.193828    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-59f277-648c7bd95b-p64wx"]
Jul 29 02:05:56.170884 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:56.170769    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a783f4fa-3ed2-43bf-b3e9-470dad50168b" path="/var/lib/kubelet/pods/a783f4fa-3ed2-43bf-b3e9-470dad50168b/volumes"
Jul 29 02:05:56.171291 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:05:56.171183    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d191f5bc-af68-477e-8495-6eef7c999a50" path="/var/lib/kubelet/pods/d191f5bc-af68-477e-8495-6eef7c999a50/volumes"
Jul 29 02:06:00.146889 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:06:00.146852    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-59f277/ipp-route-59f277-kserve-9f85bc499-vjxcn"]
Jul 29 02:06:00.365382 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:06:00.365338    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:06:15.166812 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:06:15.166772    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-59f277/ipp-route-59f277-kserve-9f85bc499-vjxcn" podUID="9775586d-f6a9-45aa-9133-d391be890e16" containerName="main" containerID="cri-o://5c54f34503306c12fefd6f1ed9f8293cd8183db7deddd9d3f4759bab7756d8fe" gracePeriod=45
Jul 29 02:06:15.422145 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:06:15.422088    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-59f277/ipp-route-59f277-kserve-9f85bc499-vjxcn"
Jul 29 02:06:15.430881 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:06:15.430860    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmzsl\" (UniqueName: \"kubernetes.io/projected/9775586d-f6a9-45aa-9133-d391be890e16-kube-api-access-lmzsl\") pod \"9775586d-f6a9-45aa-9133-d391be890e16\" (UID: \"9775586d-f6a9-45aa-9133-d391be890e16\") "
Jul 29 02:06:15.431005 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:06:15.430896    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9775586d-f6a9-45aa-9133-d391be890e16-home\") pod \"9775586d-f6a9-45aa-9133-d391be890e16\" (UID: \"9775586d-f6a9-45aa-9133-d391be890e16\") "
Jul 29 02:06:15.431005 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:06:15.430932    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9775586d-f6a9-45aa-9133-d391be890e16-tmp-dir\") pod \"9775586d-f6a9-45aa-9133-d391be890e16\" (UID: \"9775586d-f6a9-45aa-9133-d391be890e16\") "
Jul 29 02:06:15.431108 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:06:15.431015    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9775586d-f6a9-45aa-9133-d391be890e16-dshm\") pod \"9775586d-f6a9-45aa-9133-d391be890e16\" (UID: \"9775586d-f6a9-45aa-9133-d391be890e16\") "
Jul 29 02:06:15.431108 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:06:15.431047    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9775586d-f6a9-45aa-9133-d391be890e16-model-cache\") pod \"9775586d-f6a9-45aa-9133-d391be890e16\" (UID: \"9775586d-f6a9-45aa-9133-d391be890e16\") "
Jul 29 02:06:15.431108 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:06:15.431091    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9775586d-f6a9-45aa-9133-d391be890e16-tls-certs\") pod \"9775586d-f6a9-45aa-9133-d391be890e16\" (UID: \"9775586d-f6a9-45aa-9133-d391be890e16\") "
Jul 29 02:06:15.431264 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:06:15.431171    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9775586d-f6a9-45aa-9133-d391be890e16-home" (OuterVolumeSpecName: "home") pod "9775586d-f6a9-45aa-9133-d391be890e16" (UID: "9775586d-f6a9-45aa-9133-d391be890e16"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:06:15.431264 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:06:15.431225    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9775586d-f6a9-45aa-9133-d391be890e16-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9775586d-f6a9-45aa-9133-d391be890e16" (UID: "9775586d-f6a9-45aa-9133-d391be890e16"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:06:15.431431 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:06:15.431406    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9775586d-f6a9-45aa-9133-d391be890e16-model-cache" (OuterVolumeSpecName: "model-cache") pod "9775586d-f6a9-45aa-9133-d391be890e16" (UID: "9775586d-f6a9-45aa-9133-d391be890e16"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:06:15.431559 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:06:15.431539    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9775586d-f6a9-45aa-9133-d391be890e16-home\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 02:06:15.431623 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:06:15.431561    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9775586d-f6a9-45aa-9133-d391be890e16-tmp-dir\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 02:06:15.431623 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:06:15.431572    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9775586d-f6a9-45aa-9133-d391be890e16-model-cache\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 02:06:15.433048 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:06:15.433021    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9775586d-f6a9-45aa-9133-d391be890e16-dshm" (OuterVolumeSpecName: "dshm") pod "9775586d-f6a9-45aa-9133-d391be890e16" (UID: "9775586d-f6a9-45aa-9133-d391be890e16"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:06:15.433162 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:06:15.433136    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9775586d-f6a9-45aa-9133-d391be890e16-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9775586d-f6a9-45aa-9133-d391be890e16" (UID: "9775586d-f6a9-45aa-9133-d391be890e16"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 02:06:15.433162 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:06:15.433154    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9775586d-f6a9-45aa-9133-d391be890e16-kube-api-access-lmzsl" (OuterVolumeSpecName: "kube-api-access-lmzsl") pod "9775586d-f6a9-45aa-9133-d391be890e16" (UID: "9775586d-f6a9-45aa-9133-d391be890e16"). InnerVolumeSpecName "kube-api-access-lmzsl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:06:15.532599 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:06:15.532567    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9775586d-f6a9-45aa-9133-d391be890e16-dshm\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 02:06:15.532599 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:06:15.532594    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9775586d-f6a9-45aa-9133-d391be890e16-tls-certs\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 02:06:15.532599 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:06:15.532606    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmzsl\" (UniqueName: \"kubernetes.io/projected/9775586d-f6a9-45aa-9133-d391be890e16-kube-api-access-lmzsl\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 02:06:16.253799 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:06:16.253765    2580 generic.go:356] "Generic (PLEG): container finished" podID="9775586d-f6a9-45aa-9133-d391be890e16" containerID="5c54f34503306c12fefd6f1ed9f8293cd8183db7deddd9d3f4759bab7756d8fe" exitCode=0
Jul 29 02:06:16.254196 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:06:16.253812    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-59f277/ipp-route-59f277-kserve-9f85bc499-vjxcn"
Jul 29 02:06:16.254196 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:06:16.253851    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-59f277/ipp-route-59f277-kserve-9f85bc499-vjxcn" event={"ID":"9775586d-f6a9-45aa-9133-d391be890e16","Type":"ContainerDied","Data":"5c54f34503306c12fefd6f1ed9f8293cd8183db7deddd9d3f4759bab7756d8fe"}
Jul 29 02:06:16.254196 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:06:16.253897    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-59f277/ipp-route-59f277-kserve-9f85bc499-vjxcn" event={"ID":"9775586d-f6a9-45aa-9133-d391be890e16","Type":"ContainerDied","Data":"00ea6813d16b48a97184b4b8ec270d340e8a71cb86e9001f7cfb10de6d488c5c"}
Jul 29 02:06:16.254196 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:06:16.253919    2580 scope.go:117] "RemoveContainer" containerID="5c54f34503306c12fefd6f1ed9f8293cd8183db7deddd9d3f4759bab7756d8fe"
Jul 29 02:06:16.262203 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:06:16.262186    2580 scope.go:117] "RemoveContainer" containerID="5c54f34503306c12fefd6f1ed9f8293cd8183db7deddd9d3f4759bab7756d8fe"
Jul 29 02:06:16.262459 ip-10-0-142-238 kubenswrapper[2580]: E0729 02:06:16.262432    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c54f34503306c12fefd6f1ed9f8293cd8183db7deddd9d3f4759bab7756d8fe\": container with ID starting with 5c54f34503306c12fefd6f1ed9f8293cd8183db7deddd9d3f4759bab7756d8fe not found: ID does not exist" containerID="5c54f34503306c12fefd6f1ed9f8293cd8183db7deddd9d3f4759bab7756d8fe"
Jul 29 02:06:16.262513 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:06:16.262468    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c54f34503306c12fefd6f1ed9f8293cd8183db7deddd9d3f4759bab7756d8fe"} err="failed to get container status \"5c54f34503306c12fefd6f1ed9f8293cd8183db7deddd9d3f4759bab7756d8fe\": rpc error: code = NotFound desc = could not find container \"5c54f34503306c12fefd6f1ed9f8293cd8183db7deddd9d3f4759bab7756d8fe\": container with ID starting with 5c54f34503306c12fefd6f1ed9f8293cd8183db7deddd9d3f4759bab7756d8fe not found: ID does not exist"
Jul 29 02:06:16.271999 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:06:16.271963    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-59f277/ipp-route-59f277-kserve-9f85bc499-vjxcn"]
Jul 29 02:06:16.273753 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:06:16.273733    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-59f277/ipp-route-59f277-kserve-9f85bc499-vjxcn"]
Jul 29 02:06:18.171121 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:06:18.171082    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9775586d-f6a9-45aa-9133-d391be890e16" path="/var/lib/kubelet/pods/9775586d-f6a9-45aa-9133-d391be890e16/volumes"
Jul 29 02:06:36.393341 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:06:36.393305    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:06:37.586766 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:06:37.586735    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:06:45.194245 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:06:45.194210    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:06:49.199559 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:06:49.199521    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:06:49.297462 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:06:49.297427    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:06:49.461488 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:06:49.461400    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:06:49.672920 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:06:49.672887    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:07:00.485380 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:00.485332    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:07:00.512857 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:00.512824    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-7f1f73-65497477d8-44rps"]
Jul 29 02:07:00.513101 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:00.513071    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-7f1f73-65497477d8-44rps" podUID="5db19143-9af6-4824-a06f-190036e1ff0a" containerName="payload-processing" containerID="cri-o://1d1922a7716010b3f456f3ffd7e22dbe9089481c6208cf486a54608204a551d5" gracePeriod=30
Jul 29 02:07:00.522022 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:00.521992    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-7f1f73-7bf98f676d-68z8b"]
Jul 29 02:07:00.522248 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:00.522202    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-7f1f73-7bf98f676d-68z8b" podUID="3c57d23a-240c-4391-a201-0905e6b54ea6" containerName="payload-pre-processing" containerID="cri-o://2bda8351e8a9a6e49330b9716deb061d018b029efdadf1b90e667b2bea2956cd" gracePeriod=30
Jul 29 02:07:00.565512 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:00.565474    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:07:00.636432 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:00.636395    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:07:00.714837 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:00.714796    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:07:00.810475 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:00.810446    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-7f1f73-65497477d8-44rps"
Jul 29 02:07:00.829645 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:00.829616    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-7f1f73-7bf98f676d-68z8b"
Jul 29 02:07:00.867411 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:00.867380    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5db19143-9af6-4824-a06f-190036e1ff0a-plugins-config-volume\") pod \"5db19143-9af6-4824-a06f-190036e1ff0a\" (UID: \"5db19143-9af6-4824-a06f-190036e1ff0a\") "
Jul 29 02:07:00.867622 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:00.867430    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3c57d23a-240c-4391-a201-0905e6b54ea6-plugins-config-volume\") pod \"3c57d23a-240c-4391-a201-0905e6b54ea6\" (UID: \"3c57d23a-240c-4391-a201-0905e6b54ea6\") "
Jul 29 02:07:00.867622 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:00.867500    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rmf2\" (UniqueName: \"kubernetes.io/projected/5db19143-9af6-4824-a06f-190036e1ff0a-kube-api-access-9rmf2\") pod \"5db19143-9af6-4824-a06f-190036e1ff0a\" (UID: \"5db19143-9af6-4824-a06f-190036e1ff0a\") "
Jul 29 02:07:00.867622 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:00.867536    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6s9l\" (UniqueName: \"kubernetes.io/projected/3c57d23a-240c-4391-a201-0905e6b54ea6-kube-api-access-f6s9l\") pod \"3c57d23a-240c-4391-a201-0905e6b54ea6\" (UID: \"3c57d23a-240c-4391-a201-0905e6b54ea6\") "
Jul 29 02:07:00.867869 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:00.867840    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5db19143-9af6-4824-a06f-190036e1ff0a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5db19143-9af6-4824-a06f-190036e1ff0a" (UID: "5db19143-9af6-4824-a06f-190036e1ff0a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 02:07:00.867926 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:00.867904    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c57d23a-240c-4391-a201-0905e6b54ea6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3c57d23a-240c-4391-a201-0905e6b54ea6" (UID: "3c57d23a-240c-4391-a201-0905e6b54ea6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 02:07:00.869809 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:00.869786    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5db19143-9af6-4824-a06f-190036e1ff0a-kube-api-access-9rmf2" (OuterVolumeSpecName: "kube-api-access-9rmf2") pod "5db19143-9af6-4824-a06f-190036e1ff0a" (UID: "5db19143-9af6-4824-a06f-190036e1ff0a"). InnerVolumeSpecName "kube-api-access-9rmf2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:07:00.869896 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:00.869816    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c57d23a-240c-4391-a201-0905e6b54ea6-kube-api-access-f6s9l" (OuterVolumeSpecName: "kube-api-access-f6s9l") pod "3c57d23a-240c-4391-a201-0905e6b54ea6" (UID: "3c57d23a-240c-4391-a201-0905e6b54ea6"). InnerVolumeSpecName "kube-api-access-f6s9l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:07:00.968635 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:00.968593    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5db19143-9af6-4824-a06f-190036e1ff0a-plugins-config-volume\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 02:07:00.968635 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:00.968633    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3c57d23a-240c-4391-a201-0905e6b54ea6-plugins-config-volume\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 02:07:00.968635 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:00.968643    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rmf2\" (UniqueName: \"kubernetes.io/projected/5db19143-9af6-4824-a06f-190036e1ff0a-kube-api-access-9rmf2\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 02:07:00.968877 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:00.968651    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6s9l\" (UniqueName: \"kubernetes.io/projected/3c57d23a-240c-4391-a201-0905e6b54ea6-kube-api-access-f6s9l\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 02:07:01.041483 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:01.041392    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:07:01.472359 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:01.472324    2580 generic.go:356] "Generic (PLEG): container finished" podID="3c57d23a-240c-4391-a201-0905e6b54ea6" containerID="2bda8351e8a9a6e49330b9716deb061d018b029efdadf1b90e667b2bea2956cd" exitCode=0
Jul 29 02:07:01.472582 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:01.472371    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-7f1f73-7bf98f676d-68z8b"
Jul 29 02:07:01.472582 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:01.472416    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-7f1f73-7bf98f676d-68z8b" event={"ID":"3c57d23a-240c-4391-a201-0905e6b54ea6","Type":"ContainerDied","Data":"2bda8351e8a9a6e49330b9716deb061d018b029efdadf1b90e667b2bea2956cd"}
Jul 29 02:07:01.472582 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:01.472480    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-7f1f73-7bf98f676d-68z8b" event={"ID":"3c57d23a-240c-4391-a201-0905e6b54ea6","Type":"ContainerDied","Data":"593b36a0709ff692483119a7c3ec170ecf3307cbe83528079238f3c273dfc8ac"}
Jul 29 02:07:01.472582 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:01.472514    2580 scope.go:117] "RemoveContainer" containerID="2bda8351e8a9a6e49330b9716deb061d018b029efdadf1b90e667b2bea2956cd"
Jul 29 02:07:01.473941 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:01.473917    2580 generic.go:356] "Generic (PLEG): container finished" podID="5db19143-9af6-4824-a06f-190036e1ff0a" containerID="1d1922a7716010b3f456f3ffd7e22dbe9089481c6208cf486a54608204a551d5" exitCode=0
Jul 29 02:07:01.474079 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:01.473944    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-7f1f73-65497477d8-44rps" event={"ID":"5db19143-9af6-4824-a06f-190036e1ff0a","Type":"ContainerDied","Data":"1d1922a7716010b3f456f3ffd7e22dbe9089481c6208cf486a54608204a551d5"}
Jul 29 02:07:01.474079 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:01.473979    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-7f1f73-65497477d8-44rps"
Jul 29 02:07:01.474079 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:01.474011    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-7f1f73-65497477d8-44rps" event={"ID":"5db19143-9af6-4824-a06f-190036e1ff0a","Type":"ContainerDied","Data":"6ac5827ba464b9a831c22e04a1b5390108713371f655ff45ff4774df94a5a7ba"}
Jul 29 02:07:01.484237 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:01.484219    2580 scope.go:117] "RemoveContainer" containerID="2bda8351e8a9a6e49330b9716deb061d018b029efdadf1b90e667b2bea2956cd"
Jul 29 02:07:01.484559 ip-10-0-142-238 kubenswrapper[2580]: E0729 02:07:01.484542    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2bda8351e8a9a6e49330b9716deb061d018b029efdadf1b90e667b2bea2956cd\": container with ID starting with 2bda8351e8a9a6e49330b9716deb061d018b029efdadf1b90e667b2bea2956cd not found: ID does not exist" containerID="2bda8351e8a9a6e49330b9716deb061d018b029efdadf1b90e667b2bea2956cd"
Jul 29 02:07:01.484611 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:01.484567    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bda8351e8a9a6e49330b9716deb061d018b029efdadf1b90e667b2bea2956cd"} err="failed to get container status \"2bda8351e8a9a6e49330b9716deb061d018b029efdadf1b90e667b2bea2956cd\": rpc error: code = NotFound desc = could not find container \"2bda8351e8a9a6e49330b9716deb061d018b029efdadf1b90e667b2bea2956cd\": container with ID starting with 2bda8351e8a9a6e49330b9716deb061d018b029efdadf1b90e667b2bea2956cd not found: ID does not exist"
Jul 29 02:07:01.484611 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:01.484585    2580 scope.go:117] "RemoveContainer" containerID="1d1922a7716010b3f456f3ffd7e22dbe9089481c6208cf486a54608204a551d5"
Jul 29 02:07:01.493192 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:01.493174    2580 scope.go:117] "RemoveContainer" containerID="1d1922a7716010b3f456f3ffd7e22dbe9089481c6208cf486a54608204a551d5"
Jul 29 02:07:01.493506 ip-10-0-142-238 kubenswrapper[2580]: E0729 02:07:01.493428    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d1922a7716010b3f456f3ffd7e22dbe9089481c6208cf486a54608204a551d5\": container with ID starting with 1d1922a7716010b3f456f3ffd7e22dbe9089481c6208cf486a54608204a551d5 not found: ID does not exist" containerID="1d1922a7716010b3f456f3ffd7e22dbe9089481c6208cf486a54608204a551d5"
Jul 29 02:07:01.493506 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:01.493453    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d1922a7716010b3f456f3ffd7e22dbe9089481c6208cf486a54608204a551d5"} err="failed to get container status \"1d1922a7716010b3f456f3ffd7e22dbe9089481c6208cf486a54608204a551d5\": rpc error: code = NotFound desc = could not find container \"1d1922a7716010b3f456f3ffd7e22dbe9089481c6208cf486a54608204a551d5\": container with ID starting with 1d1922a7716010b3f456f3ffd7e22dbe9089481c6208cf486a54608204a551d5 not found: ID does not exist"
Jul 29 02:07:01.525687 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:01.525647    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-7f1f73-65497477d8-44rps"]
Jul 29 02:07:01.532752 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:01.532721    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-7f1f73-65497477d8-44rps"]
Jul 29 02:07:01.553137 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:01.553101    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-7f1f73-7bf98f676d-68z8b"]
Jul 29 02:07:01.557524 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:01.557494    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-7f1f73-7bf98f676d-68z8b"]
Jul 29 02:07:02.170099 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:02.170061    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c57d23a-240c-4391-a201-0905e6b54ea6" path="/var/lib/kubelet/pods/3c57d23a-240c-4391-a201-0905e6b54ea6/volumes"
Jul 29 02:07:02.170557 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:02.170535    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5db19143-9af6-4824-a06f-190036e1ff0a" path="/var/lib/kubelet/pods/5db19143-9af6-4824-a06f-190036e1ff0a/volumes"
Jul 29 02:07:07.058918 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:07.058882    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:07:07.135084 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:07.135049    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:07:07.322087 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:07.321990    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:07:07.545858 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:07.545811    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:07:18.263456 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:18.263418    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:07:18.295975 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:18.295930    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-c798cc-54654f7966-42jrq"]
Jul 29 02:07:18.296463 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:18.296187    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-c798cc-54654f7966-42jrq" podUID="782ac4c8-ad3d-44e3-8196-71d77a705863" containerName="payload-processing" containerID="cri-o://cfd8e0c4e5558e2f66385b87388a2a593c3ef59c4596704010ec148a70825e70" gracePeriod=30
Jul 29 02:07:18.304561 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:18.304514    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-c798cc-59df596976-gjzrh"]
Jul 29 02:07:18.305375 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:18.305105    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-c798cc-59df596976-gjzrh" podUID="9ebe2f84-0839-42ff-8a8e-ca07386a0c79" containerName="payload-pre-processing" containerID="cri-o://7ff4fc16eeb3474b9030b608775f0a2144ea7faf236113874db21112a5a47552" gracePeriod=30
Jul 29 02:07:18.341076 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:18.341035    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:07:18.444178 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:18.444144    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:07:18.518578 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:18.518544    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:07:18.558922 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:18.558891    2580 generic.go:356] "Generic (PLEG): container finished" podID="9ebe2f84-0839-42ff-8a8e-ca07386a0c79" containerID="7ff4fc16eeb3474b9030b608775f0a2144ea7faf236113874db21112a5a47552" exitCode=0
Jul 29 02:07:18.559137 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:18.558944    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-c798cc-59df596976-gjzrh" event={"ID":"9ebe2f84-0839-42ff-8a8e-ca07386a0c79","Type":"ContainerDied","Data":"7ff4fc16eeb3474b9030b608775f0a2144ea7faf236113874db21112a5a47552"}
Jul 29 02:07:18.560589 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:18.560556    2580 generic.go:356] "Generic (PLEG): container finished" podID="782ac4c8-ad3d-44e3-8196-71d77a705863" containerID="cfd8e0c4e5558e2f66385b87388a2a593c3ef59c4596704010ec148a70825e70" exitCode=0
Jul 29 02:07:18.560725 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:18.560624    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-c798cc-54654f7966-42jrq" event={"ID":"782ac4c8-ad3d-44e3-8196-71d77a705863","Type":"ContainerDied","Data":"cfd8e0c4e5558e2f66385b87388a2a593c3ef59c4596704010ec148a70825e70"}
Jul 29 02:07:18.560725 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:18.560684    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-c798cc-54654f7966-42jrq" event={"ID":"782ac4c8-ad3d-44e3-8196-71d77a705863","Type":"ContainerDied","Data":"128a58604aeefe2cf72f7f4f7f3554231ffe1f6b6297f850d0ce918bd1d43434"}
Jul 29 02:07:18.560725 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:18.560706    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="128a58604aeefe2cf72f7f4f7f3554231ffe1f6b6297f850d0ce918bd1d43434"
Jul 29 02:07:18.567489 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:18.567461    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-c798cc-54654f7966-42jrq"
Jul 29 02:07:18.592533 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:18.592502    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-c798cc-59df596976-gjzrh"
Jul 29 02:07:18.639187 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:18.639152    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7588k\" (UniqueName: \"kubernetes.io/projected/782ac4c8-ad3d-44e3-8196-71d77a705863-kube-api-access-7588k\") pod \"782ac4c8-ad3d-44e3-8196-71d77a705863\" (UID: \"782ac4c8-ad3d-44e3-8196-71d77a705863\") "
Jul 29 02:07:18.639366 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:18.639203    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/782ac4c8-ad3d-44e3-8196-71d77a705863-plugins-config-volume\") pod \"782ac4c8-ad3d-44e3-8196-71d77a705863\" (UID: \"782ac4c8-ad3d-44e3-8196-71d77a705863\") "
Jul 29 02:07:18.639696 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:18.639671    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/782ac4c8-ad3d-44e3-8196-71d77a705863-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "782ac4c8-ad3d-44e3-8196-71d77a705863" (UID: "782ac4c8-ad3d-44e3-8196-71d77a705863"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 02:07:18.641262 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:18.641240    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/782ac4c8-ad3d-44e3-8196-71d77a705863-kube-api-access-7588k" (OuterVolumeSpecName: "kube-api-access-7588k") pod "782ac4c8-ad3d-44e3-8196-71d77a705863" (UID: "782ac4c8-ad3d-44e3-8196-71d77a705863"). InnerVolumeSpecName "kube-api-access-7588k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:07:18.740667 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:18.740626    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ebe2f84-0839-42ff-8a8e-ca07386a0c79-plugins-config-volume\") pod \"9ebe2f84-0839-42ff-8a8e-ca07386a0c79\" (UID: \"9ebe2f84-0839-42ff-8a8e-ca07386a0c79\") "
Jul 29 02:07:18.740862 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:18.740723    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fd226\" (UniqueName: \"kubernetes.io/projected/9ebe2f84-0839-42ff-8a8e-ca07386a0c79-kube-api-access-fd226\") pod \"9ebe2f84-0839-42ff-8a8e-ca07386a0c79\" (UID: \"9ebe2f84-0839-42ff-8a8e-ca07386a0c79\") "
Jul 29 02:07:18.741049 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:18.741031    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7588k\" (UniqueName: \"kubernetes.io/projected/782ac4c8-ad3d-44e3-8196-71d77a705863-kube-api-access-7588k\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 02:07:18.741120 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:18.741053    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/782ac4c8-ad3d-44e3-8196-71d77a705863-plugins-config-volume\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 02:07:18.741159 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:18.741116    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ebe2f84-0839-42ff-8a8e-ca07386a0c79-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9ebe2f84-0839-42ff-8a8e-ca07386a0c79" (UID: "9ebe2f84-0839-42ff-8a8e-ca07386a0c79"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 02:07:18.742848 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:18.742828    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ebe2f84-0839-42ff-8a8e-ca07386a0c79-kube-api-access-fd226" (OuterVolumeSpecName: "kube-api-access-fd226") pod "9ebe2f84-0839-42ff-8a8e-ca07386a0c79" (UID: "9ebe2f84-0839-42ff-8a8e-ca07386a0c79"). InnerVolumeSpecName "kube-api-access-fd226". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:07:18.842600 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:18.842507    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ebe2f84-0839-42ff-8a8e-ca07386a0c79-plugins-config-volume\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 02:07:18.842600 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:18.842542    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fd226\" (UniqueName: \"kubernetes.io/projected/9ebe2f84-0839-42ff-8a8e-ca07386a0c79-kube-api-access-fd226\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 02:07:18.843731 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:18.843701    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:07:19.567172 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:19.567070    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-c798cc-59df596976-gjzrh" event={"ID":"9ebe2f84-0839-42ff-8a8e-ca07386a0c79","Type":"ContainerDied","Data":"84c5165a559b699225d02153cb43d78dfa956c7e4457160a35ebd6ead13f4207"}
Jul 29 02:07:19.567172 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:19.567088    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-c798cc-54654f7966-42jrq"
Jul 29 02:07:19.567763 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:19.567096    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-c798cc-59df596976-gjzrh"
Jul 29 02:07:19.567763 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:19.567170    2580 scope.go:117] "RemoveContainer" containerID="7ff4fc16eeb3474b9030b608775f0a2144ea7faf236113874db21112a5a47552"
Jul 29 02:07:19.593398 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:19.593362    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-c798cc-59df596976-gjzrh"]
Jul 29 02:07:19.598546 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:19.598521    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-c798cc-59df596976-gjzrh"]
Jul 29 02:07:19.609995 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:19.609965    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-c798cc-54654f7966-42jrq"]
Jul 29 02:07:19.614396 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:19.614370    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-c798cc-54654f7966-42jrq"]
Jul 29 02:07:20.172327 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:20.172288    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="782ac4c8-ad3d-44e3-8196-71d77a705863" path="/var/lib/kubelet/pods/782ac4c8-ad3d-44e3-8196-71d77a705863/volumes"
Jul 29 02:07:20.172789 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:20.172773    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ebe2f84-0839-42ff-8a8e-ca07386a0c79" path="/var/lib/kubelet/pods/9ebe2f84-0839-42ff-8a8e-ca07386a0c79/volumes"
Jul 29 02:07:24.886405 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:24.886365    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:07:24.988458 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:24.988422    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:07:25.134698 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:25.134660    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:07:25.361669 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:25.361641    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:07:30.476817 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:30.476781    2580 scope.go:117] "RemoveContainer" containerID="cfd8e0c4e5558e2f66385b87388a2a593c3ef59c4596704010ec148a70825e70"
Jul 29 02:07:31.816783 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:31.816672    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8g9fl_e044d9fa-39c8-49b8-94e1-550f3dbe7b26/ovn-acl-logging/0.log"
Jul 29 02:07:31.826316 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:31.826297    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8g9fl_e044d9fa-39c8-49b8-94e1-550f3dbe7b26/ovn-acl-logging/0.log"
Jul 29 02:07:35.972869 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:35.972835    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:07:35.996566 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:35.996528    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-0d32f5-65c56bbfc4-8zw2x"]
Jul 29 02:07:35.996798 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:35.996768    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-0d32f5-65c56bbfc4-8zw2x" podUID="bc2ffbcb-98fe-474d-895f-a6fee4c48001" containerName="payload-processing" containerID="cri-o://f336a51f5fdbde55a4c957645bc950f6e2115bf312fc5a0cc4545c0bad3284a3" gracePeriod=30
Jul 29 02:07:36.008006 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:36.007980    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-0d32f5-85657f46fb-r5lvh"]
Jul 29 02:07:36.008254 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:36.008224    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0d32f5-85657f46fb-r5lvh" podUID="af5b6bd6-d863-480c-93b7-e18ed0bfcbf1" containerName="payload-pre-processing" containerID="cri-o://325881d02efdf5019fe170bc9f2a59cc7c8362677d700e30f41b20bc7fa46b7e" gracePeriod=30
Jul 29 02:07:36.289932 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:36.289908    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-0d32f5-65c56bbfc4-8zw2x"
Jul 29 02:07:36.292516 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:36.292496    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0d32f5-85657f46fb-r5lvh"
Jul 29 02:07:36.305519 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:36.305494    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqbc7\" (UniqueName: \"kubernetes.io/projected/bc2ffbcb-98fe-474d-895f-a6fee4c48001-kube-api-access-sqbc7\") pod \"bc2ffbcb-98fe-474d-895f-a6fee4c48001\" (UID: \"bc2ffbcb-98fe-474d-895f-a6fee4c48001\") "
Jul 29 02:07:36.305631 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:36.305536    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc2ffbcb-98fe-474d-895f-a6fee4c48001-plugins-config-volume\") pod \"bc2ffbcb-98fe-474d-895f-a6fee4c48001\" (UID: \"bc2ffbcb-98fe-474d-895f-a6fee4c48001\") "
Jul 29 02:07:36.305897 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:36.305866    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc2ffbcb-98fe-474d-895f-a6fee4c48001-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bc2ffbcb-98fe-474d-895f-a6fee4c48001" (UID: "bc2ffbcb-98fe-474d-895f-a6fee4c48001"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 02:07:36.308269 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:36.308246    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc2ffbcb-98fe-474d-895f-a6fee4c48001-kube-api-access-sqbc7" (OuterVolumeSpecName: "kube-api-access-sqbc7") pod "bc2ffbcb-98fe-474d-895f-a6fee4c48001" (UID: "bc2ffbcb-98fe-474d-895f-a6fee4c48001"). InnerVolumeSpecName "kube-api-access-sqbc7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:07:36.406779 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:36.406744    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af5b6bd6-d863-480c-93b7-e18ed0bfcbf1-plugins-config-volume\") pod \"af5b6bd6-d863-480c-93b7-e18ed0bfcbf1\" (UID: \"af5b6bd6-d863-480c-93b7-e18ed0bfcbf1\") "
Jul 29 02:07:36.406999 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:36.406886    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cs5mm\" (UniqueName: \"kubernetes.io/projected/af5b6bd6-d863-480c-93b7-e18ed0bfcbf1-kube-api-access-cs5mm\") pod \"af5b6bd6-d863-480c-93b7-e18ed0bfcbf1\" (UID: \"af5b6bd6-d863-480c-93b7-e18ed0bfcbf1\") "
Jul 29 02:07:36.407570 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:36.407511    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af5b6bd6-d863-480c-93b7-e18ed0bfcbf1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "af5b6bd6-d863-480c-93b7-e18ed0bfcbf1" (UID: "af5b6bd6-d863-480c-93b7-e18ed0bfcbf1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 02:07:36.409396 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:36.407939    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqbc7\" (UniqueName: \"kubernetes.io/projected/bc2ffbcb-98fe-474d-895f-a6fee4c48001-kube-api-access-sqbc7\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 02:07:36.409396 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:36.407995    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc2ffbcb-98fe-474d-895f-a6fee4c48001-plugins-config-volume\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 02:07:36.409396 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:36.408010    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af5b6bd6-d863-480c-93b7-e18ed0bfcbf1-plugins-config-volume\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 02:07:36.413687 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:36.413110    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af5b6bd6-d863-480c-93b7-e18ed0bfcbf1-kube-api-access-cs5mm" (OuterVolumeSpecName: "kube-api-access-cs5mm") pod "af5b6bd6-d863-480c-93b7-e18ed0bfcbf1" (UID: "af5b6bd6-d863-480c-93b7-e18ed0bfcbf1"). InnerVolumeSpecName "kube-api-access-cs5mm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:07:36.509156 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:36.509121    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cs5mm\" (UniqueName: \"kubernetes.io/projected/af5b6bd6-d863-480c-93b7-e18ed0bfcbf1-kube-api-access-cs5mm\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 29 02:07:36.653123 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:36.653086    2580 generic.go:356] "Generic (PLEG): container finished" podID="bc2ffbcb-98fe-474d-895f-a6fee4c48001" containerID="f336a51f5fdbde55a4c957645bc950f6e2115bf312fc5a0cc4545c0bad3284a3" exitCode=0
Jul 29 02:07:36.653325 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:36.653150    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-0d32f5-65c56bbfc4-8zw2x"
Jul 29 02:07:36.653325 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:36.653177    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-0d32f5-65c56bbfc4-8zw2x" event={"ID":"bc2ffbcb-98fe-474d-895f-a6fee4c48001","Type":"ContainerDied","Data":"f336a51f5fdbde55a4c957645bc950f6e2115bf312fc5a0cc4545c0bad3284a3"}
Jul 29 02:07:36.653325 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:36.653264    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-0d32f5-65c56bbfc4-8zw2x" event={"ID":"bc2ffbcb-98fe-474d-895f-a6fee4c48001","Type":"ContainerDied","Data":"f0c7c1e43ca9b407e0a3b92949e41a3d7de3af1fde3f6e7952f657fc095c267f"}
Jul 29 02:07:36.653325 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:36.653294    2580 scope.go:117] "RemoveContainer" containerID="f336a51f5fdbde55a4c957645bc950f6e2115bf312fc5a0cc4545c0bad3284a3"
Jul 29 02:07:36.654509 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:36.654484    2580 generic.go:356] "Generic (PLEG): container finished" podID="af5b6bd6-d863-480c-93b7-e18ed0bfcbf1" containerID="325881d02efdf5019fe170bc9f2a59cc7c8362677d700e30f41b20bc7fa46b7e" exitCode=0
Jul 29 02:07:36.654620 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:36.654545    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0d32f5-85657f46fb-r5lvh"
Jul 29 02:07:36.654666 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:36.654546    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0d32f5-85657f46fb-r5lvh" event={"ID":"af5b6bd6-d863-480c-93b7-e18ed0bfcbf1","Type":"ContainerDied","Data":"325881d02efdf5019fe170bc9f2a59cc7c8362677d700e30f41b20bc7fa46b7e"}
Jul 29 02:07:36.654666 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:36.654661    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0d32f5-85657f46fb-r5lvh" event={"ID":"af5b6bd6-d863-480c-93b7-e18ed0bfcbf1","Type":"ContainerDied","Data":"9dccef1ce6dbdf3a399224e51254a17dc7cc12cb6081cb3393f51b621806cb9c"}
Jul 29 02:07:36.663978 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:36.663939    2580 scope.go:117] "RemoveContainer" containerID="f336a51f5fdbde55a4c957645bc950f6e2115bf312fc5a0cc4545c0bad3284a3"
Jul 29 02:07:36.664266 ip-10-0-142-238 kubenswrapper[2580]: E0729 02:07:36.664238    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f336a51f5fdbde55a4c957645bc950f6e2115bf312fc5a0cc4545c0bad3284a3\": container with ID starting with f336a51f5fdbde55a4c957645bc950f6e2115bf312fc5a0cc4545c0bad3284a3 not found: ID does not exist" containerID="f336a51f5fdbde55a4c957645bc950f6e2115bf312fc5a0cc4545c0bad3284a3"
Jul 29 02:07:36.664375 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:36.664275    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f336a51f5fdbde55a4c957645bc950f6e2115bf312fc5a0cc4545c0bad3284a3"} err="failed to get container status \"f336a51f5fdbde55a4c957645bc950f6e2115bf312fc5a0cc4545c0bad3284a3\": rpc error: code = NotFound desc = could not find container \"f336a51f5fdbde55a4c957645bc950f6e2115bf312fc5a0cc4545c0bad3284a3\": container with ID starting with f336a51f5fdbde55a4c957645bc950f6e2115bf312fc5a0cc4545c0bad3284a3 not found: ID does not exist"
Jul 29 02:07:36.664375 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:36.664302    2580 scope.go:117] "RemoveContainer" containerID="325881d02efdf5019fe170bc9f2a59cc7c8362677d700e30f41b20bc7fa46b7e"
Jul 29 02:07:36.672019 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:36.672002    2580 scope.go:117] "RemoveContainer" containerID="325881d02efdf5019fe170bc9f2a59cc7c8362677d700e30f41b20bc7fa46b7e"
Jul 29 02:07:36.672271 ip-10-0-142-238 kubenswrapper[2580]: E0729 02:07:36.672251    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"325881d02efdf5019fe170bc9f2a59cc7c8362677d700e30f41b20bc7fa46b7e\": container with ID starting with 325881d02efdf5019fe170bc9f2a59cc7c8362677d700e30f41b20bc7fa46b7e not found: ID does not exist" containerID="325881d02efdf5019fe170bc9f2a59cc7c8362677d700e30f41b20bc7fa46b7e"
Jul 29 02:07:36.672334 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:36.672284    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"325881d02efdf5019fe170bc9f2a59cc7c8362677d700e30f41b20bc7fa46b7e"} err="failed to get container status \"325881d02efdf5019fe170bc9f2a59cc7c8362677d700e30f41b20bc7fa46b7e\": rpc error: code = NotFound desc = could not find container \"325881d02efdf5019fe170bc9f2a59cc7c8362677d700e30f41b20bc7fa46b7e\": container with ID starting with 325881d02efdf5019fe170bc9f2a59cc7c8362677d700e30f41b20bc7fa46b7e not found: ID does not exist"
Jul 29 02:07:36.684818 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:36.684783    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-0d32f5-65c56bbfc4-8zw2x"]
Jul 29 02:07:36.686517 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:36.686496    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-0d32f5-65c56bbfc4-8zw2x"]
Jul 29 02:07:36.697922 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:36.697897    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-0d32f5-85657f46fb-r5lvh"]
Jul 29 02:07:36.703257 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:36.703232    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-0d32f5-85657f46fb-r5lvh"]
Jul 29 02:07:37.907529 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:37.907490    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:07:38.170229 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:38.170143    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af5b6bd6-d863-480c-93b7-e18ed0bfcbf1" path="/var/lib/kubelet/pods/af5b6bd6-d863-480c-93b7-e18ed0bfcbf1/volumes"
Jul 29 02:07:38.170597 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:38.170576    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc2ffbcb-98fe-474d-895f-a6fee4c48001" path="/var/lib/kubelet/pods/bc2ffbcb-98fe-474d-895f-a6fee4c48001/volumes"
Jul 29 02:07:42.625150 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:42.625111    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:07:42.693713 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:42.693675    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:07:42.873342 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:42.873301    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:07:43.087770 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:43.087679    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:07:49.358764 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:49.358737    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f677d9b6b-c4m82_64080458-f0ba-47de-aff8-b07711c5e314/copy-manifests/0.log"
Jul 29 02:07:49.364858 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:49.364834    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f677d9b6b-c4m82_64080458-f0ba-47de-aff8-b07711c5e314/manager/0.log"
Jul 29 02:07:50.809478 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:50.809443    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:07:50.910093 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:50.910056    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:07:51.898334 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:51.898303    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-tw6nq_1cc1419b-cbf6-4d65-b390-b5cb901aaaff/kuadrant-console-plugin/0.log"
Jul 29 02:07:52.352686 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:52.352577    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-t6bzj_c9a3f626-95e3-409c-a7ce-60aed362dc47/manager/0.log"
Jul 29 02:07:53.026410 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:53.026383    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dfd7865d-kmlm7_14a74c15-38c6-4478-ab30-510caf6ea8f5/kube-auth-proxy/0.log"
Jul 29 02:07:53.257206 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:53.257173    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-xf7pq_db561615-d3c7-411d-8c05-e2cda634d700/payload-pre-processing/0.log"
Jul 29 02:07:53.371417 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:53.371388    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-dlvpn_6784b90f-c19a-4022-800b-825ecca592f8/payload-processing/0.log"
Jul 29 02:07:53.943280 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:53.943249    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-cbgxt_c7c06c97-54ab-4ede-84f0-b0c41a66275c/main/0.log"
Jul 29 02:07:54.053067 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:54.053038    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-qkqvx_98f554f9-18f1-43ab-8b6d-dee3b26fca72/main/0.log"
Jul 29 02:07:54.395091 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:54.395047    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-7s5bt_f1e91449-e616-4332-bb31-999783be4311/main/0.log"
Jul 29 02:07:59.895130 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:59.895095    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:07:59.986675 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:07:59.986639    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log" limit=1024
Jul 29 02:08:02.577678 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:02.577641    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-n7dj7_aee511a0-1681-4291-90ee-eda4bfb122dc/global-pull-secret-syncer/0.log"
Jul 29 02:08:02.698724 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:02.698694    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2vj4h_2fc7f511-69f2-44bd-9e16-fd635c4bb098/konnectivity-agent/0.log"
Jul 29 02:08:02.833125 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:02.833044    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-238.ec2.internal_fc633d594ee9635d73371706219c2df2/haproxy/0.log"
Jul 29 02:08:07.779770 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:07.779684    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-tw6nq_1cc1419b-cbf6-4d65-b390-b5cb901aaaff/kuadrant-console-plugin/0.log"
Jul 29 02:08:08.216995 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:08.216965    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-t6bzj_c9a3f626-95e3-409c-a7ce-60aed362dc47/manager/0.log"
Jul 29 02:08:10.275167 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:10.275126    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-66ff4d7657-7h92s_3694d390-7790-4db6-8df9-d04a820a99c6/metrics-server/0.log"
Jul 29 02:08:10.335741 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:10.335661    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7bc76_9d972976-65f8-43de-82a8-accd5fa57ec7/node-exporter/0.log"
Jul 29 02:08:10.360306 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:10.360275    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7bc76_9d972976-65f8-43de-82a8-accd5fa57ec7/kube-rbac-proxy/0.log"
Jul 29 02:08:10.383648 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:10.383624    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7bc76_9d972976-65f8-43de-82a8-accd5fa57ec7/init-textfile/0.log"
Jul 29 02:08:10.603692 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:10.603612    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-79wzl_ea98c435-63e1-4b9b-b451-8013f67695e5/kube-rbac-proxy-main/0.log"
Jul 29 02:08:10.621470 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:10.621444    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-79wzl_ea98c435-63e1-4b9b-b451-8013f67695e5/kube-rbac-proxy-self/0.log"
Jul 29 02:08:10.644318 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:10.644294    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-79wzl_ea98c435-63e1-4b9b-b451-8013f67695e5/openshift-state-metrics/0.log"
Jul 29 02:08:10.673627 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:10.673604    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_34179654-a04c-455b-8ec2-14c1171f838f/prometheus/0.log"
Jul 29 02:08:10.693428 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:10.693405    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_34179654-a04c-455b-8ec2-14c1171f838f/config-reloader/0.log"
Jul 29 02:08:10.711918 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:10.711895    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_34179654-a04c-455b-8ec2-14c1171f838f/thanos-sidecar/0.log"
Jul 29 02:08:10.733463 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:10.733444    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_34179654-a04c-455b-8ec2-14c1171f838f/kube-rbac-proxy-web/0.log"
Jul 29 02:08:10.753402 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:10.753384    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_34179654-a04c-455b-8ec2-14c1171f838f/kube-rbac-proxy/0.log"
Jul 29 02:08:10.773201 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:10.773178    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_34179654-a04c-455b-8ec2-14c1171f838f/kube-rbac-proxy-thanos/0.log"
Jul 29 02:08:10.793112 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:10.793092    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_34179654-a04c-455b-8ec2-14c1171f838f/init-config-reloader/0.log"
Jul 29 02:08:10.818592 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:10.818570    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-l2j7z_7774e259-04cb-4070-9c71-183e5ef496a2/prometheus-operator/0.log"
Jul 29 02:08:10.838487 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:10.838469    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-l2j7z_7774e259-04cb-4070-9c71-183e5ef496a2/kube-rbac-proxy/0.log"
Jul 29 02:08:10.863128 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:10.863107    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-sxjwk_340c0f05-58f8-4adc-a39d-ef87ac591e2e/prometheus-operator-admission-webhook/0.log"
Jul 29 02:08:10.972098 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:10.972073    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-556f954dcc-h2l27_041860ba-c9b7-4a72-a526-187b513c9a6e/thanos-query/0.log"
Jul 29 02:08:10.989203 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:10.989179    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-556f954dcc-h2l27_041860ba-c9b7-4a72-a526-187b513c9a6e/kube-rbac-proxy-web/0.log"
Jul 29 02:08:11.007411 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:11.007391    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-556f954dcc-h2l27_041860ba-c9b7-4a72-a526-187b513c9a6e/kube-rbac-proxy/0.log"
Jul 29 02:08:11.025848 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:11.025827    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-556f954dcc-h2l27_041860ba-c9b7-4a72-a526-187b513c9a6e/prom-label-proxy/0.log"
Jul 29 02:08:11.045106 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:11.045082    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-556f954dcc-h2l27_041860ba-c9b7-4a72-a526-187b513c9a6e/kube-rbac-proxy-rules/0.log"
Jul 29 02:08:11.065028 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:11.064985    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-556f954dcc-h2l27_041860ba-c9b7-4a72-a526-187b513c9a6e/kube-rbac-proxy-metrics/0.log"
Jul 29 02:08:12.130419 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.130377    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8dv4l/perf-node-gather-daemonset-8v8vk"]
Jul 29 02:08:12.130821 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.130772    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a783f4fa-3ed2-43bf-b3e9-470dad50168b" containerName="payload-pre-processing"
Jul 29 02:08:12.130821 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.130785    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a783f4fa-3ed2-43bf-b3e9-470dad50168b" containerName="payload-pre-processing"
Jul 29 02:08:12.130821 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.130797    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="782ac4c8-ad3d-44e3-8196-71d77a705863" containerName="payload-processing"
Jul 29 02:08:12.130821 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.130804    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="782ac4c8-ad3d-44e3-8196-71d77a705863" containerName="payload-processing"
Jul 29 02:08:12.130821 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.130818    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c57d23a-240c-4391-a201-0905e6b54ea6" containerName="payload-pre-processing"
Jul 29 02:08:12.130821 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.130824    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c57d23a-240c-4391-a201-0905e6b54ea6" containerName="payload-pre-processing"
Jul 29 02:08:12.131040 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.130831    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9775586d-f6a9-45aa-9133-d391be890e16" containerName="main"
Jul 29 02:08:12.131040 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.130836    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9775586d-f6a9-45aa-9133-d391be890e16" containerName="main"
Jul 29 02:08:12.131040 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.130845    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d191f5bc-af68-477e-8495-6eef7c999a50" containerName="payload-processing"
Jul 29 02:08:12.131040 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.130851    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d191f5bc-af68-477e-8495-6eef7c999a50" containerName="payload-processing"
Jul 29 02:08:12.131040 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.130859    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc2ffbcb-98fe-474d-895f-a6fee4c48001" containerName="payload-processing"
Jul 29 02:08:12.131040 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.130864    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc2ffbcb-98fe-474d-895f-a6fee4c48001" containerName="payload-processing"
Jul 29 02:08:12.131040 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.130872    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ebe2f84-0839-42ff-8a8e-ca07386a0c79" containerName="payload-pre-processing"
Jul 29 02:08:12.131040 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.130878    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ebe2f84-0839-42ff-8a8e-ca07386a0c79" containerName="payload-pre-processing"
Jul 29 02:08:12.131040 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.130884    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5db19143-9af6-4824-a06f-190036e1ff0a" containerName="payload-processing"
Jul 29 02:08:12.131040 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.130889    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5db19143-9af6-4824-a06f-190036e1ff0a" containerName="payload-processing"
Jul 29 02:08:12.131040 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.130895    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fcfd967-20e0-4820-accd-07918347dabf" containerName="payload-processing"
Jul 29 02:08:12.131040 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.130901    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fcfd967-20e0-4820-accd-07918347dabf" containerName="payload-processing"
Jul 29 02:08:12.131040 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.130911    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af5b6bd6-d863-480c-93b7-e18ed0bfcbf1" containerName="payload-pre-processing"
Jul 29 02:08:12.131040 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.130916    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="af5b6bd6-d863-480c-93b7-e18ed0bfcbf1" containerName="payload-pre-processing"
Jul 29 02:08:12.131040 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.130985    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d191f5bc-af68-477e-8495-6eef7c999a50" containerName="payload-processing"
Jul 29 02:08:12.131040 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.130994    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc2ffbcb-98fe-474d-895f-a6fee4c48001" containerName="payload-processing"
Jul 29 02:08:12.131040 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.131002    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="782ac4c8-ad3d-44e3-8196-71d77a705863" containerName="payload-processing"
Jul 29 02:08:12.131040 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.131007    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="af5b6bd6-d863-480c-93b7-e18ed0bfcbf1" containerName="payload-pre-processing"
Jul 29 02:08:12.131040 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.131012    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c57d23a-240c-4391-a201-0905e6b54ea6" containerName="payload-pre-processing"
Jul 29 02:08:12.131040 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.131019    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ebe2f84-0839-42ff-8a8e-ca07386a0c79" containerName="payload-pre-processing"
Jul 29 02:08:12.131040 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.131027    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9775586d-f6a9-45aa-9133-d391be890e16" containerName="main"
Jul 29 02:08:12.131040 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.131033    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5db19143-9af6-4824-a06f-190036e1ff0a" containerName="payload-processing"
Jul 29 02:08:12.131040 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.131039    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fcfd967-20e0-4820-accd-07918347dabf" containerName="payload-processing"
Jul 29 02:08:12.131040 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.131045    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a783f4fa-3ed2-43bf-b3e9-470dad50168b" containerName="payload-pre-processing"
Jul 29 02:08:12.134380 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.134354    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8dv4l/perf-node-gather-daemonset-8v8vk"
Jul 29 02:08:12.137000 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.136945    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8dv4l\"/\"kube-root-ca.crt\""
Jul 29 02:08:12.138151 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.138128    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8dv4l\"/\"openshift-service-ca.crt\""
Jul 29 02:08:12.138281 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.138136    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8dv4l\"/\"default-dockercfg-tzxr4\""
Jul 29 02:08:12.140496 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.140475    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/05e9d578-c388-49cf-a308-07e6888e190d-proc\") pod \"perf-node-gather-daemonset-8v8vk\" (UID: \"05e9d578-c388-49cf-a308-07e6888e190d\") " pod="openshift-must-gather-8dv4l/perf-node-gather-daemonset-8v8vk"
Jul 29 02:08:12.140616 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.140512    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/05e9d578-c388-49cf-a308-07e6888e190d-podres\") pod \"perf-node-gather-daemonset-8v8vk\" (UID: \"05e9d578-c388-49cf-a308-07e6888e190d\") " pod="openshift-must-gather-8dv4l/perf-node-gather-daemonset-8v8vk"
Jul 29 02:08:12.140616 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.140547    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb72f\" (UniqueName: \"kubernetes.io/projected/05e9d578-c388-49cf-a308-07e6888e190d-kube-api-access-gb72f\") pod \"perf-node-gather-daemonset-8v8vk\" (UID: \"05e9d578-c388-49cf-a308-07e6888e190d\") " pod="openshift-must-gather-8dv4l/perf-node-gather-daemonset-8v8vk"
Jul 29 02:08:12.140616 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.140603    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05e9d578-c388-49cf-a308-07e6888e190d-sys\") pod \"perf-node-gather-daemonset-8v8vk\" (UID: \"05e9d578-c388-49cf-a308-07e6888e190d\") " pod="openshift-must-gather-8dv4l/perf-node-gather-daemonset-8v8vk"
Jul 29 02:08:12.141672 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.140694    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/05e9d578-c388-49cf-a308-07e6888e190d-lib-modules\") pod \"perf-node-gather-daemonset-8v8vk\" (UID: \"05e9d578-c388-49cf-a308-07e6888e190d\") " pod="openshift-must-gather-8dv4l/perf-node-gather-daemonset-8v8vk"
Jul 29 02:08:12.143340 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.143319    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8dv4l/perf-node-gather-daemonset-8v8vk"]
Jul 29 02:08:12.241971 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.241917    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/05e9d578-c388-49cf-a308-07e6888e190d-lib-modules\") pod \"perf-node-gather-daemonset-8v8vk\" (UID: \"05e9d578-c388-49cf-a308-07e6888e190d\") " pod="openshift-must-gather-8dv4l/perf-node-gather-daemonset-8v8vk"
Jul 29 02:08:12.242180 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.241983    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/05e9d578-c388-49cf-a308-07e6888e190d-proc\") pod \"perf-node-gather-daemonset-8v8vk\" (UID: \"05e9d578-c388-49cf-a308-07e6888e190d\") " pod="openshift-must-gather-8dv4l/perf-node-gather-daemonset-8v8vk"
Jul 29 02:08:12.242180 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.242010    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/05e9d578-c388-49cf-a308-07e6888e190d-podres\") pod \"perf-node-gather-daemonset-8v8vk\" (UID: \"05e9d578-c388-49cf-a308-07e6888e190d\") " pod="openshift-must-gather-8dv4l/perf-node-gather-daemonset-8v8vk"
Jul 29 02:08:12.242180 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.242030    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gb72f\" (UniqueName: \"kubernetes.io/projected/05e9d578-c388-49cf-a308-07e6888e190d-kube-api-access-gb72f\") pod \"perf-node-gather-daemonset-8v8vk\" (UID: \"05e9d578-c388-49cf-a308-07e6888e190d\") " pod="openshift-must-gather-8dv4l/perf-node-gather-daemonset-8v8vk"
Jul 29 02:08:12.242180 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.242069    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05e9d578-c388-49cf-a308-07e6888e190d-sys\") pod \"perf-node-gather-daemonset-8v8vk\" (UID: \"05e9d578-c388-49cf-a308-07e6888e190d\") " pod="openshift-must-gather-8dv4l/perf-node-gather-daemonset-8v8vk"
Jul 29 02:08:12.242180 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.242129    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/05e9d578-c388-49cf-a308-07e6888e190d-proc\") pod \"perf-node-gather-daemonset-8v8vk\" (UID: \"05e9d578-c388-49cf-a308-07e6888e190d\") " pod="openshift-must-gather-8dv4l/perf-node-gather-daemonset-8v8vk"
Jul 29 02:08:12.242180 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.242130    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/05e9d578-c388-49cf-a308-07e6888e190d-lib-modules\") pod \"perf-node-gather-daemonset-8v8vk\" (UID: \"05e9d578-c388-49cf-a308-07e6888e190d\") " pod="openshift-must-gather-8dv4l/perf-node-gather-daemonset-8v8vk"
Jul 29 02:08:12.242180 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.242160    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/05e9d578-c388-49cf-a308-07e6888e190d-podres\") pod \"perf-node-gather-daemonset-8v8vk\" (UID: \"05e9d578-c388-49cf-a308-07e6888e190d\") " pod="openshift-must-gather-8dv4l/perf-node-gather-daemonset-8v8vk"
Jul 29 02:08:12.242438 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.242186    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05e9d578-c388-49cf-a308-07e6888e190d-sys\") pod \"perf-node-gather-daemonset-8v8vk\" (UID: \"05e9d578-c388-49cf-a308-07e6888e190d\") " pod="openshift-must-gather-8dv4l/perf-node-gather-daemonset-8v8vk"
Jul 29 02:08:12.252792 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.252773    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb72f\" (UniqueName: \"kubernetes.io/projected/05e9d578-c388-49cf-a308-07e6888e190d-kube-api-access-gb72f\") pod \"perf-node-gather-daemonset-8v8vk\" (UID: \"05e9d578-c388-49cf-a308-07e6888e190d\") " pod="openshift-must-gather-8dv4l/perf-node-gather-daemonset-8v8vk"
Jul 29 02:08:12.445798 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.445697    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8dv4l/perf-node-gather-daemonset-8v8vk"
Jul 29 02:08:12.577036 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.577010    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8dv4l/perf-node-gather-daemonset-8v8vk"]
Jul 29 02:08:12.579077 ip-10-0-142-238 kubenswrapper[2580]: W0729 02:08:12.579050    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod05e9d578_c388_49cf_a308_07e6888e190d.slice/crio-8e4cd945de1af4a41bf96c9e3109ceb3e83b4081979a80ee39f9f4c1c6ae23ac WatchSource:0}: Error finding container 8e4cd945de1af4a41bf96c9e3109ceb3e83b4081979a80ee39f9f4c1c6ae23ac: Status 404 returned error can't find the container with id 8e4cd945de1af4a41bf96c9e3109ceb3e83b4081979a80ee39f9f4c1c6ae23ac
Jul 29 02:08:12.824856 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.824755    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8dv4l/perf-node-gather-daemonset-8v8vk" event={"ID":"05e9d578-c388-49cf-a308-07e6888e190d","Type":"ContainerStarted","Data":"951ee021855b20fc6cf221ff8e5ae6f708cd5140e8d5a7b1efedaeb9aa339b7b"}
Jul 29 02:08:12.824856 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.824813    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8dv4l/perf-node-gather-daemonset-8v8vk" event={"ID":"05e9d578-c388-49cf-a308-07e6888e190d","Type":"ContainerStarted","Data":"8e4cd945de1af4a41bf96c9e3109ceb3e83b4081979a80ee39f9f4c1c6ae23ac"}
Jul 29 02:08:12.824856 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.824840    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8dv4l/perf-node-gather-daemonset-8v8vk"
Jul 29 02:08:12.842305 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:12.842251    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8dv4l/perf-node-gather-daemonset-8v8vk" podStartSLOduration=0.842236083 podStartE2EDuration="842.236083ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 02:08:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:08:12.841147573 +0000 UTC m=+3343.153540282" watchObservedRunningTime="2026-07-29 02:08:12.842236083 +0000 UTC m=+3343.154628790"
Jul 29 02:08:13.493680 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:13.493646    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-4z2fj_a11bee19-78af-4a9c-bb1e-3a89dccf1fe2/download-server/0.log"
Jul 29 02:08:15.074310 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:15.074279    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cbv98_b783cf19-736b-4578-8839-b8e5201addde/dns/0.log"
Jul 29 02:08:15.096008 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:15.095979    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cbv98_b783cf19-736b-4578-8839-b8e5201addde/kube-rbac-proxy/0.log"
Jul 29 02:08:15.259034 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:15.259007    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-twzs7_c04440bc-a775-4a45-8ce2-32be6df62627/dns-node-resolver/0.log"
Jul 29 02:08:15.777016 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:15.776981    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5d4684d768-95cff_a718bd29-d225-4a1c-9d43-1f0e2113565a/registry/0.log"
Jul 29 02:08:15.820113 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:15.820088    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2m2ss_6bf91238-2331-4c79-be9b-4d85192cb848/node-ca/0.log"
Jul 29 02:08:16.936894 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:16.936860    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dfd7865d-kmlm7_14a74c15-38c6-4478-ab30-510caf6ea8f5/kube-auth-proxy/0.log"
Jul 29 02:08:17.026570 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:17.026536    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-xf7pq_db561615-d3c7-411d-8c05-e2cda634d700/payload-pre-processing/0.log"
Jul 29 02:08:17.052752 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:17.052722    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-dlvpn_6784b90f-c19a-4022-800b-825ecca592f8/payload-processing/0.log"
Jul 29 02:08:17.918726 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:17.918691    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-slkdh_db8a4b26-e014-4f49-9ce8-1381c14657e8/serve-healthcheck-canary/0.log"
Jul 29 02:08:18.462050 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:18.462023    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-84mml_51893d87-31b0-4e20-97b2-e0f5cc864175/kube-rbac-proxy/0.log"
Jul 29 02:08:18.479601 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:18.479577    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-84mml_51893d87-31b0-4e20-97b2-e0f5cc864175/exporter/0.log"
Jul 29 02:08:18.499370 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:18.499343    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-84mml_51893d87-31b0-4e20-97b2-e0f5cc864175/extractor/0.log"
Jul 29 02:08:18.841147 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:18.841078    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8dv4l/perf-node-gather-daemonset-8v8vk"
Jul 29 02:08:21.527585 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:21.527559    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f677d9b6b-c4m82_64080458-f0ba-47de-aff8-b07711c5e314/manager/0.log"
Jul 29 02:08:21.551702 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:21.551673    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f677d9b6b-c4m82_64080458-f0ba-47de-aff8-b07711c5e314/copy-manifests/0.log"
Jul 29 02:08:22.814286 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:22.814249    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dfd7865d-kmlm7_14a74c15-38c6-4478-ab30-510caf6ea8f5/kube-auth-proxy/0.log"
Jul 29 02:08:22.891426 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:22.891396    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-xf7pq_db561615-d3c7-411d-8c05-e2cda634d700/payload-pre-processing/0.log"
Jul 29 02:08:22.909692 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:22.909667    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-dlvpn_6784b90f-c19a-4022-800b-825ecca592f8/payload-processing/0.log"
Jul 29 02:08:22.913436 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:22.913418    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-856ff8b689-67xgg_97499168-db41-433e-83c6-f18b8ad22e82/manager/0.log"
Jul 29 02:08:24.444558 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:24.444526    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dfd7865d-kmlm7_14a74c15-38c6-4478-ab30-510caf6ea8f5/kube-auth-proxy/0.log"
Jul 29 02:08:24.519859 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:24.519818    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-xf7pq_db561615-d3c7-411d-8c05-e2cda634d700/payload-pre-processing/0.log"
Jul 29 02:08:24.542505 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:24.542473    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-dlvpn_6784b90f-c19a-4022-800b-825ecca592f8/payload-processing/0.log"
Jul 29 02:08:27.923072 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:27.923047    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-dfw8c_3f28ea1a-6863-4d28-8dd1-61d75523b441/migrator/0.log"
Jul 29 02:08:27.940059 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:27.940035    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-dfw8c_3f28ea1a-6863-4d28-8dd1-61d75523b441/graceful-termination/0.log"
Jul 29 02:08:29.308802 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:29.308769    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5h525_84b80591-4471-4103-9031-3e72a0a3ca7a/kube-multus/0.log"
Jul 29 02:08:29.492089 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:29.492061    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ps929_9c156d63-8457-4165-b635-a1e0a523c733/kube-multus-additional-cni-plugins/0.log"
Jul 29 02:08:29.510589 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:29.510568    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ps929_9c156d63-8457-4165-b635-a1e0a523c733/egress-router-binary-copy/0.log"
Jul 29 02:08:29.528788 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:29.528769    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ps929_9c156d63-8457-4165-b635-a1e0a523c733/cni-plugins/0.log"
Jul 29 02:08:29.548694 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:29.548676    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ps929_9c156d63-8457-4165-b635-a1e0a523c733/bond-cni-plugin/0.log"
Jul 29 02:08:29.567293 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:29.567240    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ps929_9c156d63-8457-4165-b635-a1e0a523c733/routeoverride-cni/0.log"
Jul 29 02:08:29.590174 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:29.590155    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ps929_9c156d63-8457-4165-b635-a1e0a523c733/whereabouts-cni-bincopy/0.log"
Jul 29 02:08:29.611839 ip-10-0-142-238 kubenswrapper[2580]: I0729 02:08:29.611822    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ps929_9c156d63-8457-4165-b635-a1e0a523c733/whereabouts-cni/0.log"