Jul 27 20:17:37.309625 ip-10-0-132-12 systemd[1]: Starting Kubernetes Kubelet... Jul 27 20:17:37.683672 ip-10-0-132-12 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 20:17:37.683672 ip-10-0-132-12 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 27 20:17:37.683672 ip-10-0-132-12 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 20:17:37.683672 ip-10-0-132-12 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 27 20:17:37.683672 ip-10-0-132-12 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 20:17:37.684291 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.683664 2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 27 20:17:37.690145 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690122 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 20:17:37.690145 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690140 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 20:17:37.690145 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690144 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 20:17:37.690145 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690147 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 20:17:37.690145 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690150 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 20:17:37.690145 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690154 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 27 20:17:37.690370 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690157 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 20:17:37.690370 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690160 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 20:17:37.690370 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690163 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 20:17:37.690370 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690166 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 20:17:37.690370 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690168 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 20:17:37.690370 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690171 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 20:17:37.690370 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690174 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 20:17:37.690370 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690176 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 20:17:37.690370 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690179 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 20:17:37.690370 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690183 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 20:17:37.690370 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690187 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 20:17:37.690370 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690190 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 20:17:37.690370 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690205 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 20:17:37.690370 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690207 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 20:17:37.690370 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690210 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 20:17:37.690370 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690213 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 20:17:37.690370 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690215 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 20:17:37.690370 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690218 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 20:17:37.690370 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690221 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 20:17:37.690370 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690223 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 20:17:37.690870 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690226 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 20:17:37.690870 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690229 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 20:17:37.690870 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690232 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 20:17:37.690870 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690236 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 20:17:37.690870 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690239 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 20:17:37.690870 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690242 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 20:17:37.690870 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690245 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 20:17:37.690870 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690248 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 20:17:37.690870 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690250 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 20:17:37.690870 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690253 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 20:17:37.690870 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690257 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 20:17:37.690870 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690260 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 20:17:37.690870 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690262 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 20:17:37.690870 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690265 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 20:17:37.690870 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690268 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 20:17:37.690870 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690272 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 20:17:37.690870 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690274 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 20:17:37.690870 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690277 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 20:17:37.690870 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690280 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 20:17:37.691325 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690282 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 20:17:37.691325 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690285 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 20:17:37.691325 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690288 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 20:17:37.691325 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690292 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 20:17:37.691325 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690295 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 20:17:37.691325 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690299 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 20:17:37.691325 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690302 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 20:17:37.691325 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690305 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 20:17:37.691325 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690307 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 20:17:37.691325 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690310 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 20:17:37.691325 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690312 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 20:17:37.691325 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690315 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 20:17:37.691325 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690317 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 20:17:37.691325 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690321 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 20:17:37.691325 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690323 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 20:17:37.691325 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690326 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 20:17:37.691325 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690328 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 20:17:37.691325 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690331 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 20:17:37.691325 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690333 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 20:17:37.691812 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690336 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 20:17:37.691812 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690338 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 20:17:37.691812 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690341 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 20:17:37.691812 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690343 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 20:17:37.691812 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690346 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 20:17:37.691812 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690348 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 20:17:37.691812 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690351 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 20:17:37.691812 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690354 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 20:17:37.691812 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690357 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 20:17:37.691812 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690360 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 20:17:37.691812 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690362 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 20:17:37.691812 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690365 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 20:17:37.691812 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690367 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 20:17:37.691812 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690370 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 20:17:37.691812 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690372 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 20:17:37.691812 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690375 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 20:17:37.691812 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690378 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 20:17:37.691812 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690380 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 20:17:37.691812 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690383 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 20:17:37.691812 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690386 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 20:17:37.692319 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690389 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 20:17:37.692319 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690391 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 20:17:37.692319 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690394 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 20:17:37.692319 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690396 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 20:17:37.692319 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690399 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 20:17:37.692319 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690402 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 20:17:37.692319 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690404 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 20:17:37.692319 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690407 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 20:17:37.692319 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690409 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 20:17:37.692319 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690411 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 20:17:37.692319 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690414 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 20:17:37.692319 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690417 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 20:17:37.692319 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690419 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 20:17:37.692319 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690422 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 20:17:37.692319 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.690424 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 20:17:37.692319 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691150 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 20:17:37.692319 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691157 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 20:17:37.692319 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691160 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 20:17:37.692319 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691164 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 20:17:37.692786 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691168 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 20:17:37.692786 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691171 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 20:17:37.692786 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691176 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 20:17:37.692786 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691179 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 20:17:37.692786 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691182 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 20:17:37.692786 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691185 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 20:17:37.692786 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691188 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 20:17:37.692786 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691191 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 20:17:37.692786 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691194 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 20:17:37.692786 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691197 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 20:17:37.692786 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691200 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 20:17:37.692786 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691203 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 20:17:37.692786 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691206 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 20:17:37.692786 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691209 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 20:17:37.692786 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691211 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 20:17:37.692786 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691214 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 20:17:37.692786 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691217 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 20:17:37.692786 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691219 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 20:17:37.692786 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691222 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 20:17:37.693265 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691224 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 20:17:37.693265 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691227 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 20:17:37.693265 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691229 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 20:17:37.693265 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691232 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 20:17:37.693265 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691234 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 20:17:37.693265 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691237 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 20:17:37.693265 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691239 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 20:17:37.693265 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691242 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 20:17:37.693265 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691244 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 20:17:37.693265 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691247 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 20:17:37.693265 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691249 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 20:17:37.693265 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691252 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 20:17:37.693265 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691255 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 20:17:37.693265 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691258 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 20:17:37.693265 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691261 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 20:17:37.693265 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691263 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 20:17:37.693265 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691266 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 20:17:37.693265 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691268 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 20:17:37.693265 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691270 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 20:17:37.693265 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691273 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 20:17:37.693877 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691275 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 20:17:37.693877 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691278 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 20:17:37.693877 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691280 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 20:17:37.693877 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691284 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 20:17:37.693877 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691286 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 20:17:37.693877 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691289 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 20:17:37.693877 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691291 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 20:17:37.693877 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691294 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 20:17:37.693877 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691296 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 20:17:37.693877 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691299 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 20:17:37.693877 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691302 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 20:17:37.693877 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691304 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 20:17:37.693877 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691307 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 20:17:37.693877 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691309 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 20:17:37.693877 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691311 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 20:17:37.693877 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691314 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 20:17:37.693877 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691316 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 20:17:37.693877 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691319 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 20:17:37.693877 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691321 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 20:17:37.693877 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691324 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 20:17:37.694374 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691326 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 20:17:37.694374 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691329 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 20:17:37.694374 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691331 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 20:17:37.694374 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691334 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 20:17:37.694374 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691337 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 20:17:37.694374 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691341 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 20:17:37.694374 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691344 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 20:17:37.694374 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691347 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 20:17:37.694374 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691349 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 20:17:37.694374 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691352 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 20:17:37.694374 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691355 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 20:17:37.694374 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691357 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 20:17:37.694374 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691360 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 20:17:37.694374 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691362 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 20:17:37.694374 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691365 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 20:17:37.694374 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691367 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 20:17:37.694374 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691370 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 20:17:37.694374 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691373 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 20:17:37.694374 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691375 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 20:17:37.694861 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691378 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 20:17:37.694861 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691381 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 20:17:37.694861 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691384 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 20:17:37.694861 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691386 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 20:17:37.694861 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691391 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 20:17:37.694861 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691395 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 20:17:37.694861 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691398 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 20:17:37.694861 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691400 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 20:17:37.694861 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691405 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 20:17:37.694861 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691408 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 20:17:37.694861 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691411 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 20:17:37.694861 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691413 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 20:17:37.694861 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691416 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 20:17:37.694861 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691419 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 20:17:37.694861 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691421 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 20:17:37.694861 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691424 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 27 20:17:37.694861 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691426 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 20:17:37.694861 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691832 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 20:17:37.694861 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691839 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 20:17:37.695344 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691841 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 20:17:37.695344 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691846 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 20:17:37.695344 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691850 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 20:17:37.695344 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691854 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 20:17:37.695344 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691857 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 20:17:37.695344 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691860 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 20:17:37.695344 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691863 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 20:17:37.695344 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691866 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 20:17:37.695344 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691869 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 20:17:37.695344 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691871 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 20:17:37.695344 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691874 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 20:17:37.695344 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691877 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 20:17:37.695344 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691879 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 20:17:37.695344 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691882 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 20:17:37.695344 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691886 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 20:17:37.695344 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691889 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 20:17:37.695344 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691891 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 20:17:37.695344 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691894 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 20:17:37.695344 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691896 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 20:17:37.695840 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691899 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 20:17:37.695840 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691901 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 20:17:37.695840 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691904 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 20:17:37.695840 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691907 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 20:17:37.695840 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691909 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 20:17:37.695840 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691912 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 20:17:37.695840 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691914 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 20:17:37.695840 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691916 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 20:17:37.695840 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691919 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 20:17:37.695840 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691922 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 20:17:37.695840 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691924 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 20:17:37.695840 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691927 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 20:17:37.695840 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691930 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 20:17:37.695840 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691932 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 20:17:37.695840 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691935 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 20:17:37.695840 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691937 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 20:17:37.695840 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691940 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 20:17:37.695840 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691942 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 20:17:37.695840 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691945 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 20:17:37.695840 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691947 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 20:17:37.696316 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691950 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 20:17:37.696316 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691952 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 20:17:37.696316 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691955 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 20:17:37.696316 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691958 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 20:17:37.696316 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691961 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 20:17:37.696316 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691964 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 20:17:37.696316 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691966 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 20:17:37.696316 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691969 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 20:17:37.696316 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691972 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 20:17:37.696316 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691974 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 20:17:37.696316 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691977 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 20:17:37.696316 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691979 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 20:17:37.696316 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691982 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 20:17:37.696316 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691984 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 20:17:37.696316 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691986 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 20:17:37.696316 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691989 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 20:17:37.696316 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691992 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 20:17:37.696316 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691994 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 20:17:37.696316 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691997 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 20:17:37.696316 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.691999 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 20:17:37.696822 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.692001 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 20:17:37.696822 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.692007 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 20:17:37.696822 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.692009 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 20:17:37.696822 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.692014 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 20:17:37.696822 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.692016 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 20:17:37.696822 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.692019 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 20:17:37.696822 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.692022 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 20:17:37.696822 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.692024 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 20:17:37.696822 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.692027 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 20:17:37.696822 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.692030 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 20:17:37.696822 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.692032 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 20:17:37.696822 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.692035 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 20:17:37.696822 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.692038 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 20:17:37.696822 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.692043 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 20:17:37.696822 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.692046 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 20:17:37.696822 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.692049 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 20:17:37.696822 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.692051 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 20:17:37.696822 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.692054 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 20:17:37.696822 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.692057 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 20:17:37.696822 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.692060 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 20:17:37.697341 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.692062 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 20:17:37.697341 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.692065 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 20:17:37.697341 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.692068 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 20:17:37.697341 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.692071 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 20:17:37.697341 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.692073 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 20:17:37.697341 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.692076 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 20:17:37.697341 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.692078 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 20:17:37.697341 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.692081 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 20:17:37.697341 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.692083 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 20:17:37.697341 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.692086 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 27 20:17:37.697341 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.692089 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 20:17:37.697341 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.692091 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 20:17:37.697341 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.692095 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 20:17:37.697341 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.692101 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 20:17:37.697341 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.692104 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 20:17:37.697341 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.692108 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 20:17:37.697341 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.692111 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 20:17:37.697341 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.692114 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 20:17:37.697341 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692189 2558 flags.go:64] FLAG: --address="0.0.0.0" Jul 27 20:17:37.697341 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692200 2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 27 20:17:37.697341 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692206 2558 flags.go:64] FLAG: --anonymous-auth="true" Jul 27 20:17:37.697874 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692211 2558 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 27 20:17:37.697874 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692215 2558 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 27 20:17:37.697874 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692218 2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 27 20:17:37.697874 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692222 2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 27 20:17:37.697874 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692226 2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 27 20:17:37.697874 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692229 2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 27 20:17:37.697874 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692232 2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 27 20:17:37.697874 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692236 2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 27 20:17:37.697874 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692239 2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 27 20:17:37.697874 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692242 2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 27 20:17:37.697874 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692245 2558 flags.go:64] FLAG: --cgroup-root="" Jul 27 20:17:37.697874 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692248 2558 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 27 20:17:37.697874 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692251 2558 flags.go:64] FLAG: --client-ca-file="" Jul 27 20:17:37.697874 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692255 2558 flags.go:64] FLAG: --cloud-provider="external" Jul 27 20:17:37.697874 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692258 2558 flags.go:64] FLAG: --cluster-dns="[]" Jul 27 20:17:37.697874 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692262 2558 flags.go:64] FLAG: --cluster-domain="" Jul 27 20:17:37.697874 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692265 2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 27 20:17:37.697874 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692268 2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 27 20:17:37.697874 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692271 2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 27 20:17:37.697874 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692274 2558 flags.go:64] FLAG: --container-log-max-files="5" Jul 27 20:17:37.697874 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692278 2558 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 27 20:17:37.697874 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692281 2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 27 20:17:37.697874 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692284 2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 27 20:17:37.698417 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692287 2558 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 27 20:17:37.698417 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692291 2558 flags.go:64] FLAG: --contention-profiling="false" Jul 27 20:17:37.698417 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692294 2558 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 27 20:17:37.698417 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692299 2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 27 20:17:37.698417 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692302 2558 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 27 20:17:37.698417 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692305 2558 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 27 20:17:37.698417 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692310 2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 27 20:17:37.698417 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692312 2558 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 27 20:17:37.698417 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692315 2558 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 27 20:17:37.698417 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692318 2558 flags.go:64] FLAG: --enable-load-reader="false" Jul 27 20:17:37.698417 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692321 2558 flags.go:64] FLAG: --enable-server="true" Jul 27 20:17:37.698417 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692324 2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 27 20:17:37.698417 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692329 2558 flags.go:64] FLAG: --event-burst="100" Jul 27 20:17:37.698417 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692332 2558 flags.go:64] FLAG: --event-qps="50" Jul 27 20:17:37.698417 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692335 2558 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 27 20:17:37.698417 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692338 2558 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 27 20:17:37.698417 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692341 2558 flags.go:64] FLAG: --eviction-hard="" Jul 27 20:17:37.698417 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692344 2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 27 20:17:37.698417 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692347 2558 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 27 20:17:37.698417 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692350 2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 27 20:17:37.698417 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692353 2558 flags.go:64] FLAG: --eviction-soft="" Jul 27 20:17:37.698417 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692356 2558 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 27 20:17:37.698417 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692359 2558 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 27 20:17:37.698417 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692362 2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 27 20:17:37.698417 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692365 2558 flags.go:64] FLAG: --experimental-mounter-path="" Jul 27 20:17:37.699057 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692368 2558 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 27 20:17:37.699057 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692371 2558 flags.go:64] FLAG: --fail-swap-on="true" Jul 27 20:17:37.699057 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692374 2558 flags.go:64] FLAG: --feature-gates="" Jul 27 20:17:37.699057 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692378 2558 flags.go:64] FLAG: --file-check-frequency="20s" Jul 27 20:17:37.699057 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692381 2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 27 20:17:37.699057 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692383 2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 27 20:17:37.699057 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692387 2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 27 20:17:37.699057 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692390 2558 flags.go:64] FLAG: --healthz-port="10248" Jul 27 20:17:37.699057 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692393 2558 flags.go:64] FLAG: --help="false" Jul 27 20:17:37.699057 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692396 2558 flags.go:64] FLAG: --hostname-override="ip-10-0-132-12.ec2.internal" Jul 27 20:17:37.699057 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692400 2558 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 27 20:17:37.699057 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692403 2558 flags.go:64] FLAG: --http-check-frequency="20s" Jul 27 20:17:37.699057 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692406 2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 27 20:17:37.699057 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692410 2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 27 20:17:37.699057 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692414 2558 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 27 20:17:37.699057 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692417 2558 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 27 20:17:37.699057 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692420 2558 flags.go:64] FLAG: --image-service-endpoint="" Jul 27 20:17:37.699057 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692422 2558 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 27 20:17:37.699057 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692426 2558 flags.go:64] FLAG: --kube-api-burst="100" Jul 27 20:17:37.699057 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692429 2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 27 20:17:37.699057 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692432 2558 flags.go:64] FLAG: --kube-api-qps="50" Jul 27 20:17:37.699057 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692434 2558 flags.go:64] FLAG: --kube-reserved="" Jul 27 20:17:37.699057 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692437 2558 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 27 20:17:37.699057 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692440 2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 27 20:17:37.699739 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692443 2558 flags.go:64] FLAG: --kubelet-cgroups="" Jul 27 20:17:37.699739 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692446 2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 27 20:17:37.699739 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692449 2558 flags.go:64] FLAG: --lock-file="" Jul 27 20:17:37.699739 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692452 2558 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 27 20:17:37.699739 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692454 2558 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 27 20:17:37.699739 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692457 2558 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 27 20:17:37.699739 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692463 2558 flags.go:64] FLAG: --log-json-split-stream="false" Jul 27 20:17:37.699739 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692470 2558 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 27 20:17:37.699739 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692473 2558 flags.go:64] FLAG: --log-text-split-stream="false" Jul 27 20:17:37.699739 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692476 2558 flags.go:64] FLAG: --logging-format="text" Jul 27 20:17:37.699739 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692479 2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 27 20:17:37.699739 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692483 2558 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 27 20:17:37.699739 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692485 2558 flags.go:64] FLAG: --manifest-url="" Jul 27 20:17:37.699739 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692488 2558 flags.go:64] FLAG: --manifest-url-header="" Jul 27 20:17:37.699739 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692492 2558 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 27 20:17:37.699739 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692495 2558 flags.go:64] FLAG: --max-open-files="1000000" Jul 27 20:17:37.699739 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692500 2558 flags.go:64] FLAG: --max-pods="110" Jul 27 20:17:37.699739 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692503 2558 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 27 20:17:37.699739 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692507 2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 27 20:17:37.699739 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692510 2558 flags.go:64] FLAG: --memory-manager-policy="None" Jul 27 20:17:37.699739 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692513 2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 27 20:17:37.699739 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692516 2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 27 20:17:37.699739 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692519 2558 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 27 20:17:37.699739 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692522 2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 27 20:17:37.699739 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692529 2558 flags.go:64] FLAG: --node-status-max-images="50" Jul 27 20:17:37.700370 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692532 2558 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 27 20:17:37.700370 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692535 2558 flags.go:64] FLAG: --oom-score-adj="-999" Jul 27 20:17:37.700370 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692538 2558 flags.go:64] FLAG: --pod-cidr="" Jul 27 20:17:37.700370 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692541 2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 27 20:17:37.700370 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692548 2558 flags.go:64] FLAG: --pod-manifest-path="" Jul 27 20:17:37.700370 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692550 2558 flags.go:64] FLAG: --pod-max-pids="-1" Jul 27 20:17:37.700370 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692553 2558 flags.go:64] FLAG: --pods-per-core="0" Jul 27 20:17:37.700370 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692556 2558 flags.go:64] FLAG: --port="10250" Jul 27 20:17:37.700370 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692559 2558 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 27 20:17:37.700370 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692562 2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0dbee74571f306c8b" Jul 27 20:17:37.700370 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692565 2558 flags.go:64] FLAG: --qos-reserved="" Jul 27 20:17:37.700370 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692568 2558 flags.go:64] FLAG: --read-only-port="10255" Jul 27 20:17:37.700370 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692571 2558 flags.go:64] FLAG: --register-node="true" Jul 27 20:17:37.700370 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692574 2558 flags.go:64] FLAG: --register-with-taints="" Jul 27 20:17:37.700370 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692582 2558 flags.go:64] FLAG: --registry-burst="10" Jul 27 20:17:37.700370 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692586 2558 flags.go:64] FLAG: --registry-qps="5" Jul 27 20:17:37.700370 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692589 2558 flags.go:64] FLAG: --reserved-cpus="" Jul 27 20:17:37.700370 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692592 2558 flags.go:64] FLAG: --reserved-memory="" Jul 27 20:17:37.700370 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692595 2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 27 20:17:37.700370 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692598 2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 27 20:17:37.700370 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692601 2558 flags.go:64] FLAG: --rotate-certificates="false" Jul 27 20:17:37.700370 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692604 2558 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 27 20:17:37.700370 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692607 2558 flags.go:64] FLAG: --runonce="false" Jul 27 20:17:37.700370 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692610 2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 27 20:17:37.700370 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692614 2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 27 20:17:37.701001 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692617 2558 flags.go:64] FLAG: --seccomp-default="false" Jul 27 20:17:37.701001 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692621 2558 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 27 20:17:37.701001 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692624 2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 27 20:17:37.701001 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692627 2558 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 27 20:17:37.701001 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692630 2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 27 20:17:37.701001 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692633 2558 flags.go:64] FLAG: --storage-driver-password="root" Jul 27 20:17:37.701001 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692636 2558 flags.go:64] FLAG: --storage-driver-secure="false" Jul 27 20:17:37.701001 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692639 2558 flags.go:64] FLAG: --storage-driver-table="stats" Jul 27 20:17:37.701001 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692642 2558 flags.go:64] FLAG: --storage-driver-user="root" Jul 27 20:17:37.701001 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692645 2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 27 20:17:37.701001 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692648 2558 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 27 20:17:37.701001 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692651 2558 flags.go:64] FLAG: --system-cgroups="" Jul 27 20:17:37.701001 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692654 2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 27 20:17:37.701001 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692659 2558 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 27 20:17:37.701001 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692662 2558 flags.go:64] FLAG: --tls-cert-file="" Jul 27 20:17:37.701001 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692664 2558 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 27 20:17:37.701001 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692669 2558 flags.go:64] FLAG: --tls-min-version="" Jul 27 20:17:37.701001 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692672 2558 flags.go:64] FLAG: --tls-private-key-file="" Jul 27 20:17:37.701001 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692674 2558 flags.go:64] FLAG: --topology-manager-policy="none" Jul 27 20:17:37.701001 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692677 2558 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 27 20:17:37.701001 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692680 2558 flags.go:64] FLAG: --topology-manager-scope="container" Jul 27 20:17:37.701001 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692683 2558 flags.go:64] FLAG: --v="2" Jul 27 20:17:37.701001 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692702 2558 flags.go:64] FLAG: --version="false" Jul 27 20:17:37.701001 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692709 2558 flags.go:64] FLAG: --vmodule="" Jul 27 20:17:37.701001 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692713 2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 27 20:17:37.701611 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.692716 2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 27 20:17:37.701611 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693474 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 20:17:37.701611 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693479 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 20:17:37.701611 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693482 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 20:17:37.701611 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693485 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 20:17:37.701611 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693489 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 20:17:37.701611 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693492 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 20:17:37.701611 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693495 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 20:17:37.701611 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693499 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 20:17:37.701611 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693502 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 20:17:37.701611 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693505 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 20:17:37.701611 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693508 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 20:17:37.701611 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693510 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 20:17:37.701611 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693513 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 20:17:37.701611 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693516 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 20:17:37.701611 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693519 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 20:17:37.701611 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693522 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 20:17:37.701611 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693525 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 20:17:37.701611 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693528 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 20:17:37.701611 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693530 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 20:17:37.702120 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693533 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 20:17:37.702120 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693535 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 20:17:37.702120 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693538 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 20:17:37.702120 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693541 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 20:17:37.702120 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693543 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 27 20:17:37.702120 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693546 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 20:17:37.702120 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693548 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 20:17:37.702120 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693552 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 20:17:37.702120 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693556 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 20:17:37.702120 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693559 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 20:17:37.702120 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693562 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 20:17:37.702120 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693565 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 20:17:37.702120 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693568 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 20:17:37.702120 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693571 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 20:17:37.702120 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693575 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 20:17:37.702120 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693578 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 20:17:37.702120 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693581 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 20:17:37.702120 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693585 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 20:17:37.702120 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693587 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 20:17:37.702581 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693590 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 20:17:37.702581 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693595 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 20:17:37.702581 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693597 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 20:17:37.702581 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693600 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 20:17:37.702581 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693603 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 20:17:37.702581 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693605 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 20:17:37.702581 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693608 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 20:17:37.702581 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693611 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 20:17:37.702581 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693613 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 20:17:37.702581 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693616 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 20:17:37.702581 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693618 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 20:17:37.702581 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693621 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 20:17:37.702581 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693624 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 20:17:37.702581 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693628 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 20:17:37.702581 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693631 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 20:17:37.702581 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693633 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 20:17:37.702581 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693636 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 20:17:37.702581 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693638 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 20:17:37.702581 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693641 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 20:17:37.702581 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693644 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 20:17:37.703096 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693646 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 20:17:37.703096 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693649 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 20:17:37.703096 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693651 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 20:17:37.703096 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693654 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 20:17:37.703096 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693656 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 20:17:37.703096 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693659 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 20:17:37.703096 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693662 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 20:17:37.703096 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693665 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 20:17:37.703096 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693668 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 20:17:37.703096 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693670 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 20:17:37.703096 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693674 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 20:17:37.703096 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693677 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 20:17:37.703096 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693679 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 20:17:37.703096 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693683 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 20:17:37.703096 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693698 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 20:17:37.703096 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693701 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 20:17:37.703096 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693704 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 20:17:37.703096 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693707 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 20:17:37.703096 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693709 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 20:17:37.703096 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693712 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 20:17:37.703580 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693714 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 20:17:37.703580 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693717 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 20:17:37.703580 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693720 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 20:17:37.703580 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693722 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 20:17:37.703580 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693724 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 20:17:37.703580 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693727 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 20:17:37.703580 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693730 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 20:17:37.703580 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693732 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 20:17:37.703580 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693735 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 20:17:37.703580 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693738 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 20:17:37.703580 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693740 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 20:17:37.703580 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693743 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 20:17:37.703580 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693746 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 20:17:37.703580 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693748 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 20:17:37.703580 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693751 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 20:17:37.703580 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693753 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 20:17:37.703580 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693756 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 20:17:37.703580 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693759 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 20:17:37.703580 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693762 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 20:17:37.704066 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693764 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 20:17:37.704066 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.693767 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 20:17:37.704066 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.694278 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 20:17:37.704066 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.700809 2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 27 20:17:37.704066 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.700824 2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 27 20:17:37.704066 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.701541 2558 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 27 20:17:37.704066 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.701548 2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 27 20:17:37.704066 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701604 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 20:17:37.704066 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701609 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 20:17:37.704066 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701613 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 20:17:37.704066 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701617 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 20:17:37.704066 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701620 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 20:17:37.704066 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701623 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 20:17:37.704066 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701626 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 20:17:37.704433 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701629 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 20:17:37.704433 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701632 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 20:17:37.704433 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701635 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 20:17:37.704433 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701638 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 20:17:37.704433 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701643 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 20:17:37.704433 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701646 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 20:17:37.704433 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701650 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 20:17:37.704433 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701653 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 20:17:37.704433 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701656 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 20:17:37.704433 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701659 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 20:17:37.704433 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701662 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 20:17:37.704433 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701665 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 20:17:37.704433 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701669 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 20:17:37.704433 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701672 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 20:17:37.704433 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701674 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 20:17:37.704433 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701677 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 20:17:37.704433 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701679 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 20:17:37.704433 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701683 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 20:17:37.704433 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701700 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 20:17:37.704951 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701704 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 20:17:37.704951 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701707 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 20:17:37.704951 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701710 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 20:17:37.704951 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701714 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 20:17:37.704951 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701717 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 20:17:37.704951 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701720 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 20:17:37.704951 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701722 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 20:17:37.704951 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701725 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 20:17:37.704951 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701728 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 20:17:37.704951 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701730 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 20:17:37.704951 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701733 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 20:17:37.704951 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701735 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 20:17:37.704951 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701738 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 20:17:37.704951 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701740 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 20:17:37.704951 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701743 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 20:17:37.704951 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701746 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 20:17:37.704951 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701749 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 20:17:37.704951 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701752 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 20:17:37.704951 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701754 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 20:17:37.704951 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701757 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 20:17:37.705425 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701759 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 27 20:17:37.705425 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701762 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 20:17:37.705425 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701764 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 20:17:37.705425 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701767 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 20:17:37.705425 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701770 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 20:17:37.705425 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701773 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 20:17:37.705425 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701775 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 20:17:37.705425 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701778 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 20:17:37.705425 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701780 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 20:17:37.705425 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701783 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 20:17:37.705425 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701785 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 20:17:37.705425 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701789 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 20:17:37.705425 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701792 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 20:17:37.705425 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701794 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 20:17:37.705425 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701797 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 20:17:37.705425 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701800 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 20:17:37.705425 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701803 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 20:17:37.705425 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701805 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 20:17:37.705425 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701808 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 20:17:37.705425 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701810 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 20:17:37.705425 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701813 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 20:17:37.705971 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701815 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 20:17:37.705971 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701818 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 20:17:37.705971 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701820 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 20:17:37.705971 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701823 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 20:17:37.705971 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701826 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 20:17:37.705971 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701828 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 20:17:37.705971 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701831 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 20:17:37.705971 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701833 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 20:17:37.705971 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701835 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 20:17:37.705971 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701838 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 20:17:37.705971 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701841 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 20:17:37.705971 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701843 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 20:17:37.705971 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701846 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 20:17:37.705971 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701849 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 20:17:37.705971 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701851 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 20:17:37.705971 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701854 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 20:17:37.705971 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701856 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 20:17:37.705971 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701859 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 20:17:37.705971 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701861 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 20:17:37.705971 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701865 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 20:17:37.706508 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701868 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 20:17:37.706508 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701872 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 20:17:37.706508 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701874 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 20:17:37.706508 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701877 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 20:17:37.706508 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701880 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 20:17:37.706508 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701882 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 20:17:37.706508 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701885 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 20:17:37.706508 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701888 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 20:17:37.706508 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701890 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 20:17:37.706508 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701893 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 20:17:37.706508 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701896 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 20:17:37.706508 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.701898 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 20:17:37.706508 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.701904 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 20:17:37.706508 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702026 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 20:17:37.706885 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702031 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 20:17:37.706885 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702034 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 20:17:37.706885 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702037 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 20:17:37.706885 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702039 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 20:17:37.706885 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702042 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 20:17:37.706885 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702045 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 20:17:37.706885 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702047 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 20:17:37.706885 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702050 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 20:17:37.706885 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702054 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 20:17:37.706885 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702059 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 20:17:37.706885 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702062 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 20:17:37.706885 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702065 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 20:17:37.706885 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702067 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 20:17:37.706885 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702070 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 20:17:37.706885 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702073 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 20:17:37.706885 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702076 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 20:17:37.706885 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702079 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 20:17:37.706885 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702082 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 20:17:37.706885 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702085 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 20:17:37.706885 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702088 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 20:17:37.707363 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702090 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 20:17:37.707363 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702093 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 20:17:37.707363 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702096 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 20:17:37.707363 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702099 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 20:17:37.707363 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702102 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 20:17:37.707363 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702105 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 20:17:37.707363 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702108 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 20:17:37.707363 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702110 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 20:17:37.707363 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702113 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 20:17:37.707363 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702116 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 20:17:37.707363 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702118 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 20:17:37.707363 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702121 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 20:17:37.707363 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702124 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 20:17:37.707363 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702126 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 20:17:37.707363 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702129 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 20:17:37.707363 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702132 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 20:17:37.707363 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702134 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 20:17:37.707363 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702137 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 20:17:37.707363 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702139 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 20:17:37.707363 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702142 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 20:17:37.707979 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702145 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 20:17:37.707979 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702148 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 20:17:37.707979 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702150 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 20:17:37.707979 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702153 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 20:17:37.707979 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702155 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 27 20:17:37.707979 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702158 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 20:17:37.707979 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702160 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 20:17:37.707979 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702163 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 20:17:37.707979 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702165 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 20:17:37.707979 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702168 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 20:17:37.707979 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702170 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 20:17:37.707979 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702173 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 20:17:37.707979 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702175 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 20:17:37.707979 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702178 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 20:17:37.707979 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702180 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 20:17:37.707979 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702185 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 20:17:37.707979 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702188 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 20:17:37.707979 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702191 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 20:17:37.707979 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702194 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 20:17:37.707979 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702197 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 20:17:37.708464 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702199 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 20:17:37.708464 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702202 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 20:17:37.708464 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702205 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 20:17:37.708464 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702207 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 20:17:37.708464 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702210 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 20:17:37.708464 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702212 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 20:17:37.708464 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702215 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 20:17:37.708464 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702217 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 20:17:37.708464 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702220 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 20:17:37.708464 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702222 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 20:17:37.708464 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702225 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 20:17:37.708464 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702227 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 20:17:37.708464 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702230 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 20:17:37.708464 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702233 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 20:17:37.708464 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702237 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 20:17:37.708464 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702240 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 20:17:37.708464 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702242 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 20:17:37.708464 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702245 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 20:17:37.708464 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702247 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 20:17:37.708947 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702250 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 20:17:37.708947 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702252 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 20:17:37.708947 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702255 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 20:17:37.708947 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702257 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 20:17:37.708947 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702260 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 20:17:37.708947 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702263 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 20:17:37.708947 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702265 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 20:17:37.708947 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702267 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 20:17:37.708947 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702270 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 20:17:37.708947 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702273 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 20:17:37.708947 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702276 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 20:17:37.708947 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702278 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 20:17:37.708947 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702280 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 20:17:37.708947 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702283 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 20:17:37.708947 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702285 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 20:17:37.708947 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702288 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 20:17:37.708947 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702290 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 20:17:37.708947 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702293 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 20:17:37.708947 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:37.702295 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 20:17:37.709435 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.702300 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 20:17:37.709435 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.702392 2558 server.go:962] "Client rotation is on, will bootstrap in background" Jul 27 20:17:37.709435 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.704313 2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 27 20:17:37.709435 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.705539 2558 server.go:1019] "Starting client certificate rotation" Jul 27 20:17:37.709435 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.705641 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 27 20:17:37.709435 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.705671 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 27 20:17:37.709435 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.707876 2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 27 20:17:37.710962 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.710950 2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 27 20:17:37.723128 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.723106 2558 log.go:25] "Validated CRI v1 runtime API" Jul 27 20:17:37.726025 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.726010 2558 log.go:25] "Validated CRI v1 image API" Jul 27 20:17:37.726813 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.726793 2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 27 20:17:37.729047 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.729018 2558 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 94ce70f4-9fd5-4659-8b90-8079cdfa627e:/dev/nvme0n1p4 f7979772-114e-4225-be2f-3cae9da355ac:/dev/nvme0n1p3] Jul 27 20:17:37.729124 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.729046 2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 27 20:17:37.734134 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.734023 2558 manager.go:216] Machine: {Timestamp:2026-07-27 20:17:37.732522185 +0000 UTC m=+0.311095765 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3152044 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec250fe3a55808513c53ae052b203126 SystemUUID:ec250fe3-a558-0851-3c53-ae052b203126 BootID:41d63a4c-eb52-4b38-8c68-b0e40f3d2be5 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1b:c5:4b:81:09 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1b:c5:4b:81:09 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9a:01:84:d2:3d:63 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 27 20:17:37.734134 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.734125 2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 27 20:17:37.734312 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.734195 2558 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 27 20:17:37.738318 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.738289 2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 27 20:17:37.738483 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.738323 2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-12.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 27 20:17:37.739089 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.739072 2558 topology_manager.go:138] "Creating topology manager with none policy" Jul 27 20:17:37.739089 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.739091 2558 container_manager_linux.go:309] "Creating device plugin manager" Jul 27 20:17:37.739196 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.739102 2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 27 20:17:37.739227 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.739202 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 27 20:17:37.739769 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.739758 2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 27 20:17:37.740664 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.740656 2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 27 20:17:37.742420 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.742409 2558 state_mem.go:36] "Initialized new in-memory state store" Jul 27 20:17:37.742533 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.742523 2558 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 27 20:17:37.742565 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.742554 2558 kubelet.go:486] "Attempting to sync node with API server" Jul 27 20:17:37.742596 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.742566 2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 27 20:17:37.742596 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.742581 2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 27 20:17:37.742596 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.742591 2558 kubelet.go:398] "Adding apiserver pod source" Jul 27 20:17:37.742676 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.742600 2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 27 20:17:37.742933 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.742922 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 27 20:17:37.742979 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.742940 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 27 20:17:37.745807 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.745792 2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 27 20:17:37.747572 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.747559 2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 27 20:17:37.747612 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.747588 2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 27 20:17:37.749200 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.749189 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 27 20:17:37.749235 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.749206 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 27 20:17:37.749235 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.749212 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 27 20:17:37.749235 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.749217 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 27 20:17:37.749235 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.749225 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 27 20:17:37.749235 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.749233 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 27 20:17:37.749382 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.749245 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 27 20:17:37.749382 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.749251 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 27 20:17:37.749382 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.749257 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 27 20:17:37.749382 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.749262 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 27 20:17:37.749382 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.749271 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 27 20:17:37.749382 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.749276 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 27 20:17:37.750132 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.750121 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 27 20:17:37.750184 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.750131 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 27 20:17:37.753186 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.753164 2558 server.go:1268] "Started kubelet" Jul 27 20:17:37.753294 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.753250 2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 27 20:17:37.753354 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.753313 2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 27 20:17:37.753401 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.753353 2558 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 27 20:17:37.753941 ip-10-0-132-12 systemd[1]: Started Kubernetes Kubelet. Jul 27 20:17:37.756099 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.756069 2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 27 20:17:37.756400 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.756376 2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-12.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 27 20:17:37.757024 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:37.756995 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-12.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 27 20:17:37.757248 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:37.757215 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 27 20:17:37.757579 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.757563 2558 server.go:310] "Adding debug handlers to kubelet server" Jul 27 20:17:37.759739 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:37.759721 2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 27 20:17:37.762082 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:37.760681 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-12.ec2.internal.18c63ee582477013 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-12.ec2.internal,UID:ip-10-0-132-12.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-12.ec2.internal,},FirstTimestamp:2026-07-27 20:17:37.753133075 +0000 UTC m=+0.331706656,LastTimestamp:2026-07-27 20:17:37.753133075 +0000 UTC m=+0.331706656,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-12.ec2.internal,}" Jul 27 20:17:37.764503 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.764484 2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 27 20:17:37.764503 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.764496 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 27 20:17:37.764762 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:37.764664 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-12.ec2.internal\" not found" Jul 27 20:17:37.765932 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.765095 2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 27 20:17:37.765932 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.765722 2558 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 27 20:17:37.765932 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.765741 2558 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 27 20:17:37.766126 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.765955 2558 reconstruct.go:97] "Volume reconstruction finished" Jul 27 20:17:37.766126 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.765965 2558 reconciler.go:29] "Reconciler: start to sync state" Jul 27 20:17:37.766218 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.766169 2558 factory.go:55] Registering systemd factory Jul 27 20:17:37.766218 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.766183 2558 factory.go:223] Registration of the systemd container factory successfully Jul 27 20:17:37.766506 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.766491 2558 factory.go:153] Registering CRI-O factory Jul 27 20:17:37.766506 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.766509 2558 factory.go:223] Registration of the crio container factory successfully Jul 27 20:17:37.766618 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.766557 2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 27 20:17:37.766618 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.766578 2558 factory.go:103] Registering Raw factory Jul 27 20:17:37.766618 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.766592 2558 manager.go:1196] Started watching for new ooms in manager Jul 27 20:17:37.767003 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.766989 2558 manager.go:349] Starting recovery of all containers Jul 27 20:17:37.770618 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:37.770592 2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-12.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 27 20:17:37.770705 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:37.770624 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 27 20:17:37.778715 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.778587 2558 manager.go:354] Recovery completed Jul 27 20:17:37.782736 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.782724 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 20:17:37.787237 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.787217 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-12.ec2.internal" event="NodeHasSufficientMemory" Jul 27 20:17:37.787313 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.787250 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-12.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 20:17:37.787313 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.787260 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-12.ec2.internal" event="NodeHasSufficientPID" Jul 27 20:17:37.787577 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.787561 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-98kpt" Jul 27 20:17:37.787835 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.787824 2558 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 27 20:17:37.787835 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.787834 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 20:17:37.787908 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.787834 2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 27 20:17:37.787908 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.787885 2558 state_mem.go:36] "Initialized new in-memory state store" Jul 27 20:17:37.789088 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:37.789025 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-12.ec2.internal.18c63ee5844fcfd4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-12.ec2.internal,UID:ip-10-0-132-12.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-12.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-12.ec2.internal,},FirstTimestamp:2026-07-27 20:17:37.787236308 +0000 UTC m=+0.365809893,LastTimestamp:2026-07-27 20:17:37.787236308 +0000 UTC m=+0.365809893,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-12.ec2.internal,}" Jul 27 20:17:37.789628 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.789617 2558 policy_none.go:49] "None policy: Start" Jul 27 20:17:37.789667 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.789632 2558 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 27 20:17:37.789667 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.789641 2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 27 20:17:37.790907 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.790896 2558 policy_none.go:47] "Start" Jul 27 20:17:37.791887 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.791747 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-12.ec2.internal" event="NodeHasSufficientMemory" Jul 27 20:17:37.791957 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.791904 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-12.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 20:17:37.791957 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.791919 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-12.ec2.internal" event="NodeHasSufficientPID" Jul 27 20:17:37.796843 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.796827 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-98kpt" Jul 27 20:17:37.802122 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:37.802063 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-12.ec2.internal.18c63ee5845019a8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-12.ec2.internal,UID:ip-10-0-132-12.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-12.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-12.ec2.internal,},FirstTimestamp:2026-07-27 20:17:37.787255208 +0000 UTC m=+0.365828787,LastTimestamp:2026-07-27 20:17:37.787255208 +0000 UTC m=+0.365828787,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-12.ec2.internal,}" Jul 27 20:17:37.822249 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.822235 2558 manager.go:337] "Starting Device Plugin manager" Jul 27 20:17:37.822320 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:37.822264 2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 27 20:17:37.822320 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.822273 2558 server.go:87] "Starting device plugin registration server" Jul 27 20:17:37.822496 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.822484 2558 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 27 20:17:37.822539 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.822498 2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 27 20:17:37.822618 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.822588 2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 27 20:17:37.822734 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.822680 2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 27 20:17:37.822734 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.822708 2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 27 20:17:37.823138 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:37.823122 2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 27 20:17:37.823204 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:37.823168 2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-12.ec2.internal\" not found" Jul 27 20:17:37.924156 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.924132 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 20:17:37.925816 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.925137 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-12.ec2.internal" event="NodeHasSufficientMemory" Jul 27 20:17:37.925816 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.925172 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-12.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 20:17:37.925816 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.925183 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-12.ec2.internal" event="NodeHasSufficientPID" Jul 27 20:17:37.925816 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.925212 2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-12.ec2.internal" Jul 27 20:17:37.926040 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.926010 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 27 20:17:37.927321 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.927302 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 27 20:17:37.927422 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.927342 2558 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 27 20:17:37.927422 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.927365 2558 kubelet.go:2448] "Starting kubelet main sync loop" Jul 27 20:17:37.927422 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:37.927399 2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 27 20:17:37.929750 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.929728 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 20:17:37.934531 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:37.934489 2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-12.ec2.internal" Jul 27 20:17:37.934531 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:37.934510 2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-12.ec2.internal\": node \"ip-10-0-132-12.ec2.internal\" not found" Jul 27 20:17:37.984121 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:37.984103 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-12.ec2.internal\" not found" Jul 27 20:17:38.030128 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:38.030095 2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-12.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-12.ec2.internal"] Jul 27 20:17:38.030212 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:38.030175 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 20:17:38.031874 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:38.031849 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-12.ec2.internal" event="NodeHasSufficientMemory" Jul 27 20:17:38.031989 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:38.031890 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-12.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 20:17:38.031989 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:38.031908 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-12.ec2.internal" event="NodeHasSufficientPID" Jul 27 20:17:38.033158 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:38.033142 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 20:17:38.033281 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:38.033261 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-12.ec2.internal" Jul 27 20:17:38.033336 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:38.033311 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 20:17:38.033993 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:38.033973 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-12.ec2.internal" event="NodeHasSufficientMemory" Jul 27 20:17:38.034085 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:38.034007 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-12.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 20:17:38.034085 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:38.034020 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-12.ec2.internal" event="NodeHasSufficientPID" Jul 27 20:17:38.034085 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:38.034037 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-12.ec2.internal" event="NodeHasSufficientMemory" Jul 27 20:17:38.034085 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:38.034058 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-12.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 20:17:38.034085 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:38.034067 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-12.ec2.internal" event="NodeHasSufficientPID" Jul 27 20:17:38.035452 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:38.035433 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-12.ec2.internal" Jul 27 20:17:38.035537 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:38.035458 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 20:17:38.036609 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:38.036580 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-12.ec2.internal" event="NodeHasSufficientMemory" Jul 27 20:17:38.036609 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:38.036608 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-12.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 20:17:38.036782 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:38.036623 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-12.ec2.internal" event="NodeHasSufficientPID" Jul 27 20:17:38.064437 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:38.064413 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-12.ec2.internal\" not found" node="ip-10-0-132-12.ec2.internal" Jul 27 20:17:38.067172 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:38.067147 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9500b4062bc35ffcbb05e58bd96d058d-config\") pod \"kube-apiserver-proxy-ip-10-0-132-12.ec2.internal\" (UID: \"9500b4062bc35ffcbb05e58bd96d058d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-12.ec2.internal" Jul 27 20:17:38.067268 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:38.067174 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7d2ddcfd94a3635c66b7a7044bfcc46f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-12.ec2.internal\" (UID: \"7d2ddcfd94a3635c66b7a7044bfcc46f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-12.ec2.internal" Jul 27 20:17:38.067268 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:38.067209 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d2ddcfd94a3635c66b7a7044bfcc46f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-12.ec2.internal\" (UID: \"7d2ddcfd94a3635c66b7a7044bfcc46f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-12.ec2.internal" Jul 27 20:17:38.069148 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:38.069129 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-12.ec2.internal\" not found" node="ip-10-0-132-12.ec2.internal" Jul 27 20:17:38.085079 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:38.085061 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-12.ec2.internal\" not found" Jul 27 20:17:38.167675 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:38.167641 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7d2ddcfd94a3635c66b7a7044bfcc46f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-12.ec2.internal\" (UID: \"7d2ddcfd94a3635c66b7a7044bfcc46f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-12.ec2.internal" Jul 27 20:17:38.167675 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:38.167596 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7d2ddcfd94a3635c66b7a7044bfcc46f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-12.ec2.internal\" (UID: \"7d2ddcfd94a3635c66b7a7044bfcc46f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-12.ec2.internal" Jul 27 20:17:38.167896 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:38.167734 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d2ddcfd94a3635c66b7a7044bfcc46f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-12.ec2.internal\" (UID: \"7d2ddcfd94a3635c66b7a7044bfcc46f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-12.ec2.internal" Jul 27 20:17:38.167896 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:38.167759 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9500b4062bc35ffcbb05e58bd96d058d-config\") pod \"kube-apiserver-proxy-ip-10-0-132-12.ec2.internal\" (UID: \"9500b4062bc35ffcbb05e58bd96d058d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-12.ec2.internal" Jul 27 20:17:38.167896 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:38.167808 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9500b4062bc35ffcbb05e58bd96d058d-config\") pod \"kube-apiserver-proxy-ip-10-0-132-12.ec2.internal\" (UID: \"9500b4062bc35ffcbb05e58bd96d058d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-12.ec2.internal" Jul 27 20:17:38.167896 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:38.167842 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d2ddcfd94a3635c66b7a7044bfcc46f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-12.ec2.internal\" (UID: \"7d2ddcfd94a3635c66b7a7044bfcc46f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-12.ec2.internal" Jul 27 20:17:38.186289 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:38.186237 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-12.ec2.internal\" not found" Jul 27 20:17:38.287186 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:38.287146 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-12.ec2.internal\" not found" Jul 27 20:17:38.370799 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:38.370769 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-12.ec2.internal" Jul 27 20:17:38.373091 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:38.373072 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-12.ec2.internal" Jul 27 20:17:38.387775 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:38.387743 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-12.ec2.internal\" not found" Jul 27 20:17:38.488742 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:38.488640 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-12.ec2.internal\" not found" Jul 27 20:17:38.589701 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:38.589661 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-12.ec2.internal\" not found" Jul 27 20:17:38.689905 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:38.689869 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-12.ec2.internal\" not found" Jul 27 20:17:38.705159 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:38.705131 2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 27 20:17:38.705287 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:38.705266 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 27 20:17:38.790862 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:38.790800 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-12.ec2.internal\" not found" Jul 27 20:17:38.801751 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:38.801722 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 20:12:38 +0000 UTC" deadline="2027-12-21 15:02:50.1143618 +0000 UTC" Jul 27 20:17:38.801837 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:38.801749 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12282h45m11.312617899s" Jul 27 20:17:38.823654 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:38.823637 2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 20:17:38.862773 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:38.862747 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 20:17:38.863901 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:38.863886 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-12.ec2.internal" event="NodeHasSufficientMemory" Jul 27 20:17:38.863967 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:38.863917 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-12.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 20:17:38.863967 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:38.863929 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-12.ec2.internal" event="NodeHasSufficientPID" Jul 27 20:17:38.891854 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:38.891832 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-12.ec2.internal\" not found" Jul 27 20:17:38.949847 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:38.949827 2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 20:17:38.964833 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:38.964811 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-12.ec2.internal" Jul 27 20:17:38.976348 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:38.976331 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 27 20:17:38.978215 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:38.978201 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-12.ec2.internal" Jul 27 20:17:38.986838 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:38.986821 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 27 20:17:39.005589 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.005573 2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 20:17:39.036251 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:39.036227 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d2ddcfd94a3635c66b7a7044bfcc46f.slice/crio-4b3c36ec372e02d1c1229ce0d15b50c66f8b4dd2b7780cd70d71ee515153b91b WatchSource:0}: Error finding container 4b3c36ec372e02d1c1229ce0d15b50c66f8b4dd2b7780cd70d71ee515153b91b: Status 404 returned error can't find the container with id 4b3c36ec372e02d1c1229ce0d15b50c66f8b4dd2b7780cd70d71ee515153b91b Jul 27 20:17:39.036875 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:39.036850 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9500b4062bc35ffcbb05e58bd96d058d.slice/crio-0b316b0a9f1a12a181acb8234717c9caeb6562026dde3a067e8a2cf5923ad6e1 WatchSource:0}: Error finding container 0b316b0a9f1a12a181acb8234717c9caeb6562026dde3a067e8a2cf5923ad6e1: Status 404 returned error can't find the container with id 0b316b0a9f1a12a181acb8234717c9caeb6562026dde3a067e8a2cf5923ad6e1 Jul 27 20:17:39.043111 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.043083 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 20:17:39.745998 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.745966 2558 apiserver.go:52] "Watching apiserver" Jul 27 20:17:39.754177 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.754153 2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 27 20:17:39.754594 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.754567 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-8lb48","openshift-multus/multus-g4jc5","openshift-ovn-kubernetes/ovnkube-node-rnj2b","kube-system/global-pull-secret-syncer-57jqw","openshift-dns/node-resolver-4xms6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-12.ec2.internal","openshift-multus/network-metrics-daemon-q4rh9","openshift-network-diagnostics/network-check-target-qbvkx","openshift-network-operator/iptables-alerter-w6nc7","kube-system/konnectivity-agent-2qctb","kube-system/kube-apiserver-proxy-ip-10-0-132-12.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhrbf","openshift-cluster-node-tuning-operator/tuned-xlf7b","openshift-image-registry/node-ca-k687z"] Jul 27 20:17:39.756324 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.756293 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4rh9" Jul 27 20:17:39.756462 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:39.756392 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4rh9" podUID="ed1721a8-1162-43d4-a7ae-20fb77b38000" Jul 27 20:17:39.757782 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.757743 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xlf7b" Jul 27 20:17:39.759552 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.759528 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.760403 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.760378 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 27 20:17:39.760498 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.760472 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mhpbk\"" Jul 27 20:17:39.760724 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.760661 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 27 20:17:39.761121 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.761103 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-57jqw" Jul 27 20:17:39.761201 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:39.761179 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-57jqw" podUID="5db14a3f-0592-417e-8de6-a29bbe4cbfbd" Jul 27 20:17:39.762296 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.762249 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 27 20:17:39.762397 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.762342 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 27 20:17:39.763013 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.762467 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 27 20:17:39.763013 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.762566 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 27 20:17:39.763013 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.762257 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 27 20:17:39.763013 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.762896 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-462gb\"" Jul 27 20:17:39.763013 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.762950 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 27 20:17:39.763303 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.763144 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4xms6" Jul 27 20:17:39.764867 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.764725 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k687z" Jul 27 20:17:39.765555 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.765531 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 27 20:17:39.765683 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.765643 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pq5r5\"" Jul 27 20:17:39.765779 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.765763 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 27 20:17:39.765876 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.765859 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 27 20:17:39.766186 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.766158 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-w6nc7" Jul 27 20:17:39.766851 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.766828 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 27 20:17:39.767135 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.767067 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 27 20:17:39.767135 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.767130 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-cvq2r\"" Jul 27 20:17:39.768298 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.767370 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 27 20:17:39.768298 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.768212 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8lb48" Jul 27 20:17:39.768478 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.768405 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 27 20:17:39.768818 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.768785 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-l8fvh\"" Jul 27 20:17:39.769271 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.769246 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 27 20:17:39.769361 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.769347 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 27 20:17:39.770486 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.770467 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 27 20:17:39.773587 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.773551 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6xfn5\"" Jul 27 20:17:39.776890 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.773700 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 27 20:17:39.776890 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.773899 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 20:17:39.776890 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.773915 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 27 20:17:39.776890 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.774067 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 27 20:17:39.776890 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.774732 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 27 20:17:39.776890 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.774916 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.776890 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.775084 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2qctb" Jul 27 20:17:39.776890 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.776370 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbvkx" Jul 27 20:17:39.776890 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:39.776524 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbvkx" podUID="828a7e08-7c87-434e-86e6-39ce766c6606" Jul 27 20:17:39.777493 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.777468 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c421dc44-8fcf-44f4-b483-8e0271833d10-node-log\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.777597 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.777507 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c421dc44-8fcf-44f4-b483-8e0271833d10-host-cni-netd\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.777597 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.777544 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c421dc44-8fcf-44f4-b483-8e0271833d10-env-overrides\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.777597 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.777576 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26p8w\" (UniqueName: \"kubernetes.io/projected/c421dc44-8fcf-44f4-b483-8e0271833d10-kube-api-access-26p8w\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.777842 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.777800 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgmvg\" (UniqueName: \"kubernetes.io/projected/47679d27-ef2f-4497-bb3d-996eb0dcfc9f-kube-api-access-jgmvg\") pod \"node-ca-k687z\" (UID: \"47679d27-ef2f-4497-bb3d-996eb0dcfc9f\") " pod="openshift-image-registry/node-ca-k687z" Jul 27 20:17:39.777955 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.777876 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed1721a8-1162-43d4-a7ae-20fb77b38000-metrics-certs\") pod \"network-metrics-daemon-q4rh9\" (UID: \"ed1721a8-1162-43d4-a7ae-20fb77b38000\") " pod="openshift-multus/network-metrics-daemon-q4rh9" Jul 27 20:17:39.778031 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.777955 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b4fa2d38-705e-4403-b764-91552b9681e1-etc-sysconfig\") pod \"tuned-xlf7b\" (UID: \"b4fa2d38-705e-4403-b764-91552b9681e1\") " pod="openshift-cluster-node-tuning-operator/tuned-xlf7b" Jul 27 20:17:39.778031 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.778015 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b4fa2d38-705e-4403-b764-91552b9681e1-etc-sysctl-d\") pod \"tuned-xlf7b\" (UID: \"b4fa2d38-705e-4403-b764-91552b9681e1\") " pod="openshift-cluster-node-tuning-operator/tuned-xlf7b" Jul 27 20:17:39.778135 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.778086 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c421dc44-8fcf-44f4-b483-8e0271833d10-ovnkube-config\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.778135 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.778124 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/71c93315-722b-43e7-aaab-23cf21d10aee-iptables-alerter-script\") pod \"iptables-alerter-w6nc7\" (UID: \"71c93315-722b-43e7-aaab-23cf21d10aee\") " pod="openshift-network-operator/iptables-alerter-w6nc7" Jul 27 20:17:39.778239 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.778195 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/71c93315-722b-43e7-aaab-23cf21d10aee-host-slash\") pod \"iptables-alerter-w6nc7\" (UID: \"71c93315-722b-43e7-aaab-23cf21d10aee\") " pod="openshift-network-operator/iptables-alerter-w6nc7" Jul 27 20:17:39.778239 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.778223 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5db14a3f-0592-417e-8de6-a29bbe4cbfbd-dbus\") pod \"global-pull-secret-syncer-57jqw\" (UID: \"5db14a3f-0592-417e-8de6-a29bbe4cbfbd\") " pod="kube-system/global-pull-secret-syncer-57jqw" Jul 27 20:17:39.778348 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.778254 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/52a8bfad-6457-45db-9d55-911c5aaa440f-hosts-file\") pod \"node-resolver-4xms6\" (UID: \"52a8bfad-6457-45db-9d55-911c5aaa440f\") " pod="openshift-dns/node-resolver-4xms6" Jul 27 20:17:39.778348 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.778306 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4fa2d38-705e-4403-b764-91552b9681e1-sys\") pod \"tuned-xlf7b\" (UID: \"b4fa2d38-705e-4403-b764-91552b9681e1\") " pod="openshift-cluster-node-tuning-operator/tuned-xlf7b" Jul 27 20:17:39.778348 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.778338 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b4fa2d38-705e-4403-b764-91552b9681e1-etc-tuned\") pod \"tuned-xlf7b\" (UID: \"b4fa2d38-705e-4403-b764-91552b9681e1\") " pod="openshift-cluster-node-tuning-operator/tuned-xlf7b" Jul 27 20:17:39.778501 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.778381 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gg67\" (UniqueName: \"kubernetes.io/projected/71c93315-722b-43e7-aaab-23cf21d10aee-kube-api-access-4gg67\") pod \"iptables-alerter-w6nc7\" (UID: \"71c93315-722b-43e7-aaab-23cf21d10aee\") " pod="openshift-network-operator/iptables-alerter-w6nc7" Jul 27 20:17:39.778592 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.778569 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5db14a3f-0592-417e-8de6-a29bbe4cbfbd-original-pull-secret\") pod \"global-pull-secret-syncer-57jqw\" (UID: \"5db14a3f-0592-417e-8de6-a29bbe4cbfbd\") " pod="kube-system/global-pull-secret-syncer-57jqw" Jul 27 20:17:39.778666 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.778598 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhrbf" Jul 27 20:17:39.778666 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.778614 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c421dc44-8fcf-44f4-b483-8e0271833d10-systemd-units\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.778666 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.778658 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/47679d27-ef2f-4497-bb3d-996eb0dcfc9f-host\") pod \"node-ca-k687z\" (UID: \"47679d27-ef2f-4497-bb3d-996eb0dcfc9f\") " pod="openshift-image-registry/node-ca-k687z" Jul 27 20:17:39.778831 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.778688 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52a8bfad-6457-45db-9d55-911c5aaa440f-tmp-dir\") pod \"node-resolver-4xms6\" (UID: \"52a8bfad-6457-45db-9d55-911c5aaa440f\") " pod="openshift-dns/node-resolver-4xms6" Jul 27 20:17:39.778831 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.778718 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9r7s\" (UniqueName: \"kubernetes.io/projected/52a8bfad-6457-45db-9d55-911c5aaa440f-kube-api-access-t9r7s\") pod \"node-resolver-4xms6\" (UID: \"52a8bfad-6457-45db-9d55-911c5aaa440f\") " pod="openshift-dns/node-resolver-4xms6" Jul 27 20:17:39.778831 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.778756 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pctf\" (UniqueName: \"kubernetes.io/projected/ed1721a8-1162-43d4-a7ae-20fb77b38000-kube-api-access-6pctf\") pod \"network-metrics-daemon-q4rh9\" (UID: \"ed1721a8-1162-43d4-a7ae-20fb77b38000\") " pod="openshift-multus/network-metrics-daemon-q4rh9" Jul 27 20:17:39.778831 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.778814 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b4fa2d38-705e-4403-b764-91552b9681e1-host\") pod \"tuned-xlf7b\" (UID: \"b4fa2d38-705e-4403-b764-91552b9681e1\") " pod="openshift-cluster-node-tuning-operator/tuned-xlf7b" Jul 27 20:17:39.779015 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.778842 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c421dc44-8fcf-44f4-b483-8e0271833d10-run-ovn\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.779015 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.778874 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c421dc44-8fcf-44f4-b483-8e0271833d10-host-run-ovn-kubernetes\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.779015 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.778904 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c421dc44-8fcf-44f4-b483-8e0271833d10-host-cni-bin\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.779015 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.778941 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c421dc44-8fcf-44f4-b483-8e0271833d10-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.779015 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.778980 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c421dc44-8fcf-44f4-b483-8e0271833d10-host-kubelet\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.779015 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.779011 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c421dc44-8fcf-44f4-b483-8e0271833d10-host-run-netns\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.779296 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.779047 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b4fa2d38-705e-4403-b764-91552b9681e1-etc-modprobe-d\") pod \"tuned-xlf7b\" (UID: \"b4fa2d38-705e-4403-b764-91552b9681e1\") " pod="openshift-cluster-node-tuning-operator/tuned-xlf7b" Jul 27 20:17:39.779296 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.779090 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b4fa2d38-705e-4403-b764-91552b9681e1-etc-sysctl-conf\") pod \"tuned-xlf7b\" (UID: \"b4fa2d38-705e-4403-b764-91552b9681e1\") " pod="openshift-cluster-node-tuning-operator/tuned-xlf7b" Jul 27 20:17:39.779296 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.779122 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b4fa2d38-705e-4403-b764-91552b9681e1-etc-systemd\") pod \"tuned-xlf7b\" (UID: \"b4fa2d38-705e-4403-b764-91552b9681e1\") " pod="openshift-cluster-node-tuning-operator/tuned-xlf7b" Jul 27 20:17:39.779296 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.779159 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b4fa2d38-705e-4403-b764-91552b9681e1-lib-modules\") pod \"tuned-xlf7b\" (UID: \"b4fa2d38-705e-4403-b764-91552b9681e1\") " pod="openshift-cluster-node-tuning-operator/tuned-xlf7b" Jul 27 20:17:39.779296 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.779191 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b4fa2d38-705e-4403-b764-91552b9681e1-tmp\") pod \"tuned-xlf7b\" (UID: \"b4fa2d38-705e-4403-b764-91552b9681e1\") " pod="openshift-cluster-node-tuning-operator/tuned-xlf7b" Jul 27 20:17:39.779296 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.779226 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c421dc44-8fcf-44f4-b483-8e0271833d10-run-openvswitch\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.779296 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.779267 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b4fa2d38-705e-4403-b764-91552b9681e1-run\") pod \"tuned-xlf7b\" (UID: \"b4fa2d38-705e-4403-b764-91552b9681e1\") " pod="openshift-cluster-node-tuning-operator/tuned-xlf7b" Jul 27 20:17:39.779671 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.779297 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4fa2d38-705e-4403-b764-91552b9681e1-var-lib-kubelet\") pod \"tuned-xlf7b\" (UID: \"b4fa2d38-705e-4403-b764-91552b9681e1\") " pod="openshift-cluster-node-tuning-operator/tuned-xlf7b" Jul 27 20:17:39.779671 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.779325 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmz7q\" (UniqueName: \"kubernetes.io/projected/b4fa2d38-705e-4403-b764-91552b9681e1-kube-api-access-hmz7q\") pod \"tuned-xlf7b\" (UID: \"b4fa2d38-705e-4403-b764-91552b9681e1\") " pod="openshift-cluster-node-tuning-operator/tuned-xlf7b" Jul 27 20:17:39.779671 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.779355 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c421dc44-8fcf-44f4-b483-8e0271833d10-run-systemd\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.779671 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.779385 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c421dc44-8fcf-44f4-b483-8e0271833d10-etc-openvswitch\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.779671 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.779427 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c421dc44-8fcf-44f4-b483-8e0271833d10-ovn-node-metrics-cert\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.779671 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.779466 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c421dc44-8fcf-44f4-b483-8e0271833d10-host-slash\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.779671 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.779492 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c421dc44-8fcf-44f4-b483-8e0271833d10-log-socket\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.779671 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.779526 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c421dc44-8fcf-44f4-b483-8e0271833d10-ovnkube-script-lib\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.779671 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.779561 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/47679d27-ef2f-4497-bb3d-996eb0dcfc9f-serviceca\") pod \"node-ca-k687z\" (UID: \"47679d27-ef2f-4497-bb3d-996eb0dcfc9f\") " pod="openshift-image-registry/node-ca-k687z" Jul 27 20:17:39.779671 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.779597 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5db14a3f-0592-417e-8de6-a29bbe4cbfbd-kubelet-config\") pod \"global-pull-secret-syncer-57jqw\" (UID: \"5db14a3f-0592-417e-8de6-a29bbe4cbfbd\") " pod="kube-system/global-pull-secret-syncer-57jqw" Jul 27 20:17:39.779671 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.779625 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4fa2d38-705e-4403-b764-91552b9681e1-etc-kubernetes\") pod \"tuned-xlf7b\" (UID: \"b4fa2d38-705e-4403-b764-91552b9681e1\") " pod="openshift-cluster-node-tuning-operator/tuned-xlf7b" Jul 27 20:17:39.779671 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.779653 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c421dc44-8fcf-44f4-b483-8e0271833d10-var-lib-openvswitch\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.780248 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.779852 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-r7cj7\"" Jul 27 20:17:39.780248 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.780045 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4qrw9\"" Jul 27 20:17:39.780408 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.780359 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 27 20:17:39.780564 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.780539 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 27 20:17:39.781036 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.781016 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 27 20:17:39.781904 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.781879 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 27 20:17:39.782012 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.781957 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lsmrb\"" Jul 27 20:17:39.782564 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.782504 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 27 20:17:39.782564 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.782538 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 27 20:17:39.782913 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.782893 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 27 20:17:39.800074 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.800051 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7mggj" Jul 27 20:17:39.808499 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.808479 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7mggj" Jul 27 20:17:39.866832 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.866727 2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 27 20:17:39.883528 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.880076 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/44eadfe3-4e47-4133-89d0-b613ce3995f3-socket-dir\") pod \"aws-ebs-csi-driver-node-dhrbf\" (UID: \"44eadfe3-4e47-4133-89d0-b613ce3995f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhrbf" Jul 27 20:17:39.883528 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.880112 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/44eadfe3-4e47-4133-89d0-b613ce3995f3-etc-selinux\") pod \"aws-ebs-csi-driver-node-dhrbf\" (UID: \"44eadfe3-4e47-4133-89d0-b613ce3995f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhrbf" Jul 27 20:17:39.883528 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.880145 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c421dc44-8fcf-44f4-b483-8e0271833d10-host-kubelet\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.883528 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.880172 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b4fa2d38-705e-4403-b764-91552b9681e1-etc-modprobe-d\") pod \"tuned-xlf7b\" (UID: \"b4fa2d38-705e-4403-b764-91552b9681e1\") " pod="openshift-cluster-node-tuning-operator/tuned-xlf7b" Jul 27 20:17:39.883528 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.880196 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c421dc44-8fcf-44f4-b483-8e0271833d10-run-openvswitch\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.883528 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.880222 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f40c6f68-b52b-4f6e-9dae-94b4f8905907-os-release\") pod \"multus-additional-cni-plugins-8lb48\" (UID: \"f40c6f68-b52b-4f6e-9dae-94b4f8905907\") " pod="openshift-multus/multus-additional-cni-plugins-8lb48" Jul 27 20:17:39.883528 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.880248 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntmjk\" (UniqueName: \"kubernetes.io/projected/44eadfe3-4e47-4133-89d0-b613ce3995f3-kube-api-access-ntmjk\") pod \"aws-ebs-csi-driver-node-dhrbf\" (UID: \"44eadfe3-4e47-4133-89d0-b613ce3995f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhrbf" Jul 27 20:17:39.883528 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.880271 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c421dc44-8fcf-44f4-b483-8e0271833d10-host-kubelet\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.883528 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.880274 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b4fa2d38-705e-4403-b764-91552b9681e1-run\") pod \"tuned-xlf7b\" (UID: \"b4fa2d38-705e-4403-b764-91552b9681e1\") " pod="openshift-cluster-node-tuning-operator/tuned-xlf7b" Jul 27 20:17:39.883528 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.880317 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b4fa2d38-705e-4403-b764-91552b9681e1-run\") pod \"tuned-xlf7b\" (UID: \"b4fa2d38-705e-4403-b764-91552b9681e1\") " pod="openshift-cluster-node-tuning-operator/tuned-xlf7b" Jul 27 20:17:39.883528 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.880317 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c421dc44-8fcf-44f4-b483-8e0271833d10-run-systemd\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.883528 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.880349 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c421dc44-8fcf-44f4-b483-8e0271833d10-etc-openvswitch\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.883528 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.880350 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c421dc44-8fcf-44f4-b483-8e0271833d10-run-systemd\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.883528 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.880377 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c421dc44-8fcf-44f4-b483-8e0271833d10-ovn-node-metrics-cert\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.883528 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.880404 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5192ecee-1724-47a3-9a8c-532390d18eae-host-var-lib-cni-multus\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.883528 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.880427 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5192ecee-1724-47a3-9a8c-532390d18eae-host-var-lib-kubelet\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.883528 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.880450 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5192ecee-1724-47a3-9a8c-532390d18eae-host-run-multus-certs\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.884557 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.880465 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b4fa2d38-705e-4403-b764-91552b9681e1-etc-modprobe-d\") pod \"tuned-xlf7b\" (UID: \"b4fa2d38-705e-4403-b764-91552b9681e1\") " pod="openshift-cluster-node-tuning-operator/tuned-xlf7b" Jul 27 20:17:39.884557 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.880488 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c421dc44-8fcf-44f4-b483-8e0271833d10-ovnkube-script-lib\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.884557 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.880512 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c421dc44-8fcf-44f4-b483-8e0271833d10-run-openvswitch\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.884557 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.880516 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f40c6f68-b52b-4f6e-9dae-94b4f8905907-cni-binary-copy\") pod \"multus-additional-cni-plugins-8lb48\" (UID: \"f40c6f68-b52b-4f6e-9dae-94b4f8905907\") " pod="openshift-multus/multus-additional-cni-plugins-8lb48" Jul 27 20:17:39.884557 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.880551 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f40c6f68-b52b-4f6e-9dae-94b4f8905907-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8lb48\" (UID: \"f40c6f68-b52b-4f6e-9dae-94b4f8905907\") " pod="openshift-multus/multus-additional-cni-plugins-8lb48" Jul 27 20:17:39.884557 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.880575 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f40c6f68-b52b-4f6e-9dae-94b4f8905907-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8lb48\" (UID: \"f40c6f68-b52b-4f6e-9dae-94b4f8905907\") " pod="openshift-multus/multus-additional-cni-plugins-8lb48" Jul 27 20:17:39.884557 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.880600 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/44eadfe3-4e47-4133-89d0-b613ce3995f3-registration-dir\") pod \"aws-ebs-csi-driver-node-dhrbf\" (UID: \"44eadfe3-4e47-4133-89d0-b613ce3995f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhrbf" Jul 27 20:17:39.884557 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.880625 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c421dc44-8fcf-44f4-b483-8e0271833d10-var-lib-openvswitch\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.884557 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.880661 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c421dc44-8fcf-44f4-b483-8e0271833d10-node-log\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.884557 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.880684 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c421dc44-8fcf-44f4-b483-8e0271833d10-host-cni-netd\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.884557 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.880707 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c421dc44-8fcf-44f4-b483-8e0271833d10-env-overrides\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.884557 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.880732 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/71c93315-722b-43e7-aaab-23cf21d10aee-iptables-alerter-script\") pod \"iptables-alerter-w6nc7\" (UID: \"71c93315-722b-43e7-aaab-23cf21d10aee\") " pod="openshift-network-operator/iptables-alerter-w6nc7" Jul 27 20:17:39.884557 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.880775 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cd020c9b-0313-4754-a8ca-5d79bdcf7d86-konnectivity-ca\") pod \"konnectivity-agent-2qctb\" (UID: \"cd020c9b-0313-4754-a8ca-5d79bdcf7d86\") " pod="kube-system/konnectivity-agent-2qctb" Jul 27 20:17:39.884557 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.880801 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed1721a8-1162-43d4-a7ae-20fb77b38000-metrics-certs\") pod \"network-metrics-daemon-q4rh9\" (UID: \"ed1721a8-1162-43d4-a7ae-20fb77b38000\") " pod="openshift-multus/network-metrics-daemon-q4rh9" Jul 27 20:17:39.884557 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.880827 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/71c93315-722b-43e7-aaab-23cf21d10aee-host-slash\") pod \"iptables-alerter-w6nc7\" (UID: \"71c93315-722b-43e7-aaab-23cf21d10aee\") " pod="openshift-network-operator/iptables-alerter-w6nc7" Jul 27 20:17:39.884557 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.880851 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5db14a3f-0592-417e-8de6-a29bbe4cbfbd-dbus\") pod \"global-pull-secret-syncer-57jqw\" (UID: \"5db14a3f-0592-417e-8de6-a29bbe4cbfbd\") " pod="kube-system/global-pull-secret-syncer-57jqw" Jul 27 20:17:39.885475 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.880878 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/44eadfe3-4e47-4133-89d0-b613ce3995f3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dhrbf\" (UID: \"44eadfe3-4e47-4133-89d0-b613ce3995f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhrbf" Jul 27 20:17:39.885475 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.880904 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/52a8bfad-6457-45db-9d55-911c5aaa440f-hosts-file\") pod \"node-resolver-4xms6\" (UID: \"52a8bfad-6457-45db-9d55-911c5aaa440f\") " pod="openshift-dns/node-resolver-4xms6" Jul 27 20:17:39.885475 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.880901 2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 27 20:17:39.885475 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.880934 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4fa2d38-705e-4403-b764-91552b9681e1-sys\") pod \"tuned-xlf7b\" (UID: \"b4fa2d38-705e-4403-b764-91552b9681e1\") " pod="openshift-cluster-node-tuning-operator/tuned-xlf7b" Jul 27 20:17:39.885475 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.880956 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b4fa2d38-705e-4403-b764-91552b9681e1-etc-tuned\") pod \"tuned-xlf7b\" (UID: \"b4fa2d38-705e-4403-b764-91552b9681e1\") " pod="openshift-cluster-node-tuning-operator/tuned-xlf7b" Jul 27 20:17:39.885475 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.880977 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gg67\" (UniqueName: \"kubernetes.io/projected/71c93315-722b-43e7-aaab-23cf21d10aee-kube-api-access-4gg67\") pod \"iptables-alerter-w6nc7\" (UID: \"71c93315-722b-43e7-aaab-23cf21d10aee\") " pod="openshift-network-operator/iptables-alerter-w6nc7" Jul 27 20:17:39.885475 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.880998 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5db14a3f-0592-417e-8de6-a29bbe4cbfbd-original-pull-secret\") pod \"global-pull-secret-syncer-57jqw\" (UID: \"5db14a3f-0592-417e-8de6-a29bbe4cbfbd\") " pod="kube-system/global-pull-secret-syncer-57jqw" Jul 27 20:17:39.885475 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.881040 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cd020c9b-0313-4754-a8ca-5d79bdcf7d86-agent-certs\") pod \"konnectivity-agent-2qctb\" (UID: \"cd020c9b-0313-4754-a8ca-5d79bdcf7d86\") " pod="kube-system/konnectivity-agent-2qctb" Jul 27 20:17:39.885475 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.881068 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5192ecee-1724-47a3-9a8c-532390d18eae-multus-daemon-config\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.885475 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.881097 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/47679d27-ef2f-4497-bb3d-996eb0dcfc9f-host\") pod \"node-ca-k687z\" (UID: \"47679d27-ef2f-4497-bb3d-996eb0dcfc9f\") " pod="openshift-image-registry/node-ca-k687z" Jul 27 20:17:39.885475 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.881121 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5192ecee-1724-47a3-9a8c-532390d18eae-multus-socket-dir-parent\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.885475 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.881146 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5192ecee-1724-47a3-9a8c-532390d18eae-multus-conf-dir\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.885475 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.881170 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52a8bfad-6457-45db-9d55-911c5aaa440f-tmp-dir\") pod \"node-resolver-4xms6\" (UID: \"52a8bfad-6457-45db-9d55-911c5aaa440f\") " pod="openshift-dns/node-resolver-4xms6" Jul 27 20:17:39.885475 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.881227 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c421dc44-8fcf-44f4-b483-8e0271833d10-etc-openvswitch\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.885475 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.881259 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9r7s\" (UniqueName: \"kubernetes.io/projected/52a8bfad-6457-45db-9d55-911c5aaa440f-kube-api-access-t9r7s\") pod \"node-resolver-4xms6\" (UID: \"52a8bfad-6457-45db-9d55-911c5aaa440f\") " pod="openshift-dns/node-resolver-4xms6" Jul 27 20:17:39.885475 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.881286 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c421dc44-8fcf-44f4-b483-8e0271833d10-run-ovn\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.885475 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.881340 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c421dc44-8fcf-44f4-b483-8e0271833d10-var-lib-openvswitch\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.885475 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.881376 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c421dc44-8fcf-44f4-b483-8e0271833d10-node-log\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.886599 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.881408 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c421dc44-8fcf-44f4-b483-8e0271833d10-host-cni-netd\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.886599 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.881438 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c421dc44-8fcf-44f4-b483-8e0271833d10-host-cni-bin\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.886599 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.881468 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5192ecee-1724-47a3-9a8c-532390d18eae-os-release\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.886599 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.881496 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/44eadfe3-4e47-4133-89d0-b613ce3995f3-device-dir\") pod \"aws-ebs-csi-driver-node-dhrbf\" (UID: \"44eadfe3-4e47-4133-89d0-b613ce3995f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhrbf" Jul 27 20:17:39.886599 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.881524 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/44eadfe3-4e47-4133-89d0-b613ce3995f3-sys-fs\") pod \"aws-ebs-csi-driver-node-dhrbf\" (UID: \"44eadfe3-4e47-4133-89d0-b613ce3995f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhrbf" Jul 27 20:17:39.886599 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.881523 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52a8bfad-6457-45db-9d55-911c5aaa440f-tmp-dir\") pod \"node-resolver-4xms6\" (UID: \"52a8bfad-6457-45db-9d55-911c5aaa440f\") " pod="openshift-dns/node-resolver-4xms6" Jul 27 20:17:39.886599 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.881872 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c421dc44-8fcf-44f4-b483-8e0271833d10-host-cni-bin\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.886599 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.881943 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/71c93315-722b-43e7-aaab-23cf21d10aee-iptables-alerter-script\") pod \"iptables-alerter-w6nc7\" (UID: \"71c93315-722b-43e7-aaab-23cf21d10aee\") " pod="openshift-network-operator/iptables-alerter-w6nc7" Jul 27 20:17:39.886599 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.882022 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c421dc44-8fcf-44f4-b483-8e0271833d10-env-overrides\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.886599 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.882066 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgmvg\" (UniqueName: \"kubernetes.io/projected/47679d27-ef2f-4497-bb3d-996eb0dcfc9f-kube-api-access-jgmvg\") pod \"node-ca-k687z\" (UID: \"47679d27-ef2f-4497-bb3d-996eb0dcfc9f\") " pod="openshift-image-registry/node-ca-k687z" Jul 27 20:17:39.886599 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.882268 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4fa2d38-705e-4403-b764-91552b9681e1-sys\") pod \"tuned-xlf7b\" (UID: \"b4fa2d38-705e-4403-b764-91552b9681e1\") " pod="openshift-cluster-node-tuning-operator/tuned-xlf7b" Jul 27 20:17:39.886599 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.882312 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/47679d27-ef2f-4497-bb3d-996eb0dcfc9f-host\") pod \"node-ca-k687z\" (UID: \"47679d27-ef2f-4497-bb3d-996eb0dcfc9f\") " pod="openshift-image-registry/node-ca-k687z" Jul 27 20:17:39.886599 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:39.882415 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 20:17:39.886599 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:39.882538 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5db14a3f-0592-417e-8de6-a29bbe4cbfbd-original-pull-secret podName:5db14a3f-0592-417e-8de6-a29bbe4cbfbd nodeName:}" failed. No retries permitted until 2026-07-27 20:17:40.382466339 +0000 UTC m=+2.961039908 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5db14a3f-0592-417e-8de6-a29bbe4cbfbd-original-pull-secret") pod "global-pull-secret-syncer-57jqw" (UID: "5db14a3f-0592-417e-8de6-a29bbe4cbfbd") : object "kube-system"/"original-pull-secret" not registered Jul 27 20:17:39.886599 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.882554 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5db14a3f-0592-417e-8de6-a29bbe4cbfbd-dbus\") pod \"global-pull-secret-syncer-57jqw\" (UID: \"5db14a3f-0592-417e-8de6-a29bbe4cbfbd\") " pod="kube-system/global-pull-secret-syncer-57jqw" Jul 27 20:17:39.886599 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:39.882659 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 20:17:39.886599 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:39.882722 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed1721a8-1162-43d4-a7ae-20fb77b38000-metrics-certs podName:ed1721a8-1162-43d4-a7ae-20fb77b38000 nodeName:}" failed. No retries permitted until 2026-07-27 20:17:40.382701579 +0000 UTC m=+2.961275157 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed1721a8-1162-43d4-a7ae-20fb77b38000-metrics-certs") pod "network-metrics-daemon-q4rh9" (UID: "ed1721a8-1162-43d4-a7ae-20fb77b38000") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 20:17:39.887603 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.882781 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c421dc44-8fcf-44f4-b483-8e0271833d10-run-ovn\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.887603 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.882777 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/71c93315-722b-43e7-aaab-23cf21d10aee-host-slash\") pod \"iptables-alerter-w6nc7\" (UID: \"71c93315-722b-43e7-aaab-23cf21d10aee\") " pod="openshift-network-operator/iptables-alerter-w6nc7" Jul 27 20:17:39.887603 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.882859 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/52a8bfad-6457-45db-9d55-911c5aaa440f-hosts-file\") pod \"node-resolver-4xms6\" (UID: \"52a8bfad-6457-45db-9d55-911c5aaa440f\") " pod="openshift-dns/node-resolver-4xms6" Jul 27 20:17:39.887603 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.882895 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f40c6f68-b52b-4f6e-9dae-94b4f8905907-system-cni-dir\") pod \"multus-additional-cni-plugins-8lb48\" (UID: \"f40c6f68-b52b-4f6e-9dae-94b4f8905907\") " pod="openshift-multus/multus-additional-cni-plugins-8lb48" Jul 27 20:17:39.887603 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.882921 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c421dc44-8fcf-44f4-b483-8e0271833d10-ovnkube-script-lib\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.887603 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.882981 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c421dc44-8fcf-44f4-b483-8e0271833d10-host-run-netns\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.887603 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.883028 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b4fa2d38-705e-4403-b764-91552b9681e1-etc-sysctl-conf\") pod \"tuned-xlf7b\" (UID: \"b4fa2d38-705e-4403-b764-91552b9681e1\") " pod="openshift-cluster-node-tuning-operator/tuned-xlf7b" Jul 27 20:17:39.887603 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.883058 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c421dc44-8fcf-44f4-b483-8e0271833d10-host-run-netns\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.887603 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.883096 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b4fa2d38-705e-4403-b764-91552b9681e1-etc-systemd\") pod \"tuned-xlf7b\" (UID: \"b4fa2d38-705e-4403-b764-91552b9681e1\") " pod="openshift-cluster-node-tuning-operator/tuned-xlf7b" Jul 27 20:17:39.887603 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.883127 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b4fa2d38-705e-4403-b764-91552b9681e1-lib-modules\") pod \"tuned-xlf7b\" (UID: \"b4fa2d38-705e-4403-b764-91552b9681e1\") " pod="openshift-cluster-node-tuning-operator/tuned-xlf7b" Jul 27 20:17:39.887603 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.883150 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b4fa2d38-705e-4403-b764-91552b9681e1-tmp\") pod \"tuned-xlf7b\" (UID: \"b4fa2d38-705e-4403-b764-91552b9681e1\") " pod="openshift-cluster-node-tuning-operator/tuned-xlf7b" Jul 27 20:17:39.887603 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.883179 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4fa2d38-705e-4403-b764-91552b9681e1-var-lib-kubelet\") pod \"tuned-xlf7b\" (UID: \"b4fa2d38-705e-4403-b764-91552b9681e1\") " pod="openshift-cluster-node-tuning-operator/tuned-xlf7b" Jul 27 20:17:39.887603 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.883170 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b4fa2d38-705e-4403-b764-91552b9681e1-etc-sysctl-conf\") pod \"tuned-xlf7b\" (UID: \"b4fa2d38-705e-4403-b764-91552b9681e1\") " pod="openshift-cluster-node-tuning-operator/tuned-xlf7b" Jul 27 20:17:39.887603 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.883202 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b4fa2d38-705e-4403-b764-91552b9681e1-etc-systemd\") pod \"tuned-xlf7b\" (UID: \"b4fa2d38-705e-4403-b764-91552b9681e1\") " pod="openshift-cluster-node-tuning-operator/tuned-xlf7b" Jul 27 20:17:39.887603 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.883235 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4fa2d38-705e-4403-b764-91552b9681e1-var-lib-kubelet\") pod \"tuned-xlf7b\" (UID: \"b4fa2d38-705e-4403-b764-91552b9681e1\") " pod="openshift-cluster-node-tuning-operator/tuned-xlf7b" Jul 27 20:17:39.887603 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.883241 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmz7q\" (UniqueName: \"kubernetes.io/projected/b4fa2d38-705e-4403-b764-91552b9681e1-kube-api-access-hmz7q\") pod \"tuned-xlf7b\" (UID: \"b4fa2d38-705e-4403-b764-91552b9681e1\") " pod="openshift-cluster-node-tuning-operator/tuned-xlf7b" Jul 27 20:17:39.887603 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.883270 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/47679d27-ef2f-4497-bb3d-996eb0dcfc9f-serviceca\") pod \"node-ca-k687z\" (UID: \"47679d27-ef2f-4497-bb3d-996eb0dcfc9f\") " pod="openshift-image-registry/node-ca-k687z" Jul 27 20:17:39.887603 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.883298 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5db14a3f-0592-417e-8de6-a29bbe4cbfbd-kubelet-config\") pod \"global-pull-secret-syncer-57jqw\" (UID: \"5db14a3f-0592-417e-8de6-a29bbe4cbfbd\") " pod="kube-system/global-pull-secret-syncer-57jqw" Jul 27 20:17:39.888523 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.883337 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6sqd\" (UniqueName: \"kubernetes.io/projected/828a7e08-7c87-434e-86e6-39ce766c6606-kube-api-access-b6sqd\") pod \"network-check-target-qbvkx\" (UID: \"828a7e08-7c87-434e-86e6-39ce766c6606\") " pod="openshift-network-diagnostics/network-check-target-qbvkx" Jul 27 20:17:39.888523 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.883369 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f40c6f68-b52b-4f6e-9dae-94b4f8905907-cnibin\") pod \"multus-additional-cni-plugins-8lb48\" (UID: \"f40c6f68-b52b-4f6e-9dae-94b4f8905907\") " pod="openshift-multus/multus-additional-cni-plugins-8lb48" Jul 27 20:17:39.888523 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.883397 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzmrk\" (UniqueName: \"kubernetes.io/projected/f40c6f68-b52b-4f6e-9dae-94b4f8905907-kube-api-access-fzmrk\") pod \"multus-additional-cni-plugins-8lb48\" (UID: \"f40c6f68-b52b-4f6e-9dae-94b4f8905907\") " pod="openshift-multus/multus-additional-cni-plugins-8lb48" Jul 27 20:17:39.888523 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.883426 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c421dc44-8fcf-44f4-b483-8e0271833d10-host-slash\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.888523 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.883471 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c421dc44-8fcf-44f4-b483-8e0271833d10-log-socket\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.888523 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.883499 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5192ecee-1724-47a3-9a8c-532390d18eae-cni-binary-copy\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.888523 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.883528 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5192ecee-1724-47a3-9a8c-532390d18eae-host-var-lib-cni-bin\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.888523 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.883573 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5192ecee-1724-47a3-9a8c-532390d18eae-hostroot\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.888523 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.883600 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b4fa2d38-705e-4403-b764-91552b9681e1-lib-modules\") pod \"tuned-xlf7b\" (UID: \"b4fa2d38-705e-4403-b764-91552b9681e1\") " pod="openshift-cluster-node-tuning-operator/tuned-xlf7b" Jul 27 20:17:39.888523 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.883615 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4fa2d38-705e-4403-b764-91552b9681e1-etc-kubernetes\") pod \"tuned-xlf7b\" (UID: \"b4fa2d38-705e-4403-b764-91552b9681e1\") " pod="openshift-cluster-node-tuning-operator/tuned-xlf7b" Jul 27 20:17:39.888523 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.883643 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26p8w\" (UniqueName: \"kubernetes.io/projected/c421dc44-8fcf-44f4-b483-8e0271833d10-kube-api-access-26p8w\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.888523 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.883712 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c421dc44-8fcf-44f4-b483-8e0271833d10-host-slash\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.888523 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.883723 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5db14a3f-0592-417e-8de6-a29bbe4cbfbd-kubelet-config\") pod \"global-pull-secret-syncer-57jqw\" (UID: \"5db14a3f-0592-417e-8de6-a29bbe4cbfbd\") " pod="kube-system/global-pull-secret-syncer-57jqw" Jul 27 20:17:39.888523 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.883783 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c421dc44-8fcf-44f4-b483-8e0271833d10-log-socket\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.888523 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.883824 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5192ecee-1724-47a3-9a8c-532390d18eae-system-cni-dir\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.888523 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.883851 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5192ecee-1724-47a3-9a8c-532390d18eae-etc-kubernetes\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.888523 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.883877 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9rdt\" (UniqueName: \"kubernetes.io/projected/5192ecee-1724-47a3-9a8c-532390d18eae-kube-api-access-p9rdt\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.889458 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.883907 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b4fa2d38-705e-4403-b764-91552b9681e1-etc-sysconfig\") pod \"tuned-xlf7b\" (UID: \"b4fa2d38-705e-4403-b764-91552b9681e1\") " pod="openshift-cluster-node-tuning-operator/tuned-xlf7b" Jul 27 20:17:39.889458 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.883950 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b4fa2d38-705e-4403-b764-91552b9681e1-etc-sysctl-d\") pod \"tuned-xlf7b\" (UID: \"b4fa2d38-705e-4403-b764-91552b9681e1\") " pod="openshift-cluster-node-tuning-operator/tuned-xlf7b" Jul 27 20:17:39.889458 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.883976 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c421dc44-8fcf-44f4-b483-8e0271833d10-ovnkube-config\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.889458 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.884007 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f40c6f68-b52b-4f6e-9dae-94b4f8905907-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8lb48\" (UID: \"f40c6f68-b52b-4f6e-9dae-94b4f8905907\") " pod="openshift-multus/multus-additional-cni-plugins-8lb48" Jul 27 20:17:39.889458 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.884035 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5192ecee-1724-47a3-9a8c-532390d18eae-cnibin\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.889458 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.884061 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5192ecee-1724-47a3-9a8c-532390d18eae-host-run-netns\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.889458 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.884089 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c421dc44-8fcf-44f4-b483-8e0271833d10-systemd-units\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.889458 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.884115 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5192ecee-1724-47a3-9a8c-532390d18eae-multus-cni-dir\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.889458 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.884148 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/47679d27-ef2f-4497-bb3d-996eb0dcfc9f-serviceca\") pod \"node-ca-k687z\" (UID: \"47679d27-ef2f-4497-bb3d-996eb0dcfc9f\") " pod="openshift-image-registry/node-ca-k687z" Jul 27 20:17:39.889458 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.884154 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pctf\" (UniqueName: \"kubernetes.io/projected/ed1721a8-1162-43d4-a7ae-20fb77b38000-kube-api-access-6pctf\") pod \"network-metrics-daemon-q4rh9\" (UID: \"ed1721a8-1162-43d4-a7ae-20fb77b38000\") " pod="openshift-multus/network-metrics-daemon-q4rh9" Jul 27 20:17:39.889458 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.884226 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b4fa2d38-705e-4403-b764-91552b9681e1-host\") pod \"tuned-xlf7b\" (UID: \"b4fa2d38-705e-4403-b764-91552b9681e1\") " pod="openshift-cluster-node-tuning-operator/tuned-xlf7b" Jul 27 20:17:39.889458 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.884261 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c421dc44-8fcf-44f4-b483-8e0271833d10-host-run-ovn-kubernetes\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.889458 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.884297 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c421dc44-8fcf-44f4-b483-8e0271833d10-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.889458 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.884333 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5192ecee-1724-47a3-9a8c-532390d18eae-host-run-k8s-cni-cncf-io\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.889458 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.884470 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b4fa2d38-705e-4403-b764-91552b9681e1-etc-sysctl-d\") pod \"tuned-xlf7b\" (UID: \"b4fa2d38-705e-4403-b764-91552b9681e1\") " pod="openshift-cluster-node-tuning-operator/tuned-xlf7b" Jul 27 20:17:39.889458 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.884509 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c421dc44-8fcf-44f4-b483-8e0271833d10-systemd-units\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.889458 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.884738 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b4fa2d38-705e-4403-b764-91552b9681e1-etc-sysconfig\") pod \"tuned-xlf7b\" (UID: \"b4fa2d38-705e-4403-b764-91552b9681e1\") " pod="openshift-cluster-node-tuning-operator/tuned-xlf7b" Jul 27 20:17:39.890353 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.884828 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4fa2d38-705e-4403-b764-91552b9681e1-etc-kubernetes\") pod \"tuned-xlf7b\" (UID: \"b4fa2d38-705e-4403-b764-91552b9681e1\") " pod="openshift-cluster-node-tuning-operator/tuned-xlf7b" Jul 27 20:17:39.890353 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.885010 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c421dc44-8fcf-44f4-b483-8e0271833d10-ovnkube-config\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.890353 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.885074 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c421dc44-8fcf-44f4-b483-8e0271833d10-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.890353 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.885121 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c421dc44-8fcf-44f4-b483-8e0271833d10-host-run-ovn-kubernetes\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.890353 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.885193 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b4fa2d38-705e-4403-b764-91552b9681e1-host\") pod \"tuned-xlf7b\" (UID: \"b4fa2d38-705e-4403-b764-91552b9681e1\") " pod="openshift-cluster-node-tuning-operator/tuned-xlf7b" Jul 27 20:17:39.890353 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.885629 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c421dc44-8fcf-44f4-b483-8e0271833d10-ovn-node-metrics-cert\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.892186 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.892148 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b4fa2d38-705e-4403-b764-91552b9681e1-etc-tuned\") pod \"tuned-xlf7b\" (UID: \"b4fa2d38-705e-4403-b764-91552b9681e1\") " pod="openshift-cluster-node-tuning-operator/tuned-xlf7b" Jul 27 20:17:39.894117 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.894050 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b4fa2d38-705e-4403-b764-91552b9681e1-tmp\") pod \"tuned-xlf7b\" (UID: \"b4fa2d38-705e-4403-b764-91552b9681e1\") " pod="openshift-cluster-node-tuning-operator/tuned-xlf7b" Jul 27 20:17:39.895183 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.895163 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9r7s\" (UniqueName: \"kubernetes.io/projected/52a8bfad-6457-45db-9d55-911c5aaa440f-kube-api-access-t9r7s\") pod \"node-resolver-4xms6\" (UID: \"52a8bfad-6457-45db-9d55-911c5aaa440f\") " pod="openshift-dns/node-resolver-4xms6" Jul 27 20:17:39.897662 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.897640 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gg67\" (UniqueName: \"kubernetes.io/projected/71c93315-722b-43e7-aaab-23cf21d10aee-kube-api-access-4gg67\") pod \"iptables-alerter-w6nc7\" (UID: \"71c93315-722b-43e7-aaab-23cf21d10aee\") " pod="openshift-network-operator/iptables-alerter-w6nc7" Jul 27 20:17:39.898392 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.898148 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgmvg\" (UniqueName: \"kubernetes.io/projected/47679d27-ef2f-4497-bb3d-996eb0dcfc9f-kube-api-access-jgmvg\") pod \"node-ca-k687z\" (UID: \"47679d27-ef2f-4497-bb3d-996eb0dcfc9f\") " pod="openshift-image-registry/node-ca-k687z" Jul 27 20:17:39.898392 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.898336 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pctf\" (UniqueName: \"kubernetes.io/projected/ed1721a8-1162-43d4-a7ae-20fb77b38000-kube-api-access-6pctf\") pod \"network-metrics-daemon-q4rh9\" (UID: \"ed1721a8-1162-43d4-a7ae-20fb77b38000\") " pod="openshift-multus/network-metrics-daemon-q4rh9" Jul 27 20:17:39.898932 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.898880 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmz7q\" (UniqueName: \"kubernetes.io/projected/b4fa2d38-705e-4403-b764-91552b9681e1-kube-api-access-hmz7q\") pod \"tuned-xlf7b\" (UID: \"b4fa2d38-705e-4403-b764-91552b9681e1\") " pod="openshift-cluster-node-tuning-operator/tuned-xlf7b" Jul 27 20:17:39.899720 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.899685 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26p8w\" (UniqueName: \"kubernetes.io/projected/c421dc44-8fcf-44f4-b483-8e0271833d10-kube-api-access-26p8w\") pod \"ovnkube-node-rnj2b\" (UID: \"c421dc44-8fcf-44f4-b483-8e0271833d10\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:39.937557 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.937488 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-12.ec2.internal" event={"ID":"7d2ddcfd94a3635c66b7a7044bfcc46f","Type":"ContainerStarted","Data":"4b3c36ec372e02d1c1229ce0d15b50c66f8b4dd2b7780cd70d71ee515153b91b"} Jul 27 20:17:39.942334 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.942306 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-12.ec2.internal" event={"ID":"9500b4062bc35ffcbb05e58bd96d058d","Type":"ContainerStarted","Data":"0b316b0a9f1a12a181acb8234717c9caeb6562026dde3a067e8a2cf5923ad6e1"} Jul 27 20:17:39.985260 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.985229 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cd020c9b-0313-4754-a8ca-5d79bdcf7d86-agent-certs\") pod \"konnectivity-agent-2qctb\" (UID: \"cd020c9b-0313-4754-a8ca-5d79bdcf7d86\") " pod="kube-system/konnectivity-agent-2qctb" Jul 27 20:17:39.985393 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.985272 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5192ecee-1724-47a3-9a8c-532390d18eae-multus-daemon-config\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.985393 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.985299 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5192ecee-1724-47a3-9a8c-532390d18eae-multus-socket-dir-parent\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.985393 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.985324 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5192ecee-1724-47a3-9a8c-532390d18eae-multus-conf-dir\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.985393 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.985351 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5192ecee-1724-47a3-9a8c-532390d18eae-os-release\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.985393 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.985377 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/44eadfe3-4e47-4133-89d0-b613ce3995f3-device-dir\") pod \"aws-ebs-csi-driver-node-dhrbf\" (UID: \"44eadfe3-4e47-4133-89d0-b613ce3995f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhrbf" Jul 27 20:17:39.985611 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.985402 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/44eadfe3-4e47-4133-89d0-b613ce3995f3-sys-fs\") pod \"aws-ebs-csi-driver-node-dhrbf\" (UID: \"44eadfe3-4e47-4133-89d0-b613ce3995f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhrbf" Jul 27 20:17:39.985611 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.985428 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f40c6f68-b52b-4f6e-9dae-94b4f8905907-system-cni-dir\") pod \"multus-additional-cni-plugins-8lb48\" (UID: \"f40c6f68-b52b-4f6e-9dae-94b4f8905907\") " pod="openshift-multus/multus-additional-cni-plugins-8lb48" Jul 27 20:17:39.985611 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.985461 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6sqd\" (UniqueName: \"kubernetes.io/projected/828a7e08-7c87-434e-86e6-39ce766c6606-kube-api-access-b6sqd\") pod \"network-check-target-qbvkx\" (UID: \"828a7e08-7c87-434e-86e6-39ce766c6606\") " pod="openshift-network-diagnostics/network-check-target-qbvkx" Jul 27 20:17:39.985611 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.985485 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f40c6f68-b52b-4f6e-9dae-94b4f8905907-cnibin\") pod \"multus-additional-cni-plugins-8lb48\" (UID: \"f40c6f68-b52b-4f6e-9dae-94b4f8905907\") " pod="openshift-multus/multus-additional-cni-plugins-8lb48" Jul 27 20:17:39.985611 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.985508 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzmrk\" (UniqueName: \"kubernetes.io/projected/f40c6f68-b52b-4f6e-9dae-94b4f8905907-kube-api-access-fzmrk\") pod \"multus-additional-cni-plugins-8lb48\" (UID: \"f40c6f68-b52b-4f6e-9dae-94b4f8905907\") " pod="openshift-multus/multus-additional-cni-plugins-8lb48" Jul 27 20:17:39.985611 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.985528 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5192ecee-1724-47a3-9a8c-532390d18eae-multus-conf-dir\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.985611 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.985571 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5192ecee-1724-47a3-9a8c-532390d18eae-cni-binary-copy\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.985611 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.985589 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/44eadfe3-4e47-4133-89d0-b613ce3995f3-sys-fs\") pod \"aws-ebs-csi-driver-node-dhrbf\" (UID: \"44eadfe3-4e47-4133-89d0-b613ce3995f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhrbf" Jul 27 20:17:39.986016 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.985612 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5192ecee-1724-47a3-9a8c-532390d18eae-host-var-lib-cni-bin\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.986016 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.985639 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5192ecee-1724-47a3-9a8c-532390d18eae-hostroot\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.986016 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.985672 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5192ecee-1724-47a3-9a8c-532390d18eae-system-cni-dir\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.986016 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.985698 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5192ecee-1724-47a3-9a8c-532390d18eae-etc-kubernetes\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.986016 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.985742 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9rdt\" (UniqueName: \"kubernetes.io/projected/5192ecee-1724-47a3-9a8c-532390d18eae-kube-api-access-p9rdt\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.986016 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.985793 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f40c6f68-b52b-4f6e-9dae-94b4f8905907-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8lb48\" (UID: \"f40c6f68-b52b-4f6e-9dae-94b4f8905907\") " pod="openshift-multus/multus-additional-cni-plugins-8lb48" Jul 27 20:17:39.986016 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.985821 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5192ecee-1724-47a3-9a8c-532390d18eae-cnibin\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.986016 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.985845 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5192ecee-1724-47a3-9a8c-532390d18eae-host-run-netns\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.986016 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.985871 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5192ecee-1724-47a3-9a8c-532390d18eae-multus-cni-dir\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.986016 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.985903 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5192ecee-1724-47a3-9a8c-532390d18eae-host-run-k8s-cni-cncf-io\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.986016 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.985907 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f40c6f68-b52b-4f6e-9dae-94b4f8905907-cnibin\") pod \"multus-additional-cni-plugins-8lb48\" (UID: \"f40c6f68-b52b-4f6e-9dae-94b4f8905907\") " pod="openshift-multus/multus-additional-cni-plugins-8lb48" Jul 27 20:17:39.986016 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.985932 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/44eadfe3-4e47-4133-89d0-b613ce3995f3-socket-dir\") pod \"aws-ebs-csi-driver-node-dhrbf\" (UID: \"44eadfe3-4e47-4133-89d0-b613ce3995f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhrbf" Jul 27 20:17:39.986016 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.985958 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/44eadfe3-4e47-4133-89d0-b613ce3995f3-etc-selinux\") pod \"aws-ebs-csi-driver-node-dhrbf\" (UID: \"44eadfe3-4e47-4133-89d0-b613ce3995f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhrbf" Jul 27 20:17:39.986016 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.985982 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5192ecee-1724-47a3-9a8c-532390d18eae-system-cni-dir\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.986016 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.985987 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f40c6f68-b52b-4f6e-9dae-94b4f8905907-os-release\") pod \"multus-additional-cni-plugins-8lb48\" (UID: \"f40c6f68-b52b-4f6e-9dae-94b4f8905907\") " pod="openshift-multus/multus-additional-cni-plugins-8lb48" Jul 27 20:17:39.986829 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.986015 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntmjk\" (UniqueName: \"kubernetes.io/projected/44eadfe3-4e47-4133-89d0-b613ce3995f3-kube-api-access-ntmjk\") pod \"aws-ebs-csi-driver-node-dhrbf\" (UID: \"44eadfe3-4e47-4133-89d0-b613ce3995f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhrbf" Jul 27 20:17:39.986829 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.986085 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5192ecee-1724-47a3-9a8c-532390d18eae-host-var-lib-cni-multus\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.986829 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.986149 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5192ecee-1724-47a3-9a8c-532390d18eae-host-var-lib-cni-multus\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.986829 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.986158 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5192ecee-1724-47a3-9a8c-532390d18eae-multus-daemon-config\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.986829 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.986179 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5192ecee-1724-47a3-9a8c-532390d18eae-multus-socket-dir-parent\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.986829 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.986199 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5192ecee-1724-47a3-9a8c-532390d18eae-etc-kubernetes\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.986829 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.986225 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5192ecee-1724-47a3-9a8c-532390d18eae-host-var-lib-kubelet\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.986829 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.986258 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5192ecee-1724-47a3-9a8c-532390d18eae-host-run-multus-certs\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.986829 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.986269 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/44eadfe3-4e47-4133-89d0-b613ce3995f3-device-dir\") pod \"aws-ebs-csi-driver-node-dhrbf\" (UID: \"44eadfe3-4e47-4133-89d0-b613ce3995f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhrbf" Jul 27 20:17:39.986829 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.986289 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f40c6f68-b52b-4f6e-9dae-94b4f8905907-cni-binary-copy\") pod \"multus-additional-cni-plugins-8lb48\" (UID: \"f40c6f68-b52b-4f6e-9dae-94b4f8905907\") " pod="openshift-multus/multus-additional-cni-plugins-8lb48" Jul 27 20:17:39.986829 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.986317 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5192ecee-1724-47a3-9a8c-532390d18eae-host-var-lib-cni-bin\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.986829 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.986319 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f40c6f68-b52b-4f6e-9dae-94b4f8905907-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8lb48\" (UID: \"f40c6f68-b52b-4f6e-9dae-94b4f8905907\") " pod="openshift-multus/multus-additional-cni-plugins-8lb48" Jul 27 20:17:39.986829 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.986362 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f40c6f68-b52b-4f6e-9dae-94b4f8905907-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8lb48\" (UID: \"f40c6f68-b52b-4f6e-9dae-94b4f8905907\") " pod="openshift-multus/multus-additional-cni-plugins-8lb48" Jul 27 20:17:39.986829 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.986399 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/44eadfe3-4e47-4133-89d0-b613ce3995f3-registration-dir\") pod \"aws-ebs-csi-driver-node-dhrbf\" (UID: \"44eadfe3-4e47-4133-89d0-b613ce3995f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhrbf" Jul 27 20:17:39.986829 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.986432 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cd020c9b-0313-4754-a8ca-5d79bdcf7d86-konnectivity-ca\") pod \"konnectivity-agent-2qctb\" (UID: \"cd020c9b-0313-4754-a8ca-5d79bdcf7d86\") " pod="kube-system/konnectivity-agent-2qctb" Jul 27 20:17:39.986829 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.986472 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/44eadfe3-4e47-4133-89d0-b613ce3995f3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dhrbf\" (UID: \"44eadfe3-4e47-4133-89d0-b613ce3995f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhrbf" Jul 27 20:17:39.986829 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.986473 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f40c6f68-b52b-4f6e-9dae-94b4f8905907-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8lb48\" (UID: \"f40c6f68-b52b-4f6e-9dae-94b4f8905907\") " pod="openshift-multus/multus-additional-cni-plugins-8lb48" Jul 27 20:17:39.987651 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.986229 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5192ecee-1724-47a3-9a8c-532390d18eae-os-release\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.987651 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.985629 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f40c6f68-b52b-4f6e-9dae-94b4f8905907-system-cni-dir\") pod \"multus-additional-cni-plugins-8lb48\" (UID: \"f40c6f68-b52b-4f6e-9dae-94b4f8905907\") " pod="openshift-multus/multus-additional-cni-plugins-8lb48" Jul 27 20:17:39.987651 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.986796 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5192ecee-1724-47a3-9a8c-532390d18eae-hostroot\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.987651 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.986856 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5192ecee-1724-47a3-9a8c-532390d18eae-host-run-multus-certs\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.987651 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.986923 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/44eadfe3-4e47-4133-89d0-b613ce3995f3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dhrbf\" (UID: \"44eadfe3-4e47-4133-89d0-b613ce3995f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhrbf" Jul 27 20:17:39.987651 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.986971 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/44eadfe3-4e47-4133-89d0-b613ce3995f3-registration-dir\") pod \"aws-ebs-csi-driver-node-dhrbf\" (UID: \"44eadfe3-4e47-4133-89d0-b613ce3995f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhrbf" Jul 27 20:17:39.987651 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.987011 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5192ecee-1724-47a3-9a8c-532390d18eae-host-run-netns\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.987651 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.987030 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f40c6f68-b52b-4f6e-9dae-94b4f8905907-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8lb48\" (UID: \"f40c6f68-b52b-4f6e-9dae-94b4f8905907\") " pod="openshift-multus/multus-additional-cni-plugins-8lb48" Jul 27 20:17:39.987651 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.987043 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f40c6f68-b52b-4f6e-9dae-94b4f8905907-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8lb48\" (UID: \"f40c6f68-b52b-4f6e-9dae-94b4f8905907\") " pod="openshift-multus/multus-additional-cni-plugins-8lb48" Jul 27 20:17:39.987651 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.987107 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5192ecee-1724-47a3-9a8c-532390d18eae-multus-cni-dir\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.987651 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.987121 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f40c6f68-b52b-4f6e-9dae-94b4f8905907-os-release\") pod \"multus-additional-cni-plugins-8lb48\" (UID: \"f40c6f68-b52b-4f6e-9dae-94b4f8905907\") " pod="openshift-multus/multus-additional-cni-plugins-8lb48" Jul 27 20:17:39.987651 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.987132 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/44eadfe3-4e47-4133-89d0-b613ce3995f3-etc-selinux\") pod \"aws-ebs-csi-driver-node-dhrbf\" (UID: \"44eadfe3-4e47-4133-89d0-b613ce3995f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhrbf" Jul 27 20:17:39.987651 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.987139 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/44eadfe3-4e47-4133-89d0-b613ce3995f3-socket-dir\") pod \"aws-ebs-csi-driver-node-dhrbf\" (UID: \"44eadfe3-4e47-4133-89d0-b613ce3995f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhrbf" Jul 27 20:17:39.987651 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.987167 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5192ecee-1724-47a3-9a8c-532390d18eae-host-run-k8s-cni-cncf-io\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.987651 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.987182 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5192ecee-1724-47a3-9a8c-532390d18eae-host-var-lib-kubelet\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.987651 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.987187 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5192ecee-1724-47a3-9a8c-532390d18eae-cnibin\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.987651 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.987536 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cd020c9b-0313-4754-a8ca-5d79bdcf7d86-konnectivity-ca\") pod \"konnectivity-agent-2qctb\" (UID: \"cd020c9b-0313-4754-a8ca-5d79bdcf7d86\") " pod="kube-system/konnectivity-agent-2qctb" Jul 27 20:17:39.987651 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.987609 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5192ecee-1724-47a3-9a8c-532390d18eae-cni-binary-copy\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.988591 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.987655 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f40c6f68-b52b-4f6e-9dae-94b4f8905907-cni-binary-copy\") pod \"multus-additional-cni-plugins-8lb48\" (UID: \"f40c6f68-b52b-4f6e-9dae-94b4f8905907\") " pod="openshift-multus/multus-additional-cni-plugins-8lb48" Jul 27 20:17:39.989882 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.989859 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cd020c9b-0313-4754-a8ca-5d79bdcf7d86-agent-certs\") pod \"konnectivity-agent-2qctb\" (UID: \"cd020c9b-0313-4754-a8ca-5d79bdcf7d86\") " pod="kube-system/konnectivity-agent-2qctb" Jul 27 20:17:39.992501 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:39.992112 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 20:17:39.992501 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:39.992135 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 20:17:39.992501 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:39.992158 2558 projected.go:196] Error preparing data for projected volume kube-api-access-b6sqd for pod openshift-network-diagnostics/network-check-target-qbvkx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 20:17:39.992501 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:39.992221 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/828a7e08-7c87-434e-86e6-39ce766c6606-kube-api-access-b6sqd podName:828a7e08-7c87-434e-86e6-39ce766c6606 nodeName:}" failed. No retries permitted until 2026-07-27 20:17:40.492202055 +0000 UTC m=+3.070775646 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-b6sqd" (UniqueName: "kubernetes.io/projected/828a7e08-7c87-434e-86e6-39ce766c6606-kube-api-access-b6sqd") pod "network-check-target-qbvkx" (UID: "828a7e08-7c87-434e-86e6-39ce766c6606") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 20:17:39.995360 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.995311 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9rdt\" (UniqueName: \"kubernetes.io/projected/5192ecee-1724-47a3-9a8c-532390d18eae-kube-api-access-p9rdt\") pod \"multus-g4jc5\" (UID: \"5192ecee-1724-47a3-9a8c-532390d18eae\") " pod="openshift-multus/multus-g4jc5" Jul 27 20:17:39.996633 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.996457 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntmjk\" (UniqueName: \"kubernetes.io/projected/44eadfe3-4e47-4133-89d0-b613ce3995f3-kube-api-access-ntmjk\") pod \"aws-ebs-csi-driver-node-dhrbf\" (UID: \"44eadfe3-4e47-4133-89d0-b613ce3995f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhrbf" Jul 27 20:17:39.996633 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:39.996555 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzmrk\" (UniqueName: \"kubernetes.io/projected/f40c6f68-b52b-4f6e-9dae-94b4f8905907-kube-api-access-fzmrk\") pod \"multus-additional-cni-plugins-8lb48\" (UID: \"f40c6f68-b52b-4f6e-9dae-94b4f8905907\") " pod="openshift-multus/multus-additional-cni-plugins-8lb48" Jul 27 20:17:40.075322 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:40.075288 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xlf7b" Jul 27 20:17:40.086645 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:40.086582 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:17:40.087313 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:40.087283 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4fa2d38_705e_4403_b764_91552b9681e1.slice/crio-8fd5e0d8bf520c697df27d83d3b4a63a6c2f99a15e11c8d90a8f574b7110f261 WatchSource:0}: Error finding container 8fd5e0d8bf520c697df27d83d3b4a63a6c2f99a15e11c8d90a8f574b7110f261: Status 404 returned error can't find the container with id 8fd5e0d8bf520c697df27d83d3b4a63a6c2f99a15e11c8d90a8f574b7110f261 Jul 27 20:17:40.097020 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:40.096997 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g4jc5" Jul 27 20:17:40.097445 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:40.097411 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc421dc44_8fcf_44f4_b483_8e0271833d10.slice/crio-d96252ab7f946a0f7ef6bb3c10fa401ca3c88aae550008bc176da4ad59b863a2 WatchSource:0}: Error finding container d96252ab7f946a0f7ef6bb3c10fa401ca3c88aae550008bc176da4ad59b863a2: Status 404 returned error can't find the container with id d96252ab7f946a0f7ef6bb3c10fa401ca3c88aae550008bc176da4ad59b863a2 Jul 27 20:17:40.105152 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:40.105130 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2qctb" Jul 27 20:17:40.106771 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:40.106747 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5192ecee_1724_47a3_9a8c_532390d18eae.slice/crio-45de84dbe3ca553ab243a67dde3e67afbb61ac3360de676fd4dc6cf588ba0eb2 WatchSource:0}: Error finding container 45de84dbe3ca553ab243a67dde3e67afbb61ac3360de676fd4dc6cf588ba0eb2: Status 404 returned error can't find the container with id 45de84dbe3ca553ab243a67dde3e67afbb61ac3360de676fd4dc6cf588ba0eb2 Jul 27 20:17:40.114485 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:40.114468 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k687z" Jul 27 20:17:40.117203 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:40.117179 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd020c9b_0313_4754_a8ca_5d79bdcf7d86.slice/crio-a9a7fee519f33846ae0ef77c192e1fc54c9e285e937173c64c978f935c94d75c WatchSource:0}: Error finding container a9a7fee519f33846ae0ef77c192e1fc54c9e285e937173c64c978f935c94d75c: Status 404 returned error can't find the container with id a9a7fee519f33846ae0ef77c192e1fc54c9e285e937173c64c978f935c94d75c Jul 27 20:17:40.125238 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:40.125213 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47679d27_ef2f_4497_bb3d_996eb0dcfc9f.slice/crio-bdcc45ff1e676fbfe2db0c4d1d87b597e86543df1e1f74dd407d37db8ca9d3ba WatchSource:0}: Error finding container bdcc45ff1e676fbfe2db0c4d1d87b597e86543df1e1f74dd407d37db8ca9d3ba: Status 404 returned error can't find the container with id bdcc45ff1e676fbfe2db0c4d1d87b597e86543df1e1f74dd407d37db8ca9d3ba Jul 27 20:17:40.126681 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:40.126661 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-w6nc7" Jul 27 20:17:40.134872 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:40.134782 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8lb48" Jul 27 20:17:40.136373 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:40.136350 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71c93315_722b_43e7_aaab_23cf21d10aee.slice/crio-d865f61a3b24c6136ff18520b2a9ed3dacb590800ea45051129dff79b8c29695 WatchSource:0}: Error finding container d865f61a3b24c6136ff18520b2a9ed3dacb590800ea45051129dff79b8c29695: Status 404 returned error can't find the container with id d865f61a3b24c6136ff18520b2a9ed3dacb590800ea45051129dff79b8c29695 Jul 27 20:17:40.143464 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:40.143305 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4xms6" Jul 27 20:17:40.144007 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:40.143986 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf40c6f68_b52b_4f6e_9dae_94b4f8905907.slice/crio-39551a5e722d87ff15e0d86e9c29313f680a91dafa042b09ac71672e34274811 WatchSource:0}: Error finding container 39551a5e722d87ff15e0d86e9c29313f680a91dafa042b09ac71672e34274811: Status 404 returned error can't find the container with id 39551a5e722d87ff15e0d86e9c29313f680a91dafa042b09ac71672e34274811 Jul 27 20:17:40.149678 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:40.149603 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhrbf" Jul 27 20:17:40.152129 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:40.152103 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52a8bfad_6457_45db_9d55_911c5aaa440f.slice/crio-eb4dbf07443180241c6f35c377ed7f6a7adf062dedb72fb1bacfa69642357c8c WatchSource:0}: Error finding container eb4dbf07443180241c6f35c377ed7f6a7adf062dedb72fb1bacfa69642357c8c: Status 404 returned error can't find the container with id eb4dbf07443180241c6f35c377ed7f6a7adf062dedb72fb1bacfa69642357c8c Jul 27 20:17:40.159806 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:17:40.159782 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44eadfe3_4e47_4133_89d0_b613ce3995f3.slice/crio-60de4dfe35b9be23d3af2888ad293e33070a7fd7034cded10f9e687a97ac0263 WatchSource:0}: Error finding container 60de4dfe35b9be23d3af2888ad293e33070a7fd7034cded10f9e687a97ac0263: Status 404 returned error can't find the container with id 60de4dfe35b9be23d3af2888ad293e33070a7fd7034cded10f9e687a97ac0263 Jul 27 20:17:40.389275 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:40.389191 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed1721a8-1162-43d4-a7ae-20fb77b38000-metrics-certs\") pod \"network-metrics-daemon-q4rh9\" (UID: \"ed1721a8-1162-43d4-a7ae-20fb77b38000\") " pod="openshift-multus/network-metrics-daemon-q4rh9" Jul 27 20:17:40.389275 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:40.389242 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5db14a3f-0592-417e-8de6-a29bbe4cbfbd-original-pull-secret\") pod \"global-pull-secret-syncer-57jqw\" (UID: \"5db14a3f-0592-417e-8de6-a29bbe4cbfbd\") " pod="kube-system/global-pull-secret-syncer-57jqw" Jul 27 20:17:40.389517 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:40.389328 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 20:17:40.389517 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:40.389351 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 20:17:40.389517 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:40.389408 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5db14a3f-0592-417e-8de6-a29bbe4cbfbd-original-pull-secret podName:5db14a3f-0592-417e-8de6-a29bbe4cbfbd nodeName:}" failed. No retries permitted until 2026-07-27 20:17:41.389389292 +0000 UTC m=+3.967962860 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5db14a3f-0592-417e-8de6-a29bbe4cbfbd-original-pull-secret") pod "global-pull-secret-syncer-57jqw" (UID: "5db14a3f-0592-417e-8de6-a29bbe4cbfbd") : object "kube-system"/"original-pull-secret" not registered Jul 27 20:17:40.389517 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:40.389429 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed1721a8-1162-43d4-a7ae-20fb77b38000-metrics-certs podName:ed1721a8-1162-43d4-a7ae-20fb77b38000 nodeName:}" failed. No retries permitted until 2026-07-27 20:17:41.389420455 +0000 UTC m=+3.967994025 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed1721a8-1162-43d4-a7ae-20fb77b38000-metrics-certs") pod "network-metrics-daemon-q4rh9" (UID: "ed1721a8-1162-43d4-a7ae-20fb77b38000") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 20:17:40.590852 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:40.590822 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6sqd\" (UniqueName: \"kubernetes.io/projected/828a7e08-7c87-434e-86e6-39ce766c6606-kube-api-access-b6sqd\") pod \"network-check-target-qbvkx\" (UID: \"828a7e08-7c87-434e-86e6-39ce766c6606\") " pod="openshift-network-diagnostics/network-check-target-qbvkx" Jul 27 20:17:40.591059 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:40.591038 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 20:17:40.591127 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:40.591064 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 20:17:40.591127 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:40.591078 2558 projected.go:196] Error preparing data for projected volume kube-api-access-b6sqd for pod openshift-network-diagnostics/network-check-target-qbvkx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 20:17:40.591233 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:40.591152 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/828a7e08-7c87-434e-86e6-39ce766c6606-kube-api-access-b6sqd podName:828a7e08-7c87-434e-86e6-39ce766c6606 nodeName:}" failed. No retries permitted until 2026-07-27 20:17:41.59113014 +0000 UTC m=+4.169703726 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-b6sqd" (UniqueName: "kubernetes.io/projected/828a7e08-7c87-434e-86e6-39ce766c6606-kube-api-access-b6sqd") pod "network-check-target-qbvkx" (UID: "828a7e08-7c87-434e-86e6-39ce766c6606") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 20:17:40.812182 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:40.812090 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 20:12:39 +0000 UTC" deadline="2028-04-24 03:33:33.643955786 +0000 UTC" Jul 27 20:17:40.812182 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:40.812133 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15271h15m52.831827313s" Jul 27 20:17:40.930821 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:40.928618 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbvkx" Jul 27 20:17:40.930821 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:40.928780 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbvkx" podUID="828a7e08-7c87-434e-86e6-39ce766c6606" Jul 27 20:17:40.948650 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:40.948596 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhrbf" event={"ID":"44eadfe3-4e47-4133-89d0-b613ce3995f3","Type":"ContainerStarted","Data":"60de4dfe35b9be23d3af2888ad293e33070a7fd7034cded10f9e687a97ac0263"} Jul 27 20:17:40.951590 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:40.951525 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4xms6" event={"ID":"52a8bfad-6457-45db-9d55-911c5aaa440f","Type":"ContainerStarted","Data":"eb4dbf07443180241c6f35c377ed7f6a7adf062dedb72fb1bacfa69642357c8c"} Jul 27 20:17:40.956420 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:40.956394 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8lb48" event={"ID":"f40c6f68-b52b-4f6e-9dae-94b4f8905907","Type":"ContainerStarted","Data":"39551a5e722d87ff15e0d86e9c29313f680a91dafa042b09ac71672e34274811"} Jul 27 20:17:40.958321 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:40.958238 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-w6nc7" event={"ID":"71c93315-722b-43e7-aaab-23cf21d10aee","Type":"ContainerStarted","Data":"d865f61a3b24c6136ff18520b2a9ed3dacb590800ea45051129dff79b8c29695"} Jul 27 20:17:40.963912 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:40.963885 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k687z" event={"ID":"47679d27-ef2f-4497-bb3d-996eb0dcfc9f","Type":"ContainerStarted","Data":"bdcc45ff1e676fbfe2db0c4d1d87b597e86543df1e1f74dd407d37db8ca9d3ba"} Jul 27 20:17:40.966660 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:40.966637 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2qctb" event={"ID":"cd020c9b-0313-4754-a8ca-5d79bdcf7d86","Type":"ContainerStarted","Data":"a9a7fee519f33846ae0ef77c192e1fc54c9e285e937173c64c978f935c94d75c"} Jul 27 20:17:40.968877 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:40.968852 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xlf7b" event={"ID":"b4fa2d38-705e-4403-b764-91552b9681e1","Type":"ContainerStarted","Data":"8fd5e0d8bf520c697df27d83d3b4a63a6c2f99a15e11c8d90a8f574b7110f261"} Jul 27 20:17:40.970425 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:40.970399 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g4jc5" event={"ID":"5192ecee-1724-47a3-9a8c-532390d18eae","Type":"ContainerStarted","Data":"45de84dbe3ca553ab243a67dde3e67afbb61ac3360de676fd4dc6cf588ba0eb2"} Jul 27 20:17:40.974573 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:40.974536 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" event={"ID":"c421dc44-8fcf-44f4-b483-8e0271833d10","Type":"ContainerStarted","Data":"d96252ab7f946a0f7ef6bb3c10fa401ca3c88aae550008bc176da4ad59b863a2"} Jul 27 20:17:41.398447 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:41.398095 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed1721a8-1162-43d4-a7ae-20fb77b38000-metrics-certs\") pod \"network-metrics-daemon-q4rh9\" (UID: \"ed1721a8-1162-43d4-a7ae-20fb77b38000\") " pod="openshift-multus/network-metrics-daemon-q4rh9" Jul 27 20:17:41.398447 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:41.398156 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5db14a3f-0592-417e-8de6-a29bbe4cbfbd-original-pull-secret\") pod \"global-pull-secret-syncer-57jqw\" (UID: \"5db14a3f-0592-417e-8de6-a29bbe4cbfbd\") " pod="kube-system/global-pull-secret-syncer-57jqw" Jul 27 20:17:41.398447 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:41.398344 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 20:17:41.398447 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:41.398409 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5db14a3f-0592-417e-8de6-a29bbe4cbfbd-original-pull-secret podName:5db14a3f-0592-417e-8de6-a29bbe4cbfbd nodeName:}" failed. No retries permitted until 2026-07-27 20:17:43.398389846 +0000 UTC m=+5.976963418 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5db14a3f-0592-417e-8de6-a29bbe4cbfbd-original-pull-secret") pod "global-pull-secret-syncer-57jqw" (UID: "5db14a3f-0592-417e-8de6-a29bbe4cbfbd") : object "kube-system"/"original-pull-secret" not registered Jul 27 20:17:41.398824 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:41.398650 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 20:17:41.398824 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:41.398703 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed1721a8-1162-43d4-a7ae-20fb77b38000-metrics-certs podName:ed1721a8-1162-43d4-a7ae-20fb77b38000 nodeName:}" failed. No retries permitted until 2026-07-27 20:17:43.398685489 +0000 UTC m=+5.977259061 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed1721a8-1162-43d4-a7ae-20fb77b38000-metrics-certs") pod "network-metrics-daemon-q4rh9" (UID: "ed1721a8-1162-43d4-a7ae-20fb77b38000") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 20:17:41.600463 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:41.600423 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6sqd\" (UniqueName: \"kubernetes.io/projected/828a7e08-7c87-434e-86e6-39ce766c6606-kube-api-access-b6sqd\") pod \"network-check-target-qbvkx\" (UID: \"828a7e08-7c87-434e-86e6-39ce766c6606\") " pod="openshift-network-diagnostics/network-check-target-qbvkx" Jul 27 20:17:41.600679 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:41.600627 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 20:17:41.600679 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:41.600649 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 20:17:41.600679 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:41.600663 2558 projected.go:196] Error preparing data for projected volume kube-api-access-b6sqd for pod openshift-network-diagnostics/network-check-target-qbvkx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 20:17:41.600877 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:41.600723 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/828a7e08-7c87-434e-86e6-39ce766c6606-kube-api-access-b6sqd podName:828a7e08-7c87-434e-86e6-39ce766c6606 nodeName:}" failed. No retries permitted until 2026-07-27 20:17:43.60070519 +0000 UTC m=+6.179278762 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-b6sqd" (UniqueName: "kubernetes.io/projected/828a7e08-7c87-434e-86e6-39ce766c6606-kube-api-access-b6sqd") pod "network-check-target-qbvkx" (UID: "828a7e08-7c87-434e-86e6-39ce766c6606") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 20:17:41.813195 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:41.813000 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 20:12:39 +0000 UTC" deadline="2028-04-27 05:32:26.775775264 +0000 UTC" Jul 27 20:17:41.813195 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:41.813067 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15345h14m44.962711789s" Jul 27 20:17:41.930715 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:41.930015 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-57jqw" Jul 27 20:17:41.930715 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:41.930137 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-57jqw" podUID="5db14a3f-0592-417e-8de6-a29bbe4cbfbd" Jul 27 20:17:41.930715 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:41.930513 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4rh9" Jul 27 20:17:41.930715 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:41.930611 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4rh9" podUID="ed1721a8-1162-43d4-a7ae-20fb77b38000" Jul 27 20:17:42.928193 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:42.928162 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbvkx" Jul 27 20:17:42.928648 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:42.928292 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbvkx" podUID="828a7e08-7c87-434e-86e6-39ce766c6606" Jul 27 20:17:43.415307 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:43.415224 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed1721a8-1162-43d4-a7ae-20fb77b38000-metrics-certs\") pod \"network-metrics-daemon-q4rh9\" (UID: \"ed1721a8-1162-43d4-a7ae-20fb77b38000\") " pod="openshift-multus/network-metrics-daemon-q4rh9" Jul 27 20:17:43.415307 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:43.415280 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5db14a3f-0592-417e-8de6-a29bbe4cbfbd-original-pull-secret\") pod \"global-pull-secret-syncer-57jqw\" (UID: \"5db14a3f-0592-417e-8de6-a29bbe4cbfbd\") " pod="kube-system/global-pull-secret-syncer-57jqw" Jul 27 20:17:43.415528 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:43.415453 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 20:17:43.415528 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:43.415515 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5db14a3f-0592-417e-8de6-a29bbe4cbfbd-original-pull-secret podName:5db14a3f-0592-417e-8de6-a29bbe4cbfbd nodeName:}" failed. No retries permitted until 2026-07-27 20:17:47.415497433 +0000 UTC m=+9.994071005 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5db14a3f-0592-417e-8de6-a29bbe4cbfbd-original-pull-secret") pod "global-pull-secret-syncer-57jqw" (UID: "5db14a3f-0592-417e-8de6-a29bbe4cbfbd") : object "kube-system"/"original-pull-secret" not registered Jul 27 20:17:43.415977 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:43.415926 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 20:17:43.416089 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:43.415987 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed1721a8-1162-43d4-a7ae-20fb77b38000-metrics-certs podName:ed1721a8-1162-43d4-a7ae-20fb77b38000 nodeName:}" failed. No retries permitted until 2026-07-27 20:17:47.415971448 +0000 UTC m=+9.994545017 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed1721a8-1162-43d4-a7ae-20fb77b38000-metrics-certs") pod "network-metrics-daemon-q4rh9" (UID: "ed1721a8-1162-43d4-a7ae-20fb77b38000") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 20:17:43.616665 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:43.616626 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6sqd\" (UniqueName: \"kubernetes.io/projected/828a7e08-7c87-434e-86e6-39ce766c6606-kube-api-access-b6sqd\") pod \"network-check-target-qbvkx\" (UID: \"828a7e08-7c87-434e-86e6-39ce766c6606\") " pod="openshift-network-diagnostics/network-check-target-qbvkx" Jul 27 20:17:43.616850 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:43.616837 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 20:17:43.616904 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:43.616857 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 20:17:43.616904 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:43.616869 2558 projected.go:196] Error preparing data for projected volume kube-api-access-b6sqd for pod openshift-network-diagnostics/network-check-target-qbvkx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 20:17:43.617000 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:43.616926 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/828a7e08-7c87-434e-86e6-39ce766c6606-kube-api-access-b6sqd podName:828a7e08-7c87-434e-86e6-39ce766c6606 nodeName:}" failed. No retries permitted until 2026-07-27 20:17:47.616909116 +0000 UTC m=+10.195482689 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-b6sqd" (UniqueName: "kubernetes.io/projected/828a7e08-7c87-434e-86e6-39ce766c6606-kube-api-access-b6sqd") pod "network-check-target-qbvkx" (UID: "828a7e08-7c87-434e-86e6-39ce766c6606") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 20:17:43.929916 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:43.928285 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-57jqw" Jul 27 20:17:43.929916 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:43.928419 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-57jqw" podUID="5db14a3f-0592-417e-8de6-a29bbe4cbfbd" Jul 27 20:17:43.929916 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:43.929730 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4rh9" Jul 27 20:17:43.929916 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:43.929873 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4rh9" podUID="ed1721a8-1162-43d4-a7ae-20fb77b38000" Jul 27 20:17:44.928497 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:44.928466 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbvkx" Jul 27 20:17:44.928676 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:44.928602 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbvkx" podUID="828a7e08-7c87-434e-86e6-39ce766c6606" Jul 27 20:17:45.927747 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:45.927652 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-57jqw" Jul 27 20:17:45.928184 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:45.927858 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-57jqw" podUID="5db14a3f-0592-417e-8de6-a29bbe4cbfbd" Jul 27 20:17:45.928184 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:45.927893 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4rh9" Jul 27 20:17:45.928184 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:45.927982 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4rh9" podUID="ed1721a8-1162-43d4-a7ae-20fb77b38000" Jul 27 20:17:46.928241 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:46.928212 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbvkx" Jul 27 20:17:46.928671 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:46.928334 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbvkx" podUID="828a7e08-7c87-434e-86e6-39ce766c6606" Jul 27 20:17:47.446631 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:47.446593 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed1721a8-1162-43d4-a7ae-20fb77b38000-metrics-certs\") pod \"network-metrics-daemon-q4rh9\" (UID: \"ed1721a8-1162-43d4-a7ae-20fb77b38000\") " pod="openshift-multus/network-metrics-daemon-q4rh9" Jul 27 20:17:47.446631 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:47.446636 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5db14a3f-0592-417e-8de6-a29bbe4cbfbd-original-pull-secret\") pod \"global-pull-secret-syncer-57jqw\" (UID: \"5db14a3f-0592-417e-8de6-a29bbe4cbfbd\") " pod="kube-system/global-pull-secret-syncer-57jqw" Jul 27 20:17:47.446881 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:47.446788 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 20:17:47.446881 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:47.446790 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 20:17:47.446881 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:47.446849 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5db14a3f-0592-417e-8de6-a29bbe4cbfbd-original-pull-secret podName:5db14a3f-0592-417e-8de6-a29bbe4cbfbd nodeName:}" failed. No retries permitted until 2026-07-27 20:17:55.446832733 +0000 UTC m=+18.025406302 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5db14a3f-0592-417e-8de6-a29bbe4cbfbd-original-pull-secret") pod "global-pull-secret-syncer-57jqw" (UID: "5db14a3f-0592-417e-8de6-a29bbe4cbfbd") : object "kube-system"/"original-pull-secret" not registered Jul 27 20:17:47.446881 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:47.446868 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed1721a8-1162-43d4-a7ae-20fb77b38000-metrics-certs podName:ed1721a8-1162-43d4-a7ae-20fb77b38000 nodeName:}" failed. No retries permitted until 2026-07-27 20:17:55.446858514 +0000 UTC m=+18.025432082 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed1721a8-1162-43d4-a7ae-20fb77b38000-metrics-certs") pod "network-metrics-daemon-q4rh9" (UID: "ed1721a8-1162-43d4-a7ae-20fb77b38000") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 20:17:47.648645 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:47.648610 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6sqd\" (UniqueName: \"kubernetes.io/projected/828a7e08-7c87-434e-86e6-39ce766c6606-kube-api-access-b6sqd\") pod \"network-check-target-qbvkx\" (UID: \"828a7e08-7c87-434e-86e6-39ce766c6606\") " pod="openshift-network-diagnostics/network-check-target-qbvkx" Jul 27 20:17:47.648833 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:47.648776 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 20:17:47.648833 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:47.648793 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 20:17:47.648833 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:47.648807 2558 projected.go:196] Error preparing data for projected volume kube-api-access-b6sqd for pod openshift-network-diagnostics/network-check-target-qbvkx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 20:17:47.648997 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:47.648867 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/828a7e08-7c87-434e-86e6-39ce766c6606-kube-api-access-b6sqd podName:828a7e08-7c87-434e-86e6-39ce766c6606 nodeName:}" failed. No retries permitted until 2026-07-27 20:17:55.648849825 +0000 UTC m=+18.227423409 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-b6sqd" (UniqueName: "kubernetes.io/projected/828a7e08-7c87-434e-86e6-39ce766c6606-kube-api-access-b6sqd") pod "network-check-target-qbvkx" (UID: "828a7e08-7c87-434e-86e6-39ce766c6606") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 20:17:47.928711 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:47.928247 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4rh9" Jul 27 20:17:47.928711 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:47.928262 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-57jqw" Jul 27 20:17:47.928711 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:47.928387 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4rh9" podUID="ed1721a8-1162-43d4-a7ae-20fb77b38000" Jul 27 20:17:47.928711 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:47.928472 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-57jqw" podUID="5db14a3f-0592-417e-8de6-a29bbe4cbfbd" Jul 27 20:17:48.927763 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:48.927735 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbvkx" Jul 27 20:17:48.927949 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:48.927856 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbvkx" podUID="828a7e08-7c87-434e-86e6-39ce766c6606" Jul 27 20:17:49.928392 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:49.928356 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4rh9" Jul 27 20:17:49.928392 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:49.928382 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-57jqw" Jul 27 20:17:49.928920 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:49.928499 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4rh9" podUID="ed1721a8-1162-43d4-a7ae-20fb77b38000" Jul 27 20:17:49.928920 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:49.928628 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-57jqw" podUID="5db14a3f-0592-417e-8de6-a29bbe4cbfbd" Jul 27 20:17:50.927790 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:50.927708 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbvkx" Jul 27 20:17:50.927930 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:50.927826 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbvkx" podUID="828a7e08-7c87-434e-86e6-39ce766c6606" Jul 27 20:17:51.928863 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:51.928632 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4rh9" Jul 27 20:17:51.929281 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:51.928710 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-57jqw" Jul 27 20:17:51.929281 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:51.928994 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4rh9" podUID="ed1721a8-1162-43d4-a7ae-20fb77b38000" Jul 27 20:17:51.929281 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:51.929049 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-57jqw" podUID="5db14a3f-0592-417e-8de6-a29bbe4cbfbd" Jul 27 20:17:52.927596 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:52.927568 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbvkx" Jul 27 20:17:52.927772 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:52.927668 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbvkx" podUID="828a7e08-7c87-434e-86e6-39ce766c6606" Jul 27 20:17:53.930144 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:53.930118 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-57jqw" Jul 27 20:17:53.930608 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:53.930154 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4rh9" Jul 27 20:17:53.930608 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:53.930231 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-57jqw" podUID="5db14a3f-0592-417e-8de6-a29bbe4cbfbd" Jul 27 20:17:53.930608 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:53.930363 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4rh9" podUID="ed1721a8-1162-43d4-a7ae-20fb77b38000" Jul 27 20:17:54.928328 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:54.928291 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbvkx" Jul 27 20:17:54.928529 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:54.928419 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbvkx" podUID="828a7e08-7c87-434e-86e6-39ce766c6606" Jul 27 20:17:55.508507 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:55.508475 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed1721a8-1162-43d4-a7ae-20fb77b38000-metrics-certs\") pod \"network-metrics-daemon-q4rh9\" (UID: \"ed1721a8-1162-43d4-a7ae-20fb77b38000\") " pod="openshift-multus/network-metrics-daemon-q4rh9" Jul 27 20:17:55.508984 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:55.508520 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5db14a3f-0592-417e-8de6-a29bbe4cbfbd-original-pull-secret\") pod \"global-pull-secret-syncer-57jqw\" (UID: \"5db14a3f-0592-417e-8de6-a29bbe4cbfbd\") " pod="kube-system/global-pull-secret-syncer-57jqw" Jul 27 20:17:55.508984 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:55.508651 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 20:17:55.508984 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:55.508732 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed1721a8-1162-43d4-a7ae-20fb77b38000-metrics-certs podName:ed1721a8-1162-43d4-a7ae-20fb77b38000 nodeName:}" failed. No retries permitted until 2026-07-27 20:18:11.508714477 +0000 UTC m=+34.087288048 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed1721a8-1162-43d4-a7ae-20fb77b38000-metrics-certs") pod "network-metrics-daemon-q4rh9" (UID: "ed1721a8-1162-43d4-a7ae-20fb77b38000") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 20:17:55.508984 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:55.508662 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 20:17:55.508984 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:55.508813 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5db14a3f-0592-417e-8de6-a29bbe4cbfbd-original-pull-secret podName:5db14a3f-0592-417e-8de6-a29bbe4cbfbd nodeName:}" failed. No retries permitted until 2026-07-27 20:18:11.508783808 +0000 UTC m=+34.087357380 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5db14a3f-0592-417e-8de6-a29bbe4cbfbd-original-pull-secret") pod "global-pull-secret-syncer-57jqw" (UID: "5db14a3f-0592-417e-8de6-a29bbe4cbfbd") : object "kube-system"/"original-pull-secret" not registered Jul 27 20:17:55.709839 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:55.709801 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6sqd\" (UniqueName: \"kubernetes.io/projected/828a7e08-7c87-434e-86e6-39ce766c6606-kube-api-access-b6sqd\") pod \"network-check-target-qbvkx\" (UID: \"828a7e08-7c87-434e-86e6-39ce766c6606\") " pod="openshift-network-diagnostics/network-check-target-qbvkx" Jul 27 20:17:55.710030 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:55.710007 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 20:17:55.710093 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:55.710035 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 20:17:55.710093 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:55.710049 2558 projected.go:196] Error preparing data for projected volume kube-api-access-b6sqd for pod openshift-network-diagnostics/network-check-target-qbvkx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 20:17:55.710198 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:55.710118 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/828a7e08-7c87-434e-86e6-39ce766c6606-kube-api-access-b6sqd podName:828a7e08-7c87-434e-86e6-39ce766c6606 nodeName:}" failed. No retries permitted until 2026-07-27 20:18:11.710098559 +0000 UTC m=+34.288672129 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-b6sqd" (UniqueName: "kubernetes.io/projected/828a7e08-7c87-434e-86e6-39ce766c6606-kube-api-access-b6sqd") pod "network-check-target-qbvkx" (UID: "828a7e08-7c87-434e-86e6-39ce766c6606") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 20:17:55.928230 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:55.928153 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4rh9" Jul 27 20:17:55.928372 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:55.928281 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4rh9" podUID="ed1721a8-1162-43d4-a7ae-20fb77b38000" Jul 27 20:17:55.928372 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:55.928333 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-57jqw" Jul 27 20:17:55.928462 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:55.928444 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-57jqw" podUID="5db14a3f-0592-417e-8de6-a29bbe4cbfbd" Jul 27 20:17:56.927741 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:56.927707 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbvkx" Jul 27 20:17:56.928090 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:56.927840 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbvkx" podUID="828a7e08-7c87-434e-86e6-39ce766c6606" Jul 27 20:17:57.929265 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:57.929230 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-57jqw" Jul 27 20:17:57.929735 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:57.929319 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4rh9" Jul 27 20:17:57.929735 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:57.929339 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-57jqw" podUID="5db14a3f-0592-417e-8de6-a29bbe4cbfbd" Jul 27 20:17:57.929735 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:57.929449 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4rh9" podUID="ed1721a8-1162-43d4-a7ae-20fb77b38000" Jul 27 20:17:58.928161 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:58.928141 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbvkx" Jul 27 20:17:58.928249 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:58.928232 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbvkx" podUID="828a7e08-7c87-434e-86e6-39ce766c6606" Jul 27 20:17:59.008116 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:59.008081 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-12.ec2.internal" event={"ID":"9500b4062bc35ffcbb05e58bd96d058d","Type":"ContainerStarted","Data":"1b317aeb89b5088c8c310377288913d6b4bbccd2e5ef3647e8e2c542c7c33a1f"} Jul 27 20:17:59.009751 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:59.009724 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xlf7b" event={"ID":"b4fa2d38-705e-4403-b764-91552b9681e1","Type":"ContainerStarted","Data":"133792d756e469d01c7cbb6b4106502511b6c41ae2f0100732137a170a003885"} Jul 27 20:17:59.011838 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:59.011725 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" event={"ID":"c421dc44-8fcf-44f4-b483-8e0271833d10","Type":"ContainerStarted","Data":"e4ae002a96bfa4e4ac7de60b6c59a97aec9509a65ff5bad92a2afdf9e42bd2b9"} Jul 27 20:17:59.022826 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:59.022789 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-12.ec2.internal" podStartSLOduration=20.022778075 podStartE2EDuration="20.022778075s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:17:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:17:59.022560877 +0000 UTC m=+21.601134478" watchObservedRunningTime="2026-07-27 20:17:59.022778075 +0000 UTC m=+21.601351664" Jul 27 20:17:59.037867 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:59.037830 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-xlf7b" podStartSLOduration=2.4706151849999998 podStartE2EDuration="21.037818275s" totalImagesPullingTime="18.56720309s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:17:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:17:59.037679853 +0000 UTC m=+21.616253441" watchObservedRunningTime="2026-07-27 20:17:59.037818275 +0000 UTC m=+21.616391865" Jul 27 20:17:59.928207 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:59.927990 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4rh9" Jul 27 20:17:59.928374 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:17:59.928055 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-57jqw" Jul 27 20:17:59.928374 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:59.928271 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4rh9" podUID="ed1721a8-1162-43d4-a7ae-20fb77b38000" Jul 27 20:17:59.928374 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:17:59.928320 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-57jqw" podUID="5db14a3f-0592-417e-8de6-a29bbe4cbfbd" Jul 27 20:18:00.014756 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:00.014722 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhrbf" event={"ID":"44eadfe3-4e47-4133-89d0-b613ce3995f3","Type":"ContainerStarted","Data":"0cb367a7d308365453c90d8e38d8d28b7f401739da42bf7a9349be21930b06a0"} Jul 27 20:18:00.015953 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:00.015925 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4xms6" event={"ID":"52a8bfad-6457-45db-9d55-911c5aaa440f","Type":"ContainerStarted","Data":"ce7e27232d57a3e25622f7c1b04ad505a63ca9e6625eb7cc364d9c461f8951dd"} Jul 27 20:18:00.017353 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:00.017331 2558 generic.go:356] "Generic (PLEG): container finished" podID="f40c6f68-b52b-4f6e-9dae-94b4f8905907" containerID="295546cf7dfefe3b4593ce456cff9c1fb6b2f189a390239730a4b3af376abfd6" exitCode=0 Jul 27 20:18:00.017460 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:00.017410 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8lb48" event={"ID":"f40c6f68-b52b-4f6e-9dae-94b4f8905907","Type":"ContainerDied","Data":"295546cf7dfefe3b4593ce456cff9c1fb6b2f189a390239730a4b3af376abfd6"} Jul 27 20:18:00.018828 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:00.018807 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-w6nc7" event={"ID":"71c93315-722b-43e7-aaab-23cf21d10aee","Type":"ContainerStarted","Data":"18a9f82e0de64ce4864653155b5a237486e52f711d5316a87e2b37ec8d68e91a"} Jul 27 20:18:00.020389 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:00.020363 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k687z" event={"ID":"47679d27-ef2f-4497-bb3d-996eb0dcfc9f","Type":"ContainerStarted","Data":"471823004f86bf35e1400d5c54f009bd65c1a5f47e6ad045ad5b23400ac42e3f"} Jul 27 20:18:00.021703 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:00.021670 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2qctb" event={"ID":"cd020c9b-0313-4754-a8ca-5d79bdcf7d86","Type":"ContainerStarted","Data":"b97ac3085725a84d8f58e125b07ef21099484f1237be1a31e90aa95d82972870"} Jul 27 20:18:00.022969 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:00.022951 2558 generic.go:356] "Generic (PLEG): container finished" podID="7d2ddcfd94a3635c66b7a7044bfcc46f" containerID="b64fc2e9aa1325c6a65e04045605eeee64eb0c09cc44bd7916feec41eea58f27" exitCode=0 Jul 27 20:18:00.023055 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:00.023023 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-12.ec2.internal" event={"ID":"7d2ddcfd94a3635c66b7a7044bfcc46f","Type":"ContainerDied","Data":"b64fc2e9aa1325c6a65e04045605eeee64eb0c09cc44bd7916feec41eea58f27"} Jul 27 20:18:00.024554 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:00.024529 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g4jc5" event={"ID":"5192ecee-1724-47a3-9a8c-532390d18eae","Type":"ContainerStarted","Data":"6f15d9a8474be5018ef0387f732918a49849ec9633083af188054285008b3f64"} Jul 27 20:18:00.027114 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:00.027099 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rnj2b_c421dc44-8fcf-44f4-b483-8e0271833d10/ovn-acl-logging/0.log" Jul 27 20:18:00.027402 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:00.027380 2558 generic.go:356] "Generic (PLEG): container finished" podID="c421dc44-8fcf-44f4-b483-8e0271833d10" containerID="2cdf58afde2a6fda59dd40d22448fcf19baf790096774ecc40ad5578d1766ffe" exitCode=1 Jul 27 20:18:00.027497 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:00.027451 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" event={"ID":"c421dc44-8fcf-44f4-b483-8e0271833d10","Type":"ContainerDied","Data":"2cdf58afde2a6fda59dd40d22448fcf19baf790096774ecc40ad5578d1766ffe"} Jul 27 20:18:00.027544 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:00.027505 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" event={"ID":"c421dc44-8fcf-44f4-b483-8e0271833d10","Type":"ContainerStarted","Data":"c87ad3f24571eab5d83854991986af311cc4c49a2283eb72632144c42142f69a"} Jul 27 20:18:00.027544 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:00.027538 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" event={"ID":"c421dc44-8fcf-44f4-b483-8e0271833d10","Type":"ContainerStarted","Data":"9a64ecf812093e207c8a4fe35133bdd9df44d344c6f5826fce3e9f433d380dad"} Jul 27 20:18:00.027637 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:00.027565 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" event={"ID":"c421dc44-8fcf-44f4-b483-8e0271833d10","Type":"ContainerStarted","Data":"5572b01a312c649226abdd69a7c6ab75fe4e3645d2e74eb2601d10f3de53963f"} Jul 27 20:18:00.027637 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:00.027593 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" event={"ID":"c421dc44-8fcf-44f4-b483-8e0271833d10","Type":"ContainerStarted","Data":"916f6a2db3dc3904b0aac30fc799d6670b0014e3f7026f09970301bd55b178dd"} Jul 27 20:18:00.043967 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:00.043930 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-w6nc7" podStartSLOduration=3.5587752569999997 podStartE2EDuration="22.043919284s" totalImagesPullingTime="18.485144027s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:17:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:18:00.04361958 +0000 UTC m=+22.622193167" watchObservedRunningTime="2026-07-27 20:18:00.043919284 +0000 UTC m=+22.622492872" Jul 27 20:18:00.044460 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:00.044429 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4xms6" podStartSLOduration=3.542537926 podStartE2EDuration="22.044419806s" totalImagesPullingTime="18.50188188s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:17:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:18:00.03058638 +0000 UTC m=+22.609159969" watchObservedRunningTime="2026-07-27 20:18:00.044419806 +0000 UTC m=+22.622993445" Jul 27 20:18:00.079243 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:00.076925 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-k687z" podStartSLOduration=3.962294869 podStartE2EDuration="22.076907782s" totalImagesPullingTime="18.114612913s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:17:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:18:00.076270122 +0000 UTC m=+22.654843711" watchObservedRunningTime="2026-07-27 20:18:00.076907782 +0000 UTC m=+22.655481372" Jul 27 20:18:00.093972 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:00.093929 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-g4jc5" podStartSLOduration=3.005868276 podStartE2EDuration="22.093916741s" totalImagesPullingTime="19.088048465s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:17:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:18:00.093587633 +0000 UTC m=+22.672161223" watchObservedRunningTime="2026-07-27 20:18:00.093916741 +0000 UTC m=+22.672490328" Jul 27 20:18:00.109581 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:00.109540 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2qctb" podStartSLOduration=3.605064026 podStartE2EDuration="22.109517771s" totalImagesPullingTime="18.504453745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:17:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:18:00.107917998 +0000 UTC m=+22.686491587" watchObservedRunningTime="2026-07-27 20:18:00.109517771 +0000 UTC m=+22.688091361" Jul 27 20:18:00.679017 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:00.678813 2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 27 20:18:00.835802 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:00.835635 2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-27T20:18:00.679014348Z","UUID":"e9d78c70-4ea3-4499-8b24-97cd07b8f65f","Handler":null,"Name":"","Endpoint":""} Jul 27 20:18:00.837313 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:00.837295 2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 27 20:18:00.837442 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:00.837328 2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 27 20:18:00.887311 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:00.887275 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:00.928356 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:00.928333 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbvkx" Jul 27 20:18:00.928486 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:00.928437 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbvkx" podUID="828a7e08-7c87-434e-86e6-39ce766c6606" Jul 27 20:18:01.000344 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:01.000305 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:01.032489 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:01.032457 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhrbf" event={"ID":"44eadfe3-4e47-4133-89d0-b613ce3995f3","Type":"ContainerStarted","Data":"3442e70a76cc60775e94abda726b5287cb7ec0960aa42c25fb940d703a6b9e4c"} Jul 27 20:18:01.034884 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:01.034857 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-12.ec2.internal" event={"ID":"7d2ddcfd94a3635c66b7a7044bfcc46f","Type":"ContainerStarted","Data":"2721d633a40c219f687460058a3f0c93f432bee78af3c7fce1987025ab180d2c"} Jul 27 20:18:01.052498 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:01.052451 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-12.ec2.internal" podStartSLOduration=22.052434505 podStartE2EDuration="22.052434505s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:17:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:18:01.051759311 +0000 UTC m=+23.630332899" watchObservedRunningTime="2026-07-27 20:18:01.052434505 +0000 UTC m=+23.631008095" Jul 27 20:18:01.460461 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:01.460427 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2qctb" Jul 27 20:18:01.461117 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:01.461095 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2qctb" Jul 27 20:18:01.927898 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:01.927863 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-57jqw" Jul 27 20:18:01.928051 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:01.927866 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4rh9" Jul 27 20:18:01.928051 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:01.928003 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-57jqw" podUID="5db14a3f-0592-417e-8de6-a29bbe4cbfbd" Jul 27 20:18:01.928167 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:01.928081 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4rh9" podUID="ed1721a8-1162-43d4-a7ae-20fb77b38000" Jul 27 20:18:02.040905 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:02.040874 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rnj2b_c421dc44-8fcf-44f4-b483-8e0271833d10/ovn-acl-logging/0.log" Jul 27 20:18:02.041357 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:02.041327 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" event={"ID":"c421dc44-8fcf-44f4-b483-8e0271833d10","Type":"ContainerStarted","Data":"5a7ff3e319abe0d7fb6b6dea9d6051dacdcc5e2961e79677c9f9af3faff13b7d"} Jul 27 20:18:02.043581 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:02.043539 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhrbf" event={"ID":"44eadfe3-4e47-4133-89d0-b613ce3995f3","Type":"ContainerStarted","Data":"bf1e5d3e9d8e328b8d6fd79b9a60037e14349056055cc3a39eafb205c2ff2a12"} Jul 27 20:18:02.044126 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:02.044099 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2qctb" Jul 27 20:18:02.044305 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:02.044289 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2qctb" Jul 27 20:18:02.063017 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:02.062967 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhrbf" podStartSLOduration=3.217894163 podStartE2EDuration="24.062942573s" totalImagesPullingTime="20.84504841s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:17:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:18:02.062215271 +0000 UTC m=+24.640788862" watchObservedRunningTime="2026-07-27 20:18:02.062942573 +0000 UTC m=+24.641516163" Jul 27 20:18:02.129736 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:02.129636 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:02.928165 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:02.928125 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbvkx" Jul 27 20:18:02.928341 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:02.928238 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbvkx" podUID="828a7e08-7c87-434e-86e6-39ce766c6606" Jul 27 20:18:03.928033 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:03.928000 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-57jqw" Jul 27 20:18:03.928473 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:03.928131 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-57jqw" podUID="5db14a3f-0592-417e-8de6-a29bbe4cbfbd" Jul 27 20:18:03.928473 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:03.928000 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4rh9" Jul 27 20:18:03.928473 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:03.928249 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4rh9" podUID="ed1721a8-1162-43d4-a7ae-20fb77b38000" Jul 27 20:18:04.332191 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:04.332161 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:04.432949 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:04.432920 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:04.532755 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:04.532725 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:04.632672 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:04.632595 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:04.927658 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:04.927580 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbvkx" Jul 27 20:18:04.927808 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:04.927711 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbvkx" podUID="828a7e08-7c87-434e-86e6-39ce766c6606" Jul 27 20:18:05.052735 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:05.052711 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rnj2b_c421dc44-8fcf-44f4-b483-8e0271833d10/ovn-acl-logging/0.log" Jul 27 20:18:05.053497 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:05.053087 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" event={"ID":"c421dc44-8fcf-44f4-b483-8e0271833d10","Type":"ContainerStarted","Data":"953acd8169d3dbea5b58689f05d5de4131e3e9979f983539ed9b9457a6ba1370"} Jul 27 20:18:05.053497 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:05.053288 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:18:05.053497 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:05.053491 2558 scope.go:117] "RemoveContainer" containerID="2cdf58afde2a6fda59dd40d22448fcf19baf790096774ecc40ad5578d1766ffe" Jul 27 20:18:05.055057 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:05.055037 2558 generic.go:356] "Generic (PLEG): container finished" podID="f40c6f68-b52b-4f6e-9dae-94b4f8905907" containerID="7a088f2e4a0be90308dbe33cc63f3a9795423b723683b1ec1160e343643caf11" exitCode=0 Jul 27 20:18:05.055177 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:05.055070 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8lb48" event={"ID":"f40c6f68-b52b-4f6e-9dae-94b4f8905907","Type":"ContainerDied","Data":"7a088f2e4a0be90308dbe33cc63f3a9795423b723683b1ec1160e343643caf11"} Jul 27 20:18:05.070139 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:05.070122 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:18:05.928348 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:05.928191 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-57jqw" Jul 27 20:18:05.928543 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:05.928269 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4rh9" Jul 27 20:18:05.928543 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:05.928414 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-57jqw" podUID="5db14a3f-0592-417e-8de6-a29bbe4cbfbd" Jul 27 20:18:05.928636 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:05.928535 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4rh9" podUID="ed1721a8-1162-43d4-a7ae-20fb77b38000" Jul 27 20:18:06.060010 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:06.059982 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8lb48" event={"ID":"f40c6f68-b52b-4f6e-9dae-94b4f8905907","Type":"ContainerStarted","Data":"fc4f36463c836793929e9828bd06fdffae5fe4407c64a450d26f9ec7c9d2ca1d"} Jul 27 20:18:06.063829 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:06.063812 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rnj2b_c421dc44-8fcf-44f4-b483-8e0271833d10/ovn-acl-logging/0.log" Jul 27 20:18:06.064225 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:06.064200 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" event={"ID":"c421dc44-8fcf-44f4-b483-8e0271833d10","Type":"ContainerStarted","Data":"2d220d094ddca310ec736f317cc05b094b6b1e3b53da24ed75fc5d0cd538ba38"} Jul 27 20:18:06.064321 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:06.064298 2558 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 27 20:18:06.064539 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:06.064523 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:18:06.078082 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:06.078058 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:18:06.090458 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:06.090413 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" podStartSLOduration=9.493486933 podStartE2EDuration="28.090396124s" totalImagesPullingTime="18.596909191s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:17:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:18:06.088620287 +0000 UTC m=+28.667193875" watchObservedRunningTime="2026-07-27 20:18:06.090396124 +0000 UTC m=+28.668969716" Jul 27 20:18:06.126311 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:06.126284 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-57jqw"] Jul 27 20:18:06.126416 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:06.126407 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-57jqw" Jul 27 20:18:06.126500 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:06.126482 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-57jqw" podUID="5db14a3f-0592-417e-8de6-a29bbe4cbfbd" Jul 27 20:18:06.129539 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:06.129519 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q4rh9"] Jul 27 20:18:06.129642 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:06.129608 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4rh9" Jul 27 20:18:06.129719 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:06.129701 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4rh9" podUID="ed1721a8-1162-43d4-a7ae-20fb77b38000" Jul 27 20:18:06.130315 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:06.130294 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qbvkx"] Jul 27 20:18:06.130403 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:06.130380 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbvkx" Jul 27 20:18:06.130486 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:06.130466 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbvkx" podUID="828a7e08-7c87-434e-86e6-39ce766c6606" Jul 27 20:18:06.867423 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:06.867392 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:18:07.068152 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:07.068120 2558 generic.go:356] "Generic (PLEG): container finished" podID="f40c6f68-b52b-4f6e-9dae-94b4f8905907" containerID="fc4f36463c836793929e9828bd06fdffae5fe4407c64a450d26f9ec7c9d2ca1d" exitCode=0 Jul 27 20:18:07.068514 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:07.068160 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8lb48" event={"ID":"f40c6f68-b52b-4f6e-9dae-94b4f8905907","Type":"ContainerDied","Data":"fc4f36463c836793929e9828bd06fdffae5fe4407c64a450d26f9ec7c9d2ca1d"} Jul 27 20:18:07.161152 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:07.161075 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:07.214340 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:07.214310 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:07.931168 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:07.931134 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-57jqw" Jul 27 20:18:07.931311 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:07.931229 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-57jqw" podUID="5db14a3f-0592-417e-8de6-a29bbe4cbfbd" Jul 27 20:18:07.931397 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:07.931362 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbvkx" Jul 27 20:18:07.933722 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:07.931578 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4rh9" Jul 27 20:18:07.933722 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:07.931750 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4rh9" podUID="ed1721a8-1162-43d4-a7ae-20fb77b38000" Jul 27 20:18:07.933722 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:07.931865 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbvkx" podUID="828a7e08-7c87-434e-86e6-39ce766c6606" Jul 27 20:18:09.075127 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:09.075091 2558 generic.go:356] "Generic (PLEG): container finished" podID="f40c6f68-b52b-4f6e-9dae-94b4f8905907" containerID="0341e36fd087b52b76b215e3104c4cc13fda4bf539dd19d49d25aebcfc8b1a39" exitCode=0 Jul 27 20:18:09.075562 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:09.075162 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8lb48" event={"ID":"f40c6f68-b52b-4f6e-9dae-94b4f8905907","Type":"ContainerDied","Data":"0341e36fd087b52b76b215e3104c4cc13fda4bf539dd19d49d25aebcfc8b1a39"} Jul 27 20:18:09.106155 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:09.106132 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:09.195014 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:09.194986 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:09.298543 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:09.298510 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:09.931137 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:09.931065 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-57jqw" Jul 27 20:18:09.931275 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:09.931172 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4rh9" Jul 27 20:18:09.931275 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:09.931185 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-57jqw" podUID="5db14a3f-0592-417e-8de6-a29bbe4cbfbd" Jul 27 20:18:09.931275 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:09.931199 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbvkx" Jul 27 20:18:09.931411 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:09.931284 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4rh9" podUID="ed1721a8-1162-43d4-a7ae-20fb77b38000" Jul 27 20:18:09.931411 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:09.931356 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbvkx" podUID="828a7e08-7c87-434e-86e6-39ce766c6606" Jul 27 20:18:10.065613 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:10.065573 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:10.166478 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:10.166442 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:10.222274 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:10.222190 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:10.801684 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:10.801642 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:11.016041 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.016007 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:11.116705 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.116609 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:11.529143 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.529063 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed1721a8-1162-43d4-a7ae-20fb77b38000-metrics-certs\") pod \"network-metrics-daemon-q4rh9\" (UID: \"ed1721a8-1162-43d4-a7ae-20fb77b38000\") " pod="openshift-multus/network-metrics-daemon-q4rh9" Jul 27 20:18:11.529143 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.529101 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5db14a3f-0592-417e-8de6-a29bbe4cbfbd-original-pull-secret\") pod \"global-pull-secret-syncer-57jqw\" (UID: \"5db14a3f-0592-417e-8de6-a29bbe4cbfbd\") " pod="kube-system/global-pull-secret-syncer-57jqw" Jul 27 20:18:11.529559 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:11.529213 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 20:18:11.529559 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:11.529221 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 20:18:11.529559 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:11.529265 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5db14a3f-0592-417e-8de6-a29bbe4cbfbd-original-pull-secret podName:5db14a3f-0592-417e-8de6-a29bbe4cbfbd nodeName:}" failed. No retries permitted until 2026-07-27 20:18:43.529251235 +0000 UTC m=+66.107824802 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5db14a3f-0592-417e-8de6-a29bbe4cbfbd-original-pull-secret") pod "global-pull-secret-syncer-57jqw" (UID: "5db14a3f-0592-417e-8de6-a29bbe4cbfbd") : object "kube-system"/"original-pull-secret" not registered Jul 27 20:18:11.529559 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:11.529291 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed1721a8-1162-43d4-a7ae-20fb77b38000-metrics-certs podName:ed1721a8-1162-43d4-a7ae-20fb77b38000 nodeName:}" failed. No retries permitted until 2026-07-27 20:18:43.529269459 +0000 UTC m=+66.107843029 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed1721a8-1162-43d4-a7ae-20fb77b38000-metrics-certs") pod "network-metrics-daemon-q4rh9" (UID: "ed1721a8-1162-43d4-a7ae-20fb77b38000") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 20:18:11.700277 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.700105 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-12.ec2.internal" event="NodeReady" Jul 27 20:18:11.700446 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.700412 2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 27 20:18:11.726511 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.726479 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:11.730929 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.730906 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6sqd\" (UniqueName: \"kubernetes.io/projected/828a7e08-7c87-434e-86e6-39ce766c6606-kube-api-access-b6sqd\") pod \"network-check-target-qbvkx\" (UID: \"828a7e08-7c87-434e-86e6-39ce766c6606\") " pod="openshift-network-diagnostics/network-check-target-qbvkx" Jul 27 20:18:11.731053 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:11.731041 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 20:18:11.731100 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:11.731055 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 20:18:11.731100 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:11.731064 2558 projected.go:196] Error preparing data for projected volume kube-api-access-b6sqd for pod openshift-network-diagnostics/network-check-target-qbvkx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 20:18:11.731189 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:11.731122 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/828a7e08-7c87-434e-86e6-39ce766c6606-kube-api-access-b6sqd podName:828a7e08-7c87-434e-86e6-39ce766c6606 nodeName:}" failed. No retries permitted until 2026-07-27 20:18:43.731104194 +0000 UTC m=+66.309677776 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-b6sqd" (UniqueName: "kubernetes.io/projected/828a7e08-7c87-434e-86e6-39ce766c6606-kube-api-access-b6sqd") pod "network-check-target-qbvkx" (UID: "828a7e08-7c87-434e-86e6-39ce766c6606") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 20:18:11.737136 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.737116 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5f664bfd6d-m9579"] Jul 27 20:18:11.739217 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.738955 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f664bfd6d-m9579" Jul 27 20:18:11.742037 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.741989 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 27 20:18:11.742037 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.742011 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 27 20:18:11.742037 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.742030 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-s87ms\"" Jul 27 20:18:11.742315 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.742014 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 27 20:18:11.748210 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.748187 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 27 20:18:11.749070 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.749049 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dx6qd"] Jul 27 20:18:11.751168 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.751137 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dx6qd" Jul 27 20:18:11.753552 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.753531 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 27 20:18:11.753682 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.753569 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-qtb5t\"" Jul 27 20:18:11.753682 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.753646 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fl7pw"] Jul 27 20:18:11.753849 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.753734 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 27 20:18:11.753948 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.753935 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 27 20:18:11.755552 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.755536 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fl7pw" Jul 27 20:18:11.758359 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.758314 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 27 20:18:11.758438 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.758406 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 27 20:18:11.759288 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.758630 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kdwph\"" Jul 27 20:18:11.759288 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.758665 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 27 20:18:11.759288 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.758848 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 27 20:18:11.759288 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.759257 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5f664bfd6d-m9579"] Jul 27 20:18:11.763156 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.763057 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dx6qd"] Jul 27 20:18:11.766550 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.766534 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4xms6_52a8bfad-6457-45db-9d55-911c5aaa440f/dns-node-resolver/0.log" Jul 27 20:18:11.768723 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.768704 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fl7pw"] Jul 27 20:18:11.773407 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.773388 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qkkjs"] Jul 27 20:18:11.775337 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.775318 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qkkjs" Jul 27 20:18:11.778066 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.778047 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 27 20:18:11.778172 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.778048 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4zfst\"" Jul 27 20:18:11.778235 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.778144 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 27 20:18:11.789487 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.789465 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qkkjs"] Jul 27 20:18:11.809831 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.809803 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:11.831360 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.831336 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/68512aa0-28ef-4ce1-bb15-f442beb63f55-bound-sa-token\") pod \"image-registry-5f664bfd6d-m9579\" (UID: \"68512aa0-28ef-4ce1-bb15-f442beb63f55\") " pod="openshift-image-registry/image-registry-5f664bfd6d-m9579" Jul 27 20:18:11.831480 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.831378 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68512aa0-28ef-4ce1-bb15-f442beb63f55-registry-tls\") pod \"image-registry-5f664bfd6d-m9579\" (UID: \"68512aa0-28ef-4ce1-bb15-f442beb63f55\") " pod="openshift-image-registry/image-registry-5f664bfd6d-m9579" Jul 27 20:18:11.831480 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.831405 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/68512aa0-28ef-4ce1-bb15-f442beb63f55-installation-pull-secrets\") pod \"image-registry-5f664bfd6d-m9579\" (UID: \"68512aa0-28ef-4ce1-bb15-f442beb63f55\") " pod="openshift-image-registry/image-registry-5f664bfd6d-m9579" Jul 27 20:18:11.831480 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.831432 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bce7955d-df77-4709-a020-751de104fe28-cert\") pod \"ingress-canary-dx6qd\" (UID: \"bce7955d-df77-4709-a020-751de104fe28\") " pod="openshift-ingress-canary/ingress-canary-dx6qd" Jul 27 20:18:11.831480 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.831458 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/68512aa0-28ef-4ce1-bb15-f442beb63f55-trusted-ca\") pod \"image-registry-5f664bfd6d-m9579\" (UID: \"68512aa0-28ef-4ce1-bb15-f442beb63f55\") " pod="openshift-image-registry/image-registry-5f664bfd6d-m9579" Jul 27 20:18:11.831480 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.831476 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26jrn\" (UniqueName: \"kubernetes.io/projected/bce7955d-df77-4709-a020-751de104fe28-kube-api-access-26jrn\") pod \"ingress-canary-dx6qd\" (UID: \"bce7955d-df77-4709-a020-751de104fe28\") " pod="openshift-ingress-canary/ingress-canary-dx6qd" Jul 27 20:18:11.831642 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.831588 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/68512aa0-28ef-4ce1-bb15-f442beb63f55-image-registry-private-configuration\") pod \"image-registry-5f664bfd6d-m9579\" (UID: \"68512aa0-28ef-4ce1-bb15-f442beb63f55\") " pod="openshift-image-registry/image-registry-5f664bfd6d-m9579" Jul 27 20:18:11.831642 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.831616 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/68512aa0-28ef-4ce1-bb15-f442beb63f55-registry-certificates\") pod \"image-registry-5f664bfd6d-m9579\" (UID: \"68512aa0-28ef-4ce1-bb15-f442beb63f55\") " pod="openshift-image-registry/image-registry-5f664bfd6d-m9579" Jul 27 20:18:11.831802 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.831641 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/68512aa0-28ef-4ce1-bb15-f442beb63f55-ca-trust-extracted\") pod \"image-registry-5f664bfd6d-m9579\" (UID: \"68512aa0-28ef-4ce1-bb15-f442beb63f55\") " pod="openshift-image-registry/image-registry-5f664bfd6d-m9579" Jul 27 20:18:11.831802 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.831664 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7khsm\" (UniqueName: \"kubernetes.io/projected/68512aa0-28ef-4ce1-bb15-f442beb63f55-kube-api-access-7khsm\") pod \"image-registry-5f664bfd6d-m9579\" (UID: \"68512aa0-28ef-4ce1-bb15-f442beb63f55\") " pod="openshift-image-registry/image-registry-5f664bfd6d-m9579" Jul 27 20:18:11.900213 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.900173 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:11.927727 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.927702 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-57jqw" Jul 27 20:18:11.927888 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.927706 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4rh9" Jul 27 20:18:11.927888 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.927832 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbvkx" Jul 27 20:18:11.930351 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.930328 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 27 20:18:11.930351 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.930351 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 27 20:18:11.930537 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.930426 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8gvk7\"" Jul 27 20:18:11.930537 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.930433 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 27 20:18:11.930727 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.930663 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 27 20:18:11.930850 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.930742 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xjfvv\"" Jul 27 20:18:11.932329 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.932305 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a93ca385-ba85-4450-92a8-568b7f2dd0f4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fl7pw\" (UID: \"a93ca385-ba85-4450-92a8-568b7f2dd0f4\") " pod="openshift-insights/insights-runtime-extractor-fl7pw" Jul 27 20:18:11.932442 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.932353 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/68512aa0-28ef-4ce1-bb15-f442beb63f55-bound-sa-token\") pod \"image-registry-5f664bfd6d-m9579\" (UID: \"68512aa0-28ef-4ce1-bb15-f442beb63f55\") " pod="openshift-image-registry/image-registry-5f664bfd6d-m9579" Jul 27 20:18:11.932442 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.932381 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pll84\" (UniqueName: \"kubernetes.io/projected/d4da60bc-259e-4bb0-a78f-f77bd712463b-kube-api-access-pll84\") pod \"dns-default-qkkjs\" (UID: \"d4da60bc-259e-4bb0-a78f-f77bd712463b\") " pod="openshift-dns/dns-default-qkkjs" Jul 27 20:18:11.932442 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.932426 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68512aa0-28ef-4ce1-bb15-f442beb63f55-registry-tls\") pod \"image-registry-5f664bfd6d-m9579\" (UID: \"68512aa0-28ef-4ce1-bb15-f442beb63f55\") " pod="openshift-image-registry/image-registry-5f664bfd6d-m9579" Jul 27 20:18:11.932601 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.932452 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/68512aa0-28ef-4ce1-bb15-f442beb63f55-installation-pull-secrets\") pod \"image-registry-5f664bfd6d-m9579\" (UID: \"68512aa0-28ef-4ce1-bb15-f442beb63f55\") " pod="openshift-image-registry/image-registry-5f664bfd6d-m9579" Jul 27 20:18:11.932601 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.932476 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bce7955d-df77-4709-a020-751de104fe28-cert\") pod \"ingress-canary-dx6qd\" (UID: \"bce7955d-df77-4709-a020-751de104fe28\") " pod="openshift-ingress-canary/ingress-canary-dx6qd" Jul 27 20:18:11.932601 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.932517 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/68512aa0-28ef-4ce1-bb15-f442beb63f55-trusted-ca\") pod \"image-registry-5f664bfd6d-m9579\" (UID: \"68512aa0-28ef-4ce1-bb15-f442beb63f55\") " pod="openshift-image-registry/image-registry-5f664bfd6d-m9579" Jul 27 20:18:11.932601 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.932544 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26jrn\" (UniqueName: \"kubernetes.io/projected/bce7955d-df77-4709-a020-751de104fe28-kube-api-access-26jrn\") pod \"ingress-canary-dx6qd\" (UID: \"bce7955d-df77-4709-a020-751de104fe28\") " pod="openshift-ingress-canary/ingress-canary-dx6qd" Jul 27 20:18:11.932601 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:11.932568 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 20:18:11.932601 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:11.932587 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f664bfd6d-m9579: secret "image-registry-tls" not found Jul 27 20:18:11.932907 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:11.932643 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68512aa0-28ef-4ce1-bb15-f442beb63f55-registry-tls podName:68512aa0-28ef-4ce1-bb15-f442beb63f55 nodeName:}" failed. No retries permitted until 2026-07-27 20:18:12.432623032 +0000 UTC m=+35.011196610 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/68512aa0-28ef-4ce1-bb15-f442beb63f55-registry-tls") pod "image-registry-5f664bfd6d-m9579" (UID: "68512aa0-28ef-4ce1-bb15-f442beb63f55") : secret "image-registry-tls" not found Jul 27 20:18:11.932907 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.932726 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a93ca385-ba85-4450-92a8-568b7f2dd0f4-crio-socket\") pod \"insights-runtime-extractor-fl7pw\" (UID: \"a93ca385-ba85-4450-92a8-568b7f2dd0f4\") " pod="openshift-insights/insights-runtime-extractor-fl7pw" Jul 27 20:18:11.932907 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.932756 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a93ca385-ba85-4450-92a8-568b7f2dd0f4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fl7pw\" (UID: \"a93ca385-ba85-4450-92a8-568b7f2dd0f4\") " pod="openshift-insights/insights-runtime-extractor-fl7pw" Jul 27 20:18:11.932907 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.932781 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lddg\" (UniqueName: \"kubernetes.io/projected/a93ca385-ba85-4450-92a8-568b7f2dd0f4-kube-api-access-5lddg\") pod \"insights-runtime-extractor-fl7pw\" (UID: \"a93ca385-ba85-4450-92a8-568b7f2dd0f4\") " pod="openshift-insights/insights-runtime-extractor-fl7pw" Jul 27 20:18:11.932907 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.932864 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/68512aa0-28ef-4ce1-bb15-f442beb63f55-image-registry-private-configuration\") pod \"image-registry-5f664bfd6d-m9579\" (UID: \"68512aa0-28ef-4ce1-bb15-f442beb63f55\") " pod="openshift-image-registry/image-registry-5f664bfd6d-m9579" Jul 27 20:18:11.932907 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.932890 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/68512aa0-28ef-4ce1-bb15-f442beb63f55-registry-certificates\") pod \"image-registry-5f664bfd6d-m9579\" (UID: \"68512aa0-28ef-4ce1-bb15-f442beb63f55\") " pod="openshift-image-registry/image-registry-5f664bfd6d-m9579" Jul 27 20:18:11.933204 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.932912 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4da60bc-259e-4bb0-a78f-f77bd712463b-tmp-dir\") pod \"dns-default-qkkjs\" (UID: \"d4da60bc-259e-4bb0-a78f-f77bd712463b\") " pod="openshift-dns/dns-default-qkkjs" Jul 27 20:18:11.933204 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.932943 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d4da60bc-259e-4bb0-a78f-f77bd712463b-config-volume\") pod \"dns-default-qkkjs\" (UID: \"d4da60bc-259e-4bb0-a78f-f77bd712463b\") " pod="openshift-dns/dns-default-qkkjs" Jul 27 20:18:11.933204 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.932970 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4da60bc-259e-4bb0-a78f-f77bd712463b-metrics-tls\") pod \"dns-default-qkkjs\" (UID: \"d4da60bc-259e-4bb0-a78f-f77bd712463b\") " pod="openshift-dns/dns-default-qkkjs" Jul 27 20:18:11.933204 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.932992 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a93ca385-ba85-4450-92a8-568b7f2dd0f4-data-volume\") pod \"insights-runtime-extractor-fl7pw\" (UID: \"a93ca385-ba85-4450-92a8-568b7f2dd0f4\") " pod="openshift-insights/insights-runtime-extractor-fl7pw" Jul 27 20:18:11.933204 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.933021 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/68512aa0-28ef-4ce1-bb15-f442beb63f55-ca-trust-extracted\") pod \"image-registry-5f664bfd6d-m9579\" (UID: \"68512aa0-28ef-4ce1-bb15-f442beb63f55\") " pod="openshift-image-registry/image-registry-5f664bfd6d-m9579" Jul 27 20:18:11.933204 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.933058 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7khsm\" (UniqueName: \"kubernetes.io/projected/68512aa0-28ef-4ce1-bb15-f442beb63f55-kube-api-access-7khsm\") pod \"image-registry-5f664bfd6d-m9579\" (UID: \"68512aa0-28ef-4ce1-bb15-f442beb63f55\") " pod="openshift-image-registry/image-registry-5f664bfd6d-m9579" Jul 27 20:18:11.933621 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.933597 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/68512aa0-28ef-4ce1-bb15-f442beb63f55-ca-trust-extracted\") pod \"image-registry-5f664bfd6d-m9579\" (UID: \"68512aa0-28ef-4ce1-bb15-f442beb63f55\") " pod="openshift-image-registry/image-registry-5f664bfd6d-m9579" Jul 27 20:18:11.933714 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.933629 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/68512aa0-28ef-4ce1-bb15-f442beb63f55-trusted-ca\") pod \"image-registry-5f664bfd6d-m9579\" (UID: \"68512aa0-28ef-4ce1-bb15-f442beb63f55\") " pod="openshift-image-registry/image-registry-5f664bfd6d-m9579" Jul 27 20:18:11.933913 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.933893 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/68512aa0-28ef-4ce1-bb15-f442beb63f55-registry-certificates\") pod \"image-registry-5f664bfd6d-m9579\" (UID: \"68512aa0-28ef-4ce1-bb15-f442beb63f55\") " pod="openshift-image-registry/image-registry-5f664bfd6d-m9579" Jul 27 20:18:11.937324 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.937304 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/68512aa0-28ef-4ce1-bb15-f442beb63f55-image-registry-private-configuration\") pod \"image-registry-5f664bfd6d-m9579\" (UID: \"68512aa0-28ef-4ce1-bb15-f442beb63f55\") " pod="openshift-image-registry/image-registry-5f664bfd6d-m9579" Jul 27 20:18:11.937428 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.937402 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/68512aa0-28ef-4ce1-bb15-f442beb63f55-installation-pull-secrets\") pod \"image-registry-5f664bfd6d-m9579\" (UID: \"68512aa0-28ef-4ce1-bb15-f442beb63f55\") " pod="openshift-image-registry/image-registry-5f664bfd6d-m9579" Jul 27 20:18:11.937480 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.937450 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bce7955d-df77-4709-a020-751de104fe28-cert\") pod \"ingress-canary-dx6qd\" (UID: \"bce7955d-df77-4709-a020-751de104fe28\") " pod="openshift-ingress-canary/ingress-canary-dx6qd" Jul 27 20:18:11.942867 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.942842 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26jrn\" (UniqueName: \"kubernetes.io/projected/bce7955d-df77-4709-a020-751de104fe28-kube-api-access-26jrn\") pod \"ingress-canary-dx6qd\" (UID: \"bce7955d-df77-4709-a020-751de104fe28\") " pod="openshift-ingress-canary/ingress-canary-dx6qd" Jul 27 20:18:11.943055 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.943033 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/68512aa0-28ef-4ce1-bb15-f442beb63f55-bound-sa-token\") pod \"image-registry-5f664bfd6d-m9579\" (UID: \"68512aa0-28ef-4ce1-bb15-f442beb63f55\") " pod="openshift-image-registry/image-registry-5f664bfd6d-m9579" Jul 27 20:18:11.943318 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.943301 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7khsm\" (UniqueName: \"kubernetes.io/projected/68512aa0-28ef-4ce1-bb15-f442beb63f55-kube-api-access-7khsm\") pod \"image-registry-5f664bfd6d-m9579\" (UID: \"68512aa0-28ef-4ce1-bb15-f442beb63f55\") " pod="openshift-image-registry/image-registry-5f664bfd6d-m9579" Jul 27 20:18:11.999031 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:11.998994 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:12.033969 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:12.033891 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a93ca385-ba85-4450-92a8-568b7f2dd0f4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fl7pw\" (UID: \"a93ca385-ba85-4450-92a8-568b7f2dd0f4\") " pod="openshift-insights/insights-runtime-extractor-fl7pw" Jul 27 20:18:12.033969 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:12.033940 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pll84\" (UniqueName: \"kubernetes.io/projected/d4da60bc-259e-4bb0-a78f-f77bd712463b-kube-api-access-pll84\") pod \"dns-default-qkkjs\" (UID: \"d4da60bc-259e-4bb0-a78f-f77bd712463b\") " pod="openshift-dns/dns-default-qkkjs" Jul 27 20:18:12.034169 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:12.033996 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a93ca385-ba85-4450-92a8-568b7f2dd0f4-crio-socket\") pod \"insights-runtime-extractor-fl7pw\" (UID: \"a93ca385-ba85-4450-92a8-568b7f2dd0f4\") " pod="openshift-insights/insights-runtime-extractor-fl7pw" Jul 27 20:18:12.034169 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:12.034016 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a93ca385-ba85-4450-92a8-568b7f2dd0f4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fl7pw\" (UID: \"a93ca385-ba85-4450-92a8-568b7f2dd0f4\") " pod="openshift-insights/insights-runtime-extractor-fl7pw" Jul 27 20:18:12.034169 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:12.034038 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lddg\" (UniqueName: \"kubernetes.io/projected/a93ca385-ba85-4450-92a8-568b7f2dd0f4-kube-api-access-5lddg\") pod \"insights-runtime-extractor-fl7pw\" (UID: \"a93ca385-ba85-4450-92a8-568b7f2dd0f4\") " pod="openshift-insights/insights-runtime-extractor-fl7pw" Jul 27 20:18:12.034169 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:12.034068 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 20:18:12.034169 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:12.034095 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4da60bc-259e-4bb0-a78f-f77bd712463b-tmp-dir\") pod \"dns-default-qkkjs\" (UID: \"d4da60bc-259e-4bb0-a78f-f77bd712463b\") " pod="openshift-dns/dns-default-qkkjs" Jul 27 20:18:12.034169 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:12.034123 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d4da60bc-259e-4bb0-a78f-f77bd712463b-config-volume\") pod \"dns-default-qkkjs\" (UID: \"d4da60bc-259e-4bb0-a78f-f77bd712463b\") " pod="openshift-dns/dns-default-qkkjs" Jul 27 20:18:12.034169 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:12.034131 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 20:18:12.034169 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:12.034149 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4da60bc-259e-4bb0-a78f-f77bd712463b-metrics-tls\") pod \"dns-default-qkkjs\" (UID: \"d4da60bc-259e-4bb0-a78f-f77bd712463b\") " pod="openshift-dns/dns-default-qkkjs" Jul 27 20:18:12.034169 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:12.034166 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a93ca385-ba85-4450-92a8-568b7f2dd0f4-insights-runtime-extractor-tls podName:a93ca385-ba85-4450-92a8-568b7f2dd0f4 nodeName:}" failed. No retries permitted until 2026-07-27 20:18:12.534145211 +0000 UTC m=+35.112718783 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a93ca385-ba85-4450-92a8-568b7f2dd0f4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fl7pw" (UID: "a93ca385-ba85-4450-92a8-568b7f2dd0f4") : secret "insights-runtime-extractor-tls" not found Jul 27 20:18:12.034624 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:12.034206 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a93ca385-ba85-4450-92a8-568b7f2dd0f4-kube-rbac-proxy-cm podName:a93ca385-ba85-4450-92a8-568b7f2dd0f4 nodeName:}" failed. No retries permitted until 2026-07-27 20:18:12.534189643 +0000 UTC m=+35.112763210 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a93ca385-ba85-4450-92a8-568b7f2dd0f4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fl7pw" (UID: "a93ca385-ba85-4450-92a8-568b7f2dd0f4") : configmap "kube-rbac-proxy" not found Jul 27 20:18:12.034624 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:12.034212 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 20:18:12.034624 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:12.034227 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a93ca385-ba85-4450-92a8-568b7f2dd0f4-data-volume\") pod \"insights-runtime-extractor-fl7pw\" (UID: \"a93ca385-ba85-4450-92a8-568b7f2dd0f4\") " pod="openshift-insights/insights-runtime-extractor-fl7pw" Jul 27 20:18:12.034624 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:12.034251 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a93ca385-ba85-4450-92a8-568b7f2dd0f4-crio-socket\") pod \"insights-runtime-extractor-fl7pw\" (UID: \"a93ca385-ba85-4450-92a8-568b7f2dd0f4\") " pod="openshift-insights/insights-runtime-extractor-fl7pw" Jul 27 20:18:12.034624 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:12.034291 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4da60bc-259e-4bb0-a78f-f77bd712463b-metrics-tls podName:d4da60bc-259e-4bb0-a78f-f77bd712463b nodeName:}" failed. No retries permitted until 2026-07-27 20:18:12.534278362 +0000 UTC m=+35.112851929 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4da60bc-259e-4bb0-a78f-f77bd712463b-metrics-tls") pod "dns-default-qkkjs" (UID: "d4da60bc-259e-4bb0-a78f-f77bd712463b") : secret "dns-default-metrics-tls" not found Jul 27 20:18:12.034892 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:12.034678 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4da60bc-259e-4bb0-a78f-f77bd712463b-tmp-dir\") pod \"dns-default-qkkjs\" (UID: \"d4da60bc-259e-4bb0-a78f-f77bd712463b\") " pod="openshift-dns/dns-default-qkkjs" Jul 27 20:18:12.034892 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:12.034787 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a93ca385-ba85-4450-92a8-568b7f2dd0f4-data-volume\") pod \"insights-runtime-extractor-fl7pw\" (UID: \"a93ca385-ba85-4450-92a8-568b7f2dd0f4\") " pod="openshift-insights/insights-runtime-extractor-fl7pw" Jul 27 20:18:12.034990 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:12.034976 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d4da60bc-259e-4bb0-a78f-f77bd712463b-config-volume\") pod \"dns-default-qkkjs\" (UID: \"d4da60bc-259e-4bb0-a78f-f77bd712463b\") " pod="openshift-dns/dns-default-qkkjs" Jul 27 20:18:12.042851 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:12.042831 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-n9zq8"] Jul 27 20:18:12.046205 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:12.046189 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-n9zq8" Jul 27 20:18:12.048483 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:12.048459 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 27 20:18:12.048483 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:12.048480 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-8z4tz\"" Jul 27 20:18:12.048623 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:12.048535 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pll84\" (UniqueName: \"kubernetes.io/projected/d4da60bc-259e-4bb0-a78f-f77bd712463b-kube-api-access-pll84\") pod \"dns-default-qkkjs\" (UID: \"d4da60bc-259e-4bb0-a78f-f77bd712463b\") " pod="openshift-dns/dns-default-qkkjs" Jul 27 20:18:12.048623 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:12.048467 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 27 20:18:12.051354 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:12.051332 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lddg\" (UniqueName: \"kubernetes.io/projected/a93ca385-ba85-4450-92a8-568b7f2dd0f4-kube-api-access-5lddg\") pod \"insights-runtime-extractor-fl7pw\" (UID: \"a93ca385-ba85-4450-92a8-568b7f2dd0f4\") " pod="openshift-insights/insights-runtime-extractor-fl7pw" Jul 27 20:18:12.054615 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:12.054570 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-n9zq8"] Jul 27 20:18:12.062672 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:12.062654 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dx6qd" Jul 27 20:18:12.097060 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:12.097025 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:12.135627 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:12.135592 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmgwk\" (UniqueName: \"kubernetes.io/projected/28bb4ec7-00e0-41f7-8dae-475d58c5ee6a-kube-api-access-tmgwk\") pod \"migrator-6865c9967-n9zq8\" (UID: \"28bb4ec7-00e0-41f7-8dae-475d58c5ee6a\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-n9zq8" Jul 27 20:18:12.201317 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:12.201278 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:12.236599 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:12.236567 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmgwk\" (UniqueName: \"kubernetes.io/projected/28bb4ec7-00e0-41f7-8dae-475d58c5ee6a-kube-api-access-tmgwk\") pod \"migrator-6865c9967-n9zq8\" (UID: \"28bb4ec7-00e0-41f7-8dae-475d58c5ee6a\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-n9zq8" Jul 27 20:18:12.244368 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:12.244332 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmgwk\" (UniqueName: \"kubernetes.io/projected/28bb4ec7-00e0-41f7-8dae-475d58c5ee6a-kube-api-access-tmgwk\") pod \"migrator-6865c9967-n9zq8\" (UID: \"28bb4ec7-00e0-41f7-8dae-475d58c5ee6a\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-n9zq8" Jul 27 20:18:12.366134 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:12.366063 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-n9zq8" Jul 27 20:18:12.438705 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:12.438661 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68512aa0-28ef-4ce1-bb15-f442beb63f55-registry-tls\") pod \"image-registry-5f664bfd6d-m9579\" (UID: \"68512aa0-28ef-4ce1-bb15-f442beb63f55\") " pod="openshift-image-registry/image-registry-5f664bfd6d-m9579" Jul 27 20:18:12.438854 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:12.438810 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 20:18:12.438854 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:12.438829 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f664bfd6d-m9579: secret "image-registry-tls" not found Jul 27 20:18:12.438960 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:12.438898 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68512aa0-28ef-4ce1-bb15-f442beb63f55-registry-tls podName:68512aa0-28ef-4ce1-bb15-f442beb63f55 nodeName:}" failed. No retries permitted until 2026-07-27 20:18:13.438877205 +0000 UTC m=+36.017450800 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/68512aa0-28ef-4ce1-bb15-f442beb63f55-registry-tls") pod "image-registry-5f664bfd6d-m9579" (UID: "68512aa0-28ef-4ce1-bb15-f442beb63f55") : secret "image-registry-tls" not found Jul 27 20:18:12.540114 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:12.540077 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4da60bc-259e-4bb0-a78f-f77bd712463b-metrics-tls\") pod \"dns-default-qkkjs\" (UID: \"d4da60bc-259e-4bb0-a78f-f77bd712463b\") " pod="openshift-dns/dns-default-qkkjs" Jul 27 20:18:12.540602 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:12.540144 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a93ca385-ba85-4450-92a8-568b7f2dd0f4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fl7pw\" (UID: \"a93ca385-ba85-4450-92a8-568b7f2dd0f4\") " pod="openshift-insights/insights-runtime-extractor-fl7pw" Jul 27 20:18:12.540602 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:12.540220 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a93ca385-ba85-4450-92a8-568b7f2dd0f4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fl7pw\" (UID: \"a93ca385-ba85-4450-92a8-568b7f2dd0f4\") " pod="openshift-insights/insights-runtime-extractor-fl7pw" Jul 27 20:18:12.540602 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:12.540230 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 20:18:12.540602 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:12.540299 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4da60bc-259e-4bb0-a78f-f77bd712463b-metrics-tls podName:d4da60bc-259e-4bb0-a78f-f77bd712463b nodeName:}" failed. No retries permitted until 2026-07-27 20:18:13.54028197 +0000 UTC m=+36.118855538 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4da60bc-259e-4bb0-a78f-f77bd712463b-metrics-tls") pod "dns-default-qkkjs" (UID: "d4da60bc-259e-4bb0-a78f-f77bd712463b") : secret "dns-default-metrics-tls" not found Jul 27 20:18:12.540602 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:12.540297 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 20:18:12.540602 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:12.540314 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 20:18:12.540602 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:12.540328 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a93ca385-ba85-4450-92a8-568b7f2dd0f4-insights-runtime-extractor-tls podName:a93ca385-ba85-4450-92a8-568b7f2dd0f4 nodeName:}" failed. No retries permitted until 2026-07-27 20:18:13.540321858 +0000 UTC m=+36.118895424 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a93ca385-ba85-4450-92a8-568b7f2dd0f4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fl7pw" (UID: "a93ca385-ba85-4450-92a8-568b7f2dd0f4") : secret "insights-runtime-extractor-tls" not found Jul 27 20:18:12.540602 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:12.540363 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a93ca385-ba85-4450-92a8-568b7f2dd0f4-kube-rbac-proxy-cm podName:a93ca385-ba85-4450-92a8-568b7f2dd0f4 nodeName:}" failed. No retries permitted until 2026-07-27 20:18:13.540347519 +0000 UTC m=+36.118921087 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a93ca385-ba85-4450-92a8-568b7f2dd0f4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fl7pw" (UID: "a93ca385-ba85-4450-92a8-568b7f2dd0f4") : configmap "kube-rbac-proxy" not found Jul 27 20:18:12.952044 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:12.952016 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k687z_47679d27-ef2f-4497-bb3d-996eb0dcfc9f/node-ca/0.log" Jul 27 20:18:13.309344 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:13.309269 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-gcnc8"] Jul 27 20:18:13.311566 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:13.311536 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-gcnc8" Jul 27 20:18:13.313935 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:13.313911 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 27 20:18:13.314059 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:13.313963 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 27 20:18:13.314059 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:13.313992 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 27 20:18:13.314059 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:13.314025 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 27 20:18:13.314928 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:13.314910 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-2xbqb\"" Jul 27 20:18:13.322290 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:13.322269 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-gcnc8"] Jul 27 20:18:13.349953 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:13.349914 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:13.401095 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:13.401064 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:13.448127 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:13.448028 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a5a55802-00ca-41a0-9233-91bf9f229dc8-signing-key\") pod \"service-ca-658d7b7c78-gcnc8\" (UID: \"a5a55802-00ca-41a0-9233-91bf9f229dc8\") " pod="openshift-service-ca/service-ca-658d7b7c78-gcnc8" Jul 27 20:18:13.448127 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:13.448063 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a5a55802-00ca-41a0-9233-91bf9f229dc8-signing-cabundle\") pod \"service-ca-658d7b7c78-gcnc8\" (UID: \"a5a55802-00ca-41a0-9233-91bf9f229dc8\") " pod="openshift-service-ca/service-ca-658d7b7c78-gcnc8" Jul 27 20:18:13.448127 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:13.448108 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9p6r4\" (UniqueName: \"kubernetes.io/projected/a5a55802-00ca-41a0-9233-91bf9f229dc8-kube-api-access-9p6r4\") pod \"service-ca-658d7b7c78-gcnc8\" (UID: \"a5a55802-00ca-41a0-9233-91bf9f229dc8\") " pod="openshift-service-ca/service-ca-658d7b7c78-gcnc8" Jul 27 20:18:13.448299 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:13.448240 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68512aa0-28ef-4ce1-bb15-f442beb63f55-registry-tls\") pod \"image-registry-5f664bfd6d-m9579\" (UID: \"68512aa0-28ef-4ce1-bb15-f442beb63f55\") " pod="openshift-image-registry/image-registry-5f664bfd6d-m9579" Jul 27 20:18:13.448391 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:13.448373 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 20:18:13.448426 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:13.448393 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f664bfd6d-m9579: secret "image-registry-tls" not found Jul 27 20:18:13.448499 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:13.448467 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68512aa0-28ef-4ce1-bb15-f442beb63f55-registry-tls podName:68512aa0-28ef-4ce1-bb15-f442beb63f55 nodeName:}" failed. No retries permitted until 2026-07-27 20:18:15.448447663 +0000 UTC m=+38.027021239 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/68512aa0-28ef-4ce1-bb15-f442beb63f55-registry-tls") pod "image-registry-5f664bfd6d-m9579" (UID: "68512aa0-28ef-4ce1-bb15-f442beb63f55") : secret "image-registry-tls" not found Jul 27 20:18:13.549052 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:13.548879 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a93ca385-ba85-4450-92a8-568b7f2dd0f4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fl7pw\" (UID: \"a93ca385-ba85-4450-92a8-568b7f2dd0f4\") " pod="openshift-insights/insights-runtime-extractor-fl7pw" Jul 27 20:18:13.549507 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:13.549137 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 20:18:13.549507 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:13.549137 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a93ca385-ba85-4450-92a8-568b7f2dd0f4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fl7pw\" (UID: \"a93ca385-ba85-4450-92a8-568b7f2dd0f4\") " pod="openshift-insights/insights-runtime-extractor-fl7pw" Jul 27 20:18:13.549507 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:13.549195 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 20:18:13.549507 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:13.549209 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a93ca385-ba85-4450-92a8-568b7f2dd0f4-insights-runtime-extractor-tls podName:a93ca385-ba85-4450-92a8-568b7f2dd0f4 nodeName:}" failed. No retries permitted until 2026-07-27 20:18:15.549187901 +0000 UTC m=+38.127761469 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a93ca385-ba85-4450-92a8-568b7f2dd0f4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fl7pw" (UID: "a93ca385-ba85-4450-92a8-568b7f2dd0f4") : secret "insights-runtime-extractor-tls" not found Jul 27 20:18:13.549507 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:13.549248 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a5a55802-00ca-41a0-9233-91bf9f229dc8-signing-key\") pod \"service-ca-658d7b7c78-gcnc8\" (UID: \"a5a55802-00ca-41a0-9233-91bf9f229dc8\") " pod="openshift-service-ca/service-ca-658d7b7c78-gcnc8" Jul 27 20:18:13.549507 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:13.549276 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a93ca385-ba85-4450-92a8-568b7f2dd0f4-kube-rbac-proxy-cm podName:a93ca385-ba85-4450-92a8-568b7f2dd0f4 nodeName:}" failed. No retries permitted until 2026-07-27 20:18:15.549242977 +0000 UTC m=+38.127816549 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a93ca385-ba85-4450-92a8-568b7f2dd0f4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fl7pw" (UID: "a93ca385-ba85-4450-92a8-568b7f2dd0f4") : configmap "kube-rbac-proxy" not found Jul 27 20:18:13.549507 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:13.549308 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a5a55802-00ca-41a0-9233-91bf9f229dc8-signing-cabundle\") pod \"service-ca-658d7b7c78-gcnc8\" (UID: \"a5a55802-00ca-41a0-9233-91bf9f229dc8\") " pod="openshift-service-ca/service-ca-658d7b7c78-gcnc8" Jul 27 20:18:13.549507 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:13.549377 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4da60bc-259e-4bb0-a78f-f77bd712463b-metrics-tls\") pod \"dns-default-qkkjs\" (UID: \"d4da60bc-259e-4bb0-a78f-f77bd712463b\") " pod="openshift-dns/dns-default-qkkjs" Jul 27 20:18:13.549507 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:13.549396 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p6r4\" (UniqueName: \"kubernetes.io/projected/a5a55802-00ca-41a0-9233-91bf9f229dc8-kube-api-access-9p6r4\") pod \"service-ca-658d7b7c78-gcnc8\" (UID: \"a5a55802-00ca-41a0-9233-91bf9f229dc8\") " pod="openshift-service-ca/service-ca-658d7b7c78-gcnc8" Jul 27 20:18:13.549836 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:13.549740 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 20:18:13.549836 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:13.549792 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4da60bc-259e-4bb0-a78f-f77bd712463b-metrics-tls podName:d4da60bc-259e-4bb0-a78f-f77bd712463b nodeName:}" failed. No retries permitted until 2026-07-27 20:18:15.549776888 +0000 UTC m=+38.128350456 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4da60bc-259e-4bb0-a78f-f77bd712463b-metrics-tls") pod "dns-default-qkkjs" (UID: "d4da60bc-259e-4bb0-a78f-f77bd712463b") : secret "dns-default-metrics-tls" not found Jul 27 20:18:13.550400 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:13.550380 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a5a55802-00ca-41a0-9233-91bf9f229dc8-signing-cabundle\") pod \"service-ca-658d7b7c78-gcnc8\" (UID: \"a5a55802-00ca-41a0-9233-91bf9f229dc8\") " pod="openshift-service-ca/service-ca-658d7b7c78-gcnc8" Jul 27 20:18:13.552654 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:13.552620 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a5a55802-00ca-41a0-9233-91bf9f229dc8-signing-key\") pod \"service-ca-658d7b7c78-gcnc8\" (UID: \"a5a55802-00ca-41a0-9233-91bf9f229dc8\") " pod="openshift-service-ca/service-ca-658d7b7c78-gcnc8" Jul 27 20:18:13.560195 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:13.560136 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p6r4\" (UniqueName: \"kubernetes.io/projected/a5a55802-00ca-41a0-9233-91bf9f229dc8-kube-api-access-9p6r4\") pod \"service-ca-658d7b7c78-gcnc8\" (UID: \"a5a55802-00ca-41a0-9233-91bf9f229dc8\") " pod="openshift-service-ca/service-ca-658d7b7c78-gcnc8" Jul 27 20:18:13.569043 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:13.569020 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-n9zq8"] Jul 27 20:18:13.572272 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:13.572252 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dx6qd"] Jul 27 20:18:13.572893 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:18:13.572874 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28bb4ec7_00e0_41f7_8dae_475d58c5ee6a.slice/crio-ce3613286ab86af00534f22157e1daefada100bd8af280dfd2e72a6316dcadec WatchSource:0}: Error finding container ce3613286ab86af00534f22157e1daefada100bd8af280dfd2e72a6316dcadec: Status 404 returned error can't find the container with id ce3613286ab86af00534f22157e1daefada100bd8af280dfd2e72a6316dcadec Jul 27 20:18:13.575916 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:18:13.575895 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbce7955d_df77_4709_a020_751de104fe28.slice/crio-af7713717010807a08dc0e7f5d5ea0968ddd948656d7c5d023d5db5229b7e86e WatchSource:0}: Error finding container af7713717010807a08dc0e7f5d5ea0968ddd948656d7c5d023d5db5229b7e86e: Status 404 returned error can't find the container with id af7713717010807a08dc0e7f5d5ea0968ddd948656d7c5d023d5db5229b7e86e Jul 27 20:18:13.625909 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:13.625878 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-gcnc8" Jul 27 20:18:13.747528 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:13.747498 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-gcnc8"] Jul 27 20:18:13.750837 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:18:13.750810 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5a55802_00ca_41a0_9233_91bf9f229dc8.slice/crio-7d9e607283640b323c861ba539b71f44e3c789de45f3beb5b2e3c460122d8870 WatchSource:0}: Error finding container 7d9e607283640b323c861ba539b71f44e3c789de45f3beb5b2e3c460122d8870: Status 404 returned error can't find the container with id 7d9e607283640b323c861ba539b71f44e3c789de45f3beb5b2e3c460122d8870 Jul 27 20:18:14.090234 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:14.090195 2558 generic.go:356] "Generic (PLEG): container finished" podID="f40c6f68-b52b-4f6e-9dae-94b4f8905907" containerID="16a45a4c9612071ea32691b0d811886d8f733e686a4cec2393e4017bfc9a3b13" exitCode=0 Jul 27 20:18:14.090400 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:14.090312 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8lb48" event={"ID":"f40c6f68-b52b-4f6e-9dae-94b4f8905907","Type":"ContainerDied","Data":"16a45a4c9612071ea32691b0d811886d8f733e686a4cec2393e4017bfc9a3b13"} Jul 27 20:18:14.091530 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:14.091505 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-gcnc8" event={"ID":"a5a55802-00ca-41a0-9233-91bf9f229dc8","Type":"ContainerStarted","Data":"7d9e607283640b323c861ba539b71f44e3c789de45f3beb5b2e3c460122d8870"} Jul 27 20:18:14.092816 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:14.092788 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-n9zq8" event={"ID":"28bb4ec7-00e0-41f7-8dae-475d58c5ee6a","Type":"ContainerStarted","Data":"ce3613286ab86af00534f22157e1daefada100bd8af280dfd2e72a6316dcadec"} Jul 27 20:18:14.094253 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:14.094231 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dx6qd" event={"ID":"bce7955d-df77-4709-a020-751de104fe28","Type":"ContainerStarted","Data":"af7713717010807a08dc0e7f5d5ea0968ddd948656d7c5d023d5db5229b7e86e"} Jul 27 20:18:14.442941 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:14.442844 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:15.103127 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:15.102803 2558 generic.go:356] "Generic (PLEG): container finished" podID="f40c6f68-b52b-4f6e-9dae-94b4f8905907" containerID="35d0f8cd225c871d296bff8ceae6cbbe659a663d6faeecacaecb98be1ab0bc01" exitCode=0 Jul 27 20:18:15.103127 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:15.102975 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8lb48" event={"ID":"f40c6f68-b52b-4f6e-9dae-94b4f8905907","Type":"ContainerDied","Data":"35d0f8cd225c871d296bff8ceae6cbbe659a663d6faeecacaecb98be1ab0bc01"} Jul 27 20:18:15.106047 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:15.106006 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-n9zq8" event={"ID":"28bb4ec7-00e0-41f7-8dae-475d58c5ee6a","Type":"ContainerStarted","Data":"015d2e40fad16d05bfe99024c45539641b56e88f0060f563e38c0ecd1a7b2009"} Jul 27 20:18:15.106186 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:15.106094 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-n9zq8" event={"ID":"28bb4ec7-00e0-41f7-8dae-475d58c5ee6a","Type":"ContainerStarted","Data":"b064de22a782b964cecf6d704b95fa6c7d187a8df4cdfdb1854fbe090cfbd0a1"} Jul 27 20:18:15.150739 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:15.150662 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-n9zq8" podStartSLOduration=1.802294276 podStartE2EDuration="3.150641549s" totalImagesPullingTime="1.348347273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:18:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:18:15.149329881 +0000 UTC m=+37.727903471" watchObservedRunningTime="2026-07-27 20:18:15.150641549 +0000 UTC m=+37.729215139" Jul 27 20:18:15.467106 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:15.467021 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68512aa0-28ef-4ce1-bb15-f442beb63f55-registry-tls\") pod \"image-registry-5f664bfd6d-m9579\" (UID: \"68512aa0-28ef-4ce1-bb15-f442beb63f55\") " pod="openshift-image-registry/image-registry-5f664bfd6d-m9579" Jul 27 20:18:15.467272 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:15.467180 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 20:18:15.467272 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:15.467205 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f664bfd6d-m9579: secret "image-registry-tls" not found Jul 27 20:18:15.467370 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:15.467273 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68512aa0-28ef-4ce1-bb15-f442beb63f55-registry-tls podName:68512aa0-28ef-4ce1-bb15-f442beb63f55 nodeName:}" failed. No retries permitted until 2026-07-27 20:18:19.467253743 +0000 UTC m=+42.045827331 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/68512aa0-28ef-4ce1-bb15-f442beb63f55-registry-tls") pod "image-registry-5f664bfd6d-m9579" (UID: "68512aa0-28ef-4ce1-bb15-f442beb63f55") : secret "image-registry-tls" not found Jul 27 20:18:15.568148 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:15.568107 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a93ca385-ba85-4450-92a8-568b7f2dd0f4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fl7pw\" (UID: \"a93ca385-ba85-4450-92a8-568b7f2dd0f4\") " pod="openshift-insights/insights-runtime-extractor-fl7pw" Jul 27 20:18:15.568325 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:15.568212 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a93ca385-ba85-4450-92a8-568b7f2dd0f4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fl7pw\" (UID: \"a93ca385-ba85-4450-92a8-568b7f2dd0f4\") " pod="openshift-insights/insights-runtime-extractor-fl7pw" Jul 27 20:18:15.568325 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:15.568279 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 20:18:15.568422 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:15.568341 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 20:18:15.568422 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:15.568351 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a93ca385-ba85-4450-92a8-568b7f2dd0f4-insights-runtime-extractor-tls podName:a93ca385-ba85-4450-92a8-568b7f2dd0f4 nodeName:}" failed. No retries permitted until 2026-07-27 20:18:19.568330279 +0000 UTC m=+42.146903849 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a93ca385-ba85-4450-92a8-568b7f2dd0f4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fl7pw" (UID: "a93ca385-ba85-4450-92a8-568b7f2dd0f4") : secret "insights-runtime-extractor-tls" not found Jul 27 20:18:15.568422 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:15.568359 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 20:18:15.568422 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:15.568286 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4da60bc-259e-4bb0-a78f-f77bd712463b-metrics-tls\") pod \"dns-default-qkkjs\" (UID: \"d4da60bc-259e-4bb0-a78f-f77bd712463b\") " pod="openshift-dns/dns-default-qkkjs" Jul 27 20:18:15.568422 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:15.568396 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a93ca385-ba85-4450-92a8-568b7f2dd0f4-kube-rbac-proxy-cm podName:a93ca385-ba85-4450-92a8-568b7f2dd0f4 nodeName:}" failed. No retries permitted until 2026-07-27 20:18:19.568378982 +0000 UTC m=+42.146952564 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a93ca385-ba85-4450-92a8-568b7f2dd0f4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fl7pw" (UID: "a93ca385-ba85-4450-92a8-568b7f2dd0f4") : configmap "kube-rbac-proxy" not found Jul 27 20:18:15.568422 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:15.568418 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4da60bc-259e-4bb0-a78f-f77bd712463b-metrics-tls podName:d4da60bc-259e-4bb0-a78f-f77bd712463b nodeName:}" failed. No retries permitted until 2026-07-27 20:18:19.568408922 +0000 UTC m=+42.146982489 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4da60bc-259e-4bb0-a78f-f77bd712463b-metrics-tls") pod "dns-default-qkkjs" (UID: "d4da60bc-259e-4bb0-a78f-f77bd712463b") : secret "dns-default-metrics-tls" not found Jul 27 20:18:15.719606 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:15.719522 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:16.057962 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:16.057888 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:16.113114 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:16.113081 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8lb48" event={"ID":"f40c6f68-b52b-4f6e-9dae-94b4f8905907","Type":"ContainerStarted","Data":"839dd89aab0583ce2db5cf0dabd669c4f80d2431b22c0a8c6635d41a9999d6a6"} Jul 27 20:18:16.130274 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:16.130239 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:16.140072 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:16.140028 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8lb48" podStartSLOduration=9.462608354 podStartE2EDuration="38.140012803s" totalImagesPullingTime="28.677404449s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:17:38 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:18:16.138085471 +0000 UTC m=+38.716659060" watchObservedRunningTime="2026-07-27 20:18:16.140012803 +0000 UTC m=+38.718586422" Jul 27 20:18:16.893620 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:16.893579 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:17.116711 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:17.116670 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-gcnc8" event={"ID":"a5a55802-00ca-41a0-9233-91bf9f229dc8","Type":"ContainerStarted","Data":"f057253f9a9a69574836fdd56d71f232f442731d9da22d34f1d20953f9ef4d11"} Jul 27 20:18:17.118398 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:17.118342 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dx6qd" event={"ID":"bce7955d-df77-4709-a020-751de104fe28","Type":"ContainerStarted","Data":"cce1abcb6e08af0aa961dcde4a306b6a91111c0094d8a6df7cef81c8eb12c0df"} Jul 27 20:18:18.139021 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:18.138973 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dx6qd" podStartSLOduration=3.696429437 podStartE2EDuration="7.138957707s" totalImagesPullingTime="3.44252827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:18:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:18:18.138162979 +0000 UTC m=+40.716736567" watchObservedRunningTime="2026-07-27 20:18:18.138957707 +0000 UTC m=+40.717531295" Jul 27 20:18:18.156487 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:18.156441 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-gcnc8" podStartSLOduration=1.895307343 podStartE2EDuration="5.156428538s" totalImagesPullingTime="3.261121195s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:18:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:18:18.155651795 +0000 UTC m=+40.734225387" watchObservedRunningTime="2026-07-27 20:18:18.156428538 +0000 UTC m=+40.735002127" Jul 27 20:18:18.548173 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:18.548085 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:18.650038 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:18.649990 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:18.706409 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:18.706381 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:18.885191 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:18.885110 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:18.942189 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:18.942154 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:19.272515 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:19.272434 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:19.498853 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:19.498812 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68512aa0-28ef-4ce1-bb15-f442beb63f55-registry-tls\") pod \"image-registry-5f664bfd6d-m9579\" (UID: \"68512aa0-28ef-4ce1-bb15-f442beb63f55\") " pod="openshift-image-registry/image-registry-5f664bfd6d-m9579" Jul 27 20:18:19.499009 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:19.498972 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 20:18:19.499009 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:19.498994 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f664bfd6d-m9579: secret "image-registry-tls" not found Jul 27 20:18:19.499096 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:19.499052 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68512aa0-28ef-4ce1-bb15-f442beb63f55-registry-tls podName:68512aa0-28ef-4ce1-bb15-f442beb63f55 nodeName:}" failed. No retries permitted until 2026-07-27 20:18:27.499035744 +0000 UTC m=+50.077609310 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/68512aa0-28ef-4ce1-bb15-f442beb63f55-registry-tls") pod "image-registry-5f664bfd6d-m9579" (UID: "68512aa0-28ef-4ce1-bb15-f442beb63f55") : secret "image-registry-tls" not found Jul 27 20:18:19.599217 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:19.599133 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a93ca385-ba85-4450-92a8-568b7f2dd0f4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fl7pw\" (UID: \"a93ca385-ba85-4450-92a8-568b7f2dd0f4\") " pod="openshift-insights/insights-runtime-extractor-fl7pw" Jul 27 20:18:19.599217 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:19.599198 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4da60bc-259e-4bb0-a78f-f77bd712463b-metrics-tls\") pod \"dns-default-qkkjs\" (UID: \"d4da60bc-259e-4bb0-a78f-f77bd712463b\") " pod="openshift-dns/dns-default-qkkjs" Jul 27 20:18:19.599377 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:19.599228 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a93ca385-ba85-4450-92a8-568b7f2dd0f4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fl7pw\" (UID: \"a93ca385-ba85-4450-92a8-568b7f2dd0f4\") " pod="openshift-insights/insights-runtime-extractor-fl7pw" Jul 27 20:18:19.599377 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:19.599336 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 20:18:19.599377 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:19.599342 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 20:18:19.599463 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:19.599397 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a93ca385-ba85-4450-92a8-568b7f2dd0f4-insights-runtime-extractor-tls podName:a93ca385-ba85-4450-92a8-568b7f2dd0f4 nodeName:}" failed. No retries permitted until 2026-07-27 20:18:27.599383175 +0000 UTC m=+50.177956742 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a93ca385-ba85-4450-92a8-568b7f2dd0f4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fl7pw" (UID: "a93ca385-ba85-4450-92a8-568b7f2dd0f4") : secret "insights-runtime-extractor-tls" not found Jul 27 20:18:19.599463 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:19.599410 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4da60bc-259e-4bb0-a78f-f77bd712463b-metrics-tls podName:d4da60bc-259e-4bb0-a78f-f77bd712463b nodeName:}" failed. No retries permitted until 2026-07-27 20:18:27.599404824 +0000 UTC m=+50.177978390 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4da60bc-259e-4bb0-a78f-f77bd712463b-metrics-tls") pod "dns-default-qkkjs" (UID: "d4da60bc-259e-4bb0-a78f-f77bd712463b") : secret "dns-default-metrics-tls" not found Jul 27 20:18:19.599783 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:19.599757 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a93ca385-ba85-4450-92a8-568b7f2dd0f4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fl7pw\" (UID: \"a93ca385-ba85-4450-92a8-568b7f2dd0f4\") " pod="openshift-insights/insights-runtime-extractor-fl7pw" Jul 27 20:18:20.250035 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:20.249999 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:20.644536 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:20.644446 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:20.842895 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:20.842861 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:21.042508 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:21.042464 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:21.441417 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:21.441328 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:22.044681 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:22.044642 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:22.160038 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:22.159974 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:22.257238 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:22.257205 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:22.310472 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:22.310393 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:22.798413 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:22.798385 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:22.898974 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:22.898938 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:23.241050 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:23.240970 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:23.443015 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:23.442979 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:23.497471 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:23.497448 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:23.909206 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:23.909120 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:24.011902 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:24.011868 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:24.251963 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:24.251932 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:24.809446 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:24.809410 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:24.907802 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:24.907776 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:25.246448 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:25.246413 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:25.446989 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:25.446958 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:25.563704 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:25.563656 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:25.846467 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:25.846388 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:25.946889 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:25.946862 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:26.014181 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:26.014152 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:26.454384 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:26.454349 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:27.089288 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:27.089260 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:27.241883 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:27.241848 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:27.560135 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:27.560101 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68512aa0-28ef-4ce1-bb15-f442beb63f55-registry-tls\") pod \"image-registry-5f664bfd6d-m9579\" (UID: \"68512aa0-28ef-4ce1-bb15-f442beb63f55\") " pod="openshift-image-registry/image-registry-5f664bfd6d-m9579" Jul 27 20:18:27.563771 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:27.563751 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68512aa0-28ef-4ce1-bb15-f442beb63f55-registry-tls\") pod \"image-registry-5f664bfd6d-m9579\" (UID: \"68512aa0-28ef-4ce1-bb15-f442beb63f55\") " pod="openshift-image-registry/image-registry-5f664bfd6d-m9579" Jul 27 20:18:27.644139 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:27.644106 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:27.650890 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:27.650873 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f664bfd6d-m9579" Jul 27 20:18:27.661214 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:27.661189 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4da60bc-259e-4bb0-a78f-f77bd712463b-metrics-tls\") pod \"dns-default-qkkjs\" (UID: \"d4da60bc-259e-4bb0-a78f-f77bd712463b\") " pod="openshift-dns/dns-default-qkkjs" Jul 27 20:18:27.661313 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:27.661233 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a93ca385-ba85-4450-92a8-568b7f2dd0f4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fl7pw\" (UID: \"a93ca385-ba85-4450-92a8-568b7f2dd0f4\") " pod="openshift-insights/insights-runtime-extractor-fl7pw" Jul 27 20:18:27.665381 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:27.663949 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4da60bc-259e-4bb0-a78f-f77bd712463b-metrics-tls\") pod \"dns-default-qkkjs\" (UID: \"d4da60bc-259e-4bb0-a78f-f77bd712463b\") " pod="openshift-dns/dns-default-qkkjs" Jul 27 20:18:27.665797 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:27.665763 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a93ca385-ba85-4450-92a8-568b7f2dd0f4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fl7pw\" (UID: \"a93ca385-ba85-4450-92a8-568b7f2dd0f4\") " pod="openshift-insights/insights-runtime-extractor-fl7pw" Jul 27 20:18:27.670271 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:27.670221 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fl7pw" Jul 27 20:18:27.687395 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:27.687375 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qkkjs" Jul 27 20:18:27.830032 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:27.829956 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5f664bfd6d-m9579"] Jul 27 20:18:27.833045 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:18:27.833016 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68512aa0_28ef_4ce1_bb15_f442beb63f55.slice/crio-eb96da5a0e55c837921da7a0c4882149e6a05676386072d7b861589bb161fa92 WatchSource:0}: Error finding container eb96da5a0e55c837921da7a0c4882149e6a05676386072d7b861589bb161fa92: Status 404 returned error can't find the container with id eb96da5a0e55c837921da7a0c4882149e6a05676386072d7b861589bb161fa92 Jul 27 20:18:27.844276 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:27.844255 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fl7pw"] Jul 27 20:18:27.851131 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:27.851090 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:27.857091 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:27.857072 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qkkjs"] Jul 27 20:18:27.859310 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:18:27.859289 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda93ca385_ba85_4450_92a8_568b7f2dd0f4.slice/crio-def472c5f29565508a722ce756269880a7a9cebc5705b610dd77a75418d3b1ab WatchSource:0}: Error finding container def472c5f29565508a722ce756269880a7a9cebc5705b610dd77a75418d3b1ab: Status 404 returned error can't find the container with id def472c5f29565508a722ce756269880a7a9cebc5705b610dd77a75418d3b1ab Jul 27 20:18:27.861839 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:18:27.861821 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4da60bc_259e_4bb0_a78f_f77bd712463b.slice/crio-f3c4a5454a22996cf97bceb963b446161c4a35a8f216fde47eddbe0706e83376 WatchSource:0}: Error finding container f3c4a5454a22996cf97bceb963b446161c4a35a8f216fde47eddbe0706e83376: Status 404 returned error can't find the container with id f3c4a5454a22996cf97bceb963b446161c4a35a8f216fde47eddbe0706e83376 Jul 27 20:18:28.150188 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:28.150106 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qkkjs" event={"ID":"d4da60bc-259e-4bb0-a78f-f77bd712463b","Type":"ContainerStarted","Data":"f3c4a5454a22996cf97bceb963b446161c4a35a8f216fde47eddbe0706e83376"} Jul 27 20:18:28.151165 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:28.151143 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fl7pw" event={"ID":"a93ca385-ba85-4450-92a8-568b7f2dd0f4","Type":"ContainerStarted","Data":"def472c5f29565508a722ce756269880a7a9cebc5705b610dd77a75418d3b1ab"} Jul 27 20:18:28.152536 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:28.152513 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f664bfd6d-m9579" event={"ID":"68512aa0-28ef-4ce1-bb15-f442beb63f55","Type":"ContainerStarted","Data":"036a5a3055427c256fcf976c95f9176b46e5b69513e9e334d9448de5bcd18c61"} Jul 27 20:18:28.152609 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:28.152553 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f664bfd6d-m9579" event={"ID":"68512aa0-28ef-4ce1-bb15-f442beb63f55","Type":"ContainerStarted","Data":"eb96da5a0e55c837921da7a0c4882149e6a05676386072d7b861589bb161fa92"} Jul 27 20:18:28.152679 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:28.152662 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5f664bfd6d-m9579" Jul 27 20:18:28.176014 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:28.175978 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5f664bfd6d-m9579" podStartSLOduration=62.175965841 podStartE2EDuration="1m2.175965841s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:17:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:18:28.175902358 +0000 UTC m=+50.754475947" watchObservedRunningTime="2026-07-27 20:18:28.175965841 +0000 UTC m=+50.754539429" Jul 27 20:18:28.245751 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:28.245715 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:28.847462 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:28.847421 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:29.048032 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:29.047998 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:29.241591 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:29.241512 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:33.174797 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:33.174762 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qkkjs" event={"ID":"d4da60bc-259e-4bb0-a78f-f77bd712463b","Type":"ContainerStarted","Data":"e4b0e8ff5037beab84e8313df4ed776b4da72286f02bbce89d10684dad77e8d2"} Jul 27 20:18:33.178525 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:33.178394 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fl7pw" event={"ID":"a93ca385-ba85-4450-92a8-568b7f2dd0f4","Type":"ContainerStarted","Data":"17e792683330c9a8cf124b5ddac9365ca871cd1b9c012b0707ef3e85bff0e8a9"} Jul 27 20:18:34.184684 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:34.184643 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qkkjs" event={"ID":"d4da60bc-259e-4bb0-a78f-f77bd712463b","Type":"ContainerStarted","Data":"e3d7cad52f85cd3e2f1e76a084e7610ea5ec74d791bcd6b1de69149ce0ee079e"} Jul 27 20:18:34.185138 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:34.184894 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qkkjs" Jul 27 20:18:34.203512 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:34.203466 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qkkjs" podStartSLOduration=17.997356441 podStartE2EDuration="23.203449594s" totalImagesPullingTime="5.206093153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:18:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:18:34.202701323 +0000 UTC m=+56.781274913" watchObservedRunningTime="2026-07-27 20:18:34.203449594 +0000 UTC m=+56.782023182" Jul 27 20:18:35.516618 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.516404 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-846bd7dbcf-wf6z8"] Jul 27 20:18:35.533898 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.533815 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5f664bfd6d-m9579"] Jul 27 20:18:35.533898 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.533860 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5448f5f68-d769m"] Jul 27 20:18:35.534089 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.533973 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846bd7dbcf-wf6z8" Jul 27 20:18:35.537862 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.537496 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 27 20:18:35.537862 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.537642 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 27 20:18:35.537862 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.537729 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 27 20:18:35.538117 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.537887 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 27 20:18:35.541679 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.538842 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-694ddfb445-phs4w"] Jul 27 20:18:35.541679 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.540939 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5448f5f68-d769m" Jul 27 20:18:35.541942 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.541786 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-846bd7dbcf-wf6z8"] Jul 27 20:18:35.544001 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.543240 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-694ddfb445-phs4w" Jul 27 20:18:35.544001 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.543811 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5448f5f68-d769m"] Jul 27 20:18:35.544001 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.543843 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-694ddfb445-phs4w"] Jul 27 20:18:35.545003 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.544975 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-v5xwp\"" Jul 27 20:18:35.545286 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.545266 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 27 20:18:35.546259 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.546228 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 27 20:18:35.546952 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.546460 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 27 20:18:35.546952 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.546785 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 27 20:18:35.547592 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.547387 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 27 20:18:35.622655 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.622620 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d9645181-8bd2-4da6-aaae-f91b14d9bf51-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-694ddfb445-phs4w\" (UID: \"d9645181-8bd2-4da6-aaae-f91b14d9bf51\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-694ddfb445-phs4w" Jul 27 20:18:35.622807 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.622747 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l4c4\" (UniqueName: \"kubernetes.io/projected/0c28bf93-ca35-4889-86cb-9007a74269cb-kube-api-access-6l4c4\") pod \"managed-serviceaccount-addon-agent-5448f5f68-d769m\" (UID: \"0c28bf93-ca35-4889-86cb-9007a74269cb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5448f5f68-d769m" Jul 27 20:18:35.622807 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.622776 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0c28bf93-ca35-4889-86cb-9007a74269cb-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5448f5f68-d769m\" (UID: \"0c28bf93-ca35-4889-86cb-9007a74269cb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5448f5f68-d769m" Jul 27 20:18:35.622807 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.622800 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f233760a-063c-4dea-9b67-a35c4ca12377-tmp\") pod \"klusterlet-addon-workmgr-846bd7dbcf-wf6z8\" (UID: \"f233760a-063c-4dea-9b67-a35c4ca12377\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846bd7dbcf-wf6z8" Jul 27 20:18:35.622940 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.622825 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d9645181-8bd2-4da6-aaae-f91b14d9bf51-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-694ddfb445-phs4w\" (UID: \"d9645181-8bd2-4da6-aaae-f91b14d9bf51\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-694ddfb445-phs4w" Jul 27 20:18:35.622940 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.622881 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f233760a-063c-4dea-9b67-a35c4ca12377-klusterlet-config\") pod \"klusterlet-addon-workmgr-846bd7dbcf-wf6z8\" (UID: \"f233760a-063c-4dea-9b67-a35c4ca12377\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846bd7dbcf-wf6z8" Jul 27 20:18:35.623034 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.623006 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d9645181-8bd2-4da6-aaae-f91b14d9bf51-hub\") pod \"cluster-proxy-proxy-agent-694ddfb445-phs4w\" (UID: \"d9645181-8bd2-4da6-aaae-f91b14d9bf51\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-694ddfb445-phs4w" Jul 27 20:18:35.623093 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.623054 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d9645181-8bd2-4da6-aaae-f91b14d9bf51-ca\") pod \"cluster-proxy-proxy-agent-694ddfb445-phs4w\" (UID: \"d9645181-8bd2-4da6-aaae-f91b14d9bf51\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-694ddfb445-phs4w" Jul 27 20:18:35.623150 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.623093 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9645181-8bd2-4da6-aaae-f91b14d9bf51-additional-service-ca\") pod \"cluster-proxy-proxy-agent-694ddfb445-phs4w\" (UID: \"d9645181-8bd2-4da6-aaae-f91b14d9bf51\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-694ddfb445-phs4w" Jul 27 20:18:35.623150 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.623121 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz956\" (UniqueName: \"kubernetes.io/projected/f233760a-063c-4dea-9b67-a35c4ca12377-kube-api-access-tz956\") pod \"klusterlet-addon-workmgr-846bd7dbcf-wf6z8\" (UID: \"f233760a-063c-4dea-9b67-a35c4ca12377\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846bd7dbcf-wf6z8" Jul 27 20:18:35.623259 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.623154 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjnm6\" (UniqueName: \"kubernetes.io/projected/d9645181-8bd2-4da6-aaae-f91b14d9bf51-kube-api-access-rjnm6\") pod \"cluster-proxy-proxy-agent-694ddfb445-phs4w\" (UID: \"d9645181-8bd2-4da6-aaae-f91b14d9bf51\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-694ddfb445-phs4w" Jul 27 20:18:35.632370 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.632339 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-587c985c7b-jqrlj"] Jul 27 20:18:35.637597 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.637582 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-587c985c7b-jqrlj" Jul 27 20:18:35.663449 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.663425 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-587c985c7b-jqrlj"] Jul 27 20:18:35.670342 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.670315 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:35.723593 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.723554 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d9645181-8bd2-4da6-aaae-f91b14d9bf51-hub\") pod \"cluster-proxy-proxy-agent-694ddfb445-phs4w\" (UID: \"d9645181-8bd2-4da6-aaae-f91b14d9bf51\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-694ddfb445-phs4w" Jul 27 20:18:35.723593 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.723590 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d9645181-8bd2-4da6-aaae-f91b14d9bf51-ca\") pod \"cluster-proxy-proxy-agent-694ddfb445-phs4w\" (UID: \"d9645181-8bd2-4da6-aaae-f91b14d9bf51\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-694ddfb445-phs4w" Jul 27 20:18:35.723846 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.723626 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9645181-8bd2-4da6-aaae-f91b14d9bf51-additional-service-ca\") pod \"cluster-proxy-proxy-agent-694ddfb445-phs4w\" (UID: \"d9645181-8bd2-4da6-aaae-f91b14d9bf51\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-694ddfb445-phs4w" Jul 27 20:18:35.723846 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.723650 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/10fb2e42-4182-43ec-b2e6-62589fe8e3df-ca-trust-extracted\") pod \"image-registry-587c985c7b-jqrlj\" (UID: \"10fb2e42-4182-43ec-b2e6-62589fe8e3df\") " pod="openshift-image-registry/image-registry-587c985c7b-jqrlj" Jul 27 20:18:35.723846 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.723708 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/10fb2e42-4182-43ec-b2e6-62589fe8e3df-trusted-ca\") pod \"image-registry-587c985c7b-jqrlj\" (UID: \"10fb2e42-4182-43ec-b2e6-62589fe8e3df\") " pod="openshift-image-registry/image-registry-587c985c7b-jqrlj" Jul 27 20:18:35.723846 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.723731 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/10fb2e42-4182-43ec-b2e6-62589fe8e3df-installation-pull-secrets\") pod \"image-registry-587c985c7b-jqrlj\" (UID: \"10fb2e42-4182-43ec-b2e6-62589fe8e3df\") " pod="openshift-image-registry/image-registry-587c985c7b-jqrlj" Jul 27 20:18:35.723846 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.723747 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7cwg\" (UniqueName: \"kubernetes.io/projected/10fb2e42-4182-43ec-b2e6-62589fe8e3df-kube-api-access-p7cwg\") pod \"image-registry-587c985c7b-jqrlj\" (UID: \"10fb2e42-4182-43ec-b2e6-62589fe8e3df\") " pod="openshift-image-registry/image-registry-587c985c7b-jqrlj" Jul 27 20:18:35.723846 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.723775 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz956\" (UniqueName: \"kubernetes.io/projected/f233760a-063c-4dea-9b67-a35c4ca12377-kube-api-access-tz956\") pod \"klusterlet-addon-workmgr-846bd7dbcf-wf6z8\" (UID: \"f233760a-063c-4dea-9b67-a35c4ca12377\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846bd7dbcf-wf6z8" Jul 27 20:18:35.723846 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.723803 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjnm6\" (UniqueName: \"kubernetes.io/projected/d9645181-8bd2-4da6-aaae-f91b14d9bf51-kube-api-access-rjnm6\") pod \"cluster-proxy-proxy-agent-694ddfb445-phs4w\" (UID: \"d9645181-8bd2-4da6-aaae-f91b14d9bf51\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-694ddfb445-phs4w" Jul 27 20:18:35.723846 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.723822 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/10fb2e42-4182-43ec-b2e6-62589fe8e3df-registry-certificates\") pod \"image-registry-587c985c7b-jqrlj\" (UID: \"10fb2e42-4182-43ec-b2e6-62589fe8e3df\") " pod="openshift-image-registry/image-registry-587c985c7b-jqrlj" Jul 27 20:18:35.723846 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.723840 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/10fb2e42-4182-43ec-b2e6-62589fe8e3df-bound-sa-token\") pod \"image-registry-587c985c7b-jqrlj\" (UID: \"10fb2e42-4182-43ec-b2e6-62589fe8e3df\") " pod="openshift-image-registry/image-registry-587c985c7b-jqrlj" Jul 27 20:18:35.724317 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.723869 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d9645181-8bd2-4da6-aaae-f91b14d9bf51-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-694ddfb445-phs4w\" (UID: \"d9645181-8bd2-4da6-aaae-f91b14d9bf51\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-694ddfb445-phs4w" Jul 27 20:18:35.724317 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.723897 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10fb2e42-4182-43ec-b2e6-62589fe8e3df-registry-tls\") pod \"image-registry-587c985c7b-jqrlj\" (UID: \"10fb2e42-4182-43ec-b2e6-62589fe8e3df\") " pod="openshift-image-registry/image-registry-587c985c7b-jqrlj" Jul 27 20:18:35.724463 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.724435 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6l4c4\" (UniqueName: \"kubernetes.io/projected/0c28bf93-ca35-4889-86cb-9007a74269cb-kube-api-access-6l4c4\") pod \"managed-serviceaccount-addon-agent-5448f5f68-d769m\" (UID: \"0c28bf93-ca35-4889-86cb-9007a74269cb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5448f5f68-d769m" Jul 27 20:18:35.724525 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.724505 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0c28bf93-ca35-4889-86cb-9007a74269cb-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5448f5f68-d769m\" (UID: \"0c28bf93-ca35-4889-86cb-9007a74269cb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5448f5f68-d769m" Jul 27 20:18:35.724580 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.724538 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f233760a-063c-4dea-9b67-a35c4ca12377-tmp\") pod \"klusterlet-addon-workmgr-846bd7dbcf-wf6z8\" (UID: \"f233760a-063c-4dea-9b67-a35c4ca12377\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846bd7dbcf-wf6z8" Jul 27 20:18:35.724626 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.724581 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d9645181-8bd2-4da6-aaae-f91b14d9bf51-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-694ddfb445-phs4w\" (UID: \"d9645181-8bd2-4da6-aaae-f91b14d9bf51\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-694ddfb445-phs4w" Jul 27 20:18:35.724626 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.724619 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/10fb2e42-4182-43ec-b2e6-62589fe8e3df-image-registry-private-configuration\") pod \"image-registry-587c985c7b-jqrlj\" (UID: \"10fb2e42-4182-43ec-b2e6-62589fe8e3df\") " pod="openshift-image-registry/image-registry-587c985c7b-jqrlj" Jul 27 20:18:35.724751 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.724662 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f233760a-063c-4dea-9b67-a35c4ca12377-klusterlet-config\") pod \"klusterlet-addon-workmgr-846bd7dbcf-wf6z8\" (UID: \"f233760a-063c-4dea-9b67-a35c4ca12377\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846bd7dbcf-wf6z8" Jul 27 20:18:35.724751 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.724720 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9645181-8bd2-4da6-aaae-f91b14d9bf51-additional-service-ca\") pod \"cluster-proxy-proxy-agent-694ddfb445-phs4w\" (UID: \"d9645181-8bd2-4da6-aaae-f91b14d9bf51\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-694ddfb445-phs4w" Jul 27 20:18:35.731393 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.725617 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f233760a-063c-4dea-9b67-a35c4ca12377-tmp\") pod \"klusterlet-addon-workmgr-846bd7dbcf-wf6z8\" (UID: \"f233760a-063c-4dea-9b67-a35c4ca12377\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846bd7dbcf-wf6z8" Jul 27 20:18:35.731393 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.728136 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0c28bf93-ca35-4889-86cb-9007a74269cb-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5448f5f68-d769m\" (UID: \"0c28bf93-ca35-4889-86cb-9007a74269cb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5448f5f68-d769m" Jul 27 20:18:35.731393 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.729136 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d9645181-8bd2-4da6-aaae-f91b14d9bf51-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-694ddfb445-phs4w\" (UID: \"d9645181-8bd2-4da6-aaae-f91b14d9bf51\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-694ddfb445-phs4w" Jul 27 20:18:35.731393 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.730268 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d9645181-8bd2-4da6-aaae-f91b14d9bf51-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-694ddfb445-phs4w\" (UID: \"d9645181-8bd2-4da6-aaae-f91b14d9bf51\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-694ddfb445-phs4w" Jul 27 20:18:35.731736 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.731715 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d9645181-8bd2-4da6-aaae-f91b14d9bf51-ca\") pod \"cluster-proxy-proxy-agent-694ddfb445-phs4w\" (UID: \"d9645181-8bd2-4da6-aaae-f91b14d9bf51\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-694ddfb445-phs4w" Jul 27 20:18:35.733671 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.733644 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d9645181-8bd2-4da6-aaae-f91b14d9bf51-hub\") pod \"cluster-proxy-proxy-agent-694ddfb445-phs4w\" (UID: \"d9645181-8bd2-4da6-aaae-f91b14d9bf51\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-694ddfb445-phs4w" Jul 27 20:18:35.733871 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.733742 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f233760a-063c-4dea-9b67-a35c4ca12377-klusterlet-config\") pod \"klusterlet-addon-workmgr-846bd7dbcf-wf6z8\" (UID: \"f233760a-063c-4dea-9b67-a35c4ca12377\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846bd7dbcf-wf6z8" Jul 27 20:18:35.736082 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.736062 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l4c4\" (UniqueName: \"kubernetes.io/projected/0c28bf93-ca35-4889-86cb-9007a74269cb-kube-api-access-6l4c4\") pod \"managed-serviceaccount-addon-agent-5448f5f68-d769m\" (UID: \"0c28bf93-ca35-4889-86cb-9007a74269cb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5448f5f68-d769m" Jul 27 20:18:35.736546 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.736524 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz956\" (UniqueName: \"kubernetes.io/projected/f233760a-063c-4dea-9b67-a35c4ca12377-kube-api-access-tz956\") pod \"klusterlet-addon-workmgr-846bd7dbcf-wf6z8\" (UID: \"f233760a-063c-4dea-9b67-a35c4ca12377\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846bd7dbcf-wf6z8" Jul 27 20:18:35.736715 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.736674 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjnm6\" (UniqueName: \"kubernetes.io/projected/d9645181-8bd2-4da6-aaae-f91b14d9bf51-kube-api-access-rjnm6\") pod \"cluster-proxy-proxy-agent-694ddfb445-phs4w\" (UID: \"d9645181-8bd2-4da6-aaae-f91b14d9bf51\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-694ddfb445-phs4w" Jul 27 20:18:35.762188 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.762160 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:35.825819 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.825738 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/10fb2e42-4182-43ec-b2e6-62589fe8e3df-ca-trust-extracted\") pod \"image-registry-587c985c7b-jqrlj\" (UID: \"10fb2e42-4182-43ec-b2e6-62589fe8e3df\") " pod="openshift-image-registry/image-registry-587c985c7b-jqrlj" Jul 27 20:18:35.825819 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.825775 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/10fb2e42-4182-43ec-b2e6-62589fe8e3df-trusted-ca\") pod \"image-registry-587c985c7b-jqrlj\" (UID: \"10fb2e42-4182-43ec-b2e6-62589fe8e3df\") " pod="openshift-image-registry/image-registry-587c985c7b-jqrlj" Jul 27 20:18:35.825819 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.825802 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/10fb2e42-4182-43ec-b2e6-62589fe8e3df-installation-pull-secrets\") pod \"image-registry-587c985c7b-jqrlj\" (UID: \"10fb2e42-4182-43ec-b2e6-62589fe8e3df\") " pod="openshift-image-registry/image-registry-587c985c7b-jqrlj" Jul 27 20:18:35.826058 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.825826 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7cwg\" (UniqueName: \"kubernetes.io/projected/10fb2e42-4182-43ec-b2e6-62589fe8e3df-kube-api-access-p7cwg\") pod \"image-registry-587c985c7b-jqrlj\" (UID: \"10fb2e42-4182-43ec-b2e6-62589fe8e3df\") " pod="openshift-image-registry/image-registry-587c985c7b-jqrlj" Jul 27 20:18:35.826058 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.825853 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/10fb2e42-4182-43ec-b2e6-62589fe8e3df-registry-certificates\") pod \"image-registry-587c985c7b-jqrlj\" (UID: \"10fb2e42-4182-43ec-b2e6-62589fe8e3df\") " pod="openshift-image-registry/image-registry-587c985c7b-jqrlj" Jul 27 20:18:35.826058 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.825881 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/10fb2e42-4182-43ec-b2e6-62589fe8e3df-bound-sa-token\") pod \"image-registry-587c985c7b-jqrlj\" (UID: \"10fb2e42-4182-43ec-b2e6-62589fe8e3df\") " pod="openshift-image-registry/image-registry-587c985c7b-jqrlj" Jul 27 20:18:35.826058 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.825920 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10fb2e42-4182-43ec-b2e6-62589fe8e3df-registry-tls\") pod \"image-registry-587c985c7b-jqrlj\" (UID: \"10fb2e42-4182-43ec-b2e6-62589fe8e3df\") " pod="openshift-image-registry/image-registry-587c985c7b-jqrlj" Jul 27 20:18:35.826058 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.825982 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/10fb2e42-4182-43ec-b2e6-62589fe8e3df-image-registry-private-configuration\") pod \"image-registry-587c985c7b-jqrlj\" (UID: \"10fb2e42-4182-43ec-b2e6-62589fe8e3df\") " pod="openshift-image-registry/image-registry-587c985c7b-jqrlj" Jul 27 20:18:35.826608 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.826571 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/10fb2e42-4182-43ec-b2e6-62589fe8e3df-ca-trust-extracted\") pod \"image-registry-587c985c7b-jqrlj\" (UID: \"10fb2e42-4182-43ec-b2e6-62589fe8e3df\") " pod="openshift-image-registry/image-registry-587c985c7b-jqrlj" Jul 27 20:18:35.826870 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.826826 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/10fb2e42-4182-43ec-b2e6-62589fe8e3df-registry-certificates\") pod \"image-registry-587c985c7b-jqrlj\" (UID: \"10fb2e42-4182-43ec-b2e6-62589fe8e3df\") " pod="openshift-image-registry/image-registry-587c985c7b-jqrlj" Jul 27 20:18:35.827293 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.827067 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/10fb2e42-4182-43ec-b2e6-62589fe8e3df-trusted-ca\") pod \"image-registry-587c985c7b-jqrlj\" (UID: \"10fb2e42-4182-43ec-b2e6-62589fe8e3df\") " pod="openshift-image-registry/image-registry-587c985c7b-jqrlj" Jul 27 20:18:35.828782 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.828751 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/10fb2e42-4182-43ec-b2e6-62589fe8e3df-image-registry-private-configuration\") pod \"image-registry-587c985c7b-jqrlj\" (UID: \"10fb2e42-4182-43ec-b2e6-62589fe8e3df\") " pod="openshift-image-registry/image-registry-587c985c7b-jqrlj" Jul 27 20:18:35.828884 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.828751 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/10fb2e42-4182-43ec-b2e6-62589fe8e3df-installation-pull-secrets\") pod \"image-registry-587c985c7b-jqrlj\" (UID: \"10fb2e42-4182-43ec-b2e6-62589fe8e3df\") " pod="openshift-image-registry/image-registry-587c985c7b-jqrlj" Jul 27 20:18:35.828964 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.828940 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10fb2e42-4182-43ec-b2e6-62589fe8e3df-registry-tls\") pod \"image-registry-587c985c7b-jqrlj\" (UID: \"10fb2e42-4182-43ec-b2e6-62589fe8e3df\") " pod="openshift-image-registry/image-registry-587c985c7b-jqrlj" Jul 27 20:18:35.836244 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.836224 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7cwg\" (UniqueName: \"kubernetes.io/projected/10fb2e42-4182-43ec-b2e6-62589fe8e3df-kube-api-access-p7cwg\") pod \"image-registry-587c985c7b-jqrlj\" (UID: \"10fb2e42-4182-43ec-b2e6-62589fe8e3df\") " pod="openshift-image-registry/image-registry-587c985c7b-jqrlj" Jul 27 20:18:35.836403 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.836381 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/10fb2e42-4182-43ec-b2e6-62589fe8e3df-bound-sa-token\") pod \"image-registry-587c985c7b-jqrlj\" (UID: \"10fb2e42-4182-43ec-b2e6-62589fe8e3df\") " pod="openshift-image-registry/image-registry-587c985c7b-jqrlj" Jul 27 20:18:35.854381 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.854357 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846bd7dbcf-wf6z8" Jul 27 20:18:35.860680 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.860649 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:35.884449 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.884425 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5448f5f68-d769m" Jul 27 20:18:35.889415 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.889396 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-694ddfb445-phs4w" Jul 27 20:18:35.955723 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.955684 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-587c985c7b-jqrlj" Jul 27 20:18:35.959574 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:35.959545 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:36.569011 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:36.568982 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-587c985c7b-jqrlj"] Jul 27 20:18:36.574851 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:18:36.574823 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10fb2e42_4182_43ec_b2e6_62589fe8e3df.slice/crio-9a2a64cac4a670c476df2e47a3126e59ef75a35fb8386c330d8aa566dd4c5c16 WatchSource:0}: Error finding container 9a2a64cac4a670c476df2e47a3126e59ef75a35fb8386c330d8aa566dd4c5c16: Status 404 returned error can't find the container with id 9a2a64cac4a670c476df2e47a3126e59ef75a35fb8386c330d8aa566dd4c5c16 Jul 27 20:18:36.603938 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:36.603914 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-694ddfb445-phs4w"] Jul 27 20:18:36.606669 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:18:36.606646 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd9645181_8bd2_4da6_aaae_f91b14d9bf51.slice/crio-50ec7bd445f835272cecfb9e12d7e12b411a3bab1416e2045f9aab0f0125b1c1 WatchSource:0}: Error finding container 50ec7bd445f835272cecfb9e12d7e12b411a3bab1416e2045f9aab0f0125b1c1: Status 404 returned error can't find the container with id 50ec7bd445f835272cecfb9e12d7e12b411a3bab1416e2045f9aab0f0125b1c1 Jul 27 20:18:36.643795 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:36.643770 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:36.701387 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:36.701307 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:36.775774 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:36.775750 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5448f5f68-d769m"] Jul 27 20:18:36.778455 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:36.778430 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-846bd7dbcf-wf6z8"] Jul 27 20:18:36.778644 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:18:36.778623 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0c28bf93_ca35_4889_86cb_9007a74269cb.slice/crio-bf09f9ba97f2d2eda651a9065a15127b1458e594d7a2e0e7cb46999b4a660099 WatchSource:0}: Error finding container bf09f9ba97f2d2eda651a9065a15127b1458e594d7a2e0e7cb46999b4a660099: Status 404 returned error can't find the container with id bf09f9ba97f2d2eda651a9065a15127b1458e594d7a2e0e7cb46999b4a660099 Jul 27 20:18:36.782351 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:18:36.782327 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf233760a_063c_4dea_9b67_a35c4ca12377.slice/crio-0b4502f2a68930c937400ef3530da5534696435c52ffd216154b33720c5650be WatchSource:0}: Error finding container 0b4502f2a68930c937400ef3530da5534696435c52ffd216154b33720c5650be: Status 404 returned error can't find the container with id 0b4502f2a68930c937400ef3530da5534696435c52ffd216154b33720c5650be Jul 27 20:18:37.156987 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:37.156954 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:37.197152 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:37.197121 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846bd7dbcf-wf6z8" event={"ID":"f233760a-063c-4dea-9b67-a35c4ca12377","Type":"ContainerStarted","Data":"0b4502f2a68930c937400ef3530da5534696435c52ffd216154b33720c5650be"} Jul 27 20:18:37.198364 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:37.198327 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5448f5f68-d769m" event={"ID":"0c28bf93-ca35-4889-86cb-9007a74269cb","Type":"ContainerStarted","Data":"bf09f9ba97f2d2eda651a9065a15127b1458e594d7a2e0e7cb46999b4a660099"} Jul 27 20:18:37.200355 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:37.200326 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fl7pw" event={"ID":"a93ca385-ba85-4450-92a8-568b7f2dd0f4","Type":"ContainerStarted","Data":"460b859b5676ba97fbb50fc4174a4ad0b5be3bb00664e929ccd9570307cda22f"} Jul 27 20:18:37.202044 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:37.202021 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-587c985c7b-jqrlj" event={"ID":"10fb2e42-4182-43ec-b2e6-62589fe8e3df","Type":"ContainerStarted","Data":"de86201650b2044dab9f439ecefe1ab13b950db861e3903b9f2c011a1cf9c24d"} Jul 27 20:18:37.202135 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:37.202065 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-587c985c7b-jqrlj" event={"ID":"10fb2e42-4182-43ec-b2e6-62589fe8e3df","Type":"ContainerStarted","Data":"9a2a64cac4a670c476df2e47a3126e59ef75a35fb8386c330d8aa566dd4c5c16"} Jul 27 20:18:37.202191 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:37.202142 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-587c985c7b-jqrlj" Jul 27 20:18:37.203352 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:37.203330 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-694ddfb445-phs4w" event={"ID":"d9645181-8bd2-4da6-aaae-f91b14d9bf51","Type":"ContainerStarted","Data":"50ec7bd445f835272cecfb9e12d7e12b411a3bab1416e2045f9aab0f0125b1c1"} Jul 27 20:18:37.217403 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:37.217369 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:37.221614 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:37.221571 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-587c985c7b-jqrlj" podStartSLOduration=2.221557716 podStartE2EDuration="2.221557716s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:18:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:18:37.220584986 +0000 UTC m=+59.799158576" watchObservedRunningTime="2026-07-27 20:18:37.221557716 +0000 UTC m=+59.800131304" Jul 27 20:18:38.085218 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:38.085184 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rnj2b" Jul 27 20:18:38.239470 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:38.239432 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:38.341259 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:38.341161 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:40.168916 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:40.168881 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:40.279160 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:40.279122 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:40.354712 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:40.354539 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:40.505312 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:40.505261 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:40.605624 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:40.605570 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:40.662300 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:40.662252 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:43.227591 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:43.227510 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-694ddfb445-phs4w" event={"ID":"d9645181-8bd2-4da6-aaae-f91b14d9bf51","Type":"ContainerStarted","Data":"c1567ce90ff4e238afd558b74e0021b3f8ffd7c6b6e8f8186cb47b2400a56533"} Jul 27 20:18:43.227591 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:43.227551 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-694ddfb445-phs4w" event={"ID":"d9645181-8bd2-4da6-aaae-f91b14d9bf51","Type":"ContainerStarted","Data":"a2c2082acf41b0b6cfa4b2442be37ed54e828dfaddbf3533c241ea96a345f6b9"} Jul 27 20:18:43.227591 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:43.227570 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-694ddfb445-phs4w" event={"ID":"d9645181-8bd2-4da6-aaae-f91b14d9bf51","Type":"ContainerStarted","Data":"80bb60ae6bcf3a5b5203775c641a20d4709d2231d69b22bdd46fcb882801e46e"} Jul 27 20:18:43.229000 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:43.228969 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5448f5f68-d769m" event={"ID":"0c28bf93-ca35-4889-86cb-9007a74269cb","Type":"ContainerStarted","Data":"79206e517df5dcabf9494464e18ef00a8c779d991c9aafaf4230503dd732a9c3"} Jul 27 20:18:43.230982 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:43.230933 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fl7pw" event={"ID":"a93ca385-ba85-4450-92a8-568b7f2dd0f4","Type":"ContainerStarted","Data":"eb0691e36cdfe5282a8910cc6d4bb2398287b77dce1e4486933747680bdf20bd"} Jul 27 20:18:43.245002 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:43.244964 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-694ddfb445-phs4w" podStartSLOduration=2.016001208 podStartE2EDuration="8.244952236s" totalImagesPullingTime="6.228951028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:18:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:18:43.244506088 +0000 UTC m=+65.823079677" watchObservedRunningTime="2026-07-27 20:18:43.244952236 +0000 UTC m=+65.823525821" Jul 27 20:18:43.257943 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:43.257901 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5448f5f68-d769m" podStartSLOduration=2.220555917 podStartE2EDuration="8.257887756s" totalImagesPullingTime="6.037331839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:18:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:18:43.257326635 +0000 UTC m=+65.835900225" watchObservedRunningTime="2026-07-27 20:18:43.257887756 +0000 UTC m=+65.836461324" Jul 27 20:18:43.275180 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:43.275138 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fl7pw" podStartSLOduration=17.435992037 podStartE2EDuration="32.275128832s" totalImagesPullingTime="14.839136795s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:18:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:18:43.274395923 +0000 UTC m=+65.852969511" watchObservedRunningTime="2026-07-27 20:18:43.275128832 +0000 UTC m=+65.853702421" Jul 27 20:18:43.597285 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:43.597248 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed1721a8-1162-43d4-a7ae-20fb77b38000-metrics-certs\") pod \"network-metrics-daemon-q4rh9\" (UID: \"ed1721a8-1162-43d4-a7ae-20fb77b38000\") " pod="openshift-multus/network-metrics-daemon-q4rh9" Jul 27 20:18:43.597285 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:43.597287 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5db14a3f-0592-417e-8de6-a29bbe4cbfbd-original-pull-secret\") pod \"global-pull-secret-syncer-57jqw\" (UID: \"5db14a3f-0592-417e-8de6-a29bbe4cbfbd\") " pod="kube-system/global-pull-secret-syncer-57jqw" Jul 27 20:18:43.599771 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:43.599747 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 27 20:18:43.599854 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:43.599815 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 27 20:18:43.609978 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:43.609949 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5db14a3f-0592-417e-8de6-a29bbe4cbfbd-original-pull-secret\") pod \"global-pull-secret-syncer-57jqw\" (UID: \"5db14a3f-0592-417e-8de6-a29bbe4cbfbd\") " pod="kube-system/global-pull-secret-syncer-57jqw" Jul 27 20:18:43.609978 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:43.609964 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed1721a8-1162-43d4-a7ae-20fb77b38000-metrics-certs\") pod \"network-metrics-daemon-q4rh9\" (UID: \"ed1721a8-1162-43d4-a7ae-20fb77b38000\") " pod="openshift-multus/network-metrics-daemon-q4rh9" Jul 27 20:18:43.751506 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:43.751475 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-57jqw" Jul 27 20:18:43.762275 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:43.762250 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8gvk7\"" Jul 27 20:18:43.770394 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:43.770372 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4rh9" Jul 27 20:18:43.798922 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:43.798894 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6sqd\" (UniqueName: \"kubernetes.io/projected/828a7e08-7c87-434e-86e6-39ce766c6606-kube-api-access-b6sqd\") pod \"network-check-target-qbvkx\" (UID: \"828a7e08-7c87-434e-86e6-39ce766c6606\") " pod="openshift-network-diagnostics/network-check-target-qbvkx" Jul 27 20:18:43.805309 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:43.805078 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 27 20:18:43.814108 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:43.813914 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 27 20:18:43.828659 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:43.828635 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6sqd\" (UniqueName: \"kubernetes.io/projected/828a7e08-7c87-434e-86e6-39ce766c6606-kube-api-access-b6sqd\") pod \"network-check-target-qbvkx\" (UID: \"828a7e08-7c87-434e-86e6-39ce766c6606\") " pod="openshift-network-diagnostics/network-check-target-qbvkx" Jul 27 20:18:43.902919 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:43.902656 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-57jqw"] Jul 27 20:18:43.905311 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:18:43.905281 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5db14a3f_0592_417e_8de6_a29bbe4cbfbd.slice/crio-52feef05918e099b1a3a2a8221bae88870346ecf4bff7ff77ed4b6c2dfe77596 WatchSource:0}: Error finding container 52feef05918e099b1a3a2a8221bae88870346ecf4bff7ff77ed4b6c2dfe77596: Status 404 returned error can't find the container with id 52feef05918e099b1a3a2a8221bae88870346ecf4bff7ff77ed4b6c2dfe77596 Jul 27 20:18:43.919900 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:43.919880 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q4rh9"] Jul 27 20:18:43.922317 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:18:43.922292 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded1721a8_1162_43d4_a7ae_20fb77b38000.slice/crio-e686ce2459c2072217182ed6d0f28eaee2f6df8282926cdcea5fc212d7eb04a4 WatchSource:0}: Error finding container e686ce2459c2072217182ed6d0f28eaee2f6df8282926cdcea5fc212d7eb04a4: Status 404 returned error can't find the container with id e686ce2459c2072217182ed6d0f28eaee2f6df8282926cdcea5fc212d7eb04a4 Jul 27 20:18:44.067792 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:44.067761 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xjfvv\"" Jul 27 20:18:44.075938 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:44.075918 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbvkx" Jul 27 20:18:44.189827 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:44.189801 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qkkjs" Jul 27 20:18:44.195011 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:44.194990 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qbvkx"] Jul 27 20:18:44.197582 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:18:44.197561 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod828a7e08_7c87_434e_86e6_39ce766c6606.slice/crio-30bb24614643f18edd29b1ce93eda9a8f6cd8744e5bea4272179e28e919f0be7 WatchSource:0}: Error finding container 30bb24614643f18edd29b1ce93eda9a8f6cd8744e5bea4272179e28e919f0be7: Status 404 returned error can't find the container with id 30bb24614643f18edd29b1ce93eda9a8f6cd8744e5bea4272179e28e919f0be7 Jul 27 20:18:44.235270 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:44.235223 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qbvkx" event={"ID":"828a7e08-7c87-434e-86e6-39ce766c6606","Type":"ContainerStarted","Data":"30bb24614643f18edd29b1ce93eda9a8f6cd8744e5bea4272179e28e919f0be7"} Jul 27 20:18:44.236382 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:44.236355 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-57jqw" event={"ID":"5db14a3f-0592-417e-8de6-a29bbe4cbfbd","Type":"ContainerStarted","Data":"52feef05918e099b1a3a2a8221bae88870346ecf4bff7ff77ed4b6c2dfe77596"} Jul 27 20:18:44.237488 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:44.237463 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q4rh9" event={"ID":"ed1721a8-1162-43d4-a7ae-20fb77b38000","Type":"ContainerStarted","Data":"e686ce2459c2072217182ed6d0f28eaee2f6df8282926cdcea5fc212d7eb04a4"} Jul 27 20:18:44.720681 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:44.720645 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:44.819577 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:44.819440 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:44.875816 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:44.875712 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:45.010790 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:45.010668 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:45.350550 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:45.350376 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:45.428947 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:45.428914 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:45.513257 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:45.513223 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:45.542544 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:45.542294 2558 patch_prober.go:28] interesting pod/image-registry-5f664bfd6d-m9579 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 27 20:18:45.542544 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:45.542385 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5f664bfd6d-m9579" podUID="68512aa0-28ef-4ce1-bb15-f442beb63f55" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 27 20:18:45.614308 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:45.614256 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:46.195292 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:46.195219 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:46.247857 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:46.247818 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q4rh9" event={"ID":"ed1721a8-1162-43d4-a7ae-20fb77b38000","Type":"ContainerStarted","Data":"07c51ecf1078c573f7b650b2b611209975d4fde3f672ed2e7586d63b1938b156"} Jul 27 20:18:46.248015 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:46.247891 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q4rh9" event={"ID":"ed1721a8-1162-43d4-a7ae-20fb77b38000","Type":"ContainerStarted","Data":"2619b972887300738a824ce6ee3eb36facf0ffa1301bfbeefddc907ef0cf9f26"} Jul 27 20:18:46.266833 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:46.266782 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-q4rh9" podStartSLOduration=66.8621288 podStartE2EDuration="1m8.266762297s" totalImagesPullingTime="1.404633497s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:17:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:18:46.265660008 +0000 UTC m=+68.844233598" watchObservedRunningTime="2026-07-27 20:18:46.266762297 +0000 UTC m=+68.845335888" Jul 27 20:18:46.399159 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:46.399100 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:46.497340 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:46.497187 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:46.597542 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:46.597446 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:46.749432 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:46.749357 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:47.027472 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:47.027393 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:47.095817 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:47.095784 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:48.613130 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:48.613082 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:48.714001 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:48.713954 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:48.778630 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:48.778540 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:49.262259 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:49.262227 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-57jqw" event={"ID":"5db14a3f-0592-417e-8de6-a29bbe4cbfbd","Type":"ContainerStarted","Data":"57f5d60a05d236b765ea540470201f401219c90d3c78fa610752a7d531f9e0ea"} Jul 27 20:18:49.263810 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:49.263786 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qbvkx" event={"ID":"828a7e08-7c87-434e-86e6-39ce766c6606","Type":"ContainerStarted","Data":"df0690d7365c609d9bc1cc00eaefbbc0f1baff2906bf0edcb039fdc26c6b6ab7"} Jul 27 20:18:49.263932 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:49.263847 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qbvkx" Jul 27 20:18:49.279582 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:49.279544 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-57jqw" podStartSLOduration=66.292921997 podStartE2EDuration="1m11.279532321s" totalImagesPullingTime="4.986610324s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:17:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:18:49.278902607 +0000 UTC m=+71.857476198" watchObservedRunningTime="2026-07-27 20:18:49.279532321 +0000 UTC m=+71.858105901" Jul 27 20:18:49.294857 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:49.294816 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qbvkx" podStartSLOduration=66.60493519 podStartE2EDuration="1m11.294803234s" totalImagesPullingTime="4.689868044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:17:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:18:49.294367502 +0000 UTC m=+71.872941090" watchObservedRunningTime="2026-07-27 20:18:49.294803234 +0000 UTC m=+71.873376822" Jul 27 20:18:50.629229 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:50.629194 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:50.692085 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:50.692045 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:52.184908 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:52.184875 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:52.243729 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:52.243682 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:52.428827 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:52.428798 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:52.526076 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:52.526045 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:52.679246 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:52.679210 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:52.778136 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:52.778048 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-r66sh"] Jul 27 20:18:52.783362 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:52.783331 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-r66sh" Jul 27 20:18:52.784972 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:52.784821 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:52.785733 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:52.785712 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 27 20:18:52.785859 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:52.785773 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 27 20:18:52.787012 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:52.786798 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bjbdd\"" Jul 27 20:18:52.787012 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:52.786812 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 27 20:18:52.787012 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:52.786799 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 27 20:18:52.787012 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:52.786875 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 27 20:18:52.787328 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:52.787104 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 27 20:18:52.874543 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:52.874515 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:52.877525 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:52.877503 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2-root\") pod \"node-exporter-r66sh\" (UID: \"c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2\") " pod="openshift-monitoring/node-exporter-r66sh" Jul 27 20:18:52.877624 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:52.877544 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2-node-exporter-tls\") pod \"node-exporter-r66sh\" (UID: \"c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2\") " pod="openshift-monitoring/node-exporter-r66sh" Jul 27 20:18:52.877624 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:52.877594 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp9wb\" (UniqueName: \"kubernetes.io/projected/c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2-kube-api-access-mp9wb\") pod \"node-exporter-r66sh\" (UID: \"c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2\") " pod="openshift-monitoring/node-exporter-r66sh" Jul 27 20:18:52.877747 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:52.877636 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r66sh\" (UID: \"c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2\") " pod="openshift-monitoring/node-exporter-r66sh" Jul 27 20:18:52.877747 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:52.877661 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2-node-exporter-accelerators-collector-config\") pod \"node-exporter-r66sh\" (UID: \"c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2\") " pod="openshift-monitoring/node-exporter-r66sh" Jul 27 20:18:52.877747 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:52.877728 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2-sys\") pod \"node-exporter-r66sh\" (UID: \"c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2\") " pod="openshift-monitoring/node-exporter-r66sh" Jul 27 20:18:52.877905 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:52.877764 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2-node-exporter-wtmp\") pod \"node-exporter-r66sh\" (UID: \"c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2\") " pod="openshift-monitoring/node-exporter-r66sh" Jul 27 20:18:52.877905 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:52.877793 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2-metrics-client-ca\") pod \"node-exporter-r66sh\" (UID: \"c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2\") " pod="openshift-monitoring/node-exporter-r66sh" Jul 27 20:18:52.877905 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:52.877822 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2-node-exporter-textfile\") pod \"node-exporter-r66sh\" (UID: \"c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2\") " pod="openshift-monitoring/node-exporter-r66sh" Jul 27 20:18:52.978707 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:52.978660 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2-node-exporter-wtmp\") pod \"node-exporter-r66sh\" (UID: \"c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2\") " pod="openshift-monitoring/node-exporter-r66sh" Jul 27 20:18:52.978875 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:52.978722 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2-metrics-client-ca\") pod \"node-exporter-r66sh\" (UID: \"c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2\") " pod="openshift-monitoring/node-exporter-r66sh" Jul 27 20:18:52.978875 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:52.978753 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2-node-exporter-textfile\") pod \"node-exporter-r66sh\" (UID: \"c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2\") " pod="openshift-monitoring/node-exporter-r66sh" Jul 27 20:18:52.978875 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:52.978786 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2-root\") pod \"node-exporter-r66sh\" (UID: \"c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2\") " pod="openshift-monitoring/node-exporter-r66sh" Jul 27 20:18:52.978875 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:52.978820 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2-node-exporter-tls\") pod \"node-exporter-r66sh\" (UID: \"c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2\") " pod="openshift-monitoring/node-exporter-r66sh" Jul 27 20:18:52.978875 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:52.978845 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp9wb\" (UniqueName: \"kubernetes.io/projected/c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2-kube-api-access-mp9wb\") pod \"node-exporter-r66sh\" (UID: \"c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2\") " pod="openshift-monitoring/node-exporter-r66sh" Jul 27 20:18:52.979147 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:52.978876 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r66sh\" (UID: \"c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2\") " pod="openshift-monitoring/node-exporter-r66sh" Jul 27 20:18:52.979147 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:52.978902 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2-node-exporter-accelerators-collector-config\") pod \"node-exporter-r66sh\" (UID: \"c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2\") " pod="openshift-monitoring/node-exporter-r66sh" Jul 27 20:18:52.979147 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:52.978936 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2-sys\") pod \"node-exporter-r66sh\" (UID: \"c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2\") " pod="openshift-monitoring/node-exporter-r66sh" Jul 27 20:18:52.979147 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:52.979034 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2-sys\") pod \"node-exporter-r66sh\" (UID: \"c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2\") " pod="openshift-monitoring/node-exporter-r66sh" Jul 27 20:18:52.979364 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:52.979153 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2-node-exporter-wtmp\") pod \"node-exporter-r66sh\" (UID: \"c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2\") " pod="openshift-monitoring/node-exporter-r66sh" Jul 27 20:18:52.979581 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:52.979560 2558 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 27 20:18:52.980109 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:52.979741 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2-metrics-client-ca\") pod \"node-exporter-r66sh\" (UID: \"c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2\") " pod="openshift-monitoring/node-exporter-r66sh" Jul 27 20:18:52.980219 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:52.980176 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2-node-exporter-accelerators-collector-config\") pod \"node-exporter-r66sh\" (UID: \"c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2\") " pod="openshift-monitoring/node-exporter-r66sh" Jul 27 20:18:52.980353 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:52.980336 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2-root\") pod \"node-exporter-r66sh\" (UID: \"c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2\") " pod="openshift-monitoring/node-exporter-r66sh" Jul 27 20:18:52.980778 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:52.980753 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2-node-exporter-textfile\") pod \"node-exporter-r66sh\" (UID: \"c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2\") " pod="openshift-monitoring/node-exporter-r66sh" Jul 27 20:18:52.980903 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:18:52.980843 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2-node-exporter-tls podName:c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2 nodeName:}" failed. No retries permitted until 2026-07-27 20:18:53.480821301 +0000 UTC m=+76.059394882 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2-node-exporter-tls") pod "node-exporter-r66sh" (UID: "c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2") : secret "node-exporter-tls" not found Jul 27 20:18:52.992199 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:52.992172 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r66sh\" (UID: \"c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2\") " pod="openshift-monitoring/node-exporter-r66sh" Jul 27 20:18:53.002266 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:53.002229 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:53.004073 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:53.004052 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp9wb\" (UniqueName: \"kubernetes.io/projected/c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2-kube-api-access-mp9wb\") pod \"node-exporter-r66sh\" (UID: \"c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2\") " pod="openshift-monitoring/node-exporter-r66sh" Jul 27 20:18:53.097380 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:53.097298 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:53.192964 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:53.192929 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:53.293012 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:53.292985 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:53.484234 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:53.484157 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2-node-exporter-tls\") pod \"node-exporter-r66sh\" (UID: \"c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2\") " pod="openshift-monitoring/node-exporter-r66sh" Jul 27 20:18:53.486377 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:53.486360 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2-node-exporter-tls\") pod \"node-exporter-r66sh\" (UID: \"c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2\") " pod="openshift-monitoring/node-exporter-r66sh" Jul 27 20:18:53.694556 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:53.694523 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-r66sh" Jul 27 20:18:53.704787 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:18:53.704755 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3f6e5aa_dd33_4506_9bcd_b1b69e4eaaa2.slice/crio-7dbb6abab209e5853b6cc6fa11d35f83a0197413ca08562dcfa977b94254d0fb WatchSource:0}: Error finding container 7dbb6abab209e5853b6cc6fa11d35f83a0197413ca08562dcfa977b94254d0fb: Status 404 returned error can't find the container with id 7dbb6abab209e5853b6cc6fa11d35f83a0197413ca08562dcfa977b94254d0fb Jul 27 20:18:53.713881 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:53.713848 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:53.830794 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:53.830766 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:54.159325 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:54.159232 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:54.279292 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:54.279245 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:54.281433 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:54.281406 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r66sh" event={"ID":"c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2","Type":"ContainerStarted","Data":"7dbb6abab209e5853b6cc6fa11d35f83a0197413ca08562dcfa977b94254d0fb"} Jul 27 20:18:54.335008 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:54.334964 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:55.286655 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:55.286625 2558 generic.go:356] "Generic (PLEG): container finished" podID="c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2" containerID="467f3dd9300c3dc61b12e3fe59470dec9e3f755bc67012c5f0385c75de67a767" exitCode=0 Jul 27 20:18:55.287033 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:55.286674 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r66sh" event={"ID":"c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2","Type":"ContainerDied","Data":"467f3dd9300c3dc61b12e3fe59470dec9e3f755bc67012c5f0385c75de67a767"} Jul 27 20:18:55.539624 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:55.539558 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5f664bfd6d-m9579" Jul 27 20:18:55.608557 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:55.608515 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:55.711516 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:55.711482 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:55.818744 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:55.818649 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:55.874566 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:55.874541 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:55.959841 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:55.959800 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:56.292007 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:56.291973 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r66sh" event={"ID":"c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2","Type":"ContainerStarted","Data":"b333fff09dda2164ddd8ef9551e195e8bace96ea3ed6c55e44050e12fcee947a"} Jul 27 20:18:56.292373 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:56.292037 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r66sh" event={"ID":"c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2","Type":"ContainerStarted","Data":"9c0823b2e462c9d85e4dbd64c6083228a16409452a51387148e8ff1b67717e55"} Jul 27 20:18:56.310779 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:56.310734 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-r66sh" podStartSLOduration=3.354349727 podStartE2EDuration="4.31072103s" totalImagesPullingTime="891.806876ms" totalInitContainerRuntime="64.564427ms" isStatefulPod=true podCreationTimestamp="2026-07-27 20:18:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:18:56.309226746 +0000 UTC m=+78.887800334" watchObservedRunningTime="2026-07-27 20:18:56.31072103 +0000 UTC m=+78.889294643" Jul 27 20:18:57.412883 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:57.412840 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:57.510846 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:57.510813 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:57.568667 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:57.568638 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:57.696283 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:57.696213 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:58.212765 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:58.212735 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-587c985c7b-jqrlj" Jul 27 20:18:58.356605 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:58.356570 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:58.816801 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:58.816764 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:58.919495 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:58.919461 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:18:58.994383 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:18:58.994350 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:19:00.226591 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:00.226550 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:19:00.285962 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:00.285927 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:19:00.561876 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:00.561802 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5f664bfd6d-m9579" podUID="68512aa0-28ef-4ce1-bb15-f442beb63f55" containerName="registry" containerID="cri-o://036a5a3055427c256fcf976c95f9176b46e5b69513e9e334d9448de5bcd18c61" gracePeriod=30 Jul 27 20:19:00.798742 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:00.798718 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f664bfd6d-m9579" Jul 27 20:19:00.945062 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:00.944993 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/68512aa0-28ef-4ce1-bb15-f442beb63f55-image-registry-private-configuration\") pod \"68512aa0-28ef-4ce1-bb15-f442beb63f55\" (UID: \"68512aa0-28ef-4ce1-bb15-f442beb63f55\") " Jul 27 20:19:00.945062 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:00.945029 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/68512aa0-28ef-4ce1-bb15-f442beb63f55-registry-certificates\") pod \"68512aa0-28ef-4ce1-bb15-f442beb63f55\" (UID: \"68512aa0-28ef-4ce1-bb15-f442beb63f55\") " Jul 27 20:19:00.945062 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:00.945056 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/68512aa0-28ef-4ce1-bb15-f442beb63f55-bound-sa-token\") pod \"68512aa0-28ef-4ce1-bb15-f442beb63f55\" (UID: \"68512aa0-28ef-4ce1-bb15-f442beb63f55\") " Jul 27 20:19:00.945321 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:00.945075 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68512aa0-28ef-4ce1-bb15-f442beb63f55-registry-tls\") pod \"68512aa0-28ef-4ce1-bb15-f442beb63f55\" (UID: \"68512aa0-28ef-4ce1-bb15-f442beb63f55\") " Jul 27 20:19:00.945321 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:00.945118 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/68512aa0-28ef-4ce1-bb15-f442beb63f55-ca-trust-extracted\") pod \"68512aa0-28ef-4ce1-bb15-f442beb63f55\" (UID: \"68512aa0-28ef-4ce1-bb15-f442beb63f55\") " Jul 27 20:19:00.945321 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:00.945138 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/68512aa0-28ef-4ce1-bb15-f442beb63f55-installation-pull-secrets\") pod \"68512aa0-28ef-4ce1-bb15-f442beb63f55\" (UID: \"68512aa0-28ef-4ce1-bb15-f442beb63f55\") " Jul 27 20:19:00.945321 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:00.945154 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7khsm\" (UniqueName: \"kubernetes.io/projected/68512aa0-28ef-4ce1-bb15-f442beb63f55-kube-api-access-7khsm\") pod \"68512aa0-28ef-4ce1-bb15-f442beb63f55\" (UID: \"68512aa0-28ef-4ce1-bb15-f442beb63f55\") " Jul 27 20:19:00.945321 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:00.945178 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/68512aa0-28ef-4ce1-bb15-f442beb63f55-trusted-ca\") pod \"68512aa0-28ef-4ce1-bb15-f442beb63f55\" (UID: \"68512aa0-28ef-4ce1-bb15-f442beb63f55\") " Jul 27 20:19:00.945624 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:00.945543 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68512aa0-28ef-4ce1-bb15-f442beb63f55-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "68512aa0-28ef-4ce1-bb15-f442beb63f55" (UID: "68512aa0-28ef-4ce1-bb15-f442beb63f55"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:19:00.945778 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:00.945668 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68512aa0-28ef-4ce1-bb15-f442beb63f55-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "68512aa0-28ef-4ce1-bb15-f442beb63f55" (UID: "68512aa0-28ef-4ce1-bb15-f442beb63f55"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:19:00.947606 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:00.947548 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68512aa0-28ef-4ce1-bb15-f442beb63f55-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "68512aa0-28ef-4ce1-bb15-f442beb63f55" (UID: "68512aa0-28ef-4ce1-bb15-f442beb63f55"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 20:19:00.947813 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:00.947781 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68512aa0-28ef-4ce1-bb15-f442beb63f55-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "68512aa0-28ef-4ce1-bb15-f442beb63f55" (UID: "68512aa0-28ef-4ce1-bb15-f442beb63f55"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:19:00.947949 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:00.947924 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68512aa0-28ef-4ce1-bb15-f442beb63f55-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "68512aa0-28ef-4ce1-bb15-f442beb63f55" (UID: "68512aa0-28ef-4ce1-bb15-f442beb63f55"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 20:19:00.948005 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:00.947926 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68512aa0-28ef-4ce1-bb15-f442beb63f55-kube-api-access-7khsm" (OuterVolumeSpecName: "kube-api-access-7khsm") pod "68512aa0-28ef-4ce1-bb15-f442beb63f55" (UID: "68512aa0-28ef-4ce1-bb15-f442beb63f55"). InnerVolumeSpecName "kube-api-access-7khsm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:19:00.948005 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:00.947953 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68512aa0-28ef-4ce1-bb15-f442beb63f55-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "68512aa0-28ef-4ce1-bb15-f442beb63f55" (UID: "68512aa0-28ef-4ce1-bb15-f442beb63f55"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:19:00.955973 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:00.955943 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68512aa0-28ef-4ce1-bb15-f442beb63f55-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "68512aa0-28ef-4ce1-bb15-f442beb63f55" (UID: "68512aa0-28ef-4ce1-bb15-f442beb63f55"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 20:19:01.045823 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:01.045799 2558 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/68512aa0-28ef-4ce1-bb15-f442beb63f55-image-registry-private-configuration\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 20:19:01.045823 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:01.045824 2558 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/68512aa0-28ef-4ce1-bb15-f442beb63f55-registry-certificates\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 20:19:01.045941 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:01.045833 2558 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/68512aa0-28ef-4ce1-bb15-f442beb63f55-bound-sa-token\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 20:19:01.045941 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:01.045841 2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68512aa0-28ef-4ce1-bb15-f442beb63f55-registry-tls\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 20:19:01.045941 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:01.045849 2558 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/68512aa0-28ef-4ce1-bb15-f442beb63f55-ca-trust-extracted\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 20:19:01.045941 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:01.045857 2558 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/68512aa0-28ef-4ce1-bb15-f442beb63f55-installation-pull-secrets\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 20:19:01.045941 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:01.045865 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7khsm\" (UniqueName: \"kubernetes.io/projected/68512aa0-28ef-4ce1-bb15-f442beb63f55-kube-api-access-7khsm\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 20:19:01.045941 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:01.045873 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/68512aa0-28ef-4ce1-bb15-f442beb63f55-trusted-ca\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 20:19:01.310566 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:01.310533 2558 generic.go:356] "Generic (PLEG): container finished" podID="68512aa0-28ef-4ce1-bb15-f442beb63f55" containerID="036a5a3055427c256fcf976c95f9176b46e5b69513e9e334d9448de5bcd18c61" exitCode=0 Jul 27 20:19:01.311039 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:01.310588 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f664bfd6d-m9579" Jul 27 20:19:01.311039 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:01.310633 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f664bfd6d-m9579" event={"ID":"68512aa0-28ef-4ce1-bb15-f442beb63f55","Type":"ContainerDied","Data":"036a5a3055427c256fcf976c95f9176b46e5b69513e9e334d9448de5bcd18c61"} Jul 27 20:19:01.311039 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:01.310684 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f664bfd6d-m9579" event={"ID":"68512aa0-28ef-4ce1-bb15-f442beb63f55","Type":"ContainerDied","Data":"eb96da5a0e55c837921da7a0c4882149e6a05676386072d7b861589bb161fa92"} Jul 27 20:19:01.311039 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:01.310719 2558 scope.go:117] "RemoveContainer" containerID="036a5a3055427c256fcf976c95f9176b46e5b69513e9e334d9448de5bcd18c61" Jul 27 20:19:01.319057 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:01.319041 2558 scope.go:117] "RemoveContainer" containerID="036a5a3055427c256fcf976c95f9176b46e5b69513e9e334d9448de5bcd18c61" Jul 27 20:19:01.319310 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:19:01.319290 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"036a5a3055427c256fcf976c95f9176b46e5b69513e9e334d9448de5bcd18c61\": container with ID starting with 036a5a3055427c256fcf976c95f9176b46e5b69513e9e334d9448de5bcd18c61 not found: ID does not exist" containerID="036a5a3055427c256fcf976c95f9176b46e5b69513e9e334d9448de5bcd18c61" Jul 27 20:19:01.319369 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:01.319317 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"036a5a3055427c256fcf976c95f9176b46e5b69513e9e334d9448de5bcd18c61"} err="failed to get container status \"036a5a3055427c256fcf976c95f9176b46e5b69513e9e334d9448de5bcd18c61\": rpc error: code = NotFound desc = could not find container \"036a5a3055427c256fcf976c95f9176b46e5b69513e9e334d9448de5bcd18c61\": container with ID starting with 036a5a3055427c256fcf976c95f9176b46e5b69513e9e334d9448de5bcd18c61 not found: ID does not exist" Jul 27 20:19:01.331369 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:01.331347 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5f664bfd6d-m9579"] Jul 27 20:19:01.337616 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:01.337597 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5f664bfd6d-m9579"] Jul 27 20:19:01.931916 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:01.931886 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68512aa0-28ef-4ce1-bb15-f442beb63f55" path="/var/lib/kubelet/pods/68512aa0-28ef-4ce1-bb15-f442beb63f55/volumes" Jul 27 20:19:02.328637 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:02.328608 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:19:02.423203 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:02.423172 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:19:03.183216 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:03.183187 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:19:03.234703 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:03.234651 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:19:04.221542 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:04.221501 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:19:04.322672 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:04.322640 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:19:05.110009 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:05.109968 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:19:05.215632 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:05.215595 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:19:07.236858 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:07.236829 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:19:07.337952 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:07.337925 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:19:11.636803 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:11.636774 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:19:11.695455 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:11.695428 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:19:12.254128 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:12.254095 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:19:12.354128 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:12.354096 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:19:13.672643 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:13.672609 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:19:13.734573 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:13.734542 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:19:13.790292 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:13.790263 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:19:14.903442 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:14.903406 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:19:20.269093 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:20.269061 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qbvkx" Jul 27 20:19:22.151927 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:22.151888 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:19:22.253931 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:22.253899 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:19:26.395636 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:26.395598 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846bd7dbcf-wf6z8" event={"ID":"f233760a-063c-4dea-9b67-a35c4ca12377","Type":"ContainerStarted","Data":"d84311a6ed0d817bfc71b4cdff8d0ffed0d185210fa4c280066975d1afdd8206"} Jul 27 20:19:26.396069 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:26.395799 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846bd7dbcf-wf6z8" Jul 27 20:19:26.397628 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:26.397608 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846bd7dbcf-wf6z8" Jul 27 20:19:26.412207 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:26.412170 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846bd7dbcf-wf6z8" podStartSLOduration=2.689473354 podStartE2EDuration="51.412159612s" totalImagesPullingTime="48.722686258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:18:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:19:26.41101347 +0000 UTC m=+108.989587059" watchObservedRunningTime="2026-07-27 20:19:26.412159612 +0000 UTC m=+108.990733201" Jul 27 20:19:29.602532 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:29.602491 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:19:29.704293 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:29.704259 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:19:29.806028 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:29.805991 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:19:49.740882 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:49.740843 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:19:49.844174 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:19:49.844139 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:20:08.819889 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:20:08.819848 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:20:08.874701 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:20:08.874658 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:20:20.769306 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:20:20.769273 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:20:20.825988 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:20:20.825958 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:20:22.227998 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:20:22.227967 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:20:22.283730 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:20:22.283680 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:20:22.367599 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:20:22.367573 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:20:22.416449 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:20:22.416420 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:20:22.964378 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:20:22.964343 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:20:23.036971 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:20:23.036938 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:20:32.981765 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:20:32.981666 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:20:33.039134 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:20:33.039101 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:20:34.761637 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:20:34.761599 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:20:37.158493 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:20:37.158460 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:20:37.259410 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:20:37.259375 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:20:37.312508 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:20:37.312479 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:21:06.659789 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:21:06.659751 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:21:19.396507 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:21:19.396474 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:21:19.492749 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:21:19.492711 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:21:40.675777 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:21:40.675730 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:21:40.776809 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:21:40.776770 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:21:40.873647 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:21:40.873616 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:21:41.684546 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:21:41.684517 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:21:44.488708 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:21:44.488637 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:21:44.589057 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:21:44.589020 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:21:45.597048 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:21:45.597013 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:21:45.697746 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:21:45.697708 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:21:47.968967 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:21:47.968930 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:21:48.404256 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:21:48.404220 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:21:51.083533 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:21:51.083494 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:21:51.183951 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:21:51.183917 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:21:55.004720 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:21:55.004670 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:21:55.077718 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:21:55.077673 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:21:55.768935 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:21:55.768907 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:22:01.499970 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:01.499873 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:22:01.597494 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:01.597459 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:22:07.760013 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:07.759975 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:22:07.859960 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:07.859929 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:22:09.869778 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:09.869741 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:22:21.695433 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:21.695394 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:22:21.794532 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:21.794495 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:22:22.308155 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:22.308118 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:22:22.526699 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:22.526625 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:22:22.634599 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:22.634528 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:22:22.692224 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:22.692187 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-r8sps"] Jul 27 20:22:22.692436 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:22.692425 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68512aa0-28ef-4ce1-bb15-f442beb63f55" containerName="registry" Jul 27 20:22:22.692478 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:22.692438 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="68512aa0-28ef-4ce1-bb15-f442beb63f55" containerName="registry" Jul 27 20:22:22.692511 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:22.692493 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="68512aa0-28ef-4ce1-bb15-f442beb63f55" containerName="registry" Jul 27 20:22:22.695493 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:22.695474 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-r8sps" Jul 27 20:22:22.702643 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:22.702620 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 27 20:22:22.702773 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:22.702759 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 27 20:22:22.702848 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:22.702832 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 27 20:22:22.702895 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:22.702881 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 27 20:22:22.702940 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:22.702887 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jw6l6\"" Jul 27 20:22:22.739572 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:22.739551 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-r8sps"] Jul 27 20:22:22.859202 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:22.859171 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/905ed094-def8-467e-97e9-84bb97bdc92e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b8fd6b656-r8sps\" (UID: \"905ed094-def8-467e-97e9-84bb97bdc92e\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-r8sps" Jul 27 20:22:22.859202 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:22.859210 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/905ed094-def8-467e-97e9-84bb97bdc92e-manifests\") pod \"opendatahub-operator-controller-manager-6b8fd6b656-r8sps\" (UID: \"905ed094-def8-467e-97e9-84bb97bdc92e\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-r8sps" Jul 27 20:22:22.859457 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:22.859255 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/905ed094-def8-467e-97e9-84bb97bdc92e-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b8fd6b656-r8sps\" (UID: \"905ed094-def8-467e-97e9-84bb97bdc92e\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-r8sps" Jul 27 20:22:22.859457 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:22.859277 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/905ed094-def8-467e-97e9-84bb97bdc92e-tmp\") pod \"opendatahub-operator-controller-manager-6b8fd6b656-r8sps\" (UID: \"905ed094-def8-467e-97e9-84bb97bdc92e\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-r8sps" Jul 27 20:22:22.859457 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:22.859305 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57krp\" (UniqueName: \"kubernetes.io/projected/905ed094-def8-467e-97e9-84bb97bdc92e-kube-api-access-57krp\") pod \"opendatahub-operator-controller-manager-6b8fd6b656-r8sps\" (UID: \"905ed094-def8-467e-97e9-84bb97bdc92e\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-r8sps" Jul 27 20:22:22.860425 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:22.860396 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:22:22.960470 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:22.960382 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/905ed094-def8-467e-97e9-84bb97bdc92e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b8fd6b656-r8sps\" (UID: \"905ed094-def8-467e-97e9-84bb97bdc92e\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-r8sps" Jul 27 20:22:22.960470 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:22.960417 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/905ed094-def8-467e-97e9-84bb97bdc92e-manifests\") pod \"opendatahub-operator-controller-manager-6b8fd6b656-r8sps\" (UID: \"905ed094-def8-467e-97e9-84bb97bdc92e\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-r8sps" Jul 27 20:22:22.960470 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:22.960449 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/905ed094-def8-467e-97e9-84bb97bdc92e-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b8fd6b656-r8sps\" (UID: \"905ed094-def8-467e-97e9-84bb97bdc92e\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-r8sps" Jul 27 20:22:22.960756 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:22.960478 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/905ed094-def8-467e-97e9-84bb97bdc92e-tmp\") pod \"opendatahub-operator-controller-manager-6b8fd6b656-r8sps\" (UID: \"905ed094-def8-467e-97e9-84bb97bdc92e\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-r8sps" Jul 27 20:22:22.960756 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:22.960511 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57krp\" (UniqueName: \"kubernetes.io/projected/905ed094-def8-467e-97e9-84bb97bdc92e-kube-api-access-57krp\") pod \"opendatahub-operator-controller-manager-6b8fd6b656-r8sps\" (UID: \"905ed094-def8-467e-97e9-84bb97bdc92e\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-r8sps" Jul 27 20:22:22.960917 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:22.960894 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/905ed094-def8-467e-97e9-84bb97bdc92e-manifests\") pod \"opendatahub-operator-controller-manager-6b8fd6b656-r8sps\" (UID: \"905ed094-def8-467e-97e9-84bb97bdc92e\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-r8sps" Jul 27 20:22:22.961601 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:22.961572 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:22:22.962907 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:22.962886 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/905ed094-def8-467e-97e9-84bb97bdc92e-tmp\") pod \"opendatahub-operator-controller-manager-6b8fd6b656-r8sps\" (UID: \"905ed094-def8-467e-97e9-84bb97bdc92e\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-r8sps" Jul 27 20:22:22.963362 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:22.963346 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/905ed094-def8-467e-97e9-84bb97bdc92e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b8fd6b656-r8sps\" (UID: \"905ed094-def8-467e-97e9-84bb97bdc92e\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-r8sps" Jul 27 20:22:22.963437 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:22.963377 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/905ed094-def8-467e-97e9-84bb97bdc92e-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b8fd6b656-r8sps\" (UID: \"905ed094-def8-467e-97e9-84bb97bdc92e\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-r8sps" Jul 27 20:22:22.967869 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:22.967848 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57krp\" (UniqueName: \"kubernetes.io/projected/905ed094-def8-467e-97e9-84bb97bdc92e-kube-api-access-57krp\") pod \"opendatahub-operator-controller-manager-6b8fd6b656-r8sps\" (UID: \"905ed094-def8-467e-97e9-84bb97bdc92e\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-r8sps" Jul 27 20:22:23.005037 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:23.005012 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-r8sps" Jul 27 20:22:23.064491 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:23.064399 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:22:23.133416 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:23.133381 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-r8sps"] Jul 27 20:22:23.136482 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:22:23.136460 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod905ed094_def8_467e_97e9_84bb97bdc92e.slice/crio-c28b1fe67c7e42441c10b7c5bd09b74b2c0d06281034dd86a109319c35d29df8 WatchSource:0}: Error finding container c28b1fe67c7e42441c10b7c5bd09b74b2c0d06281034dd86a109319c35d29df8: Status 404 returned error can't find the container with id c28b1fe67c7e42441c10b7c5bd09b74b2c0d06281034dd86a109319c35d29df8 Jul 27 20:22:23.162428 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:23.162395 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:22:23.272470 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:23.272440 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:22:23.381281 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:23.381245 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:22:23.980547 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:23.980517 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-r8sps" event={"ID":"905ed094-def8-467e-97e9-84bb97bdc92e","Type":"ContainerStarted","Data":"c28b1fe67c7e42441c10b7c5bd09b74b2c0d06281034dd86a109319c35d29df8"} Jul 27 20:22:26.203766 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:26.203731 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:22:26.300809 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:26.300782 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:22:26.992015 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:26.991973 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-r8sps" event={"ID":"905ed094-def8-467e-97e9-84bb97bdc92e","Type":"ContainerStarted","Data":"46b74955f3fd60fabc7771dc1eb4dadabf885a938cd0b6f9ebac4a1151533830"} Jul 27 20:22:27.997193 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:27.997161 2558 generic.go:356] "Generic (PLEG): container finished" podID="905ed094-def8-467e-97e9-84bb97bdc92e" containerID="46b74955f3fd60fabc7771dc1eb4dadabf885a938cd0b6f9ebac4a1151533830" exitCode=0 Jul 27 20:22:27.997563 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:27.997197 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-r8sps" event={"ID":"905ed094-def8-467e-97e9-84bb97bdc92e","Type":"ContainerDied","Data":"46b74955f3fd60fabc7771dc1eb4dadabf885a938cd0b6f9ebac4a1151533830"} Jul 27 20:22:29.003684 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:29.003640 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-r8sps" event={"ID":"905ed094-def8-467e-97e9-84bb97bdc92e","Type":"ContainerStarted","Data":"2aac476eeb67cb3f25363c0d5ab4e5334b224a68571bbbe60d8c9dc33bec23e0"} Jul 27 20:22:29.004057 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:29.003807 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-r8sps" Jul 27 20:22:29.029485 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:29.029429 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-r8sps" podStartSLOduration=2.482574418 podStartE2EDuration="7.02941205s" totalImagesPullingTime="3.538346021s" totalInitContainerRuntime="1.008491611s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:22:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:22:29.029092089 +0000 UTC m=+291.607665678" watchObservedRunningTime="2026-07-27 20:22:29.02941205 +0000 UTC m=+291.607985640" Jul 27 20:22:37.778159 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:37.778125 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rnj2b_c421dc44-8fcf-44f4-b483-8e0271833d10/ovn-acl-logging/0.log" Jul 27 20:22:37.781387 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:37.781365 2558 kubelet.go:1648] "Image garbage collection succeeded" Jul 27 20:22:37.792123 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:37.792100 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rnj2b_c421dc44-8fcf-44f4-b483-8e0271833d10/ovn-acl-logging/0.log" Jul 27 20:22:40.009483 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:40.009457 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-r8sps" Jul 27 20:22:42.065895 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:42.065840 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:22:43.530427 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:43.530395 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-dm9lm"] Jul 27 20:22:43.533269 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:43.533249 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-dm9lm" Jul 27 20:22:43.535669 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:43.535647 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-sc6vm\"" Jul 27 20:22:43.535808 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:43.535673 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 27 20:22:43.545105 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:43.545080 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-dm9lm"] Jul 27 20:22:43.616401 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:43.616364 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93f40186-af2d-4375-b40e-cb123c8dd5fa-tls-certs\") pod \"model-serving-api-54d89bd5fc-dm9lm\" (UID: \"93f40186-af2d-4375-b40e-cb123c8dd5fa\") " pod="opendatahub/model-serving-api-54d89bd5fc-dm9lm" Jul 27 20:22:43.616561 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:43.616410 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvdv7\" (UniqueName: \"kubernetes.io/projected/93f40186-af2d-4375-b40e-cb123c8dd5fa-kube-api-access-xvdv7\") pod \"model-serving-api-54d89bd5fc-dm9lm\" (UID: \"93f40186-af2d-4375-b40e-cb123c8dd5fa\") " pod="opendatahub/model-serving-api-54d89bd5fc-dm9lm" Jul 27 20:22:43.717083 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:43.717048 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93f40186-af2d-4375-b40e-cb123c8dd5fa-tls-certs\") pod \"model-serving-api-54d89bd5fc-dm9lm\" (UID: \"93f40186-af2d-4375-b40e-cb123c8dd5fa\") " pod="opendatahub/model-serving-api-54d89bd5fc-dm9lm" Jul 27 20:22:43.717252 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:43.717093 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvdv7\" (UniqueName: \"kubernetes.io/projected/93f40186-af2d-4375-b40e-cb123c8dd5fa-kube-api-access-xvdv7\") pod \"model-serving-api-54d89bd5fc-dm9lm\" (UID: \"93f40186-af2d-4375-b40e-cb123c8dd5fa\") " pod="opendatahub/model-serving-api-54d89bd5fc-dm9lm" Jul 27 20:22:43.719658 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:43.719636 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93f40186-af2d-4375-b40e-cb123c8dd5fa-tls-certs\") pod \"model-serving-api-54d89bd5fc-dm9lm\" (UID: \"93f40186-af2d-4375-b40e-cb123c8dd5fa\") " pod="opendatahub/model-serving-api-54d89bd5fc-dm9lm" Jul 27 20:22:43.725167 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:43.725143 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvdv7\" (UniqueName: \"kubernetes.io/projected/93f40186-af2d-4375-b40e-cb123c8dd5fa-kube-api-access-xvdv7\") pod \"model-serving-api-54d89bd5fc-dm9lm\" (UID: \"93f40186-af2d-4375-b40e-cb123c8dd5fa\") " pod="opendatahub/model-serving-api-54d89bd5fc-dm9lm" Jul 27 20:22:43.844795 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:43.844712 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-dm9lm" Jul 27 20:22:43.980988 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:43.980954 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-dm9lm"] Jul 27 20:22:43.984339 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:22:43.984313 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93f40186_af2d_4375_b40e_cb123c8dd5fa.slice/crio-646c65e1c1e9e8a367619410953ac317c82c67d77a6c9990864284179b6bbeea WatchSource:0}: Error finding container 646c65e1c1e9e8a367619410953ac317c82c67d77a6c9990864284179b6bbeea: Status 404 returned error can't find the container with id 646c65e1c1e9e8a367619410953ac317c82c67d77a6c9990864284179b6bbeea Jul 27 20:22:43.986817 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:43.986795 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 20:22:44.058820 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:44.058786 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-dm9lm" event={"ID":"93f40186-af2d-4375-b40e-cb123c8dd5fa","Type":"ContainerStarted","Data":"646c65e1c1e9e8a367619410953ac317c82c67d77a6c9990864284179b6bbeea"} Jul 27 20:22:44.497215 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:44.497171 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:22:46.068519 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:46.068482 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-dm9lm" event={"ID":"93f40186-af2d-4375-b40e-cb123c8dd5fa","Type":"ContainerStarted","Data":"89b1799639d5de56bffefb13429cb4ef9ef5538365ce973f6f2239cab727ca9a"} Jul 27 20:22:46.068958 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:46.068630 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-dm9lm" Jul 27 20:22:46.084740 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:46.084658 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-dm9lm" podStartSLOduration=1.416525032 podStartE2EDuration="3.084643003s" totalImagesPullingTime="1.668117971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:22:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:22:46.08346335 +0000 UTC m=+308.662036939" watchObservedRunningTime="2026-07-27 20:22:46.084643003 +0000 UTC m=+308.663216629" Jul 27 20:22:48.161844 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:48.161801 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:22:49.048380 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:49.048330 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:22:49.413475 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:49.413385 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:22:49.534808 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:49.534775 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:22:50.683204 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:50.683170 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-xf7v7"] Jul 27 20:22:50.685785 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:50.685764 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xf7v7" Jul 27 20:22:50.688454 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:50.688429 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-wr59l\"" Jul 27 20:22:50.688575 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:50.688465 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 27 20:22:50.688575 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:50.688484 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 27 20:22:50.688575 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:50.688514 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 27 20:22:50.688761 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:50.688612 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 27 20:22:50.688761 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:50.688634 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 27 20:22:50.688761 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:50.688757 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 27 20:22:50.707627 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:50.707606 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-xf7v7"] Jul 27 20:22:50.773860 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:50.773830 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2e4c67bd-ff21-45b8-93de-0a2577a61f5f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-xf7v7\" (UID: \"2e4c67bd-ff21-45b8-93de-0a2577a61f5f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xf7v7" Jul 27 20:22:50.774004 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:50.773866 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e4c67bd-ff21-45b8-93de-0a2577a61f5f-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-xf7v7\" (UID: \"2e4c67bd-ff21-45b8-93de-0a2577a61f5f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xf7v7" Jul 27 20:22:50.774004 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:50.773886 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e4c67bd-ff21-45b8-93de-0a2577a61f5f-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-xf7v7\" (UID: \"2e4c67bd-ff21-45b8-93de-0a2577a61f5f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xf7v7" Jul 27 20:22:50.774004 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:50.773936 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2e4c67bd-ff21-45b8-93de-0a2577a61f5f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-xf7v7\" (UID: \"2e4c67bd-ff21-45b8-93de-0a2577a61f5f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xf7v7" Jul 27 20:22:50.774004 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:50.773980 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2e4c67bd-ff21-45b8-93de-0a2577a61f5f-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-xf7v7\" (UID: \"2e4c67bd-ff21-45b8-93de-0a2577a61f5f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xf7v7" Jul 27 20:22:50.774140 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:50.774005 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2e4c67bd-ff21-45b8-93de-0a2577a61f5f-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-xf7v7\" (UID: \"2e4c67bd-ff21-45b8-93de-0a2577a61f5f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xf7v7" Jul 27 20:22:50.774140 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:50.774063 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmjnf\" (UniqueName: \"kubernetes.io/projected/2e4c67bd-ff21-45b8-93de-0a2577a61f5f-kube-api-access-mmjnf\") pod \"istiod-openshift-gateway-5677ccb49b-xf7v7\" (UID: \"2e4c67bd-ff21-45b8-93de-0a2577a61f5f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xf7v7" Jul 27 20:22:50.797314 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:50.797278 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:22:50.875396 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:50.875364 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmjnf\" (UniqueName: \"kubernetes.io/projected/2e4c67bd-ff21-45b8-93de-0a2577a61f5f-kube-api-access-mmjnf\") pod \"istiod-openshift-gateway-5677ccb49b-xf7v7\" (UID: \"2e4c67bd-ff21-45b8-93de-0a2577a61f5f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xf7v7" Jul 27 20:22:50.875549 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:50.875410 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2e4c67bd-ff21-45b8-93de-0a2577a61f5f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-xf7v7\" (UID: \"2e4c67bd-ff21-45b8-93de-0a2577a61f5f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xf7v7" Jul 27 20:22:50.875549 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:50.875448 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e4c67bd-ff21-45b8-93de-0a2577a61f5f-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-xf7v7\" (UID: \"2e4c67bd-ff21-45b8-93de-0a2577a61f5f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xf7v7" Jul 27 20:22:50.875549 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:50.875475 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e4c67bd-ff21-45b8-93de-0a2577a61f5f-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-xf7v7\" (UID: \"2e4c67bd-ff21-45b8-93de-0a2577a61f5f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xf7v7" Jul 27 20:22:50.875549 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:50.875500 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2e4c67bd-ff21-45b8-93de-0a2577a61f5f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-xf7v7\" (UID: \"2e4c67bd-ff21-45b8-93de-0a2577a61f5f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xf7v7" Jul 27 20:22:50.875752 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:50.875636 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2e4c67bd-ff21-45b8-93de-0a2577a61f5f-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-xf7v7\" (UID: \"2e4c67bd-ff21-45b8-93de-0a2577a61f5f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xf7v7" Jul 27 20:22:50.875752 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:50.875673 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2e4c67bd-ff21-45b8-93de-0a2577a61f5f-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-xf7v7\" (UID: \"2e4c67bd-ff21-45b8-93de-0a2577a61f5f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xf7v7" Jul 27 20:22:50.876247 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:50.876220 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2e4c67bd-ff21-45b8-93de-0a2577a61f5f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-xf7v7\" (UID: \"2e4c67bd-ff21-45b8-93de-0a2577a61f5f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xf7v7" Jul 27 20:22:50.877925 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:50.877905 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2e4c67bd-ff21-45b8-93de-0a2577a61f5f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-xf7v7\" (UID: \"2e4c67bd-ff21-45b8-93de-0a2577a61f5f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xf7v7" Jul 27 20:22:50.878034 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:50.878013 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e4c67bd-ff21-45b8-93de-0a2577a61f5f-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-xf7v7\" (UID: \"2e4c67bd-ff21-45b8-93de-0a2577a61f5f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xf7v7" Jul 27 20:22:50.878090 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:50.878065 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2e4c67bd-ff21-45b8-93de-0a2577a61f5f-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-xf7v7\" (UID: \"2e4c67bd-ff21-45b8-93de-0a2577a61f5f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xf7v7" Jul 27 20:22:50.878123 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:50.878071 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2e4c67bd-ff21-45b8-93de-0a2577a61f5f-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-xf7v7\" (UID: \"2e4c67bd-ff21-45b8-93de-0a2577a61f5f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xf7v7" Jul 27 20:22:50.894334 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:50.894314 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmjnf\" (UniqueName: \"kubernetes.io/projected/2e4c67bd-ff21-45b8-93de-0a2577a61f5f-kube-api-access-mmjnf\") pod \"istiod-openshift-gateway-5677ccb49b-xf7v7\" (UID: \"2e4c67bd-ff21-45b8-93de-0a2577a61f5f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xf7v7" Jul 27 20:22:50.894863 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:50.894844 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e4c67bd-ff21-45b8-93de-0a2577a61f5f-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-xf7v7\" (UID: \"2e4c67bd-ff21-45b8-93de-0a2577a61f5f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xf7v7" Jul 27 20:22:50.995469 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:50.995410 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xf7v7" Jul 27 20:22:51.124749 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:51.124725 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-xf7v7"] Jul 27 20:22:51.127034 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:22:51.127012 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e4c67bd_ff21_45b8_93de_0a2577a61f5f.slice/crio-31bdd481409a7ef93b26133f6b82097dd6a1b0c9a45517a898d88e9b69f103ee WatchSource:0}: Error finding container 31bdd481409a7ef93b26133f6b82097dd6a1b0c9a45517a898d88e9b69f103ee: Status 404 returned error can't find the container with id 31bdd481409a7ef93b26133f6b82097dd6a1b0c9a45517a898d88e9b69f103ee Jul 27 20:22:51.544765 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:51.544730 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-57bc674ff4-p65gg"] Jul 27 20:22:51.547427 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:51.547410 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-57bc674ff4-p65gg" Jul 27 20:22:51.551159 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:51.551141 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 27 20:22:51.551266 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:51.551182 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 27 20:22:51.551266 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:51.551216 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 27 20:22:51.551266 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:51.551219 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 27 20:22:51.551489 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:51.551473 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xd2vh\"" Jul 27 20:22:51.551578 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:51.551562 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 27 20:22:51.562271 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:51.562251 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-57bc674ff4-p65gg"] Jul 27 20:22:51.580658 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:51.580632 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqtfh\" (UniqueName: \"kubernetes.io/projected/575834d5-72af-432d-939f-ac1c257d7e2d-kube-api-access-rqtfh\") pod \"lws-controller-manager-57bc674ff4-p65gg\" (UID: \"575834d5-72af-432d-939f-ac1c257d7e2d\") " pod="openshift-lws-operator/lws-controller-manager-57bc674ff4-p65gg" Jul 27 20:22:51.580785 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:51.580664 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/575834d5-72af-432d-939f-ac1c257d7e2d-cert\") pod \"lws-controller-manager-57bc674ff4-p65gg\" (UID: \"575834d5-72af-432d-939f-ac1c257d7e2d\") " pod="openshift-lws-operator/lws-controller-manager-57bc674ff4-p65gg" Jul 27 20:22:51.580785 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:51.580706 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/575834d5-72af-432d-939f-ac1c257d7e2d-metrics-cert\") pod \"lws-controller-manager-57bc674ff4-p65gg\" (UID: \"575834d5-72af-432d-939f-ac1c257d7e2d\") " pod="openshift-lws-operator/lws-controller-manager-57bc674ff4-p65gg" Jul 27 20:22:51.580856 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:51.580808 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/575834d5-72af-432d-939f-ac1c257d7e2d-manager-config\") pod \"lws-controller-manager-57bc674ff4-p65gg\" (UID: \"575834d5-72af-432d-939f-ac1c257d7e2d\") " pod="openshift-lws-operator/lws-controller-manager-57bc674ff4-p65gg" Jul 27 20:22:51.682300 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:51.682258 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/575834d5-72af-432d-939f-ac1c257d7e2d-manager-config\") pod \"lws-controller-manager-57bc674ff4-p65gg\" (UID: \"575834d5-72af-432d-939f-ac1c257d7e2d\") " pod="openshift-lws-operator/lws-controller-manager-57bc674ff4-p65gg" Jul 27 20:22:51.683123 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:51.683096 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqtfh\" (UniqueName: \"kubernetes.io/projected/575834d5-72af-432d-939f-ac1c257d7e2d-kube-api-access-rqtfh\") pod \"lws-controller-manager-57bc674ff4-p65gg\" (UID: \"575834d5-72af-432d-939f-ac1c257d7e2d\") " pod="openshift-lws-operator/lws-controller-manager-57bc674ff4-p65gg" Jul 27 20:22:51.683264 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:51.683031 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/575834d5-72af-432d-939f-ac1c257d7e2d-manager-config\") pod \"lws-controller-manager-57bc674ff4-p65gg\" (UID: \"575834d5-72af-432d-939f-ac1c257d7e2d\") " pod="openshift-lws-operator/lws-controller-manager-57bc674ff4-p65gg" Jul 27 20:22:51.683264 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:51.683145 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/575834d5-72af-432d-939f-ac1c257d7e2d-cert\") pod \"lws-controller-manager-57bc674ff4-p65gg\" (UID: \"575834d5-72af-432d-939f-ac1c257d7e2d\") " pod="openshift-lws-operator/lws-controller-manager-57bc674ff4-p65gg" Jul 27 20:22:51.683264 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:51.683194 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/575834d5-72af-432d-939f-ac1c257d7e2d-metrics-cert\") pod \"lws-controller-manager-57bc674ff4-p65gg\" (UID: \"575834d5-72af-432d-939f-ac1c257d7e2d\") " pod="openshift-lws-operator/lws-controller-manager-57bc674ff4-p65gg" Jul 27 20:22:51.686112 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:51.686084 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/575834d5-72af-432d-939f-ac1c257d7e2d-cert\") pod \"lws-controller-manager-57bc674ff4-p65gg\" (UID: \"575834d5-72af-432d-939f-ac1c257d7e2d\") " pod="openshift-lws-operator/lws-controller-manager-57bc674ff4-p65gg" Jul 27 20:22:51.686274 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:51.686251 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/575834d5-72af-432d-939f-ac1c257d7e2d-metrics-cert\") pod \"lws-controller-manager-57bc674ff4-p65gg\" (UID: \"575834d5-72af-432d-939f-ac1c257d7e2d\") " pod="openshift-lws-operator/lws-controller-manager-57bc674ff4-p65gg" Jul 27 20:22:51.700826 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:51.700798 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqtfh\" (UniqueName: \"kubernetes.io/projected/575834d5-72af-432d-939f-ac1c257d7e2d-kube-api-access-rqtfh\") pod \"lws-controller-manager-57bc674ff4-p65gg\" (UID: \"575834d5-72af-432d-939f-ac1c257d7e2d\") " pod="openshift-lws-operator/lws-controller-manager-57bc674ff4-p65gg" Jul 27 20:22:51.857095 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:51.856997 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-57bc674ff4-p65gg" Jul 27 20:22:52.029250 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:52.029161 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-57bc674ff4-p65gg"] Jul 27 20:22:52.094286 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:52.094217 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xf7v7" event={"ID":"2e4c67bd-ff21-45b8-93de-0a2577a61f5f","Type":"ContainerStarted","Data":"31bdd481409a7ef93b26133f6b82097dd6a1b0c9a45517a898d88e9b69f103ee"} Jul 27 20:22:52.183548 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:22:52.183478 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod575834d5_72af_432d_939f_ac1c257d7e2d.slice/crio-48e2e83b2fd86347fc440df4411c4ba04251151263fa5b967fade13084afabcd WatchSource:0}: Error finding container 48e2e83b2fd86347fc440df4411c4ba04251151263fa5b967fade13084afabcd: Status 404 returned error can't find the container with id 48e2e83b2fd86347fc440df4411c4ba04251151263fa5b967fade13084afabcd Jul 27 20:22:52.489044 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:52.488925 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:22:52.590088 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:52.590051 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:22:52.824478 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:52.824423 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:22:52.923003 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:52.922966 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:22:53.099488 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:53.099410 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-57bc674ff4-p65gg" event={"ID":"575834d5-72af-432d-939f-ac1c257d7e2d","Type":"ContainerStarted","Data":"48e2e83b2fd86347fc440df4411c4ba04251151263fa5b967fade13084afabcd"} Jul 27 20:22:53.505618 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:53.505547 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:22:53.638934 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:53.638893 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 27 20:22:53.639053 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:53.638963 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 27 20:22:53.677739 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:53.677707 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:22:53.809483 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:53.809397 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:22:53.906310 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:53.906256 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:22:54.106143 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:54.106055 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xf7v7" event={"ID":"2e4c67bd-ff21-45b8-93de-0a2577a61f5f","Type":"ContainerStarted","Data":"e0a7f0f401c81184c0f037c74c84044a6d29a3a4bb1a50a40fe0a765a0d387d8"} Jul 27 20:22:54.106143 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:54.106119 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xf7v7" Jul 27 20:22:54.107889 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:54.107822 2558 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-xf7v7 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 27 20:22:54.107889 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:54.107879 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xf7v7" podUID="2e4c67bd-ff21-45b8-93de-0a2577a61f5f" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 27 20:22:54.131627 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:54.131579 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xf7v7" podStartSLOduration=1.6217862219999999 podStartE2EDuration="4.131566209s" totalImagesPullingTime="2.509779987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:22:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:22:54.12939768 +0000 UTC m=+316.707971273" watchObservedRunningTime="2026-07-27 20:22:54.131566209 +0000 UTC m=+316.710139798" Jul 27 20:22:54.359819 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:54.359683 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:22:54.585179 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:54.585123 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:22:55.059443 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:55.059392 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:22:55.110835 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:55.110809 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xf7v7" Jul 27 20:22:57.078747 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:22:57.078723 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-dm9lm" Jul 27 20:23:07.158853 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:23:07.158767 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-57bc674ff4-p65gg" event={"ID":"575834d5-72af-432d-939f-ac1c257d7e2d","Type":"ContainerStarted","Data":"b65ad33c18f9b649ec84a8893d5f3ca1ad958ee16f8ab7e30ef1bd673a467380"} Jul 27 20:23:07.159206 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:23:07.158901 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-57bc674ff4-p65gg" Jul 27 20:23:07.175446 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:23:07.175400 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-57bc674ff4-p65gg" podStartSLOduration=1.598532718 podStartE2EDuration="16.175385624s" totalImagesPullingTime="14.576852906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:22:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:23:07.173516661 +0000 UTC m=+329.752090250" watchObservedRunningTime="2026-07-27 20:23:07.175385624 +0000 UTC m=+329.753959213" Jul 27 20:23:18.165091 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:23:18.165064 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-57bc674ff4-p65gg" Jul 27 20:23:43.398138 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:23:43.398040 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:23:43.496554 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:23:43.496519 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:23:43.594359 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:23:43.594328 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:23:44.318102 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:23:44.318072 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:23:44.521986 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:23:44.521951 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:23:47.316092 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:23:47.316059 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:23:47.417444 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:23:47.417409 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:23:49.266085 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:23:49.266047 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:23:49.367109 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:23:49.367075 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:24:12.734521 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:24:12.734484 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:24:16.921473 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:24:16.921445 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:24:17.591325 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:24:17.591295 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:24:17.646884 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:24:17.646853 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:24:19.336180 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:24:19.336143 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:24:19.576481 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:24:19.576442 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:24:19.940920 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:24:19.940881 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:24:23.331790 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:24:23.331753 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:24:24.386869 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:24:24.386839 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:24:26.367594 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:24:26.367556 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:24:28.179756 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:24:28.179719 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:24:28.324138 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:24:28.324105 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:24:28.466946 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:24:28.466857 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:24:29.560555 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:24:29.560519 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:24:29.657745 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:24:29.657709 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:24:33.327981 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:24:33.327944 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:24:33.428335 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:24:33.428289 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:24:36.398554 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:24:36.398516 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:24:36.630363 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:24:36.630316 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:24:37.559668 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:24:37.559630 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:24:37.661020 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:24:37.660993 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:24:37.926834 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:24:37.926754 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:24:38.027405 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:24:38.027369 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:24:41.749292 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:24:41.749254 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:24:41.847886 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:24:41.847848 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:24:44.717379 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:24:44.717349 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:24:44.817954 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:24:44.817922 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:24:48.417517 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:24:48.417480 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:24:48.513431 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:24:48.513396 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:24:51.232371 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:24:51.232325 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:24:51.334001 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:24:51.333970 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:24:56.020522 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:24:56.020485 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:24:56.121377 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:24:56.121349 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:24:59.573654 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:24:59.573566 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:24:59.674264 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:24:59.674230 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:25:06.286752 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:25:06.286674 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:25:06.387290 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:25:06.387262 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:25:09.489252 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:25:09.489220 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:25:09.588614 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:25:09.588585 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:25:11.300680 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:25:11.300640 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:25:14.078324 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:25:14.078289 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:25:14.130656 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:25:14.130624 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:25:14.283050 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:25:14.283016 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:25:14.383283 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:25:14.383195 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:25:18.863207 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:25:18.863167 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:25:19.303105 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:25:19.303063 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:25:19.403958 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:25:19.403929 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:25:19.645596 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:25:19.645510 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:25:31.297176 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:25:31.297138 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:25:33.332480 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:25:33.332441 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:25:33.415117 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:25:33.415078 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:25:33.474970 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:25:33.474935 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:25:33.721314 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:25:33.721241 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:25:33.724253 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:25:33.724232 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-s6zgw" Jul 27 20:25:33.726790 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:25:33.726765 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9wrkj\"" Jul 27 20:25:33.726790 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:25:33.726781 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 27 20:25:33.726936 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:25:33.726810 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 27 20:25:33.727446 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:25:33.727433 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 27 20:25:33.734420 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:25:33.734393 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:25:33.762025 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:25:33.762002 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:25:33.831160 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:25:33.831137 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdjlb\" (UniqueName: \"kubernetes.io/projected/2f3f099d-3f98-4cae-8820-6c4d5b411aa3-kube-api-access-bdjlb\") pod \"limitador-limitador-54d6d988d5-s6zgw\" (UID: \"2f3f099d-3f98-4cae-8820-6c4d5b411aa3\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-s6zgw" Jul 27 20:25:33.831249 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:25:33.831172 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2f3f099d-3f98-4cae-8820-6c4d5b411aa3-config-file\") pod \"limitador-limitador-54d6d988d5-s6zgw\" (UID: \"2f3f099d-3f98-4cae-8820-6c4d5b411aa3\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-s6zgw" Jul 27 20:25:33.931711 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:25:33.931668 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdjlb\" (UniqueName: \"kubernetes.io/projected/2f3f099d-3f98-4cae-8820-6c4d5b411aa3-kube-api-access-bdjlb\") pod \"limitador-limitador-54d6d988d5-s6zgw\" (UID: \"2f3f099d-3f98-4cae-8820-6c4d5b411aa3\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-s6zgw" Jul 27 20:25:33.931867 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:25:33.931728 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2f3f099d-3f98-4cae-8820-6c4d5b411aa3-config-file\") pod \"limitador-limitador-54d6d988d5-s6zgw\" (UID: \"2f3f099d-3f98-4cae-8820-6c4d5b411aa3\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-s6zgw" Jul 27 20:25:33.932390 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:25:33.932364 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2f3f099d-3f98-4cae-8820-6c4d5b411aa3-config-file\") pod \"limitador-limitador-54d6d988d5-s6zgw\" (UID: \"2f3f099d-3f98-4cae-8820-6c4d5b411aa3\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-s6zgw" Jul 27 20:25:33.939328 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:25:33.939308 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdjlb\" (UniqueName: \"kubernetes.io/projected/2f3f099d-3f98-4cae-8820-6c4d5b411aa3-kube-api-access-bdjlb\") pod \"limitador-limitador-54d6d988d5-s6zgw\" (UID: \"2f3f099d-3f98-4cae-8820-6c4d5b411aa3\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-s6zgw" Jul 27 20:25:34.034901 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:25:34.034882 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-s6zgw" Jul 27 20:25:34.163530 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:25:34.163508 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:25:34.165561 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:25:34.165533 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f3f099d_3f98_4cae_8820_6c4d5b411aa3.slice/crio-5dd6c6fa7389aab816a33c77dbd01250da6b6d674832f63c5b7d1a9d2d8d188f WatchSource:0}: Error finding container 5dd6c6fa7389aab816a33c77dbd01250da6b6d674832f63c5b7d1a9d2d8d188f: Status 404 returned error can't find the container with id 5dd6c6fa7389aab816a33c77dbd01250da6b6d674832f63c5b7d1a9d2d8d188f Jul 27 20:25:34.166683 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:25:34.166645 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:25:34.228038 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:25:34.228014 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:25:34.684141 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:25:34.684104 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-s6zgw" event={"ID":"2f3f099d-3f98-4cae-8820-6c4d5b411aa3","Type":"ContainerStarted","Data":"5dd6c6fa7389aab816a33c77dbd01250da6b6d674832f63c5b7d1a9d2d8d188f"} Jul 27 20:25:37.699036 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:25:37.698996 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-s6zgw" event={"ID":"2f3f099d-3f98-4cae-8820-6c4d5b411aa3","Type":"ContainerStarted","Data":"4ebf6cc679e3d03233141f60b10bb257e425ae67176ed888d648b0291a774f1c"} Jul 27 20:25:37.699428 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:25:37.699145 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-s6zgw" Jul 27 20:25:37.715430 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:25:37.715379 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-s6zgw" podStartSLOduration=2.140681471 podStartE2EDuration="4.715364188s" totalImagesPullingTime="2.574682717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:25:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:25:37.715302542 +0000 UTC m=+480.293876131" watchObservedRunningTime="2026-07-27 20:25:37.715364188 +0000 UTC m=+480.293937778" Jul 27 20:25:48.704068 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:25:48.704040 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-s6zgw" Jul 27 20:25:52.967962 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:25:52.967925 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:25:53.065065 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:25:53.065020 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:25:53.419342 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:25:53.419309 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:26:05.075204 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:26:05.075163 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:26:05.626866 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:26:05.626833 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:26:11.869090 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:26:11.869026 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:26:11.936458 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:26:11.936426 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:26:11.996924 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:26:11.996889 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:26:14.981823 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:26:14.981787 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:26:15.080261 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:26:15.080229 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:26:45.562803 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:26:45.562712 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:26:45.661433 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:26:45.661396 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:26:46.117947 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:26:46.117905 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:26:46.785754 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:26:46.785723 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:26:46.882462 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:26:46.882423 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:26:47.064247 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:26:47.064176 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:26:47.185158 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:26:47.185123 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:26:58.064195 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:26:58.064160 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:26:58.163503 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:26:58.163466 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:27:04.447558 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:27:04.447524 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:27:04.916276 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:27:04.916242 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:27:17.833659 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:27:17.833622 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:27:18.715880 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:27:18.715843 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:27:20.014959 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:27:20.014919 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:27:20.070768 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:27:20.070733 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:27:20.860314 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:27:20.860276 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:27:29.029677 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:27:29.029637 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:27:30.023401 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:27:30.023366 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:27:37.800781 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:27:37.800754 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rnj2b_c421dc44-8fcf-44f4-b483-8e0271833d10/ovn-acl-logging/0.log" Jul 27 20:27:37.810892 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:27:37.810871 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rnj2b_c421dc44-8fcf-44f4-b483-8e0271833d10/ovn-acl-logging/0.log" Jul 27 20:27:45.334184 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:27:45.334151 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:27:46.815099 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:27:46.815059 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:28:22.792030 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:28:22.791994 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:28:22.892174 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:28:22.892139 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:28:25.110635 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:28:25.110602 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-5xm6m"] Jul 27 20:28:25.113713 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:28:25.113678 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xm6m" Jul 27 20:28:25.116144 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:28:25.116127 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 27 20:28:25.116242 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:28:25.116154 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-fvph7\"" Jul 27 20:28:25.117238 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:28:25.117221 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 27 20:28:25.117341 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:28:25.117269 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 27 20:28:25.125068 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:28:25.125049 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-5xm6m"] Jul 27 20:28:25.132360 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:28:25.132336 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:28:25.200966 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:28:25.200942 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bd79\" (UniqueName: \"kubernetes.io/projected/0f1c9cd4-74a9-40d2-b7ce-36b4918132e3-kube-api-access-2bd79\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5xm6m\" (UID: \"0f1c9cd4-74a9-40d2-b7ce-36b4918132e3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xm6m" Jul 27 20:28:25.201059 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:28:25.200983 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f1c9cd4-74a9-40d2-b7ce-36b4918132e3-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5xm6m\" (UID: \"0f1c9cd4-74a9-40d2-b7ce-36b4918132e3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xm6m" Jul 27 20:28:25.201059 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:28:25.201003 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f1c9cd4-74a9-40d2-b7ce-36b4918132e3-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5xm6m\" (UID: \"0f1c9cd4-74a9-40d2-b7ce-36b4918132e3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xm6m" Jul 27 20:28:25.201059 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:28:25.201024 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f1c9cd4-74a9-40d2-b7ce-36b4918132e3-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5xm6m\" (UID: \"0f1c9cd4-74a9-40d2-b7ce-36b4918132e3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xm6m" Jul 27 20:28:25.201161 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:28:25.201114 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f1c9cd4-74a9-40d2-b7ce-36b4918132e3-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5xm6m\" (UID: \"0f1c9cd4-74a9-40d2-b7ce-36b4918132e3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xm6m" Jul 27 20:28:25.201194 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:28:25.201159 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f1c9cd4-74a9-40d2-b7ce-36b4918132e3-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5xm6m\" (UID: \"0f1c9cd4-74a9-40d2-b7ce-36b4918132e3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xm6m" Jul 27 20:28:25.301792 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:28:25.301765 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f1c9cd4-74a9-40d2-b7ce-36b4918132e3-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5xm6m\" (UID: \"0f1c9cd4-74a9-40d2-b7ce-36b4918132e3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xm6m" Jul 27 20:28:25.301792 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:28:25.301796 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f1c9cd4-74a9-40d2-b7ce-36b4918132e3-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5xm6m\" (UID: \"0f1c9cd4-74a9-40d2-b7ce-36b4918132e3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xm6m" Jul 27 20:28:25.302076 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:28:25.301818 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f1c9cd4-74a9-40d2-b7ce-36b4918132e3-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5xm6m\" (UID: \"0f1c9cd4-74a9-40d2-b7ce-36b4918132e3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xm6m" Jul 27 20:28:25.302076 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:28:25.301843 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f1c9cd4-74a9-40d2-b7ce-36b4918132e3-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5xm6m\" (UID: \"0f1c9cd4-74a9-40d2-b7ce-36b4918132e3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xm6m" Jul 27 20:28:25.302076 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:28:25.301874 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f1c9cd4-74a9-40d2-b7ce-36b4918132e3-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5xm6m\" (UID: \"0f1c9cd4-74a9-40d2-b7ce-36b4918132e3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xm6m" Jul 27 20:28:25.302076 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:28:25.301893 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bd79\" (UniqueName: \"kubernetes.io/projected/0f1c9cd4-74a9-40d2-b7ce-36b4918132e3-kube-api-access-2bd79\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5xm6m\" (UID: \"0f1c9cd4-74a9-40d2-b7ce-36b4918132e3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xm6m" Jul 27 20:28:25.302288 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:28:25.302233 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f1c9cd4-74a9-40d2-b7ce-36b4918132e3-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5xm6m\" (UID: \"0f1c9cd4-74a9-40d2-b7ce-36b4918132e3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xm6m" Jul 27 20:28:25.302288 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:28:25.302267 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f1c9cd4-74a9-40d2-b7ce-36b4918132e3-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5xm6m\" (UID: \"0f1c9cd4-74a9-40d2-b7ce-36b4918132e3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xm6m" Jul 27 20:28:25.302288 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:28:25.302279 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f1c9cd4-74a9-40d2-b7ce-36b4918132e3-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5xm6m\" (UID: \"0f1c9cd4-74a9-40d2-b7ce-36b4918132e3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xm6m" Jul 27 20:28:25.304211 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:28:25.304190 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f1c9cd4-74a9-40d2-b7ce-36b4918132e3-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5xm6m\" (UID: \"0f1c9cd4-74a9-40d2-b7ce-36b4918132e3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xm6m" Jul 27 20:28:25.304457 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:28:25.304441 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f1c9cd4-74a9-40d2-b7ce-36b4918132e3-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5xm6m\" (UID: \"0f1c9cd4-74a9-40d2-b7ce-36b4918132e3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xm6m" Jul 27 20:28:25.310559 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:28:25.310542 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bd79\" (UniqueName: \"kubernetes.io/projected/0f1c9cd4-74a9-40d2-b7ce-36b4918132e3-kube-api-access-2bd79\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5xm6m\" (UID: \"0f1c9cd4-74a9-40d2-b7ce-36b4918132e3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xm6m" Jul 27 20:28:25.424398 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:28:25.424322 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xm6m" Jul 27 20:28:25.553628 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:28:25.553444 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-5xm6m"] Jul 27 20:28:25.556211 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:28:25.556184 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f1c9cd4_74a9_40d2_b7ce_36b4918132e3.slice/crio-94839a131528ae48018afb849c6bbf83a4a8a79907e638f4af89b9796f92eca7 WatchSource:0}: Error finding container 94839a131528ae48018afb849c6bbf83a4a8a79907e638f4af89b9796f92eca7: Status 404 returned error can't find the container with id 94839a131528ae48018afb849c6bbf83a4a8a79907e638f4af89b9796f92eca7 Jul 27 20:28:25.557569 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:28:25.557549 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 20:28:26.305139 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:28:26.305105 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xm6m" event={"ID":"0f1c9cd4-74a9-40d2-b7ce-36b4918132e3","Type":"ContainerStarted","Data":"94839a131528ae48018afb849c6bbf83a4a8a79907e638f4af89b9796f92eca7"} Jul 27 20:28:27.315775 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:28:27.315739 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xm6m" event={"ID":"0f1c9cd4-74a9-40d2-b7ce-36b4918132e3","Type":"ContainerStarted","Data":"ef1020d102ab6cd885e6df68a87f09ff6ea18e0152778bfc79bb1cda908e0224"} Jul 27 20:28:27.336045 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:28:27.335999 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xm6m" podStartSLOduration=1.359434081 podStartE2EDuration="2.335985182s" totalImagesPullingTime="976.551101ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:28:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:28:27.334852594 +0000 UTC m=+649.913426193" watchObservedRunningTime="2026-07-27 20:28:27.335985182 +0000 UTC m=+649.914558770" Jul 27 20:28:27.617625 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:28:27.617535 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:28:30.881604 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:28:30.881576 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:28:35.424611 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:28:35.424580 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xm6m" Jul 27 20:28:35.424997 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:28:35.424664 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xm6m" Jul 27 20:28:35.437028 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:28:35.437004 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xm6m" Jul 27 20:28:36.362309 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:28:36.362280 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xm6m" Jul 27 20:28:38.935770 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:28:38.935738 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:29:41.110020 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:29:41.109937 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:29:44.719786 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:29:44.719744 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:29:44.823921 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:29:44.823889 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:29:45.829049 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:29:45.829011 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:29:45.929989 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:29:45.929954 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:30:14.418275 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:30:14.418240 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:30:17.965424 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:30:17.965365 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:30:18.022162 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:30:18.022133 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:30:25.219375 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:30:25.219340 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:30:34.745865 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:30:34.745826 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:30:34.809545 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:30:34.809514 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:30:35.414998 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:30:35.414967 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:31:14.733631 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:31:14.733541 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:31:53.277655 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:31:53.277616 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:31:54.505640 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:31:54.505603 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:32:21.740865 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:32:21.740832 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:32:26.127707 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:32:26.127653 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:32:26.228896 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:32:26.228857 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:32:26.343547 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:32:26.343516 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:32:31.997461 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:32:31.997385 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:32:32.125157 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:32:32.125098 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:32:32.311708 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:32:32.311598 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:32:32.411776 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:32:32.411739 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:32:37.823622 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:32:37.823594 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rnj2b_c421dc44-8fcf-44f4-b483-8e0271833d10/ovn-acl-logging/0.log" Jul 27 20:32:37.830933 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:32:37.830913 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rnj2b_c421dc44-8fcf-44f4-b483-8e0271833d10/ovn-acl-logging/0.log" Jul 27 20:32:37.917530 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:32:37.917495 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:32:38.017445 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:32:38.017407 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:32:53.407727 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:32:53.407678 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:33:02.421060 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:33:02.421021 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:33:12.711621 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:33:12.711582 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:33:20.315441 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:33:20.315407 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:33:29.923338 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:33:29.923298 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:33:41.421135 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:33:41.421094 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:33:52.317116 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:33:52.317076 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:34:02.025590 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:34:02.025498 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:34:24.631700 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:34:24.631654 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:34:34.416222 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:34:34.416188 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:34:56.729642 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:34:56.729607 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:35:06.958926 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:35:06.958887 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:35:13.914476 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:35:13.914444 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:15.669513 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:35:15.669479 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:26.764580 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:35:26.764542 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:35:32.434226 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:35:32.434147 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:36.032500 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:35:36.032465 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:35:45.335211 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:35:45.335176 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:35:54.535442 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:35:54.535409 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:36:03.141192 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:36:03.137453 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:36:37.058465 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:36:37.058423 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:36:37.161458 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:36:37.161429 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:37:37.846242 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:37:37.846210 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rnj2b_c421dc44-8fcf-44f4-b483-8e0271833d10/ovn-acl-logging/0.log" Jul 27 20:37:37.852074 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:37:37.852051 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rnj2b_c421dc44-8fcf-44f4-b483-8e0271833d10/ovn-acl-logging/0.log" Jul 27 20:37:53.337993 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:37:53.337959 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:38:09.942573 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:38:09.942543 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:38:27.033340 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:38:27.033305 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:38:38.736637 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:38:38.736560 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:38:49.224250 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:38:49.224214 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:38:59.026366 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:38:59.026329 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:39:08.840501 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:39:08.840468 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:39:18.447176 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:39:18.447139 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:39:28.929412 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:39:28.929379 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:39:39.048234 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:39:39.048193 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:39:49.629885 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:39:49.629848 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:40:14.031484 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:40:14.031401 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:40:21.337789 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:40:21.337757 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:40:21.540662 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:40:21.540620 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:40:24.054608 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:40:24.054554 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:40:37.441293 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:40:37.441260 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:40:39.399856 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:40:39.399819 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:40:40.993719 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:40:40.993676 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:40:42.683052 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:40:42.683022 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:40:46.125512 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:40:46.125479 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:40:59.836749 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:40:59.836710 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:41:06.338062 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:41:06.338030 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:41:23.140514 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:41:23.140483 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:41:36.759915 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:41:36.759877 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:41:45.229541 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:41:45.229503 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:41:51.284107 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:41:51.284071 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:42:00.231729 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:42:00.231683 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:42:09.309373 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:42:09.309334 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:42:22.428520 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:42:22.428486 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:42:30.920405 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:42:30.920368 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:42:37.869330 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:42:37.869303 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rnj2b_c421dc44-8fcf-44f4-b483-8e0271833d10/ovn-acl-logging/0.log" Jul 27 20:42:37.872589 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:42:37.872568 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rnj2b_c421dc44-8fcf-44f4-b483-8e0271833d10/ovn-acl-logging/0.log" Jul 27 20:42:42.522898 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:42:42.522861 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:42:52.716410 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:42:52.716368 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:43:05.216062 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:43:05.215979 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:43:14.620808 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:43:14.620776 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:43:26.314813 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:43:26.314772 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:43:38.818345 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:43:38.818310 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:43:51.614241 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:43:51.614204 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:43:54.697356 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:43:54.697319 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:44:04.017951 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:44:04.017917 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:44:13.405709 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:44:13.405665 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:44:13.485112 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:44:13.485079 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:44:15.440425 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:44:15.440390 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:44:16.701579 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:44:16.701547 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:44:16.801526 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:44:16.801485 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:44:17.227334 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:44:17.227298 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:44:22.833557 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:44:22.833522 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:44:22.933421 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:44:22.933387 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:44:23.020014 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:44:23.019984 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:44:23.085321 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:44:23.085239 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:44:23.423658 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:44:23.423568 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:44:23.592761 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:44:23.592715 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:44:28.640498 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:44:28.640465 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:44:28.730407 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:44:28.730377 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:44:28.860651 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:44:28.860612 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:44:29.063996 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:44:29.063966 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:44:29.400878 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:44:29.400783 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:44:29.497511 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:44:29.497482 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:44:29.525845 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:44:29.525812 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-584365a2-7f4d47fdf6-tc2pr"] Jul 27 20:44:29.528937 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:44:29.528921 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-584365a2-7f4d47fdf6-tc2pr" Jul 27 20:44:29.531454 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:44:29.531433 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-584365a2\"" Jul 27 20:44:29.531596 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:44:29.531518 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-584365a2-dockercfg-d6mv6\"" Jul 27 20:44:29.539401 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:44:29.539379 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-584365a2-7f4d47fdf6-tc2pr"] Jul 27 20:44:29.680463 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:44:29.680390 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98e522a1-887f-4dcd-aef7-3c14e7530923-plugins-config-volume\") pod \"payload-processing-e2e-ait-584365a2-7f4d47fdf6-tc2pr\" (UID: \"98e522a1-887f-4dcd-aef7-3c14e7530923\") " pod="openshift-ingress/payload-processing-e2e-ait-584365a2-7f4d47fdf6-tc2pr" Jul 27 20:44:29.680463 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:44:29.680441 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmzlq\" (UniqueName: \"kubernetes.io/projected/98e522a1-887f-4dcd-aef7-3c14e7530923-kube-api-access-tmzlq\") pod \"payload-processing-e2e-ait-584365a2-7f4d47fdf6-tc2pr\" (UID: \"98e522a1-887f-4dcd-aef7-3c14e7530923\") " pod="openshift-ingress/payload-processing-e2e-ait-584365a2-7f4d47fdf6-tc2pr" Jul 27 20:44:29.781066 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:44:29.781040 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98e522a1-887f-4dcd-aef7-3c14e7530923-plugins-config-volume\") pod \"payload-processing-e2e-ait-584365a2-7f4d47fdf6-tc2pr\" (UID: \"98e522a1-887f-4dcd-aef7-3c14e7530923\") " pod="openshift-ingress/payload-processing-e2e-ait-584365a2-7f4d47fdf6-tc2pr" Jul 27 20:44:29.781184 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:44:29.781086 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmzlq\" (UniqueName: \"kubernetes.io/projected/98e522a1-887f-4dcd-aef7-3c14e7530923-kube-api-access-tmzlq\") pod \"payload-processing-e2e-ait-584365a2-7f4d47fdf6-tc2pr\" (UID: \"98e522a1-887f-4dcd-aef7-3c14e7530923\") " pod="openshift-ingress/payload-processing-e2e-ait-584365a2-7f4d47fdf6-tc2pr" Jul 27 20:44:29.781715 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:44:29.781675 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98e522a1-887f-4dcd-aef7-3c14e7530923-plugins-config-volume\") pod \"payload-processing-e2e-ait-584365a2-7f4d47fdf6-tc2pr\" (UID: \"98e522a1-887f-4dcd-aef7-3c14e7530923\") " pod="openshift-ingress/payload-processing-e2e-ait-584365a2-7f4d47fdf6-tc2pr" Jul 27 20:44:29.788475 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:44:29.788453 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmzlq\" (UniqueName: \"kubernetes.io/projected/98e522a1-887f-4dcd-aef7-3c14e7530923-kube-api-access-tmzlq\") pod \"payload-processing-e2e-ait-584365a2-7f4d47fdf6-tc2pr\" (UID: \"98e522a1-887f-4dcd-aef7-3c14e7530923\") " pod="openshift-ingress/payload-processing-e2e-ait-584365a2-7f4d47fdf6-tc2pr" Jul 27 20:44:29.840291 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:44:29.840271 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-584365a2-7f4d47fdf6-tc2pr" Jul 27 20:44:29.964794 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:44:29.964732 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-584365a2-7f4d47fdf6-tc2pr"] Jul 27 20:44:29.968137 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:44:29.968115 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98e522a1_887f_4dcd_aef7_3c14e7530923.slice/crio-b69617aaef57a752977ba94f6cf70d376cb07f4fe928aca0c4c8391edf5cbf08 WatchSource:0}: Error finding container b69617aaef57a752977ba94f6cf70d376cb07f4fe928aca0c4c8391edf5cbf08: Status 404 returned error can't find the container with id b69617aaef57a752977ba94f6cf70d376cb07f4fe928aca0c4c8391edf5cbf08 Jul 27 20:44:29.969937 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:44:29.969920 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 20:44:30.005312 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:44:30.005291 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-584365a2-7f4d47fdf6-tc2pr" event={"ID":"98e522a1-887f-4dcd-aef7-3c14e7530923","Type":"ContainerStarted","Data":"b69617aaef57a752977ba94f6cf70d376cb07f4fe928aca0c4c8391edf5cbf08"} Jul 27 20:44:33.019306 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:44:33.019269 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-584365a2-7f4d47fdf6-tc2pr" event={"ID":"98e522a1-887f-4dcd-aef7-3c14e7530923","Type":"ContainerStarted","Data":"ceabeac6651b5baedde8c8105339a07079701eb3da7f67293f67507b26b96ff1"} Jul 27 20:44:33.019679 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:44:33.019354 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-584365a2-7f4d47fdf6-tc2pr" Jul 27 20:44:33.035599 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:44:33.035555 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-584365a2-7f4d47fdf6-tc2pr" podStartSLOduration=1.9351100460000001 podStartE2EDuration="4.035541447s" totalImagesPullingTime="2.100431401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:44:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:44:33.033324967 +0000 UTC m=+1615.611898555" watchObservedRunningTime="2026-07-27 20:44:33.035541447 +0000 UTC m=+1615.614115045" Jul 27 20:44:33.114871 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:44:33.114849 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:44:44.025152 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:44:44.025120 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-584365a2-7f4d47fdf6-tc2pr" Jul 27 20:45:02.105238 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:02.105205 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:45:02.208586 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:02.208546 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:45:04.960794 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:04.960754 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:45:04.988238 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:04.988210 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-584365a2-7f4d47fdf6-tc2pr"] Jul 27 20:45:04.988485 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:04.988458 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-584365a2-7f4d47fdf6-tc2pr" podUID="98e522a1-887f-4dcd-aef7-3c14e7530923" containerName="payload-processing" containerID="cri-o://ceabeac6651b5baedde8c8105339a07079701eb3da7f67293f67507b26b96ff1" gracePeriod=30 Jul 27 20:45:05.057751 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:05.057722 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:45:05.112036 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:05.112007 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:45:05.147149 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:05.147117 2558 generic.go:356] "Generic (PLEG): container finished" podID="98e522a1-887f-4dcd-aef7-3c14e7530923" containerID="ceabeac6651b5baedde8c8105339a07079701eb3da7f67293f67507b26b96ff1" exitCode=0 Jul 27 20:45:05.147292 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:05.147185 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-584365a2-7f4d47fdf6-tc2pr" event={"ID":"98e522a1-887f-4dcd-aef7-3c14e7530923","Type":"ContainerDied","Data":"ceabeac6651b5baedde8c8105339a07079701eb3da7f67293f67507b26b96ff1"} Jul 27 20:45:05.232345 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:05.232321 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-584365a2-7f4d47fdf6-tc2pr" Jul 27 20:45:05.331682 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:05.331655 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmzlq\" (UniqueName: \"kubernetes.io/projected/98e522a1-887f-4dcd-aef7-3c14e7530923-kube-api-access-tmzlq\") pod \"98e522a1-887f-4dcd-aef7-3c14e7530923\" (UID: \"98e522a1-887f-4dcd-aef7-3c14e7530923\") " Jul 27 20:45:05.331824 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:05.331715 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98e522a1-887f-4dcd-aef7-3c14e7530923-plugins-config-volume\") pod \"98e522a1-887f-4dcd-aef7-3c14e7530923\" (UID: \"98e522a1-887f-4dcd-aef7-3c14e7530923\") " Jul 27 20:45:05.332091 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:05.332065 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98e522a1-887f-4dcd-aef7-3c14e7530923-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "98e522a1-887f-4dcd-aef7-3c14e7530923" (UID: "98e522a1-887f-4dcd-aef7-3c14e7530923"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:45:05.333714 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:05.333680 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98e522a1-887f-4dcd-aef7-3c14e7530923-kube-api-access-tmzlq" (OuterVolumeSpecName: "kube-api-access-tmzlq") pod "98e522a1-887f-4dcd-aef7-3c14e7530923" (UID: "98e522a1-887f-4dcd-aef7-3c14e7530923"). InnerVolumeSpecName "kube-api-access-tmzlq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:45:05.432126 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:05.432093 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmzlq\" (UniqueName: \"kubernetes.io/projected/98e522a1-887f-4dcd-aef7-3c14e7530923-kube-api-access-tmzlq\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 20:45:05.432126 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:05.432118 2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98e522a1-887f-4dcd-aef7-3c14e7530923-plugins-config-volume\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 20:45:06.152268 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:06.152244 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-584365a2-7f4d47fdf6-tc2pr" Jul 27 20:45:06.152639 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:06.152234 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-584365a2-7f4d47fdf6-tc2pr" event={"ID":"98e522a1-887f-4dcd-aef7-3c14e7530923","Type":"ContainerDied","Data":"b69617aaef57a752977ba94f6cf70d376cb07f4fe928aca0c4c8391edf5cbf08"} Jul 27 20:45:06.152639 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:06.152384 2558 scope.go:117] "RemoveContainer" containerID="ceabeac6651b5baedde8c8105339a07079701eb3da7f67293f67507b26b96ff1" Jul 27 20:45:06.171115 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:06.171094 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-584365a2-7f4d47fdf6-tc2pr"] Jul 27 20:45:06.174508 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:06.174487 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-584365a2-7f4d47fdf6-tc2pr"] Jul 27 20:45:07.912471 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:07.912440 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:45:07.937230 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:07.937197 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98e522a1-887f-4dcd-aef7-3c14e7530923" path="/var/lib/kubelet/pods/98e522a1-887f-4dcd-aef7-3c14e7530923/volumes" Jul 27 20:45:09.529329 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:09.529283 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:45:09.697813 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:09.697782 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:45:09.916142 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:09.916062 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:45:10.177181 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:10.177088 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:45:10.272515 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:10.272478 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:45:10.371117 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:10.371087 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:45:10.683667 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:10.683622 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:45:10.976759 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:10.976655 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:45:12.931735 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:12.931701 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:45:13.052485 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:13.052448 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:45:13.535277 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:13.535235 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:45:13.629054 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:13.629011 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:45:13.632128 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:13.632103 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-944cd4c8-6d898bcd44-b8bbv"] Jul 27 20:45:13.632419 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:13.632407 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98e522a1-887f-4dcd-aef7-3c14e7530923" containerName="payload-processing" Jul 27 20:45:13.632465 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:13.632420 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="98e522a1-887f-4dcd-aef7-3c14e7530923" containerName="payload-processing" Jul 27 20:45:13.632499 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:13.632472 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="98e522a1-887f-4dcd-aef7-3c14e7530923" containerName="payload-processing" Jul 27 20:45:13.635241 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:13.635224 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-944cd4c8-6d898bcd44-b8bbv" Jul 27 20:45:13.637563 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:13.637544 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-944cd4c8\"" Jul 27 20:45:13.637683 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:13.637594 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-944cd4c8-dockercfg-lt48v\"" Jul 27 20:45:13.644718 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:13.644683 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-944cd4c8-6d898bcd44-b8bbv"] Jul 27 20:45:13.663572 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:13.663544 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-944cd4c8-8657bf7c77-cw7m8"] Jul 27 20:45:13.666643 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:13.666628 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-944cd4c8-8657bf7c77-cw7m8" Jul 27 20:45:13.675775 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:13.675756 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-944cd4c8-8657bf7c77-cw7m8"] Jul 27 20:45:13.695243 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:13.695217 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4plb\" (UniqueName: \"kubernetes.io/projected/cd494566-58d6-471d-8a8d-76115e9acd49-kube-api-access-p4plb\") pod \"payload-processing-e2e-migrate-944cd4c8-8657bf7c77-cw7m8\" (UID: \"cd494566-58d6-471d-8a8d-76115e9acd49\") " pod="openshift-ingress/payload-processing-e2e-migrate-944cd4c8-8657bf7c77-cw7m8" Jul 27 20:45:13.695356 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:13.695279 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b7f4\" (UniqueName: \"kubernetes.io/projected/e09f2059-c805-4402-be90-ba6f08872b20-kube-api-access-5b7f4\") pod \"payload-pre-processing-e2e-migrate-944cd4c8-6d898bcd44-b8bbv\" (UID: \"e09f2059-c805-4402-be90-ba6f08872b20\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-944cd4c8-6d898bcd44-b8bbv" Jul 27 20:45:13.695421 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:13.695364 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd494566-58d6-471d-8a8d-76115e9acd49-plugins-config-volume\") pod \"payload-processing-e2e-migrate-944cd4c8-8657bf7c77-cw7m8\" (UID: \"cd494566-58d6-471d-8a8d-76115e9acd49\") " pod="openshift-ingress/payload-processing-e2e-migrate-944cd4c8-8657bf7c77-cw7m8" Jul 27 20:45:13.695421 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:13.695407 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e09f2059-c805-4402-be90-ba6f08872b20-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-944cd4c8-6d898bcd44-b8bbv\" (UID: \"e09f2059-c805-4402-be90-ba6f08872b20\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-944cd4c8-6d898bcd44-b8bbv" Jul 27 20:45:13.796001 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:13.795892 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b7f4\" (UniqueName: \"kubernetes.io/projected/e09f2059-c805-4402-be90-ba6f08872b20-kube-api-access-5b7f4\") pod \"payload-pre-processing-e2e-migrate-944cd4c8-6d898bcd44-b8bbv\" (UID: \"e09f2059-c805-4402-be90-ba6f08872b20\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-944cd4c8-6d898bcd44-b8bbv" Jul 27 20:45:13.796001 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:13.795968 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd494566-58d6-471d-8a8d-76115e9acd49-plugins-config-volume\") pod \"payload-processing-e2e-migrate-944cd4c8-8657bf7c77-cw7m8\" (UID: \"cd494566-58d6-471d-8a8d-76115e9acd49\") " pod="openshift-ingress/payload-processing-e2e-migrate-944cd4c8-8657bf7c77-cw7m8" Jul 27 20:45:13.796267 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:13.796006 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e09f2059-c805-4402-be90-ba6f08872b20-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-944cd4c8-6d898bcd44-b8bbv\" (UID: \"e09f2059-c805-4402-be90-ba6f08872b20\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-944cd4c8-6d898bcd44-b8bbv" Jul 27 20:45:13.796267 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:13.796038 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4plb\" (UniqueName: \"kubernetes.io/projected/cd494566-58d6-471d-8a8d-76115e9acd49-kube-api-access-p4plb\") pod \"payload-processing-e2e-migrate-944cd4c8-8657bf7c77-cw7m8\" (UID: \"cd494566-58d6-471d-8a8d-76115e9acd49\") " pod="openshift-ingress/payload-processing-e2e-migrate-944cd4c8-8657bf7c77-cw7m8" Jul 27 20:45:13.796838 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:13.796814 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e09f2059-c805-4402-be90-ba6f08872b20-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-944cd4c8-6d898bcd44-b8bbv\" (UID: \"e09f2059-c805-4402-be90-ba6f08872b20\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-944cd4c8-6d898bcd44-b8bbv" Jul 27 20:45:13.796930 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:13.796820 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd494566-58d6-471d-8a8d-76115e9acd49-plugins-config-volume\") pod \"payload-processing-e2e-migrate-944cd4c8-8657bf7c77-cw7m8\" (UID: \"cd494566-58d6-471d-8a8d-76115e9acd49\") " pod="openshift-ingress/payload-processing-e2e-migrate-944cd4c8-8657bf7c77-cw7m8" Jul 27 20:45:13.804003 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:13.803977 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b7f4\" (UniqueName: \"kubernetes.io/projected/e09f2059-c805-4402-be90-ba6f08872b20-kube-api-access-5b7f4\") pod \"payload-pre-processing-e2e-migrate-944cd4c8-6d898bcd44-b8bbv\" (UID: \"e09f2059-c805-4402-be90-ba6f08872b20\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-944cd4c8-6d898bcd44-b8bbv" Jul 27 20:45:13.804114 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:13.804012 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4plb\" (UniqueName: \"kubernetes.io/projected/cd494566-58d6-471d-8a8d-76115e9acd49-kube-api-access-p4plb\") pod \"payload-processing-e2e-migrate-944cd4c8-8657bf7c77-cw7m8\" (UID: \"cd494566-58d6-471d-8a8d-76115e9acd49\") " pod="openshift-ingress/payload-processing-e2e-migrate-944cd4c8-8657bf7c77-cw7m8" Jul 27 20:45:13.946558 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:13.946526 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-944cd4c8-6d898bcd44-b8bbv" Jul 27 20:45:13.978111 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:13.978078 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-944cd4c8-8657bf7c77-cw7m8" Jul 27 20:45:13.992772 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:13.992675 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:45:14.089442 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:14.089403 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-944cd4c8-6d898bcd44-b8bbv"] Jul 27 20:45:14.092568 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:45:14.092528 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode09f2059_c805_4402_be90_ba6f08872b20.slice/crio-5973bfbada94e2ea78855427238cd26ff6f7174b3ac252c3a94624c95c936de7 WatchSource:0}: Error finding container 5973bfbada94e2ea78855427238cd26ff6f7174b3ac252c3a94624c95c936de7: Status 404 returned error can't find the container with id 5973bfbada94e2ea78855427238cd26ff6f7174b3ac252c3a94624c95c936de7 Jul 27 20:45:14.128803 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:14.128770 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-944cd4c8-8657bf7c77-cw7m8"] Jul 27 20:45:14.131665 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:45:14.131638 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd494566_58d6_471d_8a8d_76115e9acd49.slice/crio-1e351ab92c6eed3c7781a4426aeb1ffd1e2ce47b85b742991e509d057909c0fd WatchSource:0}: Error finding container 1e351ab92c6eed3c7781a4426aeb1ffd1e2ce47b85b742991e509d057909c0fd: Status 404 returned error can't find the container with id 1e351ab92c6eed3c7781a4426aeb1ffd1e2ce47b85b742991e509d057909c0fd Jul 27 20:45:14.185279 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:14.185250 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-944cd4c8-8657bf7c77-cw7m8" event={"ID":"cd494566-58d6-471d-8a8d-76115e9acd49","Type":"ContainerStarted","Data":"45126e8ed88c40cb36a85b2e93bb01a163c79d33ea1e2652e452a6856550c67b"} Jul 27 20:45:14.185394 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:14.185308 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-944cd4c8-8657bf7c77-cw7m8" event={"ID":"cd494566-58d6-471d-8a8d-76115e9acd49","Type":"ContainerStarted","Data":"1e351ab92c6eed3c7781a4426aeb1ffd1e2ce47b85b742991e509d057909c0fd"} Jul 27 20:45:14.185394 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:14.185351 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-944cd4c8-8657bf7c77-cw7m8" Jul 27 20:45:14.186908 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:14.186887 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-944cd4c8-6d898bcd44-b8bbv" event={"ID":"e09f2059-c805-4402-be90-ba6f08872b20","Type":"ContainerStarted","Data":"b21233be4f7eeb89be2e1b78c5ca755c372773d3133ff2373a4449b97da53a88"} Jul 27 20:45:14.187002 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:14.186931 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-944cd4c8-6d898bcd44-b8bbv" Jul 27 20:45:14.187002 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:14.186951 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-944cd4c8-6d898bcd44-b8bbv" event={"ID":"e09f2059-c805-4402-be90-ba6f08872b20","Type":"ContainerStarted","Data":"5973bfbada94e2ea78855427238cd26ff6f7174b3ac252c3a94624c95c936de7"} Jul 27 20:45:14.200082 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:14.200024 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-944cd4c8-8657bf7c77-cw7m8" podStartSLOduration=1.200006248 podStartE2EDuration="1.200006248s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:45:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:45:14.199282193 +0000 UTC m=+1656.777855786" watchObservedRunningTime="2026-07-27 20:45:14.200006248 +0000 UTC m=+1656.778579837" Jul 27 20:45:14.214323 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:14.214281 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-944cd4c8-6d898bcd44-b8bbv" podStartSLOduration=1.214267189 podStartE2EDuration="1.214267189s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:45:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:45:14.212857289 +0000 UTC m=+1656.791430878" watchObservedRunningTime="2026-07-27 20:45:14.214267189 +0000 UTC m=+1656.792840778" Jul 27 20:45:16.014941 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:16.014906 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:45:25.193867 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:25.193837 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-944cd4c8-8657bf7c77-cw7m8" Jul 27 20:45:25.194318 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:25.193937 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-944cd4c8-6d898bcd44-b8bbv" Jul 27 20:45:29.435222 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:29.435178 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:45:48.371858 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:48.371827 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:45:48.389091 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:48.389061 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-944cd4c8-8657bf7c77-cw7m8"] Jul 27 20:45:48.389352 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:48.389327 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-944cd4c8-8657bf7c77-cw7m8" podUID="cd494566-58d6-471d-8a8d-76115e9acd49" containerName="payload-processing" containerID="cri-o://45126e8ed88c40cb36a85b2e93bb01a163c79d33ea1e2652e452a6856550c67b" gracePeriod=30 Jul 27 20:45:48.395465 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:48.395441 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-944cd4c8-6d898bcd44-b8bbv"] Jul 27 20:45:48.395852 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:48.395825 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-944cd4c8-6d898bcd44-b8bbv" podUID="e09f2059-c805-4402-be90-ba6f08872b20" containerName="payload-pre-processing" containerID="cri-o://b21233be4f7eeb89be2e1b78c5ca755c372773d3133ff2373a4449b97da53a88" gracePeriod=30 Jul 27 20:45:48.472105 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:48.472083 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:45:48.657748 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:48.657727 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-944cd4c8-8657bf7c77-cw7m8" Jul 27 20:45:48.660529 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:48.660514 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-944cd4c8-6d898bcd44-b8bbv" Jul 27 20:45:48.767805 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:48.767774 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd494566-58d6-471d-8a8d-76115e9acd49-plugins-config-volume\") pod \"cd494566-58d6-471d-8a8d-76115e9acd49\" (UID: \"cd494566-58d6-471d-8a8d-76115e9acd49\") " Jul 27 20:45:48.767805 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:48.767810 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p4plb\" (UniqueName: \"kubernetes.io/projected/cd494566-58d6-471d-8a8d-76115e9acd49-kube-api-access-p4plb\") pod \"cd494566-58d6-471d-8a8d-76115e9acd49\" (UID: \"cd494566-58d6-471d-8a8d-76115e9acd49\") " Jul 27 20:45:48.768007 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:48.767836 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e09f2059-c805-4402-be90-ba6f08872b20-plugins-config-volume\") pod \"e09f2059-c805-4402-be90-ba6f08872b20\" (UID: \"e09f2059-c805-4402-be90-ba6f08872b20\") " Jul 27 20:45:48.768007 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:48.767956 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5b7f4\" (UniqueName: \"kubernetes.io/projected/e09f2059-c805-4402-be90-ba6f08872b20-kube-api-access-5b7f4\") pod \"e09f2059-c805-4402-be90-ba6f08872b20\" (UID: \"e09f2059-c805-4402-be90-ba6f08872b20\") " Jul 27 20:45:48.768208 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:48.768179 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd494566-58d6-471d-8a8d-76115e9acd49-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cd494566-58d6-471d-8a8d-76115e9acd49" (UID: "cd494566-58d6-471d-8a8d-76115e9acd49"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:45:48.768258 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:48.768211 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e09f2059-c805-4402-be90-ba6f08872b20-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e09f2059-c805-4402-be90-ba6f08872b20" (UID: "e09f2059-c805-4402-be90-ba6f08872b20"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:45:48.769968 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:48.769943 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e09f2059-c805-4402-be90-ba6f08872b20-kube-api-access-5b7f4" (OuterVolumeSpecName: "kube-api-access-5b7f4") pod "e09f2059-c805-4402-be90-ba6f08872b20" (UID: "e09f2059-c805-4402-be90-ba6f08872b20"). InnerVolumeSpecName "kube-api-access-5b7f4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:45:48.769968 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:48.769953 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd494566-58d6-471d-8a8d-76115e9acd49-kube-api-access-p4plb" (OuterVolumeSpecName: "kube-api-access-p4plb") pod "cd494566-58d6-471d-8a8d-76115e9acd49" (UID: "cd494566-58d6-471d-8a8d-76115e9acd49"). InnerVolumeSpecName "kube-api-access-p4plb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:45:48.869328 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:48.869298 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5b7f4\" (UniqueName: \"kubernetes.io/projected/e09f2059-c805-4402-be90-ba6f08872b20-kube-api-access-5b7f4\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 20:45:48.869328 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:48.869322 2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd494566-58d6-471d-8a8d-76115e9acd49-plugins-config-volume\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 20:45:48.869328 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:48.869331 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p4plb\" (UniqueName: \"kubernetes.io/projected/cd494566-58d6-471d-8a8d-76115e9acd49-kube-api-access-p4plb\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 20:45:48.869509 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:48.869340 2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e09f2059-c805-4402-be90-ba6f08872b20-plugins-config-volume\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 20:45:49.331330 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:49.331294 2558 generic.go:356] "Generic (PLEG): container finished" podID="cd494566-58d6-471d-8a8d-76115e9acd49" containerID="45126e8ed88c40cb36a85b2e93bb01a163c79d33ea1e2652e452a6856550c67b" exitCode=0 Jul 27 20:45:49.331512 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:49.331345 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-944cd4c8-8657bf7c77-cw7m8" Jul 27 20:45:49.331512 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:49.331381 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-944cd4c8-8657bf7c77-cw7m8" event={"ID":"cd494566-58d6-471d-8a8d-76115e9acd49","Type":"ContainerDied","Data":"45126e8ed88c40cb36a85b2e93bb01a163c79d33ea1e2652e452a6856550c67b"} Jul 27 20:45:49.331512 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:49.331441 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-944cd4c8-8657bf7c77-cw7m8" event={"ID":"cd494566-58d6-471d-8a8d-76115e9acd49","Type":"ContainerDied","Data":"1e351ab92c6eed3c7781a4426aeb1ffd1e2ce47b85b742991e509d057909c0fd"} Jul 27 20:45:49.331512 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:49.331474 2558 scope.go:117] "RemoveContainer" containerID="45126e8ed88c40cb36a85b2e93bb01a163c79d33ea1e2652e452a6856550c67b" Jul 27 20:45:49.332679 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:49.332587 2558 generic.go:356] "Generic (PLEG): container finished" podID="e09f2059-c805-4402-be90-ba6f08872b20" containerID="b21233be4f7eeb89be2e1b78c5ca755c372773d3133ff2373a4449b97da53a88" exitCode=0 Jul 27 20:45:49.332679 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:49.332614 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-944cd4c8-6d898bcd44-b8bbv" event={"ID":"e09f2059-c805-4402-be90-ba6f08872b20","Type":"ContainerDied","Data":"b21233be4f7eeb89be2e1b78c5ca755c372773d3133ff2373a4449b97da53a88"} Jul 27 20:45:49.332679 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:49.332655 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-944cd4c8-6d898bcd44-b8bbv" event={"ID":"e09f2059-c805-4402-be90-ba6f08872b20","Type":"ContainerDied","Data":"5973bfbada94e2ea78855427238cd26ff6f7174b3ac252c3a94624c95c936de7"} Jul 27 20:45:49.332679 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:49.332654 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-944cd4c8-6d898bcd44-b8bbv" Jul 27 20:45:49.340700 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:49.340671 2558 scope.go:117] "RemoveContainer" containerID="45126e8ed88c40cb36a85b2e93bb01a163c79d33ea1e2652e452a6856550c67b" Jul 27 20:45:49.341004 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:45:49.340930 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45126e8ed88c40cb36a85b2e93bb01a163c79d33ea1e2652e452a6856550c67b\": container with ID starting with 45126e8ed88c40cb36a85b2e93bb01a163c79d33ea1e2652e452a6856550c67b not found: ID does not exist" containerID="45126e8ed88c40cb36a85b2e93bb01a163c79d33ea1e2652e452a6856550c67b" Jul 27 20:45:49.341004 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:49.340953 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45126e8ed88c40cb36a85b2e93bb01a163c79d33ea1e2652e452a6856550c67b"} err="failed to get container status \"45126e8ed88c40cb36a85b2e93bb01a163c79d33ea1e2652e452a6856550c67b\": rpc error: code = NotFound desc = could not find container \"45126e8ed88c40cb36a85b2e93bb01a163c79d33ea1e2652e452a6856550c67b\": container with ID starting with 45126e8ed88c40cb36a85b2e93bb01a163c79d33ea1e2652e452a6856550c67b not found: ID does not exist" Jul 27 20:45:49.341004 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:49.340968 2558 scope.go:117] "RemoveContainer" containerID="b21233be4f7eeb89be2e1b78c5ca755c372773d3133ff2373a4449b97da53a88" Jul 27 20:45:49.348334 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:49.348314 2558 scope.go:117] "RemoveContainer" containerID="b21233be4f7eeb89be2e1b78c5ca755c372773d3133ff2373a4449b97da53a88" Jul 27 20:45:49.348542 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:45:49.348524 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b21233be4f7eeb89be2e1b78c5ca755c372773d3133ff2373a4449b97da53a88\": container with ID starting with b21233be4f7eeb89be2e1b78c5ca755c372773d3133ff2373a4449b97da53a88 not found: ID does not exist" containerID="b21233be4f7eeb89be2e1b78c5ca755c372773d3133ff2373a4449b97da53a88" Jul 27 20:45:49.348598 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:49.348549 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b21233be4f7eeb89be2e1b78c5ca755c372773d3133ff2373a4449b97da53a88"} err="failed to get container status \"b21233be4f7eeb89be2e1b78c5ca755c372773d3133ff2373a4449b97da53a88\": rpc error: code = NotFound desc = could not find container \"b21233be4f7eeb89be2e1b78c5ca755c372773d3133ff2373a4449b97da53a88\": container with ID starting with b21233be4f7eeb89be2e1b78c5ca755c372773d3133ff2373a4449b97da53a88 not found: ID does not exist" Jul 27 20:45:49.354750 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:49.354728 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-944cd4c8-8657bf7c77-cw7m8"] Jul 27 20:45:49.359536 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:49.359517 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-944cd4c8-8657bf7c77-cw7m8"] Jul 27 20:45:49.369234 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:49.369215 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-944cd4c8-6d898bcd44-b8bbv"] Jul 27 20:45:49.377832 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:49.373967 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-944cd4c8-6d898bcd44-b8bbv"] Jul 27 20:45:49.934021 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:49.933991 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd494566-58d6-471d-8a8d-76115e9acd49" path="/var/lib/kubelet/pods/cd494566-58d6-471d-8a8d-76115e9acd49/volumes" Jul 27 20:45:49.934356 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:49.934343 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e09f2059-c805-4402-be90-ba6f08872b20" path="/var/lib/kubelet/pods/e09f2059-c805-4402-be90-ba6f08872b20/volumes" Jul 27 20:45:51.309995 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:51.309958 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:45:52.998218 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:52.998177 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:45:53.194914 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:53.194857 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:45:53.412549 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:53.412471 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:45:53.640076 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:53.640019 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:45:53.953660 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:53.953623 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:45:54.083753 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:54.083716 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:45:56.053022 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:56.052987 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:45:56.135807 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:56.135770 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:45:56.224651 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:56.224609 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:45:56.499355 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:56.499319 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:45:56.869133 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:56.869053 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:45:56.969254 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:56.969224 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3ac3244c-7cbffcfc8d-kx7s4"] Jul 27 20:45:56.969438 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:56.969371 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:45:56.969604 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:56.969589 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd494566-58d6-471d-8a8d-76115e9acd49" containerName="payload-processing" Jul 27 20:45:56.969668 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:56.969606 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd494566-58d6-471d-8a8d-76115e9acd49" containerName="payload-processing" Jul 27 20:45:56.969668 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:56.969622 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e09f2059-c805-4402-be90-ba6f08872b20" containerName="payload-pre-processing" Jul 27 20:45:56.969668 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:56.969627 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e09f2059-c805-4402-be90-ba6f08872b20" containerName="payload-pre-processing" Jul 27 20:45:56.969800 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:56.969670 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e09f2059-c805-4402-be90-ba6f08872b20" containerName="payload-pre-processing" Jul 27 20:45:56.969800 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:56.969678 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd494566-58d6-471d-8a8d-76115e9acd49" containerName="payload-processing" Jul 27 20:45:56.973765 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:56.973748 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-3ac3244c-7cbffcfc8d-kx7s4" Jul 27 20:45:56.976215 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:56.976191 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-3ac3244c\"" Jul 27 20:45:56.976318 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:56.976239 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-3ac3244c-dockercfg-k2729\"" Jul 27 20:45:56.992901 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:56.992881 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3ac3244c-7cbffcfc8d-kx7s4"] Jul 27 20:45:56.996537 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:56.996516 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-3ac3244c-56f978677d-tt9h9"] Jul 27 20:45:56.999536 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:56.999515 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-3ac3244c-56f978677d-tt9h9" Jul 27 20:45:57.010810 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:57.010790 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-3ac3244c-56f978677d-tt9h9"] Jul 27 20:45:57.135601 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:57.135529 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sttl\" (UniqueName: \"kubernetes.io/projected/67e2ce2c-360c-4614-aaac-b767243fe366-kube-api-access-9sttl\") pod \"payload-processing-e2e-ait-3ac3244c-56f978677d-tt9h9\" (UID: \"67e2ce2c-360c-4614-aaac-b767243fe366\") " pod="openshift-ingress/payload-processing-e2e-ait-3ac3244c-56f978677d-tt9h9" Jul 27 20:45:57.135601 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:57.135566 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/67e2ce2c-360c-4614-aaac-b767243fe366-plugins-config-volume\") pod \"payload-processing-e2e-ait-3ac3244c-56f978677d-tt9h9\" (UID: \"67e2ce2c-360c-4614-aaac-b767243fe366\") " pod="openshift-ingress/payload-processing-e2e-ait-3ac3244c-56f978677d-tt9h9" Jul 27 20:45:57.136009 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:57.135631 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgd8m\" (UniqueName: \"kubernetes.io/projected/5ec74a1c-caa8-4407-971f-d26c6423ccb8-kube-api-access-vgd8m\") pod \"payload-pre-processing-e2e-ait-3ac3244c-7cbffcfc8d-kx7s4\" (UID: \"5ec74a1c-caa8-4407-971f-d26c6423ccb8\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3ac3244c-7cbffcfc8d-kx7s4" Jul 27 20:45:57.136009 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:57.135708 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ec74a1c-caa8-4407-971f-d26c6423ccb8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-3ac3244c-7cbffcfc8d-kx7s4\" (UID: \"5ec74a1c-caa8-4407-971f-d26c6423ccb8\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3ac3244c-7cbffcfc8d-kx7s4" Jul 27 20:45:57.236642 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:57.236615 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/67e2ce2c-360c-4614-aaac-b767243fe366-plugins-config-volume\") pod \"payload-processing-e2e-ait-3ac3244c-56f978677d-tt9h9\" (UID: \"67e2ce2c-360c-4614-aaac-b767243fe366\") " pod="openshift-ingress/payload-processing-e2e-ait-3ac3244c-56f978677d-tt9h9" Jul 27 20:45:57.237134 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:57.236912 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgd8m\" (UniqueName: \"kubernetes.io/projected/5ec74a1c-caa8-4407-971f-d26c6423ccb8-kube-api-access-vgd8m\") pod \"payload-pre-processing-e2e-ait-3ac3244c-7cbffcfc8d-kx7s4\" (UID: \"5ec74a1c-caa8-4407-971f-d26c6423ccb8\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3ac3244c-7cbffcfc8d-kx7s4" Jul 27 20:45:57.237363 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:57.237306 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ec74a1c-caa8-4407-971f-d26c6423ccb8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-3ac3244c-7cbffcfc8d-kx7s4\" (UID: \"5ec74a1c-caa8-4407-971f-d26c6423ccb8\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3ac3244c-7cbffcfc8d-kx7s4" Jul 27 20:45:57.237484 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:57.237417 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sttl\" (UniqueName: \"kubernetes.io/projected/67e2ce2c-360c-4614-aaac-b767243fe366-kube-api-access-9sttl\") pod \"payload-processing-e2e-ait-3ac3244c-56f978677d-tt9h9\" (UID: \"67e2ce2c-360c-4614-aaac-b767243fe366\") " pod="openshift-ingress/payload-processing-e2e-ait-3ac3244c-56f978677d-tt9h9" Jul 27 20:45:57.237827 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:57.237802 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/67e2ce2c-360c-4614-aaac-b767243fe366-plugins-config-volume\") pod \"payload-processing-e2e-ait-3ac3244c-56f978677d-tt9h9\" (UID: \"67e2ce2c-360c-4614-aaac-b767243fe366\") " pod="openshift-ingress/payload-processing-e2e-ait-3ac3244c-56f978677d-tt9h9" Jul 27 20:45:57.238480 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:57.238459 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ec74a1c-caa8-4407-971f-d26c6423ccb8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-3ac3244c-7cbffcfc8d-kx7s4\" (UID: \"5ec74a1c-caa8-4407-971f-d26c6423ccb8\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3ac3244c-7cbffcfc8d-kx7s4" Jul 27 20:45:57.245208 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:57.245184 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgd8m\" (UniqueName: \"kubernetes.io/projected/5ec74a1c-caa8-4407-971f-d26c6423ccb8-kube-api-access-vgd8m\") pod \"payload-pre-processing-e2e-ait-3ac3244c-7cbffcfc8d-kx7s4\" (UID: \"5ec74a1c-caa8-4407-971f-d26c6423ccb8\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3ac3244c-7cbffcfc8d-kx7s4" Jul 27 20:45:57.245490 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:57.245474 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sttl\" (UniqueName: \"kubernetes.io/projected/67e2ce2c-360c-4614-aaac-b767243fe366-kube-api-access-9sttl\") pod \"payload-processing-e2e-ait-3ac3244c-56f978677d-tt9h9\" (UID: \"67e2ce2c-360c-4614-aaac-b767243fe366\") " pod="openshift-ingress/payload-processing-e2e-ait-3ac3244c-56f978677d-tt9h9" Jul 27 20:45:57.283534 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:57.283511 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-3ac3244c-7cbffcfc8d-kx7s4" Jul 27 20:45:57.309569 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:57.309541 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-3ac3244c-56f978677d-tt9h9" Jul 27 20:45:57.424975 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:57.424925 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3ac3244c-7cbffcfc8d-kx7s4"] Jul 27 20:45:57.426937 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:45:57.426898 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ec74a1c_caa8_4407_971f_d26c6423ccb8.slice/crio-ff057b951c973de3dd60cd19c51241b78fb3c4cb8ba96c801aa3dfdde4b94f0f WatchSource:0}: Error finding container ff057b951c973de3dd60cd19c51241b78fb3c4cb8ba96c801aa3dfdde4b94f0f: Status 404 returned error can't find the container with id ff057b951c973de3dd60cd19c51241b78fb3c4cb8ba96c801aa3dfdde4b94f0f Jul 27 20:45:57.451018 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:57.450990 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-3ac3244c-56f978677d-tt9h9"] Jul 27 20:45:57.461617 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:45:57.461595 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67e2ce2c_360c_4614_aaac_b767243fe366.slice/crio-198537bbd8ac5ffd36aebd86756cea63a5b9d7d6a75ac19a46366db12c4ee2cb WatchSource:0}: Error finding container 198537bbd8ac5ffd36aebd86756cea63a5b9d7d6a75ac19a46366db12c4ee2cb: Status 404 returned error can't find the container with id 198537bbd8ac5ffd36aebd86756cea63a5b9d7d6a75ac19a46366db12c4ee2cb Jul 27 20:45:58.373452 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:58.373413 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-3ac3244c-56f978677d-tt9h9" event={"ID":"67e2ce2c-360c-4614-aaac-b767243fe366","Type":"ContainerStarted","Data":"0289ae7646b4a763e14911645c2f63ad80215091b1ef44cfbc233fa517dd0fe9"} Jul 27 20:45:58.373931 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:58.373473 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-3ac3244c-56f978677d-tt9h9" event={"ID":"67e2ce2c-360c-4614-aaac-b767243fe366","Type":"ContainerStarted","Data":"198537bbd8ac5ffd36aebd86756cea63a5b9d7d6a75ac19a46366db12c4ee2cb"} Jul 27 20:45:58.373931 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:58.373532 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-3ac3244c-56f978677d-tt9h9" Jul 27 20:45:58.374957 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:58.374930 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-3ac3244c-7cbffcfc8d-kx7s4" event={"ID":"5ec74a1c-caa8-4407-971f-d26c6423ccb8","Type":"ContainerStarted","Data":"1dade5bcf765a6a59ff529144d6568b86d8bbe1af4688809085023a4b54cc19c"} Jul 27 20:45:58.375070 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:58.374965 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-3ac3244c-7cbffcfc8d-kx7s4" event={"ID":"5ec74a1c-caa8-4407-971f-d26c6423ccb8","Type":"ContainerStarted","Data":"ff057b951c973de3dd60cd19c51241b78fb3c4cb8ba96c801aa3dfdde4b94f0f"} Jul 27 20:45:58.375070 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:58.374995 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-3ac3244c-7cbffcfc8d-kx7s4" Jul 27 20:45:58.389786 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:58.389739 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-3ac3244c-56f978677d-tt9h9" podStartSLOduration=2.389722996 podStartE2EDuration="2.389722996s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:45:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:45:58.389116811 +0000 UTC m=+1700.967690401" watchObservedRunningTime="2026-07-27 20:45:58.389722996 +0000 UTC m=+1700.968296585" Jul 27 20:45:58.407836 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:45:58.407796 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-3ac3244c-7cbffcfc8d-kx7s4" podStartSLOduration=2.407783809 podStartE2EDuration="2.407783809s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:45:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:45:58.406807679 +0000 UTC m=+1700.985381270" watchObservedRunningTime="2026-07-27 20:45:58.407783809 +0000 UTC m=+1700.986357376" Jul 27 20:46:02.309195 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:02.309119 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:46:09.381560 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:09.381522 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-3ac3244c-56f978677d-tt9h9" Jul 27 20:46:09.382025 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:09.381604 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-3ac3244c-7cbffcfc8d-kx7s4" Jul 27 20:46:32.346914 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:32.346875 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:46:32.374901 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:32.374869 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-3ac3244c-56f978677d-tt9h9"] Jul 27 20:46:32.375136 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:32.375109 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-3ac3244c-56f978677d-tt9h9" podUID="67e2ce2c-360c-4614-aaac-b767243fe366" containerName="payload-processing" containerID="cri-o://0289ae7646b4a763e14911645c2f63ad80215091b1ef44cfbc233fa517dd0fe9" gracePeriod=30 Jul 27 20:46:32.380714 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:32.380663 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3ac3244c-7cbffcfc8d-kx7s4"] Jul 27 20:46:32.380934 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:32.380898 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-3ac3244c-7cbffcfc8d-kx7s4" podUID="5ec74a1c-caa8-4407-971f-d26c6423ccb8" containerName="payload-pre-processing" containerID="cri-o://1dade5bcf765a6a59ff529144d6568b86d8bbe1af4688809085023a4b54cc19c" gracePeriod=30 Jul 27 20:46:32.411265 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:32.411231 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:46:32.510916 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:32.510883 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:46:32.523883 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:32.523854 2558 generic.go:356] "Generic (PLEG): container finished" podID="67e2ce2c-360c-4614-aaac-b767243fe366" containerID="0289ae7646b4a763e14911645c2f63ad80215091b1ef44cfbc233fa517dd0fe9" exitCode=0 Jul 27 20:46:32.524026 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:32.523904 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-3ac3244c-56f978677d-tt9h9" event={"ID":"67e2ce2c-360c-4614-aaac-b767243fe366","Type":"ContainerDied","Data":"0289ae7646b4a763e14911645c2f63ad80215091b1ef44cfbc233fa517dd0fe9"} Jul 27 20:46:32.525584 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:32.525563 2558 generic.go:356] "Generic (PLEG): container finished" podID="5ec74a1c-caa8-4407-971f-d26c6423ccb8" containerID="1dade5bcf765a6a59ff529144d6568b86d8bbe1af4688809085023a4b54cc19c" exitCode=0 Jul 27 20:46:32.525713 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:32.525607 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-3ac3244c-7cbffcfc8d-kx7s4" event={"ID":"5ec74a1c-caa8-4407-971f-d26c6423ccb8","Type":"ContainerDied","Data":"1dade5bcf765a6a59ff529144d6568b86d8bbe1af4688809085023a4b54cc19c"} Jul 27 20:46:32.641530 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:32.641511 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-3ac3244c-56f978677d-tt9h9" Jul 27 20:46:32.644409 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:32.644393 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-3ac3244c-7cbffcfc8d-kx7s4" Jul 27 20:46:32.710133 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:32.710102 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vgd8m\" (UniqueName: \"kubernetes.io/projected/5ec74a1c-caa8-4407-971f-d26c6423ccb8-kube-api-access-vgd8m\") pod \"5ec74a1c-caa8-4407-971f-d26c6423ccb8\" (UID: \"5ec74a1c-caa8-4407-971f-d26c6423ccb8\") " Jul 27 20:46:32.710133 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:32.710136 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/67e2ce2c-360c-4614-aaac-b767243fe366-plugins-config-volume\") pod \"67e2ce2c-360c-4614-aaac-b767243fe366\" (UID: \"67e2ce2c-360c-4614-aaac-b767243fe366\") " Jul 27 20:46:32.710315 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:32.710157 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ec74a1c-caa8-4407-971f-d26c6423ccb8-plugins-config-volume\") pod \"5ec74a1c-caa8-4407-971f-d26c6423ccb8\" (UID: \"5ec74a1c-caa8-4407-971f-d26c6423ccb8\") " Jul 27 20:46:32.710315 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:32.710216 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9sttl\" (UniqueName: \"kubernetes.io/projected/67e2ce2c-360c-4614-aaac-b767243fe366-kube-api-access-9sttl\") pod \"67e2ce2c-360c-4614-aaac-b767243fe366\" (UID: \"67e2ce2c-360c-4614-aaac-b767243fe366\") " Jul 27 20:46:32.710531 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:32.710512 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67e2ce2c-360c-4614-aaac-b767243fe366-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "67e2ce2c-360c-4614-aaac-b767243fe366" (UID: "67e2ce2c-360c-4614-aaac-b767243fe366"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:46:32.710566 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:32.710530 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ec74a1c-caa8-4407-971f-d26c6423ccb8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5ec74a1c-caa8-4407-971f-d26c6423ccb8" (UID: "5ec74a1c-caa8-4407-971f-d26c6423ccb8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:46:32.712381 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:32.712355 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ec74a1c-caa8-4407-971f-d26c6423ccb8-kube-api-access-vgd8m" (OuterVolumeSpecName: "kube-api-access-vgd8m") pod "5ec74a1c-caa8-4407-971f-d26c6423ccb8" (UID: "5ec74a1c-caa8-4407-971f-d26c6423ccb8"). InnerVolumeSpecName "kube-api-access-vgd8m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:46:32.712381 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:32.712370 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67e2ce2c-360c-4614-aaac-b767243fe366-kube-api-access-9sttl" (OuterVolumeSpecName: "kube-api-access-9sttl") pod "67e2ce2c-360c-4614-aaac-b767243fe366" (UID: "67e2ce2c-360c-4614-aaac-b767243fe366"). InnerVolumeSpecName "kube-api-access-9sttl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:46:32.811195 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:32.811162 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9sttl\" (UniqueName: \"kubernetes.io/projected/67e2ce2c-360c-4614-aaac-b767243fe366-kube-api-access-9sttl\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 20:46:32.811195 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:32.811190 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vgd8m\" (UniqueName: \"kubernetes.io/projected/5ec74a1c-caa8-4407-971f-d26c6423ccb8-kube-api-access-vgd8m\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 20:46:32.811195 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:32.811204 2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/67e2ce2c-360c-4614-aaac-b767243fe366-plugins-config-volume\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 20:46:32.811381 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:32.811213 2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ec74a1c-caa8-4407-971f-d26c6423ccb8-plugins-config-volume\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 20:46:33.532277 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:33.532245 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-3ac3244c-7cbffcfc8d-kx7s4" Jul 27 20:46:33.532718 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:33.532280 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-3ac3244c-7cbffcfc8d-kx7s4" event={"ID":"5ec74a1c-caa8-4407-971f-d26c6423ccb8","Type":"ContainerDied","Data":"ff057b951c973de3dd60cd19c51241b78fb3c4cb8ba96c801aa3dfdde4b94f0f"} Jul 27 20:46:33.532718 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:33.532337 2558 scope.go:117] "RemoveContainer" containerID="1dade5bcf765a6a59ff529144d6568b86d8bbe1af4688809085023a4b54cc19c" Jul 27 20:46:33.533563 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:33.533458 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-3ac3244c-56f978677d-tt9h9" event={"ID":"67e2ce2c-360c-4614-aaac-b767243fe366","Type":"ContainerDied","Data":"198537bbd8ac5ffd36aebd86756cea63a5b9d7d6a75ac19a46366db12c4ee2cb"} Jul 27 20:46:33.533563 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:33.533491 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-3ac3244c-56f978677d-tt9h9" Jul 27 20:46:33.540796 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:33.540760 2558 scope.go:117] "RemoveContainer" containerID="0289ae7646b4a763e14911645c2f63ad80215091b1ef44cfbc233fa517dd0fe9" Jul 27 20:46:33.556015 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:33.555995 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-3ac3244c-56f978677d-tt9h9"] Jul 27 20:46:33.559025 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:33.559006 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-3ac3244c-56f978677d-tt9h9"] Jul 27 20:46:33.569092 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:33.569071 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3ac3244c-7cbffcfc8d-kx7s4"] Jul 27 20:46:33.572647 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:33.572630 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3ac3244c-7cbffcfc8d-kx7s4"] Jul 27 20:46:33.933372 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:33.933338 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ec74a1c-caa8-4407-971f-d26c6423ccb8" path="/var/lib/kubelet/pods/5ec74a1c-caa8-4407-971f-d26c6423ccb8/volumes" Jul 27 20:46:33.933712 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:33.933681 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67e2ce2c-360c-4614-aaac-b767243fe366" path="/var/lib/kubelet/pods/67e2ce2c-360c-4614-aaac-b767243fe366/volumes" Jul 27 20:46:35.511366 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:35.511328 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:46:36.915087 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:36.915055 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:46:38.065201 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:38.065157 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:46:38.295997 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:38.295965 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:46:38.527042 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:38.526998 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:46:38.820066 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:38.820018 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:46:39.042983 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:39.042942 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:46:41.292906 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:41.292846 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:46:41.392224 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:41.392200 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:46:41.576464 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:41.576357 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:46:41.856326 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:41.856236 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:46:42.119582 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:42.119507 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:46:42.213930 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:42.213896 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:46:42.218336 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:42.218313 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f693d665-56666b4bdd-bwhf9"] Jul 27 20:46:42.218583 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:42.218570 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67e2ce2c-360c-4614-aaac-b767243fe366" containerName="payload-processing" Jul 27 20:46:42.218619 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:42.218584 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="67e2ce2c-360c-4614-aaac-b767243fe366" containerName="payload-processing" Jul 27 20:46:42.218619 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:42.218599 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ec74a1c-caa8-4407-971f-d26c6423ccb8" containerName="payload-pre-processing" Jul 27 20:46:42.218619 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:42.218605 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ec74a1c-caa8-4407-971f-d26c6423ccb8" containerName="payload-pre-processing" Jul 27 20:46:42.218737 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:42.218654 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ec74a1c-caa8-4407-971f-d26c6423ccb8" containerName="payload-pre-processing" Jul 27 20:46:42.218737 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:42.218661 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="67e2ce2c-360c-4614-aaac-b767243fe366" containerName="payload-processing" Jul 27 20:46:42.221303 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:42.221290 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-f693d665-56666b4bdd-bwhf9" Jul 27 20:46:42.224093 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:42.224072 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-f693d665-dockercfg-xfxx2\"" Jul 27 20:46:42.224195 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:42.224073 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-f693d665\"" Jul 27 20:46:42.241006 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:42.240984 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f693d665-56666b4bdd-bwhf9"] Jul 27 20:46:42.282923 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:42.282894 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqfzk\" (UniqueName: \"kubernetes.io/projected/80144b38-dcaa-43b3-9a29-a203ee66e58d-kube-api-access-fqfzk\") pod \"payload-pre-processing-e2e-derive-f693d665-56666b4bdd-bwhf9\" (UID: \"80144b38-dcaa-43b3-9a29-a203ee66e58d\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f693d665-56666b4bdd-bwhf9" Jul 27 20:46:42.283031 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:42.282937 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80144b38-dcaa-43b3-9a29-a203ee66e58d-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-f693d665-56666b4bdd-bwhf9\" (UID: \"80144b38-dcaa-43b3-9a29-a203ee66e58d\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f693d665-56666b4bdd-bwhf9" Jul 27 20:46:42.363736 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:42.363705 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-f693d665-f4d566cdb-9tkpw"] Jul 27 20:46:42.366725 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:42.366710 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-f693d665-f4d566cdb-9tkpw" Jul 27 20:46:42.376733 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:42.376709 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-f693d665-f4d566cdb-9tkpw"] Jul 27 20:46:42.383670 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:42.383649 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqfzk\" (UniqueName: \"kubernetes.io/projected/80144b38-dcaa-43b3-9a29-a203ee66e58d-kube-api-access-fqfzk\") pod \"payload-pre-processing-e2e-derive-f693d665-56666b4bdd-bwhf9\" (UID: \"80144b38-dcaa-43b3-9a29-a203ee66e58d\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f693d665-56666b4bdd-bwhf9" Jul 27 20:46:42.383776 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:42.383700 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80144b38-dcaa-43b3-9a29-a203ee66e58d-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-f693d665-56666b4bdd-bwhf9\" (UID: \"80144b38-dcaa-43b3-9a29-a203ee66e58d\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f693d665-56666b4bdd-bwhf9" Jul 27 20:46:42.384347 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:42.384330 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80144b38-dcaa-43b3-9a29-a203ee66e58d-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-f693d665-56666b4bdd-bwhf9\" (UID: \"80144b38-dcaa-43b3-9a29-a203ee66e58d\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f693d665-56666b4bdd-bwhf9" Jul 27 20:46:42.393041 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:42.393022 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqfzk\" (UniqueName: \"kubernetes.io/projected/80144b38-dcaa-43b3-9a29-a203ee66e58d-kube-api-access-fqfzk\") pod \"payload-pre-processing-e2e-derive-f693d665-56666b4bdd-bwhf9\" (UID: \"80144b38-dcaa-43b3-9a29-a203ee66e58d\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f693d665-56666b4bdd-bwhf9" Jul 27 20:46:42.484797 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:42.484771 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76jsz\" (UniqueName: \"kubernetes.io/projected/42dfce1e-aa9f-4263-874d-e6497ece4bd6-kube-api-access-76jsz\") pod \"payload-processing-e2e-derive-f693d665-f4d566cdb-9tkpw\" (UID: \"42dfce1e-aa9f-4263-874d-e6497ece4bd6\") " pod="openshift-ingress/payload-processing-e2e-derive-f693d665-f4d566cdb-9tkpw" Jul 27 20:46:42.484903 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:42.484803 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42dfce1e-aa9f-4263-874d-e6497ece4bd6-plugins-config-volume\") pod \"payload-processing-e2e-derive-f693d665-f4d566cdb-9tkpw\" (UID: \"42dfce1e-aa9f-4263-874d-e6497ece4bd6\") " pod="openshift-ingress/payload-processing-e2e-derive-f693d665-f4d566cdb-9tkpw" Jul 27 20:46:42.531240 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:42.531223 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-f693d665-56666b4bdd-bwhf9" Jul 27 20:46:42.586235 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:42.586163 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76jsz\" (UniqueName: \"kubernetes.io/projected/42dfce1e-aa9f-4263-874d-e6497ece4bd6-kube-api-access-76jsz\") pod \"payload-processing-e2e-derive-f693d665-f4d566cdb-9tkpw\" (UID: \"42dfce1e-aa9f-4263-874d-e6497ece4bd6\") " pod="openshift-ingress/payload-processing-e2e-derive-f693d665-f4d566cdb-9tkpw" Jul 27 20:46:42.586235 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:42.586215 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42dfce1e-aa9f-4263-874d-e6497ece4bd6-plugins-config-volume\") pod \"payload-processing-e2e-derive-f693d665-f4d566cdb-9tkpw\" (UID: \"42dfce1e-aa9f-4263-874d-e6497ece4bd6\") " pod="openshift-ingress/payload-processing-e2e-derive-f693d665-f4d566cdb-9tkpw" Jul 27 20:46:42.587443 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:42.587231 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42dfce1e-aa9f-4263-874d-e6497ece4bd6-plugins-config-volume\") pod \"payload-processing-e2e-derive-f693d665-f4d566cdb-9tkpw\" (UID: \"42dfce1e-aa9f-4263-874d-e6497ece4bd6\") " pod="openshift-ingress/payload-processing-e2e-derive-f693d665-f4d566cdb-9tkpw" Jul 27 20:46:42.594490 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:42.594463 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76jsz\" (UniqueName: \"kubernetes.io/projected/42dfce1e-aa9f-4263-874d-e6497ece4bd6-kube-api-access-76jsz\") pod \"payload-processing-e2e-derive-f693d665-f4d566cdb-9tkpw\" (UID: \"42dfce1e-aa9f-4263-874d-e6497ece4bd6\") " pod="openshift-ingress/payload-processing-e2e-derive-f693d665-f4d566cdb-9tkpw" Jul 27 20:46:42.665607 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:42.665535 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f693d665-56666b4bdd-bwhf9"] Jul 27 20:46:42.669099 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:46:42.669062 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80144b38_dcaa_43b3_9a29_a203ee66e58d.slice/crio-446575baba7947823a1bc2646bcc261e9ce4219a41e09b700c332d8e507008d3 WatchSource:0}: Error finding container 446575baba7947823a1bc2646bcc261e9ce4219a41e09b700c332d8e507008d3: Status 404 returned error can't find the container with id 446575baba7947823a1bc2646bcc261e9ce4219a41e09b700c332d8e507008d3 Jul 27 20:46:42.676723 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:42.676702 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-f693d665-f4d566cdb-9tkpw" Jul 27 20:46:42.799592 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:42.799569 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-f693d665-f4d566cdb-9tkpw"] Jul 27 20:46:42.801700 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:46:42.801669 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42dfce1e_aa9f_4263_874d_e6497ece4bd6.slice/crio-08cc5458a7aa37ee7e1ec46959a6cdcac7ef8c20d3c3786bd6f978a25d83e115 WatchSource:0}: Error finding container 08cc5458a7aa37ee7e1ec46959a6cdcac7ef8c20d3c3786bd6f978a25d83e115: Status 404 returned error can't find the container with id 08cc5458a7aa37ee7e1ec46959a6cdcac7ef8c20d3c3786bd6f978a25d83e115 Jul 27 20:46:43.587774 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:43.587728 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-f693d665-56666b4bdd-bwhf9" event={"ID":"80144b38-dcaa-43b3-9a29-a203ee66e58d","Type":"ContainerStarted","Data":"bd00dd882715171f6200df31236469663bde119f5c0d6f386d542f1f36b3c92c"} Jul 27 20:46:43.588203 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:43.587794 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-f693d665-56666b4bdd-bwhf9" event={"ID":"80144b38-dcaa-43b3-9a29-a203ee66e58d","Type":"ContainerStarted","Data":"446575baba7947823a1bc2646bcc261e9ce4219a41e09b700c332d8e507008d3"} Jul 27 20:46:43.588203 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:43.587866 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-f693d665-56666b4bdd-bwhf9" Jul 27 20:46:43.589233 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:43.589207 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-f693d665-f4d566cdb-9tkpw" event={"ID":"42dfce1e-aa9f-4263-874d-e6497ece4bd6","Type":"ContainerStarted","Data":"c31fb96576d67b35a6000f141fa53e395bd70b8c4fcccce488d6c1f1bac9f37f"} Jul 27 20:46:43.589361 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:43.589253 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-f693d665-f4d566cdb-9tkpw" event={"ID":"42dfce1e-aa9f-4263-874d-e6497ece4bd6","Type":"ContainerStarted","Data":"08cc5458a7aa37ee7e1ec46959a6cdcac7ef8c20d3c3786bd6f978a25d83e115"} Jul 27 20:46:43.589361 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:43.589287 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-f693d665-f4d566cdb-9tkpw" Jul 27 20:46:43.602453 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:43.602402 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-f693d665-56666b4bdd-bwhf9" podStartSLOduration=1.602385776 podStartE2EDuration="1.602385776s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:46:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:46:43.601486055 +0000 UTC m=+1746.180059643" watchObservedRunningTime="2026-07-27 20:46:43.602385776 +0000 UTC m=+1746.180959366" Jul 27 20:46:43.617847 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:43.617808 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-f693d665-f4d566cdb-9tkpw" podStartSLOduration=1.61779658 podStartE2EDuration="1.61779658s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:46:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:46:43.616536323 +0000 UTC m=+1746.195109911" watchObservedRunningTime="2026-07-27 20:46:43.61779658 +0000 UTC m=+1746.196370146" Jul 27 20:46:47.079620 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:47.079588 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:46:47.915511 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:47.915476 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:46:54.595319 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:54.595288 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-f693d665-56666b4bdd-bwhf9" Jul 27 20:46:54.595791 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:46:54.595362 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-f693d665-f4d566cdb-9tkpw" Jul 27 20:47:16.740413 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:16.740375 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:47:16.778509 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:16.778483 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-f693d665-f4d566cdb-9tkpw"] Jul 27 20:47:16.778797 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:16.778769 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-f693d665-f4d566cdb-9tkpw" podUID="42dfce1e-aa9f-4263-874d-e6497ece4bd6" containerName="payload-processing" containerID="cri-o://c31fb96576d67b35a6000f141fa53e395bd70b8c4fcccce488d6c1f1bac9f37f" gracePeriod=30 Jul 27 20:47:16.786614 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:16.786176 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f693d665-56666b4bdd-bwhf9"] Jul 27 20:47:16.786614 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:16.786377 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-f693d665-56666b4bdd-bwhf9" podUID="80144b38-dcaa-43b3-9a29-a203ee66e58d" containerName="payload-pre-processing" containerID="cri-o://bd00dd882715171f6200df31236469663bde119f5c0d6f386d542f1f36b3c92c" gracePeriod=30 Jul 27 20:47:16.817807 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:16.817753 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:47:16.875121 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:16.875097 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:47:17.057941 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:17.057918 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-f693d665-f4d566cdb-9tkpw" Jul 27 20:47:17.061050 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:17.061032 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-f693d665-56666b4bdd-bwhf9" Jul 27 20:47:17.158478 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:17.158453 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80144b38-dcaa-43b3-9a29-a203ee66e58d-plugins-config-volume\") pod \"80144b38-dcaa-43b3-9a29-a203ee66e58d\" (UID: \"80144b38-dcaa-43b3-9a29-a203ee66e58d\") " Jul 27 20:47:17.158478 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:17.158480 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42dfce1e-aa9f-4263-874d-e6497ece4bd6-plugins-config-volume\") pod \"42dfce1e-aa9f-4263-874d-e6497ece4bd6\" (UID: \"42dfce1e-aa9f-4263-874d-e6497ece4bd6\") " Jul 27 20:47:17.158683 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:17.158504 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76jsz\" (UniqueName: \"kubernetes.io/projected/42dfce1e-aa9f-4263-874d-e6497ece4bd6-kube-api-access-76jsz\") pod \"42dfce1e-aa9f-4263-874d-e6497ece4bd6\" (UID: \"42dfce1e-aa9f-4263-874d-e6497ece4bd6\") " Jul 27 20:47:17.158683 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:17.158527 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fqfzk\" (UniqueName: \"kubernetes.io/projected/80144b38-dcaa-43b3-9a29-a203ee66e58d-kube-api-access-fqfzk\") pod \"80144b38-dcaa-43b3-9a29-a203ee66e58d\" (UID: \"80144b38-dcaa-43b3-9a29-a203ee66e58d\") " Jul 27 20:47:17.158918 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:17.158895 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80144b38-dcaa-43b3-9a29-a203ee66e58d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "80144b38-dcaa-43b3-9a29-a203ee66e58d" (UID: "80144b38-dcaa-43b3-9a29-a203ee66e58d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:47:17.158918 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:17.158907 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42dfce1e-aa9f-4263-874d-e6497ece4bd6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "42dfce1e-aa9f-4263-874d-e6497ece4bd6" (UID: "42dfce1e-aa9f-4263-874d-e6497ece4bd6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:47:17.160640 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:17.160618 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80144b38-dcaa-43b3-9a29-a203ee66e58d-kube-api-access-fqfzk" (OuterVolumeSpecName: "kube-api-access-fqfzk") pod "80144b38-dcaa-43b3-9a29-a203ee66e58d" (UID: "80144b38-dcaa-43b3-9a29-a203ee66e58d"). InnerVolumeSpecName "kube-api-access-fqfzk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:47:17.160640 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:17.160632 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42dfce1e-aa9f-4263-874d-e6497ece4bd6-kube-api-access-76jsz" (OuterVolumeSpecName: "kube-api-access-76jsz") pod "42dfce1e-aa9f-4263-874d-e6497ece4bd6" (UID: "42dfce1e-aa9f-4263-874d-e6497ece4bd6"). InnerVolumeSpecName "kube-api-access-76jsz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:47:17.260020 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:17.259999 2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80144b38-dcaa-43b3-9a29-a203ee66e58d-plugins-config-volume\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 20:47:17.260020 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:17.260018 2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42dfce1e-aa9f-4263-874d-e6497ece4bd6-plugins-config-volume\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 20:47:17.260147 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:17.260027 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76jsz\" (UniqueName: \"kubernetes.io/projected/42dfce1e-aa9f-4263-874d-e6497ece4bd6-kube-api-access-76jsz\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 20:47:17.260147 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:17.260036 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fqfzk\" (UniqueName: \"kubernetes.io/projected/80144b38-dcaa-43b3-9a29-a203ee66e58d-kube-api-access-fqfzk\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 20:47:17.735179 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:17.735145 2558 generic.go:356] "Generic (PLEG): container finished" podID="80144b38-dcaa-43b3-9a29-a203ee66e58d" containerID="bd00dd882715171f6200df31236469663bde119f5c0d6f386d542f1f36b3c92c" exitCode=0 Jul 27 20:47:17.735344 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:17.735190 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-f693d665-56666b4bdd-bwhf9" Jul 27 20:47:17.735344 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:17.735235 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-f693d665-56666b4bdd-bwhf9" event={"ID":"80144b38-dcaa-43b3-9a29-a203ee66e58d","Type":"ContainerDied","Data":"bd00dd882715171f6200df31236469663bde119f5c0d6f386d542f1f36b3c92c"} Jul 27 20:47:17.735344 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:17.735293 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-f693d665-56666b4bdd-bwhf9" event={"ID":"80144b38-dcaa-43b3-9a29-a203ee66e58d","Type":"ContainerDied","Data":"446575baba7947823a1bc2646bcc261e9ce4219a41e09b700c332d8e507008d3"} Jul 27 20:47:17.735344 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:17.735326 2558 scope.go:117] "RemoveContainer" containerID="bd00dd882715171f6200df31236469663bde119f5c0d6f386d542f1f36b3c92c" Jul 27 20:47:17.736547 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:17.736525 2558 generic.go:356] "Generic (PLEG): container finished" podID="42dfce1e-aa9f-4263-874d-e6497ece4bd6" containerID="c31fb96576d67b35a6000f141fa53e395bd70b8c4fcccce488d6c1f1bac9f37f" exitCode=0 Jul 27 20:47:17.736617 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:17.736592 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-f693d665-f4d566cdb-9tkpw" Jul 27 20:47:17.736617 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:17.736600 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-f693d665-f4d566cdb-9tkpw" event={"ID":"42dfce1e-aa9f-4263-874d-e6497ece4bd6","Type":"ContainerDied","Data":"c31fb96576d67b35a6000f141fa53e395bd70b8c4fcccce488d6c1f1bac9f37f"} Jul 27 20:47:17.736723 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:17.736637 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-f693d665-f4d566cdb-9tkpw" event={"ID":"42dfce1e-aa9f-4263-874d-e6497ece4bd6","Type":"ContainerDied","Data":"08cc5458a7aa37ee7e1ec46959a6cdcac7ef8c20d3c3786bd6f978a25d83e115"} Jul 27 20:47:17.742921 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:17.742884 2558 scope.go:117] "RemoveContainer" containerID="bd00dd882715171f6200df31236469663bde119f5c0d6f386d542f1f36b3c92c" Jul 27 20:47:17.743212 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:47:17.743153 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd00dd882715171f6200df31236469663bde119f5c0d6f386d542f1f36b3c92c\": container with ID starting with bd00dd882715171f6200df31236469663bde119f5c0d6f386d542f1f36b3c92c not found: ID does not exist" containerID="bd00dd882715171f6200df31236469663bde119f5c0d6f386d542f1f36b3c92c" Jul 27 20:47:17.743212 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:17.743176 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd00dd882715171f6200df31236469663bde119f5c0d6f386d542f1f36b3c92c"} err="failed to get container status \"bd00dd882715171f6200df31236469663bde119f5c0d6f386d542f1f36b3c92c\": rpc error: code = NotFound desc = could not find container \"bd00dd882715171f6200df31236469663bde119f5c0d6f386d542f1f36b3c92c\": container with ID starting with bd00dd882715171f6200df31236469663bde119f5c0d6f386d542f1f36b3c92c not found: ID does not exist" Jul 27 20:47:17.743212 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:17.743192 2558 scope.go:117] "RemoveContainer" containerID="c31fb96576d67b35a6000f141fa53e395bd70b8c4fcccce488d6c1f1bac9f37f" Jul 27 20:47:17.751161 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:17.751144 2558 scope.go:117] "RemoveContainer" containerID="c31fb96576d67b35a6000f141fa53e395bd70b8c4fcccce488d6c1f1bac9f37f" Jul 27 20:47:17.751420 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:47:17.751403 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c31fb96576d67b35a6000f141fa53e395bd70b8c4fcccce488d6c1f1bac9f37f\": container with ID starting with c31fb96576d67b35a6000f141fa53e395bd70b8c4fcccce488d6c1f1bac9f37f not found: ID does not exist" containerID="c31fb96576d67b35a6000f141fa53e395bd70b8c4fcccce488d6c1f1bac9f37f" Jul 27 20:47:17.751494 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:17.751425 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c31fb96576d67b35a6000f141fa53e395bd70b8c4fcccce488d6c1f1bac9f37f"} err="failed to get container status \"c31fb96576d67b35a6000f141fa53e395bd70b8c4fcccce488d6c1f1bac9f37f\": rpc error: code = NotFound desc = could not find container \"c31fb96576d67b35a6000f141fa53e395bd70b8c4fcccce488d6c1f1bac9f37f\": container with ID starting with c31fb96576d67b35a6000f141fa53e395bd70b8c4fcccce488d6c1f1bac9f37f not found: ID does not exist" Jul 27 20:47:17.759247 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:17.759228 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f693d665-56666b4bdd-bwhf9"] Jul 27 20:47:17.766516 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:17.766482 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f693d665-56666b4bdd-bwhf9"] Jul 27 20:47:17.774473 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:17.774451 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-f693d665-f4d566cdb-9tkpw"] Jul 27 20:47:17.779249 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:17.779227 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-f693d665-f4d566cdb-9tkpw"] Jul 27 20:47:17.933035 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:17.933014 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42dfce1e-aa9f-4263-874d-e6497ece4bd6" path="/var/lib/kubelet/pods/42dfce1e-aa9f-4263-874d-e6497ece4bd6/volumes" Jul 27 20:47:17.933341 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:17.933328 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80144b38-dcaa-43b3-9a29-a203ee66e58d" path="/var/lib/kubelet/pods/80144b38-dcaa-43b3-9a29-a203ee66e58d/volumes" Jul 27 20:47:19.610952 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:19.610907 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:47:21.269918 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:21.269887 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:47:21.417471 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:21.417443 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:47:21.657950 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:21.657856 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:47:22.140192 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:22.140149 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:47:22.245133 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:22.245079 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:47:22.337505 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:22.337474 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:47:23.709417 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:23.709383 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:47:29.793275 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:29.793192 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:47:29.900574 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:29.900542 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:47:29.993227 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:29.993201 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:47:30.102469 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:30.102393 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:47:30.475559 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:30.475482 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:47:37.891298 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:37.891270 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rnj2b_c421dc44-8fcf-44f4-b483-8e0271833d10/ovn-acl-logging/0.log" Jul 27 20:47:37.892383 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:37.892358 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rnj2b_c421dc44-8fcf-44f4-b483-8e0271833d10/ovn-acl-logging/0.log" Jul 27 20:47:56.479874 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:47:56.479819 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:48:02.419063 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:48:02.419023 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:48:02.523006 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:48:02.522970 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:48:02.620278 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:48:02.620247 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:48:18.474306 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:48:18.474268 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:48:24.192504 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:48:24.192470 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:48:24.255198 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:48:24.255157 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:48:24.318893 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:48:24.318867 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:48:24.418771 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:48:24.418744 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:48:34.908326 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:48:34.908281 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:48:35.682572 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:48:35.682536 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:48:41.620196 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:48:41.620155 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:48:41.731670 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:48:41.731639 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:48:41.824183 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:48:41.824154 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:48:41.920585 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:48:41.920496 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:48:42.705395 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:48:42.705353 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:48:42.810039 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:48:42.810005 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:48:42.914062 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:48:42.914025 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:48:44.424130 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:48:44.424092 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:48:46.222403 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:48:46.222372 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:48:50.333230 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:48:50.333197 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:48:50.433347 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:48:50.433305 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:48:51.003340 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:48:51.003300 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:48:56.225764 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:48:56.225730 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:48:56.763722 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:48:56.763666 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:48:56.864595 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:48:56.864560 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:48:57.001256 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:48:57.001220 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:48:57.286142 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:48:57.286111 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:48:57.491030 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:48:57.490994 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:49:00.543611 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:00.543526 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:49:00.635610 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:00.635582 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:49:00.722918 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:00.722879 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:49:00.825721 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:00.825618 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:49:01.381750 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:01.381713 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:49:01.482105 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:01.482072 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:49:01.508669 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:01.508639 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e6938e60-f6c4646f4-55hfq"] Jul 27 20:49:01.508941 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:01.508929 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80144b38-dcaa-43b3-9a29-a203ee66e58d" containerName="payload-pre-processing" Jul 27 20:49:01.508985 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:01.508943 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="80144b38-dcaa-43b3-9a29-a203ee66e58d" containerName="payload-pre-processing" Jul 27 20:49:01.508985 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:01.508953 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42dfce1e-aa9f-4263-874d-e6497ece4bd6" containerName="payload-processing" Jul 27 20:49:01.508985 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:01.508960 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="42dfce1e-aa9f-4263-874d-e6497ece4bd6" containerName="payload-processing" Jul 27 20:49:01.509076 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:01.509014 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="80144b38-dcaa-43b3-9a29-a203ee66e58d" containerName="payload-pre-processing" Jul 27 20:49:01.509076 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:01.509022 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="42dfce1e-aa9f-4263-874d-e6497ece4bd6" containerName="payload-processing" Jul 27 20:49:01.511914 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:01.511899 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-e6938e60-f6c4646f4-55hfq" Jul 27 20:49:01.514515 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:01.514495 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-e6938e60-dockercfg-mxbgw\"" Jul 27 20:49:01.514934 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:01.514915 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-e6938e60\"" Jul 27 20:49:01.526582 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:01.526559 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e6938e60-f6c4646f4-55hfq"] Jul 27 20:49:01.533042 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:01.533024 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7c6v\" (UniqueName: \"kubernetes.io/projected/594bd620-3840-46a3-8189-60e467a6a075-kube-api-access-h7c6v\") pod \"payload-processing-e2e-mt-e6938e60-f6c4646f4-55hfq\" (UID: \"594bd620-3840-46a3-8189-60e467a6a075\") " pod="openshift-ingress/payload-processing-e2e-mt-e6938e60-f6c4646f4-55hfq" Jul 27 20:49:01.533124 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:01.533063 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/594bd620-3840-46a3-8189-60e467a6a075-plugins-config-volume\") pod \"payload-processing-e2e-mt-e6938e60-f6c4646f4-55hfq\" (UID: \"594bd620-3840-46a3-8189-60e467a6a075\") " pod="openshift-ingress/payload-processing-e2e-mt-e6938e60-f6c4646f4-55hfq" Jul 27 20:49:01.576324 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:01.576297 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e6938e60-7b5c5d4cf6-wc9wb"] Jul 27 20:49:01.579368 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:01.579354 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-e6938e60-7b5c5d4cf6-wc9wb" Jul 27 20:49:01.587955 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:01.587939 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e6938e60-7b5c5d4cf6-wc9wb"] Jul 27 20:49:01.633500 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:01.633427 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47bhj\" (UniqueName: \"kubernetes.io/projected/e1712ac9-d41f-441b-9d0b-5899673a3958-kube-api-access-47bhj\") pod \"payload-pre-processing-e2e-mt-e6938e60-7b5c5d4cf6-wc9wb\" (UID: \"e1712ac9-d41f-441b-9d0b-5899673a3958\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e6938e60-7b5c5d4cf6-wc9wb" Jul 27 20:49:01.633500 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:01.633477 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/594bd620-3840-46a3-8189-60e467a6a075-plugins-config-volume\") pod \"payload-processing-e2e-mt-e6938e60-f6c4646f4-55hfq\" (UID: \"594bd620-3840-46a3-8189-60e467a6a075\") " pod="openshift-ingress/payload-processing-e2e-mt-e6938e60-f6c4646f4-55hfq" Jul 27 20:49:01.633666 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:01.633574 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e1712ac9-d41f-441b-9d0b-5899673a3958-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-e6938e60-7b5c5d4cf6-wc9wb\" (UID: \"e1712ac9-d41f-441b-9d0b-5899673a3958\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e6938e60-7b5c5d4cf6-wc9wb" Jul 27 20:49:01.633666 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:01.633609 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7c6v\" (UniqueName: \"kubernetes.io/projected/594bd620-3840-46a3-8189-60e467a6a075-kube-api-access-h7c6v\") pod \"payload-processing-e2e-mt-e6938e60-f6c4646f4-55hfq\" (UID: \"594bd620-3840-46a3-8189-60e467a6a075\") " pod="openshift-ingress/payload-processing-e2e-mt-e6938e60-f6c4646f4-55hfq" Jul 27 20:49:01.634273 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:01.634252 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/594bd620-3840-46a3-8189-60e467a6a075-plugins-config-volume\") pod \"payload-processing-e2e-mt-e6938e60-f6c4646f4-55hfq\" (UID: \"594bd620-3840-46a3-8189-60e467a6a075\") " pod="openshift-ingress/payload-processing-e2e-mt-e6938e60-f6c4646f4-55hfq" Jul 27 20:49:01.641959 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:01.641934 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7c6v\" (UniqueName: \"kubernetes.io/projected/594bd620-3840-46a3-8189-60e467a6a075-kube-api-access-h7c6v\") pod \"payload-processing-e2e-mt-e6938e60-f6c4646f4-55hfq\" (UID: \"594bd620-3840-46a3-8189-60e467a6a075\") " pod="openshift-ingress/payload-processing-e2e-mt-e6938e60-f6c4646f4-55hfq" Jul 27 20:49:01.734815 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:01.734783 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47bhj\" (UniqueName: \"kubernetes.io/projected/e1712ac9-d41f-441b-9d0b-5899673a3958-kube-api-access-47bhj\") pod \"payload-pre-processing-e2e-mt-e6938e60-7b5c5d4cf6-wc9wb\" (UID: \"e1712ac9-d41f-441b-9d0b-5899673a3958\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e6938e60-7b5c5d4cf6-wc9wb" Jul 27 20:49:01.735008 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:01.734882 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e1712ac9-d41f-441b-9d0b-5899673a3958-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-e6938e60-7b5c5d4cf6-wc9wb\" (UID: \"e1712ac9-d41f-441b-9d0b-5899673a3958\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e6938e60-7b5c5d4cf6-wc9wb" Jul 27 20:49:01.735547 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:01.735525 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e1712ac9-d41f-441b-9d0b-5899673a3958-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-e6938e60-7b5c5d4cf6-wc9wb\" (UID: \"e1712ac9-d41f-441b-9d0b-5899673a3958\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e6938e60-7b5c5d4cf6-wc9wb" Jul 27 20:49:01.743275 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:01.743248 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47bhj\" (UniqueName: \"kubernetes.io/projected/e1712ac9-d41f-441b-9d0b-5899673a3958-kube-api-access-47bhj\") pod \"payload-pre-processing-e2e-mt-e6938e60-7b5c5d4cf6-wc9wb\" (UID: \"e1712ac9-d41f-441b-9d0b-5899673a3958\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e6938e60-7b5c5d4cf6-wc9wb" Jul 27 20:49:01.821968 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:01.821935 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-e6938e60-f6c4646f4-55hfq" Jul 27 20:49:01.890293 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:01.890233 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-e6938e60-7b5c5d4cf6-wc9wb" Jul 27 20:49:01.959579 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:01.959553 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e6938e60-f6c4646f4-55hfq"] Jul 27 20:49:01.962451 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:49:01.962422 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod594bd620_3840_46a3_8189_60e467a6a075.slice/crio-c3c20f13c99078e93673de7a52a464fba61b4578d4a9778f6d20f11e6d46f17e WatchSource:0}: Error finding container c3c20f13c99078e93673de7a52a464fba61b4578d4a9778f6d20f11e6d46f17e: Status 404 returned error can't find the container with id c3c20f13c99078e93673de7a52a464fba61b4578d4a9778f6d20f11e6d46f17e Jul 27 20:49:02.148859 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:02.148770 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-e6938e60-f6c4646f4-55hfq" event={"ID":"594bd620-3840-46a3-8189-60e467a6a075","Type":"ContainerStarted","Data":"f90c5e2e07061026cb56358fde9e16f2b1f73f17c3023f2fc125189aa8132778"} Jul 27 20:49:02.148859 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:02.148851 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-e6938e60-f6c4646f4-55hfq" event={"ID":"594bd620-3840-46a3-8189-60e467a6a075","Type":"ContainerStarted","Data":"c3c20f13c99078e93673de7a52a464fba61b4578d4a9778f6d20f11e6d46f17e"} Jul 27 20:49:02.149051 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:02.148913 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-e6938e60-f6c4646f4-55hfq" Jul 27 20:49:02.166479 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:02.166428 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-e6938e60-f6c4646f4-55hfq" podStartSLOduration=1.166413381 podStartE2EDuration="1.166413381s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:49:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:49:02.165617872 +0000 UTC m=+1884.744191462" watchObservedRunningTime="2026-07-27 20:49:02.166413381 +0000 UTC m=+1884.744986970" Jul 27 20:49:02.240133 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:02.240099 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e6938e60-7b5c5d4cf6-wc9wb"] Jul 27 20:49:02.244136 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:49:02.244109 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1712ac9_d41f_441b_9d0b_5899673a3958.slice/crio-eb6052226098036e47d998061ec9a43507372e33d9524e98b3d364c747b37686 WatchSource:0}: Error finding container eb6052226098036e47d998061ec9a43507372e33d9524e98b3d364c747b37686: Status 404 returned error can't find the container with id eb6052226098036e47d998061ec9a43507372e33d9524e98b3d364c747b37686 Jul 27 20:49:03.154122 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:03.154083 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-e6938e60-7b5c5d4cf6-wc9wb" event={"ID":"e1712ac9-d41f-441b-9d0b-5899673a3958","Type":"ContainerStarted","Data":"bd822f1ff69d9bb43a683884b8a4b6722930dcb4fd07b354b8a68a4fdd4246dd"} Jul 27 20:49:03.154550 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:03.154142 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-e6938e60-7b5c5d4cf6-wc9wb" event={"ID":"e1712ac9-d41f-441b-9d0b-5899673a3958","Type":"ContainerStarted","Data":"eb6052226098036e47d998061ec9a43507372e33d9524e98b3d364c747b37686"} Jul 27 20:49:03.154550 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:03.154342 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-e6938e60-7b5c5d4cf6-wc9wb" Jul 27 20:49:03.170890 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:03.170844 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-e6938e60-7b5c5d4cf6-wc9wb" podStartSLOduration=2.170829669 podStartE2EDuration="2.170829669s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:49:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:49:03.169265361 +0000 UTC m=+1885.747838949" watchObservedRunningTime="2026-07-27 20:49:03.170829669 +0000 UTC m=+1885.749403258" Jul 27 20:49:05.016551 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:05.016512 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:49:05.424185 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:05.424098 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:49:05.633013 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:05.632978 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:49:05.733016 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:05.732943 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:49:06.049621 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:06.049583 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:49:11.614974 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:11.614924 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:49:11.716642 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:11.716605 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:49:13.156452 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:13.156420 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-e6938e60-f6c4646f4-55hfq" Jul 27 20:49:14.159812 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:14.159779 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-e6938e60-7b5c5d4cf6-wc9wb" Jul 27 20:49:22.449833 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:22.449801 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:49:22.478556 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:22.478528 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e6938e60-f6c4646f4-55hfq"] Jul 27 20:49:22.478763 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:22.478734 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-e6938e60-f6c4646f4-55hfq" podUID="594bd620-3840-46a3-8189-60e467a6a075" containerName="payload-processing" containerID="cri-o://f90c5e2e07061026cb56358fde9e16f2b1f73f17c3023f2fc125189aa8132778" gracePeriod=30 Jul 27 20:49:22.483471 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:22.483402 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e6938e60-7b5c5d4cf6-wc9wb"] Jul 27 20:49:22.483658 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:22.483627 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-e6938e60-7b5c5d4cf6-wc9wb" podUID="e1712ac9-d41f-441b-9d0b-5899673a3958" containerName="payload-pre-processing" containerID="cri-o://bd822f1ff69d9bb43a683884b8a4b6722930dcb4fd07b354b8a68a4fdd4246dd" gracePeriod=30 Jul 27 20:49:22.548063 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:22.548013 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:49:22.649702 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:22.649649 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:49:22.749370 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:22.749345 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-e6938e60-f6c4646f4-55hfq" Jul 27 20:49:22.752037 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:22.752019 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-e6938e60-7b5c5d4cf6-wc9wb" Jul 27 20:49:22.913933 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:22.913905 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e1712ac9-d41f-441b-9d0b-5899673a3958-plugins-config-volume\") pod \"e1712ac9-d41f-441b-9d0b-5899673a3958\" (UID: \"e1712ac9-d41f-441b-9d0b-5899673a3958\") " Jul 27 20:49:22.914080 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:22.913940 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7c6v\" (UniqueName: \"kubernetes.io/projected/594bd620-3840-46a3-8189-60e467a6a075-kube-api-access-h7c6v\") pod \"594bd620-3840-46a3-8189-60e467a6a075\" (UID: \"594bd620-3840-46a3-8189-60e467a6a075\") " Jul 27 20:49:22.914080 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:22.913971 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47bhj\" (UniqueName: \"kubernetes.io/projected/e1712ac9-d41f-441b-9d0b-5899673a3958-kube-api-access-47bhj\") pod \"e1712ac9-d41f-441b-9d0b-5899673a3958\" (UID: \"e1712ac9-d41f-441b-9d0b-5899673a3958\") " Jul 27 20:49:22.914080 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:22.914050 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/594bd620-3840-46a3-8189-60e467a6a075-plugins-config-volume\") pod \"594bd620-3840-46a3-8189-60e467a6a075\" (UID: \"594bd620-3840-46a3-8189-60e467a6a075\") " Jul 27 20:49:22.914437 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:22.914407 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1712ac9-d41f-441b-9d0b-5899673a3958-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e1712ac9-d41f-441b-9d0b-5899673a3958" (UID: "e1712ac9-d41f-441b-9d0b-5899673a3958"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:49:22.914437 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:22.914417 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/594bd620-3840-46a3-8189-60e467a6a075-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "594bd620-3840-46a3-8189-60e467a6a075" (UID: "594bd620-3840-46a3-8189-60e467a6a075"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:49:22.915954 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:22.915927 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/594bd620-3840-46a3-8189-60e467a6a075-kube-api-access-h7c6v" (OuterVolumeSpecName: "kube-api-access-h7c6v") pod "594bd620-3840-46a3-8189-60e467a6a075" (UID: "594bd620-3840-46a3-8189-60e467a6a075"). InnerVolumeSpecName "kube-api-access-h7c6v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:49:22.916038 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:22.915970 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1712ac9-d41f-441b-9d0b-5899673a3958-kube-api-access-47bhj" (OuterVolumeSpecName: "kube-api-access-47bhj") pod "e1712ac9-d41f-441b-9d0b-5899673a3958" (UID: "e1712ac9-d41f-441b-9d0b-5899673a3958"). InnerVolumeSpecName "kube-api-access-47bhj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:49:23.014794 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:23.014767 2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/594bd620-3840-46a3-8189-60e467a6a075-plugins-config-volume\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 20:49:23.014794 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:23.014790 2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e1712ac9-d41f-441b-9d0b-5899673a3958-plugins-config-volume\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 20:49:23.014944 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:23.014800 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7c6v\" (UniqueName: \"kubernetes.io/projected/594bd620-3840-46a3-8189-60e467a6a075-kube-api-access-h7c6v\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 20:49:23.014944 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:23.014808 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47bhj\" (UniqueName: \"kubernetes.io/projected/e1712ac9-d41f-441b-9d0b-5899673a3958-kube-api-access-47bhj\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 20:49:23.234546 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:23.234513 2558 generic.go:356] "Generic (PLEG): container finished" podID="e1712ac9-d41f-441b-9d0b-5899673a3958" containerID="bd822f1ff69d9bb43a683884b8a4b6722930dcb4fd07b354b8a68a4fdd4246dd" exitCode=0 Jul 27 20:49:23.234739 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:23.234557 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-e6938e60-7b5c5d4cf6-wc9wb" Jul 27 20:49:23.234739 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:23.234590 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-e6938e60-7b5c5d4cf6-wc9wb" event={"ID":"e1712ac9-d41f-441b-9d0b-5899673a3958","Type":"ContainerDied","Data":"bd822f1ff69d9bb43a683884b8a4b6722930dcb4fd07b354b8a68a4fdd4246dd"} Jul 27 20:49:23.234739 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:23.234645 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-e6938e60-7b5c5d4cf6-wc9wb" event={"ID":"e1712ac9-d41f-441b-9d0b-5899673a3958","Type":"ContainerDied","Data":"eb6052226098036e47d998061ec9a43507372e33d9524e98b3d364c747b37686"} Jul 27 20:49:23.234739 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:23.234676 2558 scope.go:117] "RemoveContainer" containerID="bd822f1ff69d9bb43a683884b8a4b6722930dcb4fd07b354b8a68a4fdd4246dd" Jul 27 20:49:23.235913 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:23.235891 2558 generic.go:356] "Generic (PLEG): container finished" podID="594bd620-3840-46a3-8189-60e467a6a075" containerID="f90c5e2e07061026cb56358fde9e16f2b1f73f17c3023f2fc125189aa8132778" exitCode=0 Jul 27 20:49:23.235976 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:23.235923 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-e6938e60-f6c4646f4-55hfq" event={"ID":"594bd620-3840-46a3-8189-60e467a6a075","Type":"ContainerDied","Data":"f90c5e2e07061026cb56358fde9e16f2b1f73f17c3023f2fc125189aa8132778"} Jul 27 20:49:23.236021 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:23.235974 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-e6938e60-f6c4646f4-55hfq" event={"ID":"594bd620-3840-46a3-8189-60e467a6a075","Type":"ContainerDied","Data":"c3c20f13c99078e93673de7a52a464fba61b4578d4a9778f6d20f11e6d46f17e"} Jul 27 20:49:23.236021 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:23.235936 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-e6938e60-f6c4646f4-55hfq" Jul 27 20:49:23.242820 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:23.242805 2558 scope.go:117] "RemoveContainer" containerID="bd822f1ff69d9bb43a683884b8a4b6722930dcb4fd07b354b8a68a4fdd4246dd" Jul 27 20:49:23.243069 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:49:23.243052 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd822f1ff69d9bb43a683884b8a4b6722930dcb4fd07b354b8a68a4fdd4246dd\": container with ID starting with bd822f1ff69d9bb43a683884b8a4b6722930dcb4fd07b354b8a68a4fdd4246dd not found: ID does not exist" containerID="bd822f1ff69d9bb43a683884b8a4b6722930dcb4fd07b354b8a68a4fdd4246dd" Jul 27 20:49:23.243119 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:23.243076 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd822f1ff69d9bb43a683884b8a4b6722930dcb4fd07b354b8a68a4fdd4246dd"} err="failed to get container status \"bd822f1ff69d9bb43a683884b8a4b6722930dcb4fd07b354b8a68a4fdd4246dd\": rpc error: code = NotFound desc = could not find container \"bd822f1ff69d9bb43a683884b8a4b6722930dcb4fd07b354b8a68a4fdd4246dd\": container with ID starting with bd822f1ff69d9bb43a683884b8a4b6722930dcb4fd07b354b8a68a4fdd4246dd not found: ID does not exist" Jul 27 20:49:23.243119 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:23.243093 2558 scope.go:117] "RemoveContainer" containerID="f90c5e2e07061026cb56358fde9e16f2b1f73f17c3023f2fc125189aa8132778" Jul 27 20:49:23.250279 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:23.250263 2558 scope.go:117] "RemoveContainer" containerID="f90c5e2e07061026cb56358fde9e16f2b1f73f17c3023f2fc125189aa8132778" Jul 27 20:49:23.250517 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:49:23.250500 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f90c5e2e07061026cb56358fde9e16f2b1f73f17c3023f2fc125189aa8132778\": container with ID starting with f90c5e2e07061026cb56358fde9e16f2b1f73f17c3023f2fc125189aa8132778 not found: ID does not exist" containerID="f90c5e2e07061026cb56358fde9e16f2b1f73f17c3023f2fc125189aa8132778" Jul 27 20:49:23.250580 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:23.250521 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f90c5e2e07061026cb56358fde9e16f2b1f73f17c3023f2fc125189aa8132778"} err="failed to get container status \"f90c5e2e07061026cb56358fde9e16f2b1f73f17c3023f2fc125189aa8132778\": rpc error: code = NotFound desc = could not find container \"f90c5e2e07061026cb56358fde9e16f2b1f73f17c3023f2fc125189aa8132778\": container with ID starting with f90c5e2e07061026cb56358fde9e16f2b1f73f17c3023f2fc125189aa8132778 not found: ID does not exist" Jul 27 20:49:23.258811 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:23.258792 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e6938e60-f6c4646f4-55hfq"] Jul 27 20:49:23.264409 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:23.264386 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e6938e60-f6c4646f4-55hfq"] Jul 27 20:49:23.273641 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:23.273596 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e6938e60-7b5c5d4cf6-wc9wb"] Jul 27 20:49:23.279470 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:23.279449 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e6938e60-7b5c5d4cf6-wc9wb"] Jul 27 20:49:23.933534 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:23.933500 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="594bd620-3840-46a3-8189-60e467a6a075" path="/var/lib/kubelet/pods/594bd620-3840-46a3-8189-60e467a6a075/volumes" Jul 27 20:49:23.933911 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:23.933861 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1712ac9-d41f-441b-9d0b-5899673a3958" path="/var/lib/kubelet/pods/e1712ac9-d41f-441b-9d0b-5899673a3958/volumes" Jul 27 20:49:25.414934 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:25.414904 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:49:27.000520 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:27.000483 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:49:27.363136 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:27.363054 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:49:33.174674 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:33.174632 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:49:33.233019 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:33.232965 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:49:33.436066 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:33.435953 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:49:33.655109 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:33.655068 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:49:33.784133 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:33.784101 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:49:33.886170 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:33.886129 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:49:33.992922 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:33.992874 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:49:39.730582 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:39.730544 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:49:39.832252 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:39.832222 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:49:39.930864 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:39.930839 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:49:40.074446 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:40.074410 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:49:44.526020 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:44.525983 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:49:45.824453 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:45.824418 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:49:45.882943 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:45.882909 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:49:52.537373 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:52.537332 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:49:52.823037 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:52.822951 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:49:52.951762 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:52.951724 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:49:55.821294 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:55.821252 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:49:55.896217 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:55.896179 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:49:55.968231 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:55.968205 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:49:56.070864 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:56.070829 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:49:56.419228 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:56.419194 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:49:56.513010 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:56.512975 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:49:56.516371 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:56.516349 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-afbe9b95-67f4f67fdd-l7ldv"] Jul 27 20:49:56.516669 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:56.516655 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="594bd620-3840-46a3-8189-60e467a6a075" containerName="payload-processing" Jul 27 20:49:56.516728 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:56.516671 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="594bd620-3840-46a3-8189-60e467a6a075" containerName="payload-processing" Jul 27 20:49:56.516728 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:56.516702 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1712ac9-d41f-441b-9d0b-5899673a3958" containerName="payload-pre-processing" Jul 27 20:49:56.516728 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:56.516707 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1712ac9-d41f-441b-9d0b-5899673a3958" containerName="payload-pre-processing" Jul 27 20:49:56.516819 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:56.516766 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="594bd620-3840-46a3-8189-60e467a6a075" containerName="payload-processing" Jul 27 20:49:56.516819 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:56.516773 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1712ac9-d41f-441b-9d0b-5899673a3958" containerName="payload-pre-processing" Jul 27 20:49:56.519643 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:56.519629 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-afbe9b95-67f4f67fdd-l7ldv" Jul 27 20:49:56.522049 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:56.522031 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-afbe9b95\"" Jul 27 20:49:56.527944 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:56.527925 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-afbe9b95-67f4f67fdd-l7ldv"] Jul 27 20:49:56.550623 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:56.550601 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-afbe9b95-bd5c9d898-wphxd"] Jul 27 20:49:56.553736 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:56.553721 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-afbe9b95-bd5c9d898-wphxd" Jul 27 20:49:56.556091 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:56.556072 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-afbe9b95-dockercfg-ngpvx\"" Jul 27 20:49:56.565713 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:56.565682 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-afbe9b95-bd5c9d898-wphxd"] Jul 27 20:49:56.576129 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:56.576106 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f9276c8-3b49-43ac-a252-390a6a9714b4-plugins-config-volume\") pod \"payload-processing-e2e-mt-afbe9b95-bd5c9d898-wphxd\" (UID: \"2f9276c8-3b49-43ac-a252-390a6a9714b4\") " pod="openshift-ingress/payload-processing-e2e-mt-afbe9b95-bd5c9d898-wphxd" Jul 27 20:49:56.576266 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:56.576242 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/979e9943-044d-4d0a-85e9-f7f6368234de-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-afbe9b95-67f4f67fdd-l7ldv\" (UID: \"979e9943-044d-4d0a-85e9-f7f6368234de\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-afbe9b95-67f4f67fdd-l7ldv" Jul 27 20:49:56.576317 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:56.576287 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpb7h\" (UniqueName: \"kubernetes.io/projected/979e9943-044d-4d0a-85e9-f7f6368234de-kube-api-access-kpb7h\") pod \"payload-pre-processing-e2e-mt-afbe9b95-67f4f67fdd-l7ldv\" (UID: \"979e9943-044d-4d0a-85e9-f7f6368234de\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-afbe9b95-67f4f67fdd-l7ldv" Jul 27 20:49:56.576356 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:56.576337 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8zbv\" (UniqueName: \"kubernetes.io/projected/2f9276c8-3b49-43ac-a252-390a6a9714b4-kube-api-access-d8zbv\") pod \"payload-processing-e2e-mt-afbe9b95-bd5c9d898-wphxd\" (UID: \"2f9276c8-3b49-43ac-a252-390a6a9714b4\") " pod="openshift-ingress/payload-processing-e2e-mt-afbe9b95-bd5c9d898-wphxd" Jul 27 20:49:56.677437 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:56.677366 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/979e9943-044d-4d0a-85e9-f7f6368234de-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-afbe9b95-67f4f67fdd-l7ldv\" (UID: \"979e9943-044d-4d0a-85e9-f7f6368234de\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-afbe9b95-67f4f67fdd-l7ldv" Jul 27 20:49:56.677437 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:56.677402 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpb7h\" (UniqueName: \"kubernetes.io/projected/979e9943-044d-4d0a-85e9-f7f6368234de-kube-api-access-kpb7h\") pod \"payload-pre-processing-e2e-mt-afbe9b95-67f4f67fdd-l7ldv\" (UID: \"979e9943-044d-4d0a-85e9-f7f6368234de\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-afbe9b95-67f4f67fdd-l7ldv" Jul 27 20:49:56.677437 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:56.677428 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8zbv\" (UniqueName: \"kubernetes.io/projected/2f9276c8-3b49-43ac-a252-390a6a9714b4-kube-api-access-d8zbv\") pod \"payload-processing-e2e-mt-afbe9b95-bd5c9d898-wphxd\" (UID: \"2f9276c8-3b49-43ac-a252-390a6a9714b4\") " pod="openshift-ingress/payload-processing-e2e-mt-afbe9b95-bd5c9d898-wphxd" Jul 27 20:49:56.677637 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:56.677461 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f9276c8-3b49-43ac-a252-390a6a9714b4-plugins-config-volume\") pod \"payload-processing-e2e-mt-afbe9b95-bd5c9d898-wphxd\" (UID: \"2f9276c8-3b49-43ac-a252-390a6a9714b4\") " pod="openshift-ingress/payload-processing-e2e-mt-afbe9b95-bd5c9d898-wphxd" Jul 27 20:49:56.678149 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:56.678128 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/979e9943-044d-4d0a-85e9-f7f6368234de-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-afbe9b95-67f4f67fdd-l7ldv\" (UID: \"979e9943-044d-4d0a-85e9-f7f6368234de\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-afbe9b95-67f4f67fdd-l7ldv" Jul 27 20:49:56.678194 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:56.678155 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f9276c8-3b49-43ac-a252-390a6a9714b4-plugins-config-volume\") pod \"payload-processing-e2e-mt-afbe9b95-bd5c9d898-wphxd\" (UID: \"2f9276c8-3b49-43ac-a252-390a6a9714b4\") " pod="openshift-ingress/payload-processing-e2e-mt-afbe9b95-bd5c9d898-wphxd" Jul 27 20:49:56.685714 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:56.685671 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8zbv\" (UniqueName: \"kubernetes.io/projected/2f9276c8-3b49-43ac-a252-390a6a9714b4-kube-api-access-d8zbv\") pod \"payload-processing-e2e-mt-afbe9b95-bd5c9d898-wphxd\" (UID: \"2f9276c8-3b49-43ac-a252-390a6a9714b4\") " pod="openshift-ingress/payload-processing-e2e-mt-afbe9b95-bd5c9d898-wphxd" Jul 27 20:49:56.685830 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:56.685796 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpb7h\" (UniqueName: \"kubernetes.io/projected/979e9943-044d-4d0a-85e9-f7f6368234de-kube-api-access-kpb7h\") pod \"payload-pre-processing-e2e-mt-afbe9b95-67f4f67fdd-l7ldv\" (UID: \"979e9943-044d-4d0a-85e9-f7f6368234de\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-afbe9b95-67f4f67fdd-l7ldv" Jul 27 20:49:56.830188 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:56.830160 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-afbe9b95-67f4f67fdd-l7ldv" Jul 27 20:49:56.863427 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:56.863400 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-afbe9b95-bd5c9d898-wphxd" Jul 27 20:49:56.969963 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:56.969933 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-afbe9b95-67f4f67fdd-l7ldv"] Jul 27 20:49:56.973211 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:49:56.973179 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod979e9943_044d_4d0a_85e9_f7f6368234de.slice/crio-2b9dc756134158cf348c3813137b803bb1d4afd665bc6664fd5df02d3e3b175c WatchSource:0}: Error finding container 2b9dc756134158cf348c3813137b803bb1d4afd665bc6664fd5df02d3e3b175c: Status 404 returned error can't find the container with id 2b9dc756134158cf348c3813137b803bb1d4afd665bc6664fd5df02d3e3b175c Jul 27 20:49:57.009053 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:57.009030 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-afbe9b95-bd5c9d898-wphxd"] Jul 27 20:49:57.011780 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:49:57.011756 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f9276c8_3b49_43ac_a252_390a6a9714b4.slice/crio-29c7ae6c5c46d1270df04e76999e2c4c828e00f9cd3f0e85cab03a5ee4afabe8 WatchSource:0}: Error finding container 29c7ae6c5c46d1270df04e76999e2c4c828e00f9cd3f0e85cab03a5ee4afabe8: Status 404 returned error can't find the container with id 29c7ae6c5c46d1270df04e76999e2c4c828e00f9cd3f0e85cab03a5ee4afabe8 Jul 27 20:49:57.373816 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:57.373765 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-afbe9b95-bd5c9d898-wphxd" event={"ID":"2f9276c8-3b49-43ac-a252-390a6a9714b4","Type":"ContainerStarted","Data":"96f588ca3820be7abbcf4238a92bcf40684a6a3a92a084454cf0b5845a95565a"} Jul 27 20:49:57.374028 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:57.373832 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-afbe9b95-bd5c9d898-wphxd" Jul 27 20:49:57.374028 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:57.373859 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-afbe9b95-bd5c9d898-wphxd" event={"ID":"2f9276c8-3b49-43ac-a252-390a6a9714b4","Type":"ContainerStarted","Data":"29c7ae6c5c46d1270df04e76999e2c4c828e00f9cd3f0e85cab03a5ee4afabe8"} Jul 27 20:49:57.375353 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:57.375329 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-afbe9b95-67f4f67fdd-l7ldv" event={"ID":"979e9943-044d-4d0a-85e9-f7f6368234de","Type":"ContainerStarted","Data":"a7685524022a5d2c5b7a813748e8a62d8e4b4e9666e25b8351daaea7741d1436"} Jul 27 20:49:57.375490 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:57.375367 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-afbe9b95-67f4f67fdd-l7ldv" event={"ID":"979e9943-044d-4d0a-85e9-f7f6368234de","Type":"ContainerStarted","Data":"2b9dc756134158cf348c3813137b803bb1d4afd665bc6664fd5df02d3e3b175c"} Jul 27 20:49:57.375490 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:57.375467 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-afbe9b95-67f4f67fdd-l7ldv" Jul 27 20:49:57.389940 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:57.389888 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-afbe9b95-bd5c9d898-wphxd" podStartSLOduration=1.389872566 podStartE2EDuration="1.389872566s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:49:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:49:57.388577997 +0000 UTC m=+1939.967151586" watchObservedRunningTime="2026-07-27 20:49:57.389872566 +0000 UTC m=+1939.968446155" Jul 27 20:49:57.403135 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:57.403095 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-afbe9b95-67f4f67fdd-l7ldv" podStartSLOduration=1.403082244 podStartE2EDuration="1.403082244s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:49:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:49:57.402240719 +0000 UTC m=+1939.980814309" watchObservedRunningTime="2026-07-27 20:49:57.403082244 +0000 UTC m=+1939.981655874" Jul 27 20:49:59.563901 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:49:59.563867 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:50:00.301603 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:00.301570 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:50:02.319087 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:02.319049 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:50:08.380837 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:08.380803 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-afbe9b95-bd5c9d898-wphxd" Jul 27 20:50:08.381209 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:08.380883 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-afbe9b95-67f4f67fdd-l7ldv" Jul 27 20:50:10.640740 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:10.640705 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:50:16.911890 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:16.911857 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:50:25.719786 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:25.719749 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:50:43.523637 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:43.523557 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:50:44.993418 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:44.993383 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:50:45.016379 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:45.016349 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-afbe9b95-bd5c9d898-wphxd"] Jul 27 20:50:45.016616 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:45.016591 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-afbe9b95-bd5c9d898-wphxd" podUID="2f9276c8-3b49-43ac-a252-390a6a9714b4" containerName="payload-processing" containerID="cri-o://96f588ca3820be7abbcf4238a92bcf40684a6a3a92a084454cf0b5845a95565a" gracePeriod=30 Jul 27 20:50:45.027302 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:45.027277 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-afbe9b95-67f4f67fdd-l7ldv"] Jul 27 20:50:45.027642 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:45.027605 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-afbe9b95-67f4f67fdd-l7ldv" podUID="979e9943-044d-4d0a-85e9-f7f6368234de" containerName="payload-pre-processing" containerID="cri-o://a7685524022a5d2c5b7a813748e8a62d8e4b4e9666e25b8351daaea7741d1436" gracePeriod=30 Jul 27 20:50:45.298099 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:45.298077 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-afbe9b95-bd5c9d898-wphxd" Jul 27 20:50:45.304158 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:45.304138 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-afbe9b95-67f4f67fdd-l7ldv" Jul 27 20:50:45.358415 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:45.358392 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/979e9943-044d-4d0a-85e9-f7f6368234de-plugins-config-volume\") pod \"979e9943-044d-4d0a-85e9-f7f6368234de\" (UID: \"979e9943-044d-4d0a-85e9-f7f6368234de\") " Jul 27 20:50:45.358535 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:45.358432 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpb7h\" (UniqueName: \"kubernetes.io/projected/979e9943-044d-4d0a-85e9-f7f6368234de-kube-api-access-kpb7h\") pod \"979e9943-044d-4d0a-85e9-f7f6368234de\" (UID: \"979e9943-044d-4d0a-85e9-f7f6368234de\") " Jul 27 20:50:45.358535 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:45.358479 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8zbv\" (UniqueName: \"kubernetes.io/projected/2f9276c8-3b49-43ac-a252-390a6a9714b4-kube-api-access-d8zbv\") pod \"2f9276c8-3b49-43ac-a252-390a6a9714b4\" (UID: \"2f9276c8-3b49-43ac-a252-390a6a9714b4\") " Jul 27 20:50:45.358535 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:45.358501 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f9276c8-3b49-43ac-a252-390a6a9714b4-plugins-config-volume\") pod \"2f9276c8-3b49-43ac-a252-390a6a9714b4\" (UID: \"2f9276c8-3b49-43ac-a252-390a6a9714b4\") " Jul 27 20:50:45.358900 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:45.358821 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/979e9943-044d-4d0a-85e9-f7f6368234de-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "979e9943-044d-4d0a-85e9-f7f6368234de" (UID: "979e9943-044d-4d0a-85e9-f7f6368234de"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:50:45.359062 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:45.359027 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f9276c8-3b49-43ac-a252-390a6a9714b4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2f9276c8-3b49-43ac-a252-390a6a9714b4" (UID: "2f9276c8-3b49-43ac-a252-390a6a9714b4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:50:45.360593 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:45.360571 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/979e9943-044d-4d0a-85e9-f7f6368234de-kube-api-access-kpb7h" (OuterVolumeSpecName: "kube-api-access-kpb7h") pod "979e9943-044d-4d0a-85e9-f7f6368234de" (UID: "979e9943-044d-4d0a-85e9-f7f6368234de"). InnerVolumeSpecName "kube-api-access-kpb7h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:50:45.360593 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:45.360576 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f9276c8-3b49-43ac-a252-390a6a9714b4-kube-api-access-d8zbv" (OuterVolumeSpecName: "kube-api-access-d8zbv") pod "2f9276c8-3b49-43ac-a252-390a6a9714b4" (UID: "2f9276c8-3b49-43ac-a252-390a6a9714b4"). InnerVolumeSpecName "kube-api-access-d8zbv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:50:45.459387 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:45.459363 2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f9276c8-3b49-43ac-a252-390a6a9714b4-plugins-config-volume\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 20:50:45.459387 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:45.459385 2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/979e9943-044d-4d0a-85e9-f7f6368234de-plugins-config-volume\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 20:50:45.459387 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:45.459393 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpb7h\" (UniqueName: \"kubernetes.io/projected/979e9943-044d-4d0a-85e9-f7f6368234de-kube-api-access-kpb7h\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 20:50:45.459790 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:45.459402 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8zbv\" (UniqueName: \"kubernetes.io/projected/2f9276c8-3b49-43ac-a252-390a6a9714b4-kube-api-access-d8zbv\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 20:50:45.567912 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:45.567802 2558 generic.go:356] "Generic (PLEG): container finished" podID="2f9276c8-3b49-43ac-a252-390a6a9714b4" containerID="96f588ca3820be7abbcf4238a92bcf40684a6a3a92a084454cf0b5845a95565a" exitCode=0 Jul 27 20:50:45.568146 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:45.567933 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-afbe9b95-bd5c9d898-wphxd" Jul 27 20:50:45.568146 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:45.567955 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-afbe9b95-bd5c9d898-wphxd" event={"ID":"2f9276c8-3b49-43ac-a252-390a6a9714b4","Type":"ContainerDied","Data":"96f588ca3820be7abbcf4238a92bcf40684a6a3a92a084454cf0b5845a95565a"} Jul 27 20:50:45.568146 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:45.568086 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-afbe9b95-bd5c9d898-wphxd" event={"ID":"2f9276c8-3b49-43ac-a252-390a6a9714b4","Type":"ContainerDied","Data":"29c7ae6c5c46d1270df04e76999e2c4c828e00f9cd3f0e85cab03a5ee4afabe8"} Jul 27 20:50:45.568146 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:45.568124 2558 scope.go:117] "RemoveContainer" containerID="96f588ca3820be7abbcf4238a92bcf40684a6a3a92a084454cf0b5845a95565a" Jul 27 20:50:45.570173 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:45.570147 2558 generic.go:356] "Generic (PLEG): container finished" podID="979e9943-044d-4d0a-85e9-f7f6368234de" containerID="a7685524022a5d2c5b7a813748e8a62d8e4b4e9666e25b8351daaea7741d1436" exitCode=0 Jul 27 20:50:45.570316 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:45.570191 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-afbe9b95-67f4f67fdd-l7ldv" event={"ID":"979e9943-044d-4d0a-85e9-f7f6368234de","Type":"ContainerDied","Data":"a7685524022a5d2c5b7a813748e8a62d8e4b4e9666e25b8351daaea7741d1436"} Jul 27 20:50:45.570316 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:45.570230 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-afbe9b95-67f4f67fdd-l7ldv" event={"ID":"979e9943-044d-4d0a-85e9-f7f6368234de","Type":"ContainerDied","Data":"2b9dc756134158cf348c3813137b803bb1d4afd665bc6664fd5df02d3e3b175c"} Jul 27 20:50:45.570316 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:45.570302 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-afbe9b95-67f4f67fdd-l7ldv" Jul 27 20:50:45.578954 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:45.578936 2558 scope.go:117] "RemoveContainer" containerID="96f588ca3820be7abbcf4238a92bcf40684a6a3a92a084454cf0b5845a95565a" Jul 27 20:50:45.579280 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:50:45.579235 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96f588ca3820be7abbcf4238a92bcf40684a6a3a92a084454cf0b5845a95565a\": container with ID starting with 96f588ca3820be7abbcf4238a92bcf40684a6a3a92a084454cf0b5845a95565a not found: ID does not exist" containerID="96f588ca3820be7abbcf4238a92bcf40684a6a3a92a084454cf0b5845a95565a" Jul 27 20:50:45.579280 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:45.579271 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96f588ca3820be7abbcf4238a92bcf40684a6a3a92a084454cf0b5845a95565a"} err="failed to get container status \"96f588ca3820be7abbcf4238a92bcf40684a6a3a92a084454cf0b5845a95565a\": rpc error: code = NotFound desc = could not find container \"96f588ca3820be7abbcf4238a92bcf40684a6a3a92a084454cf0b5845a95565a\": container with ID starting with 96f588ca3820be7abbcf4238a92bcf40684a6a3a92a084454cf0b5845a95565a not found: ID does not exist" Jul 27 20:50:45.579450 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:45.579292 2558 scope.go:117] "RemoveContainer" containerID="a7685524022a5d2c5b7a813748e8a62d8e4b4e9666e25b8351daaea7741d1436" Jul 27 20:50:45.591842 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:45.591822 2558 scope.go:117] "RemoveContainer" containerID="a7685524022a5d2c5b7a813748e8a62d8e4b4e9666e25b8351daaea7741d1436" Jul 27 20:50:45.592833 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:45.592808 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-afbe9b95-bd5c9d898-wphxd"] Jul 27 20:50:45.596961 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:50:45.596925 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7685524022a5d2c5b7a813748e8a62d8e4b4e9666e25b8351daaea7741d1436\": container with ID starting with a7685524022a5d2c5b7a813748e8a62d8e4b4e9666e25b8351daaea7741d1436 not found: ID does not exist" containerID="a7685524022a5d2c5b7a813748e8a62d8e4b4e9666e25b8351daaea7741d1436" Jul 27 20:50:45.596961 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:45.596955 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7685524022a5d2c5b7a813748e8a62d8e4b4e9666e25b8351daaea7741d1436"} err="failed to get container status \"a7685524022a5d2c5b7a813748e8a62d8e4b4e9666e25b8351daaea7741d1436\": rpc error: code = NotFound desc = could not find container \"a7685524022a5d2c5b7a813748e8a62d8e4b4e9666e25b8351daaea7741d1436\": container with ID starting with a7685524022a5d2c5b7a813748e8a62d8e4b4e9666e25b8351daaea7741d1436 not found: ID does not exist" Jul 27 20:50:45.597553 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:45.597532 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-afbe9b95-bd5c9d898-wphxd"] Jul 27 20:50:45.607888 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:45.607869 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-afbe9b95-67f4f67fdd-l7ldv"] Jul 27 20:50:45.613702 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:45.613672 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-afbe9b95-67f4f67fdd-l7ldv"] Jul 27 20:50:45.933436 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:45.933360 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f9276c8-3b49-43ac-a252-390a6a9714b4" path="/var/lib/kubelet/pods/2f9276c8-3b49-43ac-a252-390a6a9714b4/volumes" Jul 27 20:50:45.933723 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:45.933709 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="979e9943-044d-4d0a-85e9-f7f6368234de" path="/var/lib/kubelet/pods/979e9943-044d-4d0a-85e9-f7f6368234de/volumes" Jul 27 20:50:46.326504 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:46.326453 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:50:49.499005 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:49.498947 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:50:52.641093 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:52.641055 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:50:54.025430 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:54.025393 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:50:57.672763 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:50:57.672718 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:51:33.893400 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:51:33.893358 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:51:35.224065 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:51:35.224029 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:51:40.717082 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:51:40.717044 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:51:46.363032 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:51:46.362986 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:51:46.442171 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:51:46.442137 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:51:46.648520 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:51:46.648433 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:51:46.848639 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:51:46.848605 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:51:47.891558 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:51:47.891518 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:51:47.989161 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:51:47.989134 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:51:48.089375 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:51:48.089347 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:51:48.785809 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:51:48.785771 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:51:48.895098 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:51:48.895065 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:51:49.042987 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:51:49.042901 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:51:50.343584 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:51:50.343546 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:51:50.520558 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:51:50.520517 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:51:56.068411 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:51:56.068379 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:51:56.171002 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:51:56.170977 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:51:56.794308 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:51:56.794272 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:52:02.124545 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:02.124465 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:52:02.583271 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:02.583236 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:52:02.692595 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:02.692559 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:52:02.784711 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:02.784661 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:52:13.266864 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:13.266815 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:52:13.618293 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:13.618209 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:52:34.579741 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:34.579685 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:52:37.915856 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:37.915830 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rnj2b_c421dc44-8fcf-44f4-b483-8e0271833d10/ovn-acl-logging/0.log" Jul 27 20:52:37.916867 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:37.916841 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rnj2b_c421dc44-8fcf-44f4-b483-8e0271833d10/ovn-acl-logging/0.log" Jul 27 20:52:40.901040 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:40.900989 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:52:41.001312 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:41.001273 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:52:41.227640 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:41.227555 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:52:41.534326 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:41.534286 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:52:42.031086 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:42.031023 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:52:44.736458 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:44.736419 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:52:44.822033 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:44.821987 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:52:44.895336 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:44.895283 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:52:45.385150 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:45.385120 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:52:45.484125 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:45.484091 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:52:45.489019 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:45.488995 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c5205b-689795dd88-pd7cc"] Jul 27 20:52:45.489260 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:45.489248 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f9276c8-3b49-43ac-a252-390a6a9714b4" containerName="payload-processing" Jul 27 20:52:45.489302 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:45.489261 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f9276c8-3b49-43ac-a252-390a6a9714b4" containerName="payload-processing" Jul 27 20:52:45.489302 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:45.489278 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="979e9943-044d-4d0a-85e9-f7f6368234de" containerName="payload-pre-processing" Jul 27 20:52:45.489302 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:45.489283 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="979e9943-044d-4d0a-85e9-f7f6368234de" containerName="payload-pre-processing" Jul 27 20:52:45.489392 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:45.489334 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="979e9943-044d-4d0a-85e9-f7f6368234de" containerName="payload-pre-processing" Jul 27 20:52:45.489392 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:45.489340 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f9276c8-3b49-43ac-a252-390a6a9714b4" containerName="payload-processing" Jul 27 20:52:45.491872 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:45.491854 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c5205b-689795dd88-pd7cc" Jul 27 20:52:45.494315 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:45.494294 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-c5205b-dockercfg-62hlk\"" Jul 27 20:52:45.494421 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:45.494302 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-c5205b\"" Jul 27 20:52:45.502925 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:45.502904 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c5205b-689795dd88-pd7cc"] Jul 27 20:52:45.517590 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:45.517567 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c5205b-66445464d-qn2j4"] Jul 27 20:52:45.520363 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:45.520347 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-c5205b-66445464d-qn2j4" Jul 27 20:52:45.533728 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:45.533707 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c5205b-66445464d-qn2j4"] Jul 27 20:52:45.578330 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:45.578299 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwcxr\" (UniqueName: \"kubernetes.io/projected/0433e389-6854-488c-ad9b-bad6ab3bd2f3-kube-api-access-mwcxr\") pod \"payload-pre-processing-e2e-inf-a-c5205b-689795dd88-pd7cc\" (UID: \"0433e389-6854-488c-ad9b-bad6ab3bd2f3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c5205b-689795dd88-pd7cc" Jul 27 20:52:45.578488 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:45.578371 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0433e389-6854-488c-ad9b-bad6ab3bd2f3-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-c5205b-689795dd88-pd7cc\" (UID: \"0433e389-6854-488c-ad9b-bad6ab3bd2f3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c5205b-689795dd88-pd7cc" Jul 27 20:52:45.679465 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:45.679393 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0433e389-6854-488c-ad9b-bad6ab3bd2f3-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-c5205b-689795dd88-pd7cc\" (UID: \"0433e389-6854-488c-ad9b-bad6ab3bd2f3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c5205b-689795dd88-pd7cc" Jul 27 20:52:45.679465 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:45.679434 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwcxr\" (UniqueName: \"kubernetes.io/projected/0433e389-6854-488c-ad9b-bad6ab3bd2f3-kube-api-access-mwcxr\") pod \"payload-pre-processing-e2e-inf-a-c5205b-689795dd88-pd7cc\" (UID: \"0433e389-6854-488c-ad9b-bad6ab3bd2f3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c5205b-689795dd88-pd7cc" Jul 27 20:52:45.679465 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:45.679462 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksktf\" (UniqueName: \"kubernetes.io/projected/41e75b1e-fad8-47cb-b625-ec2842791022-kube-api-access-ksktf\") pod \"payload-processing-e2e-inf-a-c5205b-66445464d-qn2j4\" (UID: \"41e75b1e-fad8-47cb-b625-ec2842791022\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c5205b-66445464d-qn2j4" Jul 27 20:52:45.679754 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:45.679506 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41e75b1e-fad8-47cb-b625-ec2842791022-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-c5205b-66445464d-qn2j4\" (UID: \"41e75b1e-fad8-47cb-b625-ec2842791022\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c5205b-66445464d-qn2j4" Jul 27 20:52:45.680097 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:45.680078 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0433e389-6854-488c-ad9b-bad6ab3bd2f3-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-c5205b-689795dd88-pd7cc\" (UID: \"0433e389-6854-488c-ad9b-bad6ab3bd2f3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c5205b-689795dd88-pd7cc" Jul 27 20:52:45.687161 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:45.687133 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwcxr\" (UniqueName: \"kubernetes.io/projected/0433e389-6854-488c-ad9b-bad6ab3bd2f3-kube-api-access-mwcxr\") pod \"payload-pre-processing-e2e-inf-a-c5205b-689795dd88-pd7cc\" (UID: \"0433e389-6854-488c-ad9b-bad6ab3bd2f3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c5205b-689795dd88-pd7cc" Jul 27 20:52:45.780856 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:45.780825 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksktf\" (UniqueName: \"kubernetes.io/projected/41e75b1e-fad8-47cb-b625-ec2842791022-kube-api-access-ksktf\") pod \"payload-processing-e2e-inf-a-c5205b-66445464d-qn2j4\" (UID: \"41e75b1e-fad8-47cb-b625-ec2842791022\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c5205b-66445464d-qn2j4" Jul 27 20:52:45.781206 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:45.780876 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41e75b1e-fad8-47cb-b625-ec2842791022-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-c5205b-66445464d-qn2j4\" (UID: \"41e75b1e-fad8-47cb-b625-ec2842791022\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c5205b-66445464d-qn2j4" Jul 27 20:52:45.781495 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:45.781478 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41e75b1e-fad8-47cb-b625-ec2842791022-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-c5205b-66445464d-qn2j4\" (UID: \"41e75b1e-fad8-47cb-b625-ec2842791022\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c5205b-66445464d-qn2j4" Jul 27 20:52:45.788329 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:45.788299 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksktf\" (UniqueName: \"kubernetes.io/projected/41e75b1e-fad8-47cb-b625-ec2842791022-kube-api-access-ksktf\") pod \"payload-processing-e2e-inf-a-c5205b-66445464d-qn2j4\" (UID: \"41e75b1e-fad8-47cb-b625-ec2842791022\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c5205b-66445464d-qn2j4" Jul 27 20:52:45.801680 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:45.801662 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c5205b-689795dd88-pd7cc" Jul 27 20:52:45.829592 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:45.829572 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-c5205b-66445464d-qn2j4" Jul 27 20:52:45.948225 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:45.946441 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c5205b-689795dd88-pd7cc"] Jul 27 20:52:45.968515 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:45.968491 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c5205b-66445464d-qn2j4"] Jul 27 20:52:45.969808 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:52:45.969786 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41e75b1e_fad8_47cb_b625_ec2842791022.slice/crio-326d5915d7b5888e08d9fed61122728c238db72f96bea13977bacd20da432e8b WatchSource:0}: Error finding container 326d5915d7b5888e08d9fed61122728c238db72f96bea13977bacd20da432e8b: Status 404 returned error can't find the container with id 326d5915d7b5888e08d9fed61122728c238db72f96bea13977bacd20da432e8b Jul 27 20:52:46.044331 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:46.044300 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c5205b-689795dd88-pd7cc" event={"ID":"0433e389-6854-488c-ad9b-bad6ab3bd2f3","Type":"ContainerStarted","Data":"4e2891288d79eb3b5f2b0eb8fab55514cf8c199217dfd15bdf6aca0763185e1e"} Jul 27 20:52:46.044470 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:46.044360 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c5205b-689795dd88-pd7cc" event={"ID":"0433e389-6854-488c-ad9b-bad6ab3bd2f3","Type":"ContainerStarted","Data":"e59fb0127769ea2fee0634859612288f0b0d60d5e501645a58dbcb66f8332a02"} Jul 27 20:52:46.044470 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:46.044389 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c5205b-689795dd88-pd7cc" Jul 27 20:52:46.045655 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:46.045628 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-c5205b-66445464d-qn2j4" event={"ID":"41e75b1e-fad8-47cb-b625-ec2842791022","Type":"ContainerStarted","Data":"839ea5d3648618ab216f06d045b7db182ead778ab18819e272b86a61e3788985"} Jul 27 20:52:46.045766 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:46.045670 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-c5205b-66445464d-qn2j4" event={"ID":"41e75b1e-fad8-47cb-b625-ec2842791022","Type":"ContainerStarted","Data":"326d5915d7b5888e08d9fed61122728c238db72f96bea13977bacd20da432e8b"} Jul 27 20:52:46.045766 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:46.045715 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-c5205b-66445464d-qn2j4" Jul 27 20:52:46.061096 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:46.061047 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c5205b-689795dd88-pd7cc" podStartSLOduration=1.061030009 podStartE2EDuration="1.061030009s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:52:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:52:46.058912318 +0000 UTC m=+2108.637485907" watchObservedRunningTime="2026-07-27 20:52:46.061030009 +0000 UTC m=+2108.639603600" Jul 27 20:52:46.074985 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:46.074943 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-c5205b-66445464d-qn2j4" podStartSLOduration=1.074927938 podStartE2EDuration="1.074927938s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:52:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:52:46.074054432 +0000 UTC m=+2108.652628022" watchObservedRunningTime="2026-07-27 20:52:46.074927938 +0000 UTC m=+2108.653501560" Jul 27 20:52:49.243249 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:49.243195 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:52:49.560313 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:49.560271 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:52:49.866969 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:49.866891 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:52:50.257060 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:50.257032 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:52:52.210447 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:52.210411 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:52:52.816409 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:52.816374 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:52:52.919525 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:52.919487 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:52:53.013641 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:53.013602 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:52:53.398570 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:53.398535 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:52:53.532409 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:53.532372 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:52:53.630117 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:53.630083 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:52:53.637253 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:53.637228 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-704ca2-869f5c66dd-rx2gz"] Jul 27 20:52:53.640698 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:53.640667 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-704ca2-869f5c66dd-rx2gz" Jul 27 20:52:53.643038 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:53.643017 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-704ca2-dockercfg-rtmn8\"" Jul 27 20:52:53.643162 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:53.643145 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-704ca2\"" Jul 27 20:52:53.650085 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:53.650032 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-704ca2-869f5c66dd-rx2gz"] Jul 27 20:52:53.654718 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:53.654682 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-704ca2-6469fdbcc8-9nkkm"] Jul 27 20:52:53.657664 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:53.657651 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-704ca2-6469fdbcc8-9nkkm" Jul 27 20:52:53.668902 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:53.668882 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-704ca2-6469fdbcc8-9nkkm"] Jul 27 20:52:53.743749 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:53.743711 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l85w4\" (UniqueName: \"kubernetes.io/projected/455cb1f3-d3e7-4948-9474-0053221395bc-kube-api-access-l85w4\") pod \"payload-processing-e2e-inf-b-704ca2-6469fdbcc8-9nkkm\" (UID: \"455cb1f3-d3e7-4948-9474-0053221395bc\") " pod="openshift-ingress/payload-processing-e2e-inf-b-704ca2-6469fdbcc8-9nkkm" Jul 27 20:52:53.743923 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:53.743780 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/409fbe75-6405-41b3-ae9b-3a4be474eb88-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-704ca2-869f5c66dd-rx2gz\" (UID: \"409fbe75-6405-41b3-ae9b-3a4be474eb88\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-704ca2-869f5c66dd-rx2gz" Jul 27 20:52:53.743923 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:53.743841 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pxp5\" (UniqueName: \"kubernetes.io/projected/409fbe75-6405-41b3-ae9b-3a4be474eb88-kube-api-access-2pxp5\") pod \"payload-pre-processing-e2e-inf-b-704ca2-869f5c66dd-rx2gz\" (UID: \"409fbe75-6405-41b3-ae9b-3a4be474eb88\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-704ca2-869f5c66dd-rx2gz" Jul 27 20:52:53.744010 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:53.743942 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/455cb1f3-d3e7-4948-9474-0053221395bc-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-704ca2-6469fdbcc8-9nkkm\" (UID: \"455cb1f3-d3e7-4948-9474-0053221395bc\") " pod="openshift-ingress/payload-processing-e2e-inf-b-704ca2-6469fdbcc8-9nkkm" Jul 27 20:52:53.844645 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:53.844608 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pxp5\" (UniqueName: \"kubernetes.io/projected/409fbe75-6405-41b3-ae9b-3a4be474eb88-kube-api-access-2pxp5\") pod \"payload-pre-processing-e2e-inf-b-704ca2-869f5c66dd-rx2gz\" (UID: \"409fbe75-6405-41b3-ae9b-3a4be474eb88\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-704ca2-869f5c66dd-rx2gz" Jul 27 20:52:53.844855 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:53.844678 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/455cb1f3-d3e7-4948-9474-0053221395bc-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-704ca2-6469fdbcc8-9nkkm\" (UID: \"455cb1f3-d3e7-4948-9474-0053221395bc\") " pod="openshift-ingress/payload-processing-e2e-inf-b-704ca2-6469fdbcc8-9nkkm" Jul 27 20:52:53.844855 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:53.844726 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l85w4\" (UniqueName: \"kubernetes.io/projected/455cb1f3-d3e7-4948-9474-0053221395bc-kube-api-access-l85w4\") pod \"payload-processing-e2e-inf-b-704ca2-6469fdbcc8-9nkkm\" (UID: \"455cb1f3-d3e7-4948-9474-0053221395bc\") " pod="openshift-ingress/payload-processing-e2e-inf-b-704ca2-6469fdbcc8-9nkkm" Jul 27 20:52:53.844979 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:53.844881 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/409fbe75-6405-41b3-ae9b-3a4be474eb88-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-704ca2-869f5c66dd-rx2gz\" (UID: \"409fbe75-6405-41b3-ae9b-3a4be474eb88\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-704ca2-869f5c66dd-rx2gz" Jul 27 20:52:53.845508 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:53.845483 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/455cb1f3-d3e7-4948-9474-0053221395bc-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-704ca2-6469fdbcc8-9nkkm\" (UID: \"455cb1f3-d3e7-4948-9474-0053221395bc\") " pod="openshift-ingress/payload-processing-e2e-inf-b-704ca2-6469fdbcc8-9nkkm" Jul 27 20:52:53.845612 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:53.845546 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/409fbe75-6405-41b3-ae9b-3a4be474eb88-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-704ca2-869f5c66dd-rx2gz\" (UID: \"409fbe75-6405-41b3-ae9b-3a4be474eb88\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-704ca2-869f5c66dd-rx2gz" Jul 27 20:52:53.852335 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:53.852313 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pxp5\" (UniqueName: \"kubernetes.io/projected/409fbe75-6405-41b3-ae9b-3a4be474eb88-kube-api-access-2pxp5\") pod \"payload-pre-processing-e2e-inf-b-704ca2-869f5c66dd-rx2gz\" (UID: \"409fbe75-6405-41b3-ae9b-3a4be474eb88\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-704ca2-869f5c66dd-rx2gz" Jul 27 20:52:53.852427 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:53.852318 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l85w4\" (UniqueName: \"kubernetes.io/projected/455cb1f3-d3e7-4948-9474-0053221395bc-kube-api-access-l85w4\") pod \"payload-processing-e2e-inf-b-704ca2-6469fdbcc8-9nkkm\" (UID: \"455cb1f3-d3e7-4948-9474-0053221395bc\") " pod="openshift-ingress/payload-processing-e2e-inf-b-704ca2-6469fdbcc8-9nkkm" Jul 27 20:52:53.951559 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:53.951480 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-704ca2-869f5c66dd-rx2gz" Jul 27 20:52:53.968754 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:53.968730 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-704ca2-6469fdbcc8-9nkkm" Jul 27 20:52:54.088834 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:54.088804 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-704ca2-869f5c66dd-rx2gz"] Jul 27 20:52:54.092085 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:52:54.092046 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod409fbe75_6405_41b3_ae9b_3a4be474eb88.slice/crio-267eee32074667adde2f338ee8fc1c5e36f71ca54c171101b41d5955b5548432 WatchSource:0}: Error finding container 267eee32074667adde2f338ee8fc1c5e36f71ca54c171101b41d5955b5548432: Status 404 returned error can't find the container with id 267eee32074667adde2f338ee8fc1c5e36f71ca54c171101b41d5955b5548432 Jul 27 20:52:54.324015 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:54.322408 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-704ca2-6469fdbcc8-9nkkm"] Jul 27 20:52:54.325951 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:52:54.325925 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod455cb1f3_d3e7_4948_9474_0053221395bc.slice/crio-f43d0c111f12a64f818c0d40a5fad9b7b1afc76cbe2a6148fb277d749d72e543 WatchSource:0}: Error finding container f43d0c111f12a64f818c0d40a5fad9b7b1afc76cbe2a6148fb277d749d72e543: Status 404 returned error can't find the container with id f43d0c111f12a64f818c0d40a5fad9b7b1afc76cbe2a6148fb277d749d72e543 Jul 27 20:52:55.084433 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:55.084401 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-704ca2-869f5c66dd-rx2gz" event={"ID":"409fbe75-6405-41b3-ae9b-3a4be474eb88","Type":"ContainerStarted","Data":"488e58da1f1ce00fae6b4951eb98eafcb37c24cb6a423062312c1deb9161ffc9"} Jul 27 20:52:55.084846 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:55.084449 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-704ca2-869f5c66dd-rx2gz" event={"ID":"409fbe75-6405-41b3-ae9b-3a4be474eb88","Type":"ContainerStarted","Data":"267eee32074667adde2f338ee8fc1c5e36f71ca54c171101b41d5955b5548432"} Jul 27 20:52:55.084846 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:55.084476 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-704ca2-869f5c66dd-rx2gz" Jul 27 20:52:55.085950 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:55.085925 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-704ca2-6469fdbcc8-9nkkm" event={"ID":"455cb1f3-d3e7-4948-9474-0053221395bc","Type":"ContainerStarted","Data":"1ae98a40c0518df49c36fe60c11adcc865c8ed38e6080c362692c01a99c7cdd6"} Jul 27 20:52:55.086042 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:55.085974 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-704ca2-6469fdbcc8-9nkkm" event={"ID":"455cb1f3-d3e7-4948-9474-0053221395bc","Type":"ContainerStarted","Data":"f43d0c111f12a64f818c0d40a5fad9b7b1afc76cbe2a6148fb277d749d72e543"} Jul 27 20:52:55.086042 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:55.085996 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-704ca2-6469fdbcc8-9nkkm" Jul 27 20:52:55.098843 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:55.098799 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-704ca2-869f5c66dd-rx2gz" podStartSLOduration=2.098785488 podStartE2EDuration="2.098785488s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:52:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:52:55.098005214 +0000 UTC m=+2117.676578803" watchObservedRunningTime="2026-07-27 20:52:55.098785488 +0000 UTC m=+2117.677359078" Jul 27 20:52:55.112367 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:55.112328 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-704ca2-6469fdbcc8-9nkkm" podStartSLOduration=2.112318717 podStartE2EDuration="2.112318717s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:52:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:52:55.111319576 +0000 UTC m=+2117.689893166" watchObservedRunningTime="2026-07-27 20:52:55.112318717 +0000 UTC m=+2117.690892306" Jul 27 20:52:57.051377 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:57.051348 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-c5205b-66445464d-qn2j4" Jul 27 20:52:57.051797 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:57.051608 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c5205b-689795dd88-pd7cc" Jul 27 20:52:57.289893 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:52:57.289862 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:53:06.092553 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:53:06.092523 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-704ca2-869f5c66dd-rx2gz" Jul 27 20:53:06.092994 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:53:06.092681 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-704ca2-6469fdbcc8-9nkkm" Jul 27 20:53:06.816101 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:53:06.816064 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:53:11.832345 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:53:11.832302 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:53:16.315407 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:53:16.315371 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:53:40.394783 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:53:40.394684 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:53:45.021589 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:53:45.021549 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:54:02.611702 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:02.611657 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:54:22.103556 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:22.103516 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:54:23.113833 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:23.113791 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:54:29.408898 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:29.408859 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:54:32.151393 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:32.151352 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:54:32.252456 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:32.252418 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:54:33.664908 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:33.664874 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:54:33.688099 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:33.688068 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c5205b-66445464d-qn2j4"] Jul 27 20:54:33.688337 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:33.688310 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-c5205b-66445464d-qn2j4" podUID="41e75b1e-fad8-47cb-b625-ec2842791022" containerName="payload-processing" containerID="cri-o://839ea5d3648618ab216f06d045b7db182ead778ab18819e272b86a61e3788985" gracePeriod=30 Jul 27 20:54:33.694697 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:33.694657 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c5205b-689795dd88-pd7cc"] Jul 27 20:54:33.694898 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:33.694872 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c5205b-689795dd88-pd7cc" podUID="0433e389-6854-488c-ad9b-bad6ab3bd2f3" containerName="payload-pre-processing" containerID="cri-o://4e2891288d79eb3b5f2b0eb8fab55514cf8c199217dfd15bdf6aca0763185e1e" gracePeriod=30 Jul 27 20:54:33.728349 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:33.728314 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:54:33.785744 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:33.785715 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:54:33.954865 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:33.954842 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-c5205b-66445464d-qn2j4" Jul 27 20:54:33.970024 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:33.970007 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c5205b-689795dd88-pd7cc" Jul 27 20:54:34.057522 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:34.057497 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0433e389-6854-488c-ad9b-bad6ab3bd2f3-plugins-config-volume\") pod \"0433e389-6854-488c-ad9b-bad6ab3bd2f3\" (UID: \"0433e389-6854-488c-ad9b-bad6ab3bd2f3\") " Jul 27 20:54:34.057714 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:34.057535 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ksktf\" (UniqueName: \"kubernetes.io/projected/41e75b1e-fad8-47cb-b625-ec2842791022-kube-api-access-ksktf\") pod \"41e75b1e-fad8-47cb-b625-ec2842791022\" (UID: \"41e75b1e-fad8-47cb-b625-ec2842791022\") " Jul 27 20:54:34.057714 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:34.057650 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41e75b1e-fad8-47cb-b625-ec2842791022-plugins-config-volume\") pod \"41e75b1e-fad8-47cb-b625-ec2842791022\" (UID: \"41e75b1e-fad8-47cb-b625-ec2842791022\") " Jul 27 20:54:34.057801 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:34.057711 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwcxr\" (UniqueName: \"kubernetes.io/projected/0433e389-6854-488c-ad9b-bad6ab3bd2f3-kube-api-access-mwcxr\") pod \"0433e389-6854-488c-ad9b-bad6ab3bd2f3\" (UID: \"0433e389-6854-488c-ad9b-bad6ab3bd2f3\") " Jul 27 20:54:34.058010 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:34.057990 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0433e389-6854-488c-ad9b-bad6ab3bd2f3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0433e389-6854-488c-ad9b-bad6ab3bd2f3" (UID: "0433e389-6854-488c-ad9b-bad6ab3bd2f3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:54:34.058068 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:34.058017 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41e75b1e-fad8-47cb-b625-ec2842791022-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "41e75b1e-fad8-47cb-b625-ec2842791022" (UID: "41e75b1e-fad8-47cb-b625-ec2842791022"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:54:34.059833 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:34.059810 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0433e389-6854-488c-ad9b-bad6ab3bd2f3-kube-api-access-mwcxr" (OuterVolumeSpecName: "kube-api-access-mwcxr") pod "0433e389-6854-488c-ad9b-bad6ab3bd2f3" (UID: "0433e389-6854-488c-ad9b-bad6ab3bd2f3"). InnerVolumeSpecName "kube-api-access-mwcxr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:54:34.059833 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:34.059815 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41e75b1e-fad8-47cb-b625-ec2842791022-kube-api-access-ksktf" (OuterVolumeSpecName: "kube-api-access-ksktf") pod "41e75b1e-fad8-47cb-b625-ec2842791022" (UID: "41e75b1e-fad8-47cb-b625-ec2842791022"). InnerVolumeSpecName "kube-api-access-ksktf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:54:34.158559 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:34.158535 2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41e75b1e-fad8-47cb-b625-ec2842791022-plugins-config-volume\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 20:54:34.158559 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:34.158554 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwcxr\" (UniqueName: \"kubernetes.io/projected/0433e389-6854-488c-ad9b-bad6ab3bd2f3-kube-api-access-mwcxr\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 20:54:34.158559 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:34.158563 2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0433e389-6854-488c-ad9b-bad6ab3bd2f3-plugins-config-volume\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 20:54:34.158771 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:34.158571 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ksktf\" (UniqueName: \"kubernetes.io/projected/41e75b1e-fad8-47cb-b625-ec2842791022-kube-api-access-ksktf\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 20:54:34.501098 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:34.501064 2558 generic.go:356] "Generic (PLEG): container finished" podID="41e75b1e-fad8-47cb-b625-ec2842791022" containerID="839ea5d3648618ab216f06d045b7db182ead778ab18819e272b86a61e3788985" exitCode=0 Jul 27 20:54:34.501298 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:34.501106 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-c5205b-66445464d-qn2j4" Jul 27 20:54:34.501298 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:34.501155 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-c5205b-66445464d-qn2j4" event={"ID":"41e75b1e-fad8-47cb-b625-ec2842791022","Type":"ContainerDied","Data":"839ea5d3648618ab216f06d045b7db182ead778ab18819e272b86a61e3788985"} Jul 27 20:54:34.501298 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:34.501208 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-c5205b-66445464d-qn2j4" event={"ID":"41e75b1e-fad8-47cb-b625-ec2842791022","Type":"ContainerDied","Data":"326d5915d7b5888e08d9fed61122728c238db72f96bea13977bacd20da432e8b"} Jul 27 20:54:34.501298 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:34.501235 2558 scope.go:117] "RemoveContainer" containerID="839ea5d3648618ab216f06d045b7db182ead778ab18819e272b86a61e3788985" Jul 27 20:54:34.502362 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:34.502343 2558 generic.go:356] "Generic (PLEG): container finished" podID="0433e389-6854-488c-ad9b-bad6ab3bd2f3" containerID="4e2891288d79eb3b5f2b0eb8fab55514cf8c199217dfd15bdf6aca0763185e1e" exitCode=0 Jul 27 20:54:34.502453 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:34.502388 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c5205b-689795dd88-pd7cc" event={"ID":"0433e389-6854-488c-ad9b-bad6ab3bd2f3","Type":"ContainerDied","Data":"4e2891288d79eb3b5f2b0eb8fab55514cf8c199217dfd15bdf6aca0763185e1e"} Jul 27 20:54:34.502453 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:34.502440 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c5205b-689795dd88-pd7cc" event={"ID":"0433e389-6854-488c-ad9b-bad6ab3bd2f3","Type":"ContainerDied","Data":"e59fb0127769ea2fee0634859612288f0b0d60d5e501645a58dbcb66f8332a02"} Jul 27 20:54:34.502565 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:34.502394 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c5205b-689795dd88-pd7cc" Jul 27 20:54:34.510393 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:34.510383 2558 scope.go:117] "RemoveContainer" containerID="839ea5d3648618ab216f06d045b7db182ead778ab18819e272b86a61e3788985" Jul 27 20:54:34.510819 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:54:34.510628 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"839ea5d3648618ab216f06d045b7db182ead778ab18819e272b86a61e3788985\": container with ID starting with 839ea5d3648618ab216f06d045b7db182ead778ab18819e272b86a61e3788985 not found: ID does not exist" containerID="839ea5d3648618ab216f06d045b7db182ead778ab18819e272b86a61e3788985" Jul 27 20:54:34.510819 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:34.510659 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"839ea5d3648618ab216f06d045b7db182ead778ab18819e272b86a61e3788985"} err="failed to get container status \"839ea5d3648618ab216f06d045b7db182ead778ab18819e272b86a61e3788985\": rpc error: code = NotFound desc = could not find container \"839ea5d3648618ab216f06d045b7db182ead778ab18819e272b86a61e3788985\": container with ID starting with 839ea5d3648618ab216f06d045b7db182ead778ab18819e272b86a61e3788985 not found: ID does not exist" Jul 27 20:54:34.510819 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:34.510675 2558 scope.go:117] "RemoveContainer" containerID="4e2891288d79eb3b5f2b0eb8fab55514cf8c199217dfd15bdf6aca0763185e1e" Jul 27 20:54:34.518035 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:34.518020 2558 scope.go:117] "RemoveContainer" containerID="4e2891288d79eb3b5f2b0eb8fab55514cf8c199217dfd15bdf6aca0763185e1e" Jul 27 20:54:34.518283 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:54:34.518268 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e2891288d79eb3b5f2b0eb8fab55514cf8c199217dfd15bdf6aca0763185e1e\": container with ID starting with 4e2891288d79eb3b5f2b0eb8fab55514cf8c199217dfd15bdf6aca0763185e1e not found: ID does not exist" containerID="4e2891288d79eb3b5f2b0eb8fab55514cf8c199217dfd15bdf6aca0763185e1e" Jul 27 20:54:34.518329 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:34.518289 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e2891288d79eb3b5f2b0eb8fab55514cf8c199217dfd15bdf6aca0763185e1e"} err="failed to get container status \"4e2891288d79eb3b5f2b0eb8fab55514cf8c199217dfd15bdf6aca0763185e1e\": rpc error: code = NotFound desc = could not find container \"4e2891288d79eb3b5f2b0eb8fab55514cf8c199217dfd15bdf6aca0763185e1e\": container with ID starting with 4e2891288d79eb3b5f2b0eb8fab55514cf8c199217dfd15bdf6aca0763185e1e not found: ID does not exist" Jul 27 20:54:34.525723 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:34.525702 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c5205b-689795dd88-pd7cc"] Jul 27 20:54:34.531625 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:34.531604 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c5205b-689795dd88-pd7cc"] Jul 27 20:54:34.542884 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:34.542865 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c5205b-66445464d-qn2j4"] Jul 27 20:54:34.548249 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:34.548231 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c5205b-66445464d-qn2j4"] Jul 27 20:54:35.932976 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:35.932943 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0433e389-6854-488c-ad9b-bad6ab3bd2f3" path="/var/lib/kubelet/pods/0433e389-6854-488c-ad9b-bad6ab3bd2f3/volumes" Jul 27 20:54:35.933429 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:35.933279 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41e75b1e-fad8-47cb-b625-ec2842791022" path="/var/lib/kubelet/pods/41e75b1e-fad8-47cb-b625-ec2842791022/volumes" Jul 27 20:54:37.823814 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:37.823782 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:54:38.311397 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:38.311362 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:54:38.713884 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:38.713805 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:54:44.550892 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:44.550855 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:54:44.651091 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:44.651062 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:54:44.820468 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:44.820388 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:54:45.047986 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:45.047950 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:54:46.625542 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:46.625504 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:54:46.683578 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:46.683542 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:54:55.609702 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:55.609618 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:54:55.631154 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:55.631122 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-704ca2-6469fdbcc8-9nkkm"] Jul 27 20:54:55.631402 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:55.631377 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-704ca2-6469fdbcc8-9nkkm" podUID="455cb1f3-d3e7-4948-9474-0053221395bc" containerName="payload-processing" containerID="cri-o://1ae98a40c0518df49c36fe60c11adcc865c8ed38e6080c362692c01a99c7cdd6" gracePeriod=30 Jul 27 20:54:55.638610 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:55.638586 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-704ca2-869f5c66dd-rx2gz"] Jul 27 20:54:55.638999 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:55.638830 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-704ca2-869f5c66dd-rx2gz" podUID="409fbe75-6405-41b3-ae9b-3a4be474eb88" containerName="payload-pre-processing" containerID="cri-o://488e58da1f1ce00fae6b4951eb98eafcb37c24cb6a423062312c1deb9161ffc9" gracePeriod=30 Jul 27 20:54:55.668761 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:55.668732 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:54:55.724357 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:55.724327 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:54:55.903738 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:55.903716 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-704ca2-6469fdbcc8-9nkkm" Jul 27 20:54:55.906197 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:55.906182 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-704ca2-869f5c66dd-rx2gz" Jul 27 20:54:56.041870 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:56.041836 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/455cb1f3-d3e7-4948-9474-0053221395bc-plugins-config-volume\") pod \"455cb1f3-d3e7-4948-9474-0053221395bc\" (UID: \"455cb1f3-d3e7-4948-9474-0053221395bc\") " Jul 27 20:54:56.041870 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:56.041872 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/409fbe75-6405-41b3-ae9b-3a4be474eb88-plugins-config-volume\") pod \"409fbe75-6405-41b3-ae9b-3a4be474eb88\" (UID: \"409fbe75-6405-41b3-ae9b-3a4be474eb88\") " Jul 27 20:54:56.042075 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:56.041907 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l85w4\" (UniqueName: \"kubernetes.io/projected/455cb1f3-d3e7-4948-9474-0053221395bc-kube-api-access-l85w4\") pod \"455cb1f3-d3e7-4948-9474-0053221395bc\" (UID: \"455cb1f3-d3e7-4948-9474-0053221395bc\") " Jul 27 20:54:56.042075 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:56.041953 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2pxp5\" (UniqueName: \"kubernetes.io/projected/409fbe75-6405-41b3-ae9b-3a4be474eb88-kube-api-access-2pxp5\") pod \"409fbe75-6405-41b3-ae9b-3a4be474eb88\" (UID: \"409fbe75-6405-41b3-ae9b-3a4be474eb88\") " Jul 27 20:54:56.042351 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:56.042321 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/409fbe75-6405-41b3-ae9b-3a4be474eb88-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "409fbe75-6405-41b3-ae9b-3a4be474eb88" (UID: "409fbe75-6405-41b3-ae9b-3a4be474eb88"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:54:56.042401 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:56.042331 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/455cb1f3-d3e7-4948-9474-0053221395bc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "455cb1f3-d3e7-4948-9474-0053221395bc" (UID: "455cb1f3-d3e7-4948-9474-0053221395bc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:54:56.043943 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:56.043922 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/455cb1f3-d3e7-4948-9474-0053221395bc-kube-api-access-l85w4" (OuterVolumeSpecName: "kube-api-access-l85w4") pod "455cb1f3-d3e7-4948-9474-0053221395bc" (UID: "455cb1f3-d3e7-4948-9474-0053221395bc"). InnerVolumeSpecName "kube-api-access-l85w4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:54:56.044028 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:56.044011 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/409fbe75-6405-41b3-ae9b-3a4be474eb88-kube-api-access-2pxp5" (OuterVolumeSpecName: "kube-api-access-2pxp5") pod "409fbe75-6405-41b3-ae9b-3a4be474eb88" (UID: "409fbe75-6405-41b3-ae9b-3a4be474eb88"). InnerVolumeSpecName "kube-api-access-2pxp5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:54:56.143027 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:56.142954 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l85w4\" (UniqueName: \"kubernetes.io/projected/455cb1f3-d3e7-4948-9474-0053221395bc-kube-api-access-l85w4\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 20:54:56.143027 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:56.142980 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2pxp5\" (UniqueName: \"kubernetes.io/projected/409fbe75-6405-41b3-ae9b-3a4be474eb88-kube-api-access-2pxp5\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 20:54:56.143027 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:56.142994 2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/455cb1f3-d3e7-4948-9474-0053221395bc-plugins-config-volume\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 20:54:56.143027 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:56.143005 2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/409fbe75-6405-41b3-ae9b-3a4be474eb88-plugins-config-volume\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 20:54:56.593650 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:56.593610 2558 generic.go:356] "Generic (PLEG): container finished" podID="409fbe75-6405-41b3-ae9b-3a4be474eb88" containerID="488e58da1f1ce00fae6b4951eb98eafcb37c24cb6a423062312c1deb9161ffc9" exitCode=0 Jul 27 20:54:56.593650 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:56.593638 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-704ca2-869f5c66dd-rx2gz" Jul 27 20:54:56.593907 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:56.593668 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-704ca2-869f5c66dd-rx2gz" event={"ID":"409fbe75-6405-41b3-ae9b-3a4be474eb88","Type":"ContainerDied","Data":"488e58da1f1ce00fae6b4951eb98eafcb37c24cb6a423062312c1deb9161ffc9"} Jul 27 20:54:56.593907 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:56.593738 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-704ca2-869f5c66dd-rx2gz" event={"ID":"409fbe75-6405-41b3-ae9b-3a4be474eb88","Type":"ContainerDied","Data":"267eee32074667adde2f338ee8fc1c5e36f71ca54c171101b41d5955b5548432"} Jul 27 20:54:56.593907 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:56.593765 2558 scope.go:117] "RemoveContainer" containerID="488e58da1f1ce00fae6b4951eb98eafcb37c24cb6a423062312c1deb9161ffc9" Jul 27 20:54:56.595009 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:56.594989 2558 generic.go:356] "Generic (PLEG): container finished" podID="455cb1f3-d3e7-4948-9474-0053221395bc" containerID="1ae98a40c0518df49c36fe60c11adcc865c8ed38e6080c362692c01a99c7cdd6" exitCode=0 Jul 27 20:54:56.595073 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:56.595033 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-704ca2-6469fdbcc8-9nkkm" event={"ID":"455cb1f3-d3e7-4948-9474-0053221395bc","Type":"ContainerDied","Data":"1ae98a40c0518df49c36fe60c11adcc865c8ed38e6080c362692c01a99c7cdd6"} Jul 27 20:54:56.595073 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:56.595044 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-704ca2-6469fdbcc8-9nkkm" Jul 27 20:54:56.595073 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:56.595070 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-704ca2-6469fdbcc8-9nkkm" event={"ID":"455cb1f3-d3e7-4948-9474-0053221395bc","Type":"ContainerDied","Data":"f43d0c111f12a64f818c0d40a5fad9b7b1afc76cbe2a6148fb277d749d72e543"} Jul 27 20:54:56.602878 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:56.602756 2558 scope.go:117] "RemoveContainer" containerID="488e58da1f1ce00fae6b4951eb98eafcb37c24cb6a423062312c1deb9161ffc9" Jul 27 20:54:56.603063 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:54:56.603038 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"488e58da1f1ce00fae6b4951eb98eafcb37c24cb6a423062312c1deb9161ffc9\": container with ID starting with 488e58da1f1ce00fae6b4951eb98eafcb37c24cb6a423062312c1deb9161ffc9 not found: ID does not exist" containerID="488e58da1f1ce00fae6b4951eb98eafcb37c24cb6a423062312c1deb9161ffc9" Jul 27 20:54:56.603125 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:56.603077 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"488e58da1f1ce00fae6b4951eb98eafcb37c24cb6a423062312c1deb9161ffc9"} err="failed to get container status \"488e58da1f1ce00fae6b4951eb98eafcb37c24cb6a423062312c1deb9161ffc9\": rpc error: code = NotFound desc = could not find container \"488e58da1f1ce00fae6b4951eb98eafcb37c24cb6a423062312c1deb9161ffc9\": container with ID starting with 488e58da1f1ce00fae6b4951eb98eafcb37c24cb6a423062312c1deb9161ffc9 not found: ID does not exist" Jul 27 20:54:56.603125 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:56.603100 2558 scope.go:117] "RemoveContainer" containerID="1ae98a40c0518df49c36fe60c11adcc865c8ed38e6080c362692c01a99c7cdd6" Jul 27 20:54:56.610286 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:56.610270 2558 scope.go:117] "RemoveContainer" containerID="1ae98a40c0518df49c36fe60c11adcc865c8ed38e6080c362692c01a99c7cdd6" Jul 27 20:54:56.610558 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:54:56.610480 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ae98a40c0518df49c36fe60c11adcc865c8ed38e6080c362692c01a99c7cdd6\": container with ID starting with 1ae98a40c0518df49c36fe60c11adcc865c8ed38e6080c362692c01a99c7cdd6 not found: ID does not exist" containerID="1ae98a40c0518df49c36fe60c11adcc865c8ed38e6080c362692c01a99c7cdd6" Jul 27 20:54:56.610558 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:56.610500 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ae98a40c0518df49c36fe60c11adcc865c8ed38e6080c362692c01a99c7cdd6"} err="failed to get container status \"1ae98a40c0518df49c36fe60c11adcc865c8ed38e6080c362692c01a99c7cdd6\": rpc error: code = NotFound desc = could not find container \"1ae98a40c0518df49c36fe60c11adcc865c8ed38e6080c362692c01a99c7cdd6\": container with ID starting with 1ae98a40c0518df49c36fe60c11adcc865c8ed38e6080c362692c01a99c7cdd6 not found: ID does not exist" Jul 27 20:54:56.619195 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:56.619175 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-704ca2-6469fdbcc8-9nkkm"] Jul 27 20:54:56.626742 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:56.626724 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-704ca2-6469fdbcc8-9nkkm"] Jul 27 20:54:56.637385 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:56.637367 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-704ca2-869f5c66dd-rx2gz"] Jul 27 20:54:56.643992 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:56.643973 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-704ca2-869f5c66dd-rx2gz"] Jul 27 20:54:57.520930 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:57.520888 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:54:57.933572 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:57.933491 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="409fbe75-6405-41b3-ae9b-3a4be474eb88" path="/var/lib/kubelet/pods/409fbe75-6405-41b3-ae9b-3a4be474eb88/volumes" Jul 27 20:54:57.933936 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:54:57.933870 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="455cb1f3-d3e7-4948-9474-0053221395bc" path="/var/lib/kubelet/pods/455cb1f3-d3e7-4948-9474-0053221395bc/volumes" Jul 27 20:55:00.235937 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:00.235861 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:55:00.695078 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:00.695041 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:55:06.311470 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:06.311414 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:55:06.376532 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:06.376498 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:55:06.589921 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:06.589840 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:55:06.801159 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:06.801122 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:55:07.155244 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:07.155208 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:55:07.504922 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:07.504888 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:55:07.958918 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:07.958831 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:55:10.566857 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:10.566810 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:55:10.650473 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:10.650440 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:55:10.719331 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:10.719297 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:55:10.891845 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:10.891756 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:55:11.227318 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:11.227241 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:55:11.327410 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:11.327373 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:55:11.327702 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:11.327674 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-cc8abd-7db9b5c996-qk4th"] Jul 27 20:55:11.327960 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:11.327948 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="455cb1f3-d3e7-4948-9474-0053221395bc" containerName="payload-processing" Jul 27 20:55:11.327999 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:11.327963 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="455cb1f3-d3e7-4948-9474-0053221395bc" containerName="payload-processing" Jul 27 20:55:11.327999 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:11.327977 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0433e389-6854-488c-ad9b-bad6ab3bd2f3" containerName="payload-pre-processing" Jul 27 20:55:11.327999 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:11.327983 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0433e389-6854-488c-ad9b-bad6ab3bd2f3" containerName="payload-pre-processing" Jul 27 20:55:11.327999 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:11.327999 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41e75b1e-fad8-47cb-b625-ec2842791022" containerName="payload-processing" Jul 27 20:55:11.328125 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:11.328005 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="41e75b1e-fad8-47cb-b625-ec2842791022" containerName="payload-processing" Jul 27 20:55:11.328125 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:11.328013 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="409fbe75-6405-41b3-ae9b-3a4be474eb88" containerName="payload-pre-processing" Jul 27 20:55:11.328125 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:11.328018 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="409fbe75-6405-41b3-ae9b-3a4be474eb88" containerName="payload-pre-processing" Jul 27 20:55:11.328125 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:11.328060 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="0433e389-6854-488c-ad9b-bad6ab3bd2f3" containerName="payload-pre-processing" Jul 27 20:55:11.328125 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:11.328066 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="455cb1f3-d3e7-4948-9474-0053221395bc" containerName="payload-processing" Jul 27 20:55:11.328125 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:11.328074 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="41e75b1e-fad8-47cb-b625-ec2842791022" containerName="payload-processing" Jul 27 20:55:11.328125 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:11.328079 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="409fbe75-6405-41b3-ae9b-3a4be474eb88" containerName="payload-pre-processing" Jul 27 20:55:11.332474 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:11.332455 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-cc8abd-7db9b5c996-qk4th" Jul 27 20:55:11.335015 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:11.334998 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-cc8abd\"" Jul 27 20:55:11.335114 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:11.335032 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-cc8abd-dockercfg-zk4kp\"" Jul 27 20:55:11.341883 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:11.341859 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-cc8abd-7db9b5c996-qk4th"] Jul 27 20:55:11.350361 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:11.350337 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0158f0f9-f380-44a9-b62e-14385ff297b5-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-cc8abd-7db9b5c996-qk4th\" (UID: \"0158f0f9-f380-44a9-b62e-14385ff297b5\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-cc8abd-7db9b5c996-qk4th" Jul 27 20:55:11.350447 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:11.350368 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kt2sp\" (UniqueName: \"kubernetes.io/projected/0158f0f9-f380-44a9-b62e-14385ff297b5-kube-api-access-kt2sp\") pod \"payload-pre-processing-e2e-api-a-cc8abd-7db9b5c996-qk4th\" (UID: \"0158f0f9-f380-44a9-b62e-14385ff297b5\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-cc8abd-7db9b5c996-qk4th" Jul 27 20:55:11.370418 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:11.370390 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-cc8abd-5f5958957d-r8zn5"] Jul 27 20:55:11.373401 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:11.373384 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-cc8abd-5f5958957d-r8zn5" Jul 27 20:55:11.389975 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:11.389956 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-cc8abd-5f5958957d-r8zn5"] Jul 27 20:55:11.450885 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:11.450851 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq2hp\" (UniqueName: \"kubernetes.io/projected/d9691bf0-6c6a-46fe-9a02-e49fc74289a6-kube-api-access-xq2hp\") pod \"payload-processing-e2e-api-a-cc8abd-5f5958957d-r8zn5\" (UID: \"d9691bf0-6c6a-46fe-9a02-e49fc74289a6\") " pod="openshift-ingress/payload-processing-e2e-api-a-cc8abd-5f5958957d-r8zn5" Jul 27 20:55:11.451048 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:11.450916 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0158f0f9-f380-44a9-b62e-14385ff297b5-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-cc8abd-7db9b5c996-qk4th\" (UID: \"0158f0f9-f380-44a9-b62e-14385ff297b5\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-cc8abd-7db9b5c996-qk4th" Jul 27 20:55:11.451048 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:11.450949 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt2sp\" (UniqueName: \"kubernetes.io/projected/0158f0f9-f380-44a9-b62e-14385ff297b5-kube-api-access-kt2sp\") pod \"payload-pre-processing-e2e-api-a-cc8abd-7db9b5c996-qk4th\" (UID: \"0158f0f9-f380-44a9-b62e-14385ff297b5\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-cc8abd-7db9b5c996-qk4th" Jul 27 20:55:11.451048 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:11.451002 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d9691bf0-6c6a-46fe-9a02-e49fc74289a6-plugins-config-volume\") pod \"payload-processing-e2e-api-a-cc8abd-5f5958957d-r8zn5\" (UID: \"d9691bf0-6c6a-46fe-9a02-e49fc74289a6\") " pod="openshift-ingress/payload-processing-e2e-api-a-cc8abd-5f5958957d-r8zn5" Jul 27 20:55:11.451668 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:11.451648 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0158f0f9-f380-44a9-b62e-14385ff297b5-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-cc8abd-7db9b5c996-qk4th\" (UID: \"0158f0f9-f380-44a9-b62e-14385ff297b5\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-cc8abd-7db9b5c996-qk4th" Jul 27 20:55:11.460304 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:11.460279 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kt2sp\" (UniqueName: \"kubernetes.io/projected/0158f0f9-f380-44a9-b62e-14385ff297b5-kube-api-access-kt2sp\") pod \"payload-pre-processing-e2e-api-a-cc8abd-7db9b5c996-qk4th\" (UID: \"0158f0f9-f380-44a9-b62e-14385ff297b5\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-cc8abd-7db9b5c996-qk4th" Jul 27 20:55:11.551553 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:11.551523 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xq2hp\" (UniqueName: \"kubernetes.io/projected/d9691bf0-6c6a-46fe-9a02-e49fc74289a6-kube-api-access-xq2hp\") pod \"payload-processing-e2e-api-a-cc8abd-5f5958957d-r8zn5\" (UID: \"d9691bf0-6c6a-46fe-9a02-e49fc74289a6\") " pod="openshift-ingress/payload-processing-e2e-api-a-cc8abd-5f5958957d-r8zn5" Jul 27 20:55:11.551713 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:11.551590 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d9691bf0-6c6a-46fe-9a02-e49fc74289a6-plugins-config-volume\") pod \"payload-processing-e2e-api-a-cc8abd-5f5958957d-r8zn5\" (UID: \"d9691bf0-6c6a-46fe-9a02-e49fc74289a6\") " pod="openshift-ingress/payload-processing-e2e-api-a-cc8abd-5f5958957d-r8zn5" Jul 27 20:55:11.552231 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:11.552209 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d9691bf0-6c6a-46fe-9a02-e49fc74289a6-plugins-config-volume\") pod \"payload-processing-e2e-api-a-cc8abd-5f5958957d-r8zn5\" (UID: \"d9691bf0-6c6a-46fe-9a02-e49fc74289a6\") " pod="openshift-ingress/payload-processing-e2e-api-a-cc8abd-5f5958957d-r8zn5" Jul 27 20:55:11.559984 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:11.559959 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq2hp\" (UniqueName: \"kubernetes.io/projected/d9691bf0-6c6a-46fe-9a02-e49fc74289a6-kube-api-access-xq2hp\") pod \"payload-processing-e2e-api-a-cc8abd-5f5958957d-r8zn5\" (UID: \"d9691bf0-6c6a-46fe-9a02-e49fc74289a6\") " pod="openshift-ingress/payload-processing-e2e-api-a-cc8abd-5f5958957d-r8zn5" Jul 27 20:55:11.642804 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:11.642773 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-cc8abd-7db9b5c996-qk4th" Jul 27 20:55:11.682630 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:11.682604 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-cc8abd-5f5958957d-r8zn5" Jul 27 20:55:11.780349 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:11.780319 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-cc8abd-7db9b5c996-qk4th"] Jul 27 20:55:11.784324 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:55:11.784291 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0158f0f9_f380_44a9_b62e_14385ff297b5.slice/crio-3beeedd50ce75fc41e0387f46c2f08d50ec5c4f0e38f6100184203ef4d81befe WatchSource:0}: Error finding container 3beeedd50ce75fc41e0387f46c2f08d50ec5c4f0e38f6100184203ef4d81befe: Status 404 returned error can't find the container with id 3beeedd50ce75fc41e0387f46c2f08d50ec5c4f0e38f6100184203ef4d81befe Jul 27 20:55:11.823242 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:11.823215 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-cc8abd-5f5958957d-r8zn5"] Jul 27 20:55:11.831633 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:55:11.831601 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9691bf0_6c6a_46fe_9a02_e49fc74289a6.slice/crio-9122bf1f055cb64a6b52d29b136a27bed499e7c71aa9eec7fc43971943c64421 WatchSource:0}: Error finding container 9122bf1f055cb64a6b52d29b136a27bed499e7c71aa9eec7fc43971943c64421: Status 404 returned error can't find the container with id 9122bf1f055cb64a6b52d29b136a27bed499e7c71aa9eec7fc43971943c64421 Jul 27 20:55:12.663660 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:12.663624 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-cc8abd-5f5958957d-r8zn5" event={"ID":"d9691bf0-6c6a-46fe-9a02-e49fc74289a6","Type":"ContainerStarted","Data":"fae52c96b56426f28231d627957d196b204552c873cd0faa64f4fa7ecba0630b"} Jul 27 20:55:12.664130 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:12.663732 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-cc8abd-5f5958957d-r8zn5" event={"ID":"d9691bf0-6c6a-46fe-9a02-e49fc74289a6","Type":"ContainerStarted","Data":"9122bf1f055cb64a6b52d29b136a27bed499e7c71aa9eec7fc43971943c64421"} Jul 27 20:55:12.664130 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:12.663865 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-cc8abd-5f5958957d-r8zn5" Jul 27 20:55:12.665716 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:12.665290 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-cc8abd-7db9b5c996-qk4th" event={"ID":"0158f0f9-f380-44a9-b62e-14385ff297b5","Type":"ContainerStarted","Data":"63aef5e421fae99133a2cf8cd38032d9463f4fa85c106b558fb1b602cba9b8e6"} Jul 27 20:55:12.665716 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:12.665350 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-cc8abd-7db9b5c996-qk4th" event={"ID":"0158f0f9-f380-44a9-b62e-14385ff297b5","Type":"ContainerStarted","Data":"3beeedd50ce75fc41e0387f46c2f08d50ec5c4f0e38f6100184203ef4d81befe"} Jul 27 20:55:12.665716 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:12.665379 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-cc8abd-7db9b5c996-qk4th" Jul 27 20:55:12.681994 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:12.681949 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-cc8abd-5f5958957d-r8zn5" podStartSLOduration=1.681934966 podStartE2EDuration="1.681934966s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:55:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:55:12.681151354 +0000 UTC m=+2255.259724944" watchObservedRunningTime="2026-07-27 20:55:12.681934966 +0000 UTC m=+2255.260508532" Jul 27 20:55:12.697399 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:12.697353 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-cc8abd-7db9b5c996-qk4th" podStartSLOduration=1.697340564 podStartE2EDuration="1.697340564s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:55:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:55:12.696401519 +0000 UTC m=+2255.274975108" watchObservedRunningTime="2026-07-27 20:55:12.697340564 +0000 UTC m=+2255.275914198" Jul 27 20:55:13.922210 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:13.922175 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:55:15.072621 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:15.072583 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:55:15.566487 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:15.566454 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:55:15.861901 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:15.861801 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:55:15.961492 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:15.961455 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:55:18.649361 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:18.649327 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:55:18.751355 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:18.751316 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:55:18.849396 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:18.849355 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:55:18.963303 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:18.963207 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:55:19.341286 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:19.341250 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:55:19.438588 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:19.438554 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:55:19.443059 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:19.443035 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-d4c2c3-6fb5d86fdd-qh5dn"] Jul 27 20:55:19.446257 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:19.446240 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-d4c2c3-6fb5d86fdd-qh5dn" Jul 27 20:55:19.448664 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:19.448638 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-d4c2c3-dockercfg-gnrvz\"" Jul 27 20:55:19.448773 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:19.448665 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-d4c2c3\"" Jul 27 20:55:19.457849 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:19.457828 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-d4c2c3-6fb5d86fdd-qh5dn"] Jul 27 20:55:19.459142 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:19.459124 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-d4c2c3-658775fbdd-9fjft"] Jul 27 20:55:19.462256 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:19.462239 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-d4c2c3-658775fbdd-9fjft" Jul 27 20:55:19.472006 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:19.471984 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-d4c2c3-658775fbdd-9fjft"] Jul 27 20:55:19.515063 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:19.515041 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrcfc\" (UniqueName: \"kubernetes.io/projected/acf95063-b0d9-44ae-adff-2981772b3fd0-kube-api-access-lrcfc\") pod \"payload-processing-e2e-api-b-d4c2c3-658775fbdd-9fjft\" (UID: \"acf95063-b0d9-44ae-adff-2981772b3fd0\") " pod="openshift-ingress/payload-processing-e2e-api-b-d4c2c3-658775fbdd-9fjft" Jul 27 20:55:19.515155 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:19.515071 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rd6hc\" (UniqueName: \"kubernetes.io/projected/787cd6f1-5a4d-4898-8b50-8dfc67e668e3-kube-api-access-rd6hc\") pod \"payload-pre-processing-e2e-api-b-d4c2c3-6fb5d86fdd-qh5dn\" (UID: \"787cd6f1-5a4d-4898-8b50-8dfc67e668e3\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-d4c2c3-6fb5d86fdd-qh5dn" Jul 27 20:55:19.515155 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:19.515100 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/acf95063-b0d9-44ae-adff-2981772b3fd0-plugins-config-volume\") pod \"payload-processing-e2e-api-b-d4c2c3-658775fbdd-9fjft\" (UID: \"acf95063-b0d9-44ae-adff-2981772b3fd0\") " pod="openshift-ingress/payload-processing-e2e-api-b-d4c2c3-658775fbdd-9fjft" Jul 27 20:55:19.515234 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:19.515208 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/787cd6f1-5a4d-4898-8b50-8dfc67e668e3-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-d4c2c3-6fb5d86fdd-qh5dn\" (UID: \"787cd6f1-5a4d-4898-8b50-8dfc67e668e3\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-d4c2c3-6fb5d86fdd-qh5dn" Jul 27 20:55:19.615927 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:19.615858 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rd6hc\" (UniqueName: \"kubernetes.io/projected/787cd6f1-5a4d-4898-8b50-8dfc67e668e3-kube-api-access-rd6hc\") pod \"payload-pre-processing-e2e-api-b-d4c2c3-6fb5d86fdd-qh5dn\" (UID: \"787cd6f1-5a4d-4898-8b50-8dfc67e668e3\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-d4c2c3-6fb5d86fdd-qh5dn" Jul 27 20:55:19.615927 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:19.615900 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/acf95063-b0d9-44ae-adff-2981772b3fd0-plugins-config-volume\") pod \"payload-processing-e2e-api-b-d4c2c3-658775fbdd-9fjft\" (UID: \"acf95063-b0d9-44ae-adff-2981772b3fd0\") " pod="openshift-ingress/payload-processing-e2e-api-b-d4c2c3-658775fbdd-9fjft" Jul 27 20:55:19.616105 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:19.615946 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/787cd6f1-5a4d-4898-8b50-8dfc67e668e3-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-d4c2c3-6fb5d86fdd-qh5dn\" (UID: \"787cd6f1-5a4d-4898-8b50-8dfc67e668e3\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-d4c2c3-6fb5d86fdd-qh5dn" Jul 27 20:55:19.616105 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:19.615974 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrcfc\" (UniqueName: \"kubernetes.io/projected/acf95063-b0d9-44ae-adff-2981772b3fd0-kube-api-access-lrcfc\") pod \"payload-processing-e2e-api-b-d4c2c3-658775fbdd-9fjft\" (UID: \"acf95063-b0d9-44ae-adff-2981772b3fd0\") " pod="openshift-ingress/payload-processing-e2e-api-b-d4c2c3-658775fbdd-9fjft" Jul 27 20:55:19.616647 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:19.616625 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/acf95063-b0d9-44ae-adff-2981772b3fd0-plugins-config-volume\") pod \"payload-processing-e2e-api-b-d4c2c3-658775fbdd-9fjft\" (UID: \"acf95063-b0d9-44ae-adff-2981772b3fd0\") " pod="openshift-ingress/payload-processing-e2e-api-b-d4c2c3-658775fbdd-9fjft" Jul 27 20:55:19.616761 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:19.616648 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/787cd6f1-5a4d-4898-8b50-8dfc67e668e3-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-d4c2c3-6fb5d86fdd-qh5dn\" (UID: \"787cd6f1-5a4d-4898-8b50-8dfc67e668e3\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-d4c2c3-6fb5d86fdd-qh5dn" Jul 27 20:55:19.623567 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:19.623546 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrcfc\" (UniqueName: \"kubernetes.io/projected/acf95063-b0d9-44ae-adff-2981772b3fd0-kube-api-access-lrcfc\") pod \"payload-processing-e2e-api-b-d4c2c3-658775fbdd-9fjft\" (UID: \"acf95063-b0d9-44ae-adff-2981772b3fd0\") " pod="openshift-ingress/payload-processing-e2e-api-b-d4c2c3-658775fbdd-9fjft" Jul 27 20:55:19.623736 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:19.623716 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rd6hc\" (UniqueName: \"kubernetes.io/projected/787cd6f1-5a4d-4898-8b50-8dfc67e668e3-kube-api-access-rd6hc\") pod \"payload-pre-processing-e2e-api-b-d4c2c3-6fb5d86fdd-qh5dn\" (UID: \"787cd6f1-5a4d-4898-8b50-8dfc67e668e3\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-d4c2c3-6fb5d86fdd-qh5dn" Jul 27 20:55:19.756259 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:19.756236 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-d4c2c3-6fb5d86fdd-qh5dn" Jul 27 20:55:19.773314 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:19.773290 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-d4c2c3-658775fbdd-9fjft" Jul 27 20:55:19.893969 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:19.893935 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-d4c2c3-6fb5d86fdd-qh5dn"] Jul 27 20:55:19.897835 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:55:19.897808 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod787cd6f1_5a4d_4898_8b50_8dfc67e668e3.slice/crio-081f2be5697950daeb57dfdbbf44a64258381ebad2123eedd32437e9d2875021 WatchSource:0}: Error finding container 081f2be5697950daeb57dfdbbf44a64258381ebad2123eedd32437e9d2875021: Status 404 returned error can't find the container with id 081f2be5697950daeb57dfdbbf44a64258381ebad2123eedd32437e9d2875021 Jul 27 20:55:19.917109 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:19.917085 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-d4c2c3-658775fbdd-9fjft"] Jul 27 20:55:19.931666 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:55:19.931636 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacf95063_b0d9_44ae_adff_2981772b3fd0.slice/crio-5ca3f5aa49da01ff6f5caeceb318cba4688761ea85227199538619d1c7474749 WatchSource:0}: Error finding container 5ca3f5aa49da01ff6f5caeceb318cba4688761ea85227199538619d1c7474749: Status 404 returned error can't find the container with id 5ca3f5aa49da01ff6f5caeceb318cba4688761ea85227199538619d1c7474749 Jul 27 20:55:20.699476 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:20.699434 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-d4c2c3-658775fbdd-9fjft" event={"ID":"acf95063-b0d9-44ae-adff-2981772b3fd0","Type":"ContainerStarted","Data":"18273b944878971ebd43a952e00e0c8835c189fdbab3584394c7352231fb24a4"} Jul 27 20:55:20.699662 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:20.699499 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-d4c2c3-658775fbdd-9fjft" event={"ID":"acf95063-b0d9-44ae-adff-2981772b3fd0","Type":"ContainerStarted","Data":"5ca3f5aa49da01ff6f5caeceb318cba4688761ea85227199538619d1c7474749"} Jul 27 20:55:20.699662 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:20.699529 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-d4c2c3-658775fbdd-9fjft" Jul 27 20:55:20.701084 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:20.701062 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-d4c2c3-6fb5d86fdd-qh5dn" event={"ID":"787cd6f1-5a4d-4898-8b50-8dfc67e668e3","Type":"ContainerStarted","Data":"167d1c9082a136230e3eb3271f432e42a659bdd8a3da35622fe7ce08111b3e1c"} Jul 27 20:55:20.701184 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:20.701105 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-d4c2c3-6fb5d86fdd-qh5dn" event={"ID":"787cd6f1-5a4d-4898-8b50-8dfc67e668e3","Type":"ContainerStarted","Data":"081f2be5697950daeb57dfdbbf44a64258381ebad2123eedd32437e9d2875021"} Jul 27 20:55:20.701184 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:20.701133 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-d4c2c3-6fb5d86fdd-qh5dn" Jul 27 20:55:20.716501 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:20.716456 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-d4c2c3-658775fbdd-9fjft" podStartSLOduration=1.71644173 podStartE2EDuration="1.71644173s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:55:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:55:20.715454052 +0000 UTC m=+2263.294027640" watchObservedRunningTime="2026-07-27 20:55:20.71644173 +0000 UTC m=+2263.295015319" Jul 27 20:55:20.731819 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:20.731781 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-d4c2c3-6fb5d86fdd-qh5dn" podStartSLOduration=1.7317680690000001 podStartE2EDuration="1.731768069s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:55:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:55:20.730885135 +0000 UTC m=+2263.309458724" watchObservedRunningTime="2026-07-27 20:55:20.731768069 +0000 UTC m=+2263.310341657" Jul 27 20:55:23.178506 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:23.178464 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:55:23.672237 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:23.672206 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-cc8abd-7db9b5c996-qk4th" Jul 27 20:55:23.672420 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:23.672279 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-cc8abd-5f5958957d-r8zn5" Jul 27 20:55:31.708460 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:31.708428 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-d4c2c3-6fb5d86fdd-qh5dn" Jul 27 20:55:31.708886 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:31.708502 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-d4c2c3-658775fbdd-9fjft" Jul 27 20:55:34.130028 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:34.129990 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:55:46.898443 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:46.898402 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:55:46.927288 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:46.927258 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-cc8abd-5f5958957d-r8zn5"] Jul 27 20:55:46.927504 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:46.927477 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-cc8abd-5f5958957d-r8zn5" podUID="d9691bf0-6c6a-46fe-9a02-e49fc74289a6" containerName="payload-processing" containerID="cri-o://fae52c96b56426f28231d627957d196b204552c873cd0faa64f4fa7ecba0630b" gracePeriod=30 Jul 27 20:55:46.934465 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:46.934440 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-cc8abd-7db9b5c996-qk4th"] Jul 27 20:55:46.934706 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:46.934664 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-cc8abd-7db9b5c996-qk4th" podUID="0158f0f9-f380-44a9-b62e-14385ff297b5" containerName="payload-pre-processing" containerID="cri-o://63aef5e421fae99133a2cf8cd38032d9463f4fa85c106b558fb1b602cba9b8e6" gracePeriod=30 Jul 27 20:55:47.212138 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:47.212116 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-cc8abd-5f5958957d-r8zn5" Jul 27 20:55:47.223777 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:47.223760 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-cc8abd-7db9b5c996-qk4th" Jul 27 20:55:47.349118 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:47.349096 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0158f0f9-f380-44a9-b62e-14385ff297b5-plugins-config-volume\") pod \"0158f0f9-f380-44a9-b62e-14385ff297b5\" (UID: \"0158f0f9-f380-44a9-b62e-14385ff297b5\") " Jul 27 20:55:47.349258 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:47.349134 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d9691bf0-6c6a-46fe-9a02-e49fc74289a6-plugins-config-volume\") pod \"d9691bf0-6c6a-46fe-9a02-e49fc74289a6\" (UID: \"d9691bf0-6c6a-46fe-9a02-e49fc74289a6\") " Jul 27 20:55:47.349258 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:47.349177 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kt2sp\" (UniqueName: \"kubernetes.io/projected/0158f0f9-f380-44a9-b62e-14385ff297b5-kube-api-access-kt2sp\") pod \"0158f0f9-f380-44a9-b62e-14385ff297b5\" (UID: \"0158f0f9-f380-44a9-b62e-14385ff297b5\") " Jul 27 20:55:47.349258 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:47.349210 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xq2hp\" (UniqueName: \"kubernetes.io/projected/d9691bf0-6c6a-46fe-9a02-e49fc74289a6-kube-api-access-xq2hp\") pod \"d9691bf0-6c6a-46fe-9a02-e49fc74289a6\" (UID: \"d9691bf0-6c6a-46fe-9a02-e49fc74289a6\") " Jul 27 20:55:47.349503 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:47.349482 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0158f0f9-f380-44a9-b62e-14385ff297b5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0158f0f9-f380-44a9-b62e-14385ff297b5" (UID: "0158f0f9-f380-44a9-b62e-14385ff297b5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:55:47.349596 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:47.349566 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9691bf0-6c6a-46fe-9a02-e49fc74289a6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d9691bf0-6c6a-46fe-9a02-e49fc74289a6" (UID: "d9691bf0-6c6a-46fe-9a02-e49fc74289a6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:55:47.351245 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:47.351219 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9691bf0-6c6a-46fe-9a02-e49fc74289a6-kube-api-access-xq2hp" (OuterVolumeSpecName: "kube-api-access-xq2hp") pod "d9691bf0-6c6a-46fe-9a02-e49fc74289a6" (UID: "d9691bf0-6c6a-46fe-9a02-e49fc74289a6"). InnerVolumeSpecName "kube-api-access-xq2hp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:55:47.351357 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:47.351333 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0158f0f9-f380-44a9-b62e-14385ff297b5-kube-api-access-kt2sp" (OuterVolumeSpecName: "kube-api-access-kt2sp") pod "0158f0f9-f380-44a9-b62e-14385ff297b5" (UID: "0158f0f9-f380-44a9-b62e-14385ff297b5"). InnerVolumeSpecName "kube-api-access-kt2sp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:55:47.450455 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:47.450370 2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0158f0f9-f380-44a9-b62e-14385ff297b5-plugins-config-volume\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 20:55:47.450455 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:47.450397 2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d9691bf0-6c6a-46fe-9a02-e49fc74289a6-plugins-config-volume\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 20:55:47.450455 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:47.450410 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kt2sp\" (UniqueName: \"kubernetes.io/projected/0158f0f9-f380-44a9-b62e-14385ff297b5-kube-api-access-kt2sp\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 20:55:47.450455 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:47.450419 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xq2hp\" (UniqueName: \"kubernetes.io/projected/d9691bf0-6c6a-46fe-9a02-e49fc74289a6-kube-api-access-xq2hp\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 20:55:47.814643 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:47.814605 2558 generic.go:356] "Generic (PLEG): container finished" podID="d9691bf0-6c6a-46fe-9a02-e49fc74289a6" containerID="fae52c96b56426f28231d627957d196b204552c873cd0faa64f4fa7ecba0630b" exitCode=0 Jul 27 20:55:47.814832 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:47.814655 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-cc8abd-5f5958957d-r8zn5" Jul 27 20:55:47.814832 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:47.814706 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-cc8abd-5f5958957d-r8zn5" event={"ID":"d9691bf0-6c6a-46fe-9a02-e49fc74289a6","Type":"ContainerDied","Data":"fae52c96b56426f28231d627957d196b204552c873cd0faa64f4fa7ecba0630b"} Jul 27 20:55:47.814832 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:47.814775 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-cc8abd-5f5958957d-r8zn5" event={"ID":"d9691bf0-6c6a-46fe-9a02-e49fc74289a6","Type":"ContainerDied","Data":"9122bf1f055cb64a6b52d29b136a27bed499e7c71aa9eec7fc43971943c64421"} Jul 27 20:55:47.814832 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:47.814813 2558 scope.go:117] "RemoveContainer" containerID="fae52c96b56426f28231d627957d196b204552c873cd0faa64f4fa7ecba0630b" Jul 27 20:55:47.815875 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:47.815849 2558 generic.go:356] "Generic (PLEG): container finished" podID="0158f0f9-f380-44a9-b62e-14385ff297b5" containerID="63aef5e421fae99133a2cf8cd38032d9463f4fa85c106b558fb1b602cba9b8e6" exitCode=0 Jul 27 20:55:47.816065 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:47.815889 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-cc8abd-7db9b5c996-qk4th" Jul 27 20:55:47.816065 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:47.815939 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-cc8abd-7db9b5c996-qk4th" event={"ID":"0158f0f9-f380-44a9-b62e-14385ff297b5","Type":"ContainerDied","Data":"63aef5e421fae99133a2cf8cd38032d9463f4fa85c106b558fb1b602cba9b8e6"} Jul 27 20:55:47.816065 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:47.815971 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-cc8abd-7db9b5c996-qk4th" event={"ID":"0158f0f9-f380-44a9-b62e-14385ff297b5","Type":"ContainerDied","Data":"3beeedd50ce75fc41e0387f46c2f08d50ec5c4f0e38f6100184203ef4d81befe"} Jul 27 20:55:47.824423 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:47.824337 2558 scope.go:117] "RemoveContainer" containerID="fae52c96b56426f28231d627957d196b204552c873cd0faa64f4fa7ecba0630b" Jul 27 20:55:47.824730 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:55:47.824708 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fae52c96b56426f28231d627957d196b204552c873cd0faa64f4fa7ecba0630b\": container with ID starting with fae52c96b56426f28231d627957d196b204552c873cd0faa64f4fa7ecba0630b not found: ID does not exist" containerID="fae52c96b56426f28231d627957d196b204552c873cd0faa64f4fa7ecba0630b" Jul 27 20:55:47.824827 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:47.824736 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fae52c96b56426f28231d627957d196b204552c873cd0faa64f4fa7ecba0630b"} err="failed to get container status \"fae52c96b56426f28231d627957d196b204552c873cd0faa64f4fa7ecba0630b\": rpc error: code = NotFound desc = could not find container \"fae52c96b56426f28231d627957d196b204552c873cd0faa64f4fa7ecba0630b\": container with ID starting with fae52c96b56426f28231d627957d196b204552c873cd0faa64f4fa7ecba0630b not found: ID does not exist" Jul 27 20:55:47.824827 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:47.824752 2558 scope.go:117] "RemoveContainer" containerID="63aef5e421fae99133a2cf8cd38032d9463f4fa85c106b558fb1b602cba9b8e6" Jul 27 20:55:47.831988 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:47.831971 2558 scope.go:117] "RemoveContainer" containerID="63aef5e421fae99133a2cf8cd38032d9463f4fa85c106b558fb1b602cba9b8e6" Jul 27 20:55:47.832261 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:55:47.832232 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63aef5e421fae99133a2cf8cd38032d9463f4fa85c106b558fb1b602cba9b8e6\": container with ID starting with 63aef5e421fae99133a2cf8cd38032d9463f4fa85c106b558fb1b602cba9b8e6 not found: ID does not exist" containerID="63aef5e421fae99133a2cf8cd38032d9463f4fa85c106b558fb1b602cba9b8e6" Jul 27 20:55:47.832348 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:47.832262 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63aef5e421fae99133a2cf8cd38032d9463f4fa85c106b558fb1b602cba9b8e6"} err="failed to get container status \"63aef5e421fae99133a2cf8cd38032d9463f4fa85c106b558fb1b602cba9b8e6\": rpc error: code = NotFound desc = could not find container \"63aef5e421fae99133a2cf8cd38032d9463f4fa85c106b558fb1b602cba9b8e6\": container with ID starting with 63aef5e421fae99133a2cf8cd38032d9463f4fa85c106b558fb1b602cba9b8e6 not found: ID does not exist" Jul 27 20:55:47.842899 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:47.842877 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-cc8abd-5f5958957d-r8zn5"] Jul 27 20:55:47.848476 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:47.848458 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-cc8abd-5f5958957d-r8zn5"] Jul 27 20:55:47.857236 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:47.857216 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-cc8abd-7db9b5c996-qk4th"] Jul 27 20:55:47.862678 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:47.862660 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-cc8abd-7db9b5c996-qk4th"] Jul 27 20:55:47.937978 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:47.935956 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0158f0f9-f380-44a9-b62e-14385ff297b5" path="/var/lib/kubelet/pods/0158f0f9-f380-44a9-b62e-14385ff297b5/volumes" Jul 27 20:55:47.937978 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:47.936470 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9691bf0-6c6a-46fe-9a02-e49fc74289a6" path="/var/lib/kubelet/pods/d9691bf0-6c6a-46fe-9a02-e49fc74289a6/volumes" Jul 27 20:55:48.258625 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:48.258590 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:55:51.527249 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:51.527209 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:55:51.831616 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:51.831532 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:55:51.917986 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:51.917948 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:55:52.044095 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:52.044062 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:55:57.727964 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:57.727927 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:55:57.822204 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:57.822172 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:55:57.996991 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:57.996895 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:55:58.215132 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:55:58.215103 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:56:01.339100 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:01.339066 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:56:13.834382 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:13.834345 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:56:13.856185 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:13.856155 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-d4c2c3-658775fbdd-9fjft"] Jul 27 20:56:13.856371 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:13.856347 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-d4c2c3-658775fbdd-9fjft" podUID="acf95063-b0d9-44ae-adff-2981772b3fd0" containerName="payload-processing" containerID="cri-o://18273b944878971ebd43a952e00e0c8835c189fdbab3584394c7352231fb24a4" gracePeriod=30 Jul 27 20:56:13.861489 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:13.861467 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-d4c2c3-6fb5d86fdd-qh5dn"] Jul 27 20:56:13.861860 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:13.861832 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-d4c2c3-6fb5d86fdd-qh5dn" podUID="787cd6f1-5a4d-4898-8b50-8dfc67e668e3" containerName="payload-pre-processing" containerID="cri-o://167d1c9082a136230e3eb3271f432e42a659bdd8a3da35622fe7ce08111b3e1c" gracePeriod=30 Jul 27 20:56:13.893345 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:13.893316 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:56:13.957466 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:13.957439 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:56:14.105467 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:14.105446 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-d4c2c3-658775fbdd-9fjft" Jul 27 20:56:14.136608 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:14.136586 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-d4c2c3-6fb5d86fdd-qh5dn" Jul 27 20:56:14.157467 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:14.157444 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/acf95063-b0d9-44ae-adff-2981772b3fd0-plugins-config-volume\") pod \"acf95063-b0d9-44ae-adff-2981772b3fd0\" (UID: \"acf95063-b0d9-44ae-adff-2981772b3fd0\") " Jul 27 20:56:14.157574 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:14.157474 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rd6hc\" (UniqueName: \"kubernetes.io/projected/787cd6f1-5a4d-4898-8b50-8dfc67e668e3-kube-api-access-rd6hc\") pod \"787cd6f1-5a4d-4898-8b50-8dfc67e668e3\" (UID: \"787cd6f1-5a4d-4898-8b50-8dfc67e668e3\") " Jul 27 20:56:14.157574 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:14.157502 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/787cd6f1-5a4d-4898-8b50-8dfc67e668e3-plugins-config-volume\") pod \"787cd6f1-5a4d-4898-8b50-8dfc67e668e3\" (UID: \"787cd6f1-5a4d-4898-8b50-8dfc67e668e3\") " Jul 27 20:56:14.157574 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:14.157521 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lrcfc\" (UniqueName: \"kubernetes.io/projected/acf95063-b0d9-44ae-adff-2981772b3fd0-kube-api-access-lrcfc\") pod \"acf95063-b0d9-44ae-adff-2981772b3fd0\" (UID: \"acf95063-b0d9-44ae-adff-2981772b3fd0\") " Jul 27 20:56:14.157919 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:14.157899 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/787cd6f1-5a4d-4898-8b50-8dfc67e668e3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "787cd6f1-5a4d-4898-8b50-8dfc67e668e3" (UID: "787cd6f1-5a4d-4898-8b50-8dfc67e668e3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:56:14.157978 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:14.157909 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/acf95063-b0d9-44ae-adff-2981772b3fd0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "acf95063-b0d9-44ae-adff-2981772b3fd0" (UID: "acf95063-b0d9-44ae-adff-2981772b3fd0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:56:14.159561 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:14.159537 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/787cd6f1-5a4d-4898-8b50-8dfc67e668e3-kube-api-access-rd6hc" (OuterVolumeSpecName: "kube-api-access-rd6hc") pod "787cd6f1-5a4d-4898-8b50-8dfc67e668e3" (UID: "787cd6f1-5a4d-4898-8b50-8dfc67e668e3"). InnerVolumeSpecName "kube-api-access-rd6hc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:56:14.159653 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:14.159568 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acf95063-b0d9-44ae-adff-2981772b3fd0-kube-api-access-lrcfc" (OuterVolumeSpecName: "kube-api-access-lrcfc") pod "acf95063-b0d9-44ae-adff-2981772b3fd0" (UID: "acf95063-b0d9-44ae-adff-2981772b3fd0"). InnerVolumeSpecName "kube-api-access-lrcfc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:56:14.258586 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:14.258559 2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/acf95063-b0d9-44ae-adff-2981772b3fd0-plugins-config-volume\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 20:56:14.258586 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:14.258582 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rd6hc\" (UniqueName: \"kubernetes.io/projected/787cd6f1-5a4d-4898-8b50-8dfc67e668e3-kube-api-access-rd6hc\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 20:56:14.258586 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:14.258591 2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/787cd6f1-5a4d-4898-8b50-8dfc67e668e3-plugins-config-volume\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 20:56:14.258819 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:14.258601 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrcfc\" (UniqueName: \"kubernetes.io/projected/acf95063-b0d9-44ae-adff-2981772b3fd0-kube-api-access-lrcfc\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 20:56:14.931769 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:14.931735 2558 generic.go:356] "Generic (PLEG): container finished" podID="acf95063-b0d9-44ae-adff-2981772b3fd0" containerID="18273b944878971ebd43a952e00e0c8835c189fdbab3584394c7352231fb24a4" exitCode=0 Jul 27 20:56:14.932202 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:14.931791 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-d4c2c3-658775fbdd-9fjft" Jul 27 20:56:14.932202 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:14.931825 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-d4c2c3-658775fbdd-9fjft" event={"ID":"acf95063-b0d9-44ae-adff-2981772b3fd0","Type":"ContainerDied","Data":"18273b944878971ebd43a952e00e0c8835c189fdbab3584394c7352231fb24a4"} Jul 27 20:56:14.932202 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:14.931889 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-d4c2c3-658775fbdd-9fjft" event={"ID":"acf95063-b0d9-44ae-adff-2981772b3fd0","Type":"ContainerDied","Data":"5ca3f5aa49da01ff6f5caeceb318cba4688761ea85227199538619d1c7474749"} Jul 27 20:56:14.932202 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:14.931924 2558 scope.go:117] "RemoveContainer" containerID="18273b944878971ebd43a952e00e0c8835c189fdbab3584394c7352231fb24a4" Jul 27 20:56:14.933246 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:14.933121 2558 generic.go:356] "Generic (PLEG): container finished" podID="787cd6f1-5a4d-4898-8b50-8dfc67e668e3" containerID="167d1c9082a136230e3eb3271f432e42a659bdd8a3da35622fe7ce08111b3e1c" exitCode=0 Jul 27 20:56:14.933246 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:14.933147 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-d4c2c3-6fb5d86fdd-qh5dn" event={"ID":"787cd6f1-5a4d-4898-8b50-8dfc67e668e3","Type":"ContainerDied","Data":"167d1c9082a136230e3eb3271f432e42a659bdd8a3da35622fe7ce08111b3e1c"} Jul 27 20:56:14.933246 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:14.933177 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-d4c2c3-6fb5d86fdd-qh5dn" Jul 27 20:56:14.933246 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:14.933197 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-d4c2c3-6fb5d86fdd-qh5dn" event={"ID":"787cd6f1-5a4d-4898-8b50-8dfc67e668e3","Type":"ContainerDied","Data":"081f2be5697950daeb57dfdbbf44a64258381ebad2123eedd32437e9d2875021"} Jul 27 20:56:14.940705 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:14.940677 2558 scope.go:117] "RemoveContainer" containerID="18273b944878971ebd43a952e00e0c8835c189fdbab3584394c7352231fb24a4" Jul 27 20:56:14.940983 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:56:14.940941 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18273b944878971ebd43a952e00e0c8835c189fdbab3584394c7352231fb24a4\": container with ID starting with 18273b944878971ebd43a952e00e0c8835c189fdbab3584394c7352231fb24a4 not found: ID does not exist" containerID="18273b944878971ebd43a952e00e0c8835c189fdbab3584394c7352231fb24a4" Jul 27 20:56:14.940983 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:14.940965 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18273b944878971ebd43a952e00e0c8835c189fdbab3584394c7352231fb24a4"} err="failed to get container status \"18273b944878971ebd43a952e00e0c8835c189fdbab3584394c7352231fb24a4\": rpc error: code = NotFound desc = could not find container \"18273b944878971ebd43a952e00e0c8835c189fdbab3584394c7352231fb24a4\": container with ID starting with 18273b944878971ebd43a952e00e0c8835c189fdbab3584394c7352231fb24a4 not found: ID does not exist" Jul 27 20:56:14.940983 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:14.940981 2558 scope.go:117] "RemoveContainer" containerID="167d1c9082a136230e3eb3271f432e42a659bdd8a3da35622fe7ce08111b3e1c" Jul 27 20:56:14.948323 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:14.948309 2558 scope.go:117] "RemoveContainer" containerID="167d1c9082a136230e3eb3271f432e42a659bdd8a3da35622fe7ce08111b3e1c" Jul 27 20:56:14.948539 ip-10-0-132-12 kubenswrapper[2558]: E0727 20:56:14.948521 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"167d1c9082a136230e3eb3271f432e42a659bdd8a3da35622fe7ce08111b3e1c\": container with ID starting with 167d1c9082a136230e3eb3271f432e42a659bdd8a3da35622fe7ce08111b3e1c not found: ID does not exist" containerID="167d1c9082a136230e3eb3271f432e42a659bdd8a3da35622fe7ce08111b3e1c" Jul 27 20:56:14.948577 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:14.948547 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"167d1c9082a136230e3eb3271f432e42a659bdd8a3da35622fe7ce08111b3e1c"} err="failed to get container status \"167d1c9082a136230e3eb3271f432e42a659bdd8a3da35622fe7ce08111b3e1c\": rpc error: code = NotFound desc = could not find container \"167d1c9082a136230e3eb3271f432e42a659bdd8a3da35622fe7ce08111b3e1c\": container with ID starting with 167d1c9082a136230e3eb3271f432e42a659bdd8a3da35622fe7ce08111b3e1c not found: ID does not exist" Jul 27 20:56:14.955950 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:14.955932 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-d4c2c3-658775fbdd-9fjft"] Jul 27 20:56:14.962194 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:14.962175 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-d4c2c3-658775fbdd-9fjft"] Jul 27 20:56:14.972120 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:14.972099 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-d4c2c3-6fb5d86fdd-qh5dn"] Jul 27 20:56:14.975416 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:14.975394 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-d4c2c3-6fb5d86fdd-qh5dn"] Jul 27 20:56:15.933227 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:15.933198 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="787cd6f1-5a4d-4898-8b50-8dfc67e668e3" path="/var/lib/kubelet/pods/787cd6f1-5a4d-4898-8b50-8dfc67e668e3/volumes" Jul 27 20:56:15.933618 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:15.933552 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acf95063-b0d9-44ae-adff-2981772b3fd0" path="/var/lib/kubelet/pods/acf95063-b0d9-44ae-adff-2981772b3fd0/volumes" Jul 27 20:56:18.429478 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:18.429443 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:56:18.516502 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:18.516469 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:56:18.800341 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:18.800305 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:56:24.679133 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:24.679091 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:56:24.779501 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:24.779460 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:56:24.956615 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:24.956534 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:56:25.171564 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:25.171526 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:56:25.530546 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:25.530511 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:56:25.843628 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:25.843552 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:56:26.137098 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:26.137003 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:56:28.402649 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:28.402615 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:56:28.986234 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:28.986206 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:56:29.088520 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:29.088486 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:56:29.261035 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:29.260998 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:56:29.479136 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:29.479092 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:56:29.864104 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:29.864066 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:56:29.969523 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:29.969491 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-132aad-64bcff89f6-x5d4f"] Jul 27 20:56:29.969862 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:29.969841 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acf95063-b0d9-44ae-adff-2981772b3fd0" containerName="payload-processing" Jul 27 20:56:29.969862 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:29.969863 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="acf95063-b0d9-44ae-adff-2981772b3fd0" containerName="payload-processing" Jul 27 20:56:29.970069 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:29.969894 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0158f0f9-f380-44a9-b62e-14385ff297b5" containerName="payload-pre-processing" Jul 27 20:56:29.970069 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:29.969901 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0158f0f9-f380-44a9-b62e-14385ff297b5" containerName="payload-pre-processing" Jul 27 20:56:29.970069 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:29.969907 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9691bf0-6c6a-46fe-9a02-e49fc74289a6" containerName="payload-processing" Jul 27 20:56:29.970069 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:29.969913 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9691bf0-6c6a-46fe-9a02-e49fc74289a6" containerName="payload-processing" Jul 27 20:56:29.970069 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:29.969925 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="787cd6f1-5a4d-4898-8b50-8dfc67e668e3" containerName="payload-pre-processing" Jul 27 20:56:29.970069 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:29.969934 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="787cd6f1-5a4d-4898-8b50-8dfc67e668e3" containerName="payload-pre-processing" Jul 27 20:56:29.970069 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:29.970001 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="0158f0f9-f380-44a9-b62e-14385ff297b5" containerName="payload-pre-processing" Jul 27 20:56:29.970069 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:29.970012 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="acf95063-b0d9-44ae-adff-2981772b3fd0" containerName="payload-processing" Jul 27 20:56:29.970069 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:29.970027 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9691bf0-6c6a-46fe-9a02-e49fc74289a6" containerName="payload-processing" Jul 27 20:56:29.970069 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:29.970029 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:56:29.970412 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:29.970035 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="787cd6f1-5a4d-4898-8b50-8dfc67e668e3" containerName="payload-pre-processing" Jul 27 20:56:29.974256 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:29.974239 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-132aad-64bcff89f6-x5d4f" Jul 27 20:56:29.976448 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:29.976430 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-132aad-dockercfg-jxfkm\"" Jul 27 20:56:29.976555 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:29.976459 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-132aad\"" Jul 27 20:56:29.983364 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:29.983341 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-132aad-64bcff89f6-x5d4f"] Jul 27 20:56:30.002478 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:30.002454 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-132aad-57fd95965d-fntb4"] Jul 27 20:56:30.005681 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:30.005661 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-132aad-57fd95965d-fntb4" Jul 27 20:56:30.015300 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:30.015276 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-132aad-57fd95965d-fntb4"] Jul 27 20:56:30.088489 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:30.088457 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea1fdbb2-05b0-4b61-87a3-b8039c9459ba-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-132aad-57fd95965d-fntb4\" (UID: \"ea1fdbb2-05b0-4b61-87a3-b8039c9459ba\") " pod="openshift-ingress/payload-processing-e2e-shared-a-132aad-57fd95965d-fntb4" Jul 27 20:56:30.088647 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:30.088494 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b0fce49-3066-427f-b908-d71e7f22030d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-132aad-64bcff89f6-x5d4f\" (UID: \"9b0fce49-3066-427f-b908-d71e7f22030d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-132aad-64bcff89f6-x5d4f" Jul 27 20:56:30.088647 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:30.088583 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmgm7\" (UniqueName: \"kubernetes.io/projected/ea1fdbb2-05b0-4b61-87a3-b8039c9459ba-kube-api-access-bmgm7\") pod \"payload-processing-e2e-shared-a-132aad-57fd95965d-fntb4\" (UID: \"ea1fdbb2-05b0-4b61-87a3-b8039c9459ba\") " pod="openshift-ingress/payload-processing-e2e-shared-a-132aad-57fd95965d-fntb4" Jul 27 20:56:30.088647 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:30.088626 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c99ck\" (UniqueName: \"kubernetes.io/projected/9b0fce49-3066-427f-b908-d71e7f22030d-kube-api-access-c99ck\") pod \"payload-pre-processing-e2e-shared-a-132aad-64bcff89f6-x5d4f\" (UID: \"9b0fce49-3066-427f-b908-d71e7f22030d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-132aad-64bcff89f6-x5d4f" Jul 27 20:56:30.189033 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:30.188954 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c99ck\" (UniqueName: \"kubernetes.io/projected/9b0fce49-3066-427f-b908-d71e7f22030d-kube-api-access-c99ck\") pod \"payload-pre-processing-e2e-shared-a-132aad-64bcff89f6-x5d4f\" (UID: \"9b0fce49-3066-427f-b908-d71e7f22030d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-132aad-64bcff89f6-x5d4f" Jul 27 20:56:30.189033 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:30.189009 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea1fdbb2-05b0-4b61-87a3-b8039c9459ba-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-132aad-57fd95965d-fntb4\" (UID: \"ea1fdbb2-05b0-4b61-87a3-b8039c9459ba\") " pod="openshift-ingress/payload-processing-e2e-shared-a-132aad-57fd95965d-fntb4" Jul 27 20:56:30.189033 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:30.189027 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b0fce49-3066-427f-b908-d71e7f22030d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-132aad-64bcff89f6-x5d4f\" (UID: \"9b0fce49-3066-427f-b908-d71e7f22030d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-132aad-64bcff89f6-x5d4f" Jul 27 20:56:30.189241 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:30.189066 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmgm7\" (UniqueName: \"kubernetes.io/projected/ea1fdbb2-05b0-4b61-87a3-b8039c9459ba-kube-api-access-bmgm7\") pod \"payload-processing-e2e-shared-a-132aad-57fd95965d-fntb4\" (UID: \"ea1fdbb2-05b0-4b61-87a3-b8039c9459ba\") " pod="openshift-ingress/payload-processing-e2e-shared-a-132aad-57fd95965d-fntb4" Jul 27 20:56:30.189791 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:30.189771 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea1fdbb2-05b0-4b61-87a3-b8039c9459ba-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-132aad-57fd95965d-fntb4\" (UID: \"ea1fdbb2-05b0-4b61-87a3-b8039c9459ba\") " pod="openshift-ingress/payload-processing-e2e-shared-a-132aad-57fd95965d-fntb4" Jul 27 20:56:30.189791 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:30.189784 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b0fce49-3066-427f-b908-d71e7f22030d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-132aad-64bcff89f6-x5d4f\" (UID: \"9b0fce49-3066-427f-b908-d71e7f22030d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-132aad-64bcff89f6-x5d4f" Jul 27 20:56:30.196854 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:30.196829 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmgm7\" (UniqueName: \"kubernetes.io/projected/ea1fdbb2-05b0-4b61-87a3-b8039c9459ba-kube-api-access-bmgm7\") pod \"payload-processing-e2e-shared-a-132aad-57fd95965d-fntb4\" (UID: \"ea1fdbb2-05b0-4b61-87a3-b8039c9459ba\") " pod="openshift-ingress/payload-processing-e2e-shared-a-132aad-57fd95965d-fntb4" Jul 27 20:56:30.196961 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:30.196910 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c99ck\" (UniqueName: \"kubernetes.io/projected/9b0fce49-3066-427f-b908-d71e7f22030d-kube-api-access-c99ck\") pod \"payload-pre-processing-e2e-shared-a-132aad-64bcff89f6-x5d4f\" (UID: \"9b0fce49-3066-427f-b908-d71e7f22030d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-132aad-64bcff89f6-x5d4f" Jul 27 20:56:30.285313 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:30.285284 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-132aad-64bcff89f6-x5d4f" Jul 27 20:56:30.316596 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:30.316568 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-132aad-57fd95965d-fntb4" Jul 27 20:56:30.421730 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:30.421680 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-132aad-64bcff89f6-x5d4f"] Jul 27 20:56:30.424640 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:56:30.424617 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b0fce49_3066_427f_b908_d71e7f22030d.slice/crio-9ae7f80b9d3b4300b2f20426218bced4762f76cd9ec1e04b8ececb725f332618 WatchSource:0}: Error finding container 9ae7f80b9d3b4300b2f20426218bced4762f76cd9ec1e04b8ececb725f332618: Status 404 returned error can't find the container with id 9ae7f80b9d3b4300b2f20426218bced4762f76cd9ec1e04b8ececb725f332618 Jul 27 20:56:30.456468 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:30.456442 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-132aad-57fd95965d-fntb4"] Jul 27 20:56:30.458486 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:56:30.458460 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea1fdbb2_05b0_4b61_87a3_b8039c9459ba.slice/crio-12561bbe62194bbb62cedb9d6cc5d9938fbaff3e4bffafd0cfc62103c9176317 WatchSource:0}: Error finding container 12561bbe62194bbb62cedb9d6cc5d9938fbaff3e4bffafd0cfc62103c9176317: Status 404 returned error can't find the container with id 12561bbe62194bbb62cedb9d6cc5d9938fbaff3e4bffafd0cfc62103c9176317 Jul 27 20:56:31.004592 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:31.004552 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-132aad-57fd95965d-fntb4" event={"ID":"ea1fdbb2-05b0-4b61-87a3-b8039c9459ba","Type":"ContainerStarted","Data":"d8ce44455bf7515360cc54db3cf21bc0462363511c85cd0760ed66aa94475c0b"} Jul 27 20:56:31.005044 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:31.004609 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-132aad-57fd95965d-fntb4" event={"ID":"ea1fdbb2-05b0-4b61-87a3-b8039c9459ba","Type":"ContainerStarted","Data":"12561bbe62194bbb62cedb9d6cc5d9938fbaff3e4bffafd0cfc62103c9176317"} Jul 27 20:56:31.005044 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:31.004683 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-132aad-57fd95965d-fntb4" Jul 27 20:56:31.006098 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:31.006072 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-132aad-64bcff89f6-x5d4f" event={"ID":"9b0fce49-3066-427f-b908-d71e7f22030d","Type":"ContainerStarted","Data":"a1c04396d5359c9be6fbb89e7a4ad13a0d06d9babe6b3c7dc5b8fd7843c56648"} Jul 27 20:56:31.006205 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:31.006114 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-132aad-64bcff89f6-x5d4f" event={"ID":"9b0fce49-3066-427f-b908-d71e7f22030d","Type":"ContainerStarted","Data":"9ae7f80b9d3b4300b2f20426218bced4762f76cd9ec1e04b8ececb725f332618"} Jul 27 20:56:31.006205 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:31.006134 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-132aad-64bcff89f6-x5d4f" Jul 27 20:56:31.021050 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:31.021009 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-132aad-57fd95965d-fntb4" podStartSLOduration=2.020996608 podStartE2EDuration="2.020996608s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:56:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:56:31.019864481 +0000 UTC m=+2333.598438070" watchObservedRunningTime="2026-07-27 20:56:31.020996608 +0000 UTC m=+2333.599570198" Jul 27 20:56:31.034418 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:31.034378 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-132aad-64bcff89f6-x5d4f" podStartSLOduration=2.03436506 podStartE2EDuration="2.03436506s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:56:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:56:31.033911373 +0000 UTC m=+2333.612484963" watchObservedRunningTime="2026-07-27 20:56:31.03436506 +0000 UTC m=+2333.612938649" Jul 27 20:56:33.496370 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:33.496339 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:56:33.846097 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:33.846063 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:56:34.122726 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:34.122621 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:56:34.613390 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:34.613352 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:56:37.030280 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:37.030239 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:56:37.113473 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:37.113442 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:56:37.185748 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:37.185713 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:56:37.294748 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:37.294667 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:56:37.716646 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:37.716569 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:56:37.726005 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:37.725969 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:56:37.804868 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:37.804839 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-66b603-6fc59647b8-t42kr"] Jul 27 20:56:37.807134 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:37.807106 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:56:37.808125 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:37.808106 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-66b603-6fc59647b8-t42kr" Jul 27 20:56:37.810611 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:37.810590 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-66b603-dockercfg-wnhzd\"" Jul 27 20:56:37.810611 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:37.810602 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-66b603\"" Jul 27 20:56:37.817735 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:37.817714 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-66b603-6fc59647b8-t42kr"] Jul 27 20:56:37.850751 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:37.850732 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-66b603-67887659b6-jrjk4"] Jul 27 20:56:37.853926 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:37.853908 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-66b603-67887659b6-jrjk4" Jul 27 20:56:37.864635 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:37.864614 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-66b603-67887659b6-jrjk4"] Jul 27 20:56:37.952196 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:37.952167 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9n9d\" (UniqueName: \"kubernetes.io/projected/2a23deac-be2d-4ddf-8dde-b4150430d650-kube-api-access-c9n9d\") pod \"payload-processing-e2e-shared-b-66b603-67887659b6-jrjk4\" (UID: \"2a23deac-be2d-4ddf-8dde-b4150430d650\") " pod="openshift-ingress/payload-processing-e2e-shared-b-66b603-67887659b6-jrjk4" Jul 27 20:56:37.952368 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:37.952207 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nrhs\" (UniqueName: \"kubernetes.io/projected/1b202b8e-728d-4f81-aad5-f0b39552cb22-kube-api-access-7nrhs\") pod \"payload-pre-processing-e2e-shared-b-66b603-6fc59647b8-t42kr\" (UID: \"1b202b8e-728d-4f81-aad5-f0b39552cb22\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-66b603-6fc59647b8-t42kr" Jul 27 20:56:37.952368 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:37.952265 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b202b8e-728d-4f81-aad5-f0b39552cb22-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-66b603-6fc59647b8-t42kr\" (UID: \"1b202b8e-728d-4f81-aad5-f0b39552cb22\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-66b603-6fc59647b8-t42kr" Jul 27 20:56:37.952368 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:37.952309 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a23deac-be2d-4ddf-8dde-b4150430d650-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-66b603-67887659b6-jrjk4\" (UID: \"2a23deac-be2d-4ddf-8dde-b4150430d650\") " pod="openshift-ingress/payload-processing-e2e-shared-b-66b603-67887659b6-jrjk4" Jul 27 20:56:38.052987 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:38.052928 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b202b8e-728d-4f81-aad5-f0b39552cb22-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-66b603-6fc59647b8-t42kr\" (UID: \"1b202b8e-728d-4f81-aad5-f0b39552cb22\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-66b603-6fc59647b8-t42kr" Jul 27 20:56:38.052987 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:38.052967 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a23deac-be2d-4ddf-8dde-b4150430d650-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-66b603-67887659b6-jrjk4\" (UID: \"2a23deac-be2d-4ddf-8dde-b4150430d650\") " pod="openshift-ingress/payload-processing-e2e-shared-b-66b603-67887659b6-jrjk4" Jul 27 20:56:38.053371 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:38.053027 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9n9d\" (UniqueName: \"kubernetes.io/projected/2a23deac-be2d-4ddf-8dde-b4150430d650-kube-api-access-c9n9d\") pod \"payload-processing-e2e-shared-b-66b603-67887659b6-jrjk4\" (UID: \"2a23deac-be2d-4ddf-8dde-b4150430d650\") " pod="openshift-ingress/payload-processing-e2e-shared-b-66b603-67887659b6-jrjk4" Jul 27 20:56:38.053371 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:38.053054 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nrhs\" (UniqueName: \"kubernetes.io/projected/1b202b8e-728d-4f81-aad5-f0b39552cb22-kube-api-access-7nrhs\") pod \"payload-pre-processing-e2e-shared-b-66b603-6fc59647b8-t42kr\" (UID: \"1b202b8e-728d-4f81-aad5-f0b39552cb22\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-66b603-6fc59647b8-t42kr" Jul 27 20:56:38.053674 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:38.053655 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a23deac-be2d-4ddf-8dde-b4150430d650-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-66b603-67887659b6-jrjk4\" (UID: \"2a23deac-be2d-4ddf-8dde-b4150430d650\") " pod="openshift-ingress/payload-processing-e2e-shared-b-66b603-67887659b6-jrjk4" Jul 27 20:56:38.053747 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:38.053707 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b202b8e-728d-4f81-aad5-f0b39552cb22-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-66b603-6fc59647b8-t42kr\" (UID: \"1b202b8e-728d-4f81-aad5-f0b39552cb22\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-66b603-6fc59647b8-t42kr" Jul 27 20:56:38.061322 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:38.061299 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9n9d\" (UniqueName: \"kubernetes.io/projected/2a23deac-be2d-4ddf-8dde-b4150430d650-kube-api-access-c9n9d\") pod \"payload-processing-e2e-shared-b-66b603-67887659b6-jrjk4\" (UID: \"2a23deac-be2d-4ddf-8dde-b4150430d650\") " pod="openshift-ingress/payload-processing-e2e-shared-b-66b603-67887659b6-jrjk4" Jul 27 20:56:38.061640 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:38.061623 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nrhs\" (UniqueName: \"kubernetes.io/projected/1b202b8e-728d-4f81-aad5-f0b39552cb22-kube-api-access-7nrhs\") pod \"payload-pre-processing-e2e-shared-b-66b603-6fc59647b8-t42kr\" (UID: \"1b202b8e-728d-4f81-aad5-f0b39552cb22\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-66b603-6fc59647b8-t42kr" Jul 27 20:56:38.119057 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:38.119021 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-66b603-6fc59647b8-t42kr" Jul 27 20:56:38.163678 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:38.163631 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-66b603-67887659b6-jrjk4" Jul 27 20:56:38.259068 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:38.259036 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-66b603-6fc59647b8-t42kr"] Jul 27 20:56:38.260203 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:56:38.260166 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b202b8e_728d_4f81_aad5_f0b39552cb22.slice/crio-b965beeeb55315b0a16f0a9728a8340ff36b275fce2adb435e59dc7152adef43 WatchSource:0}: Error finding container b965beeeb55315b0a16f0a9728a8340ff36b275fce2adb435e59dc7152adef43: Status 404 returned error can't find the container with id b965beeeb55315b0a16f0a9728a8340ff36b275fce2adb435e59dc7152adef43 Jul 27 20:56:38.308853 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:38.308832 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-66b603-67887659b6-jrjk4"] Jul 27 20:56:38.310975 ip-10-0-132-12 kubenswrapper[2558]: W0727 20:56:38.310953 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a23deac_be2d_4ddf_8dde_b4150430d650.slice/crio-b3e0c8859059b43e70c7430f96888cdd0550e93d6ad22abe37ada15a0dfdbd4b WatchSource:0}: Error finding container b3e0c8859059b43e70c7430f96888cdd0550e93d6ad22abe37ada15a0dfdbd4b: Status 404 returned error can't find the container with id b3e0c8859059b43e70c7430f96888cdd0550e93d6ad22abe37ada15a0dfdbd4b Jul 27 20:56:39.042394 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:39.042353 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-66b603-6fc59647b8-t42kr" event={"ID":"1b202b8e-728d-4f81-aad5-f0b39552cb22","Type":"ContainerStarted","Data":"4c44e3c457604303e5d86d7a7c61e626f1f7841664553802141ef3b6afe74df0"} Jul 27 20:56:39.042601 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:39.042448 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-66b603-6fc59647b8-t42kr" event={"ID":"1b202b8e-728d-4f81-aad5-f0b39552cb22","Type":"ContainerStarted","Data":"b965beeeb55315b0a16f0a9728a8340ff36b275fce2adb435e59dc7152adef43"} Jul 27 20:56:39.042601 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:39.042479 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-66b603-6fc59647b8-t42kr" Jul 27 20:56:39.044004 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:39.043978 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-66b603-67887659b6-jrjk4" event={"ID":"2a23deac-be2d-4ddf-8dde-b4150430d650","Type":"ContainerStarted","Data":"0c2afe002b4d365e341b4c64ac1a20e2042cd4235ad276d0a77cf24ad737b54b"} Jul 27 20:56:39.044114 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:39.044022 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-66b603-67887659b6-jrjk4" event={"ID":"2a23deac-be2d-4ddf-8dde-b4150430d650","Type":"ContainerStarted","Data":"b3e0c8859059b43e70c7430f96888cdd0550e93d6ad22abe37ada15a0dfdbd4b"} Jul 27 20:56:39.044114 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:39.044102 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-66b603-67887659b6-jrjk4" Jul 27 20:56:39.057985 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:39.057944 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-66b603-6fc59647b8-t42kr" podStartSLOduration=2.057930804 podStartE2EDuration="2.057930804s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:56:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:56:39.056632337 +0000 UTC m=+2341.635205940" watchObservedRunningTime="2026-07-27 20:56:39.057930804 +0000 UTC m=+2341.636504416" Jul 27 20:56:39.070955 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:39.070901 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-66b603-67887659b6-jrjk4" podStartSLOduration=2.070886929 podStartE2EDuration="2.070886929s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:56:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:56:39.07088319 +0000 UTC m=+2341.649456780" watchObservedRunningTime="2026-07-27 20:56:39.070886929 +0000 UTC m=+2341.649460520" Jul 27 20:56:41.529073 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:41.529037 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:56:42.012831 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:42.012804 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-132aad-64bcff89f6-x5d4f" Jul 27 20:56:42.012984 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:42.012868 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-132aad-57fd95965d-fntb4" Jul 27 20:56:50.049865 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:50.049835 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-66b603-67887659b6-jrjk4" Jul 27 20:56:50.050219 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:50.049904 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-66b603-6fc59647b8-t42kr" Jul 27 20:56:52.017420 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:56:52.017387 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:57:10.638551 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:57:10.638515 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:57:13.918972 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:57:13.918931 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:57:37.940515 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:57:37.940490 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rnj2b_c421dc44-8fcf-44f4-b483-8e0271833d10/ovn-acl-logging/0.log" Jul 27 20:57:37.940920 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:57:37.940489 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rnj2b_c421dc44-8fcf-44f4-b483-8e0271833d10/ovn-acl-logging/0.log" Jul 27 20:57:44.313680 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:57:44.313640 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:57:48.018289 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:57:48.018254 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:58:13.717444 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:58:13.717407 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:58:33.620500 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:58:33.620464 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 20:58:35.318964 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:58:35.318931 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:58:52.915668 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:58:52.915627 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:59:14.711951 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:59:14.711921 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:59:32.123852 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:59:32.123777 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 20:59:52.015968 ip-10-0-132-12 kubenswrapper[2558]: I0727 20:59:52.015935 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 21:00:11.013907 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:00:11.013870 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 21:00:33.509773 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:00:33.509738 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 21:00:52.519787 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:00:52.519756 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 21:01:19.419973 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:01:19.419898 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 21:01:37.109539 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:01:37.109508 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 21:02:02.925331 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:02:02.925298 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 21:02:06.757697 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:02:06.757665 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:02:08.435115 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:02:08.435083 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:02:09.289450 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:02:09.289417 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:02:20.114949 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:02:20.114915 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 21:02:24.752355 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:02:24.752309 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:02:29.530596 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:02:29.530516 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 21:02:37.962229 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:02:37.962201 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rnj2b_c421dc44-8fcf-44f4-b483-8e0271833d10/ovn-acl-logging/0.log" Jul 27 21:02:37.962641 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:02:37.962557 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rnj2b_c421dc44-8fcf-44f4-b483-8e0271833d10/ovn-acl-logging/0.log" Jul 27 21:02:48.204141 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:02:48.204092 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:02:51.833946 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:02:51.833901 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 21:03:22.533412 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:03:22.533377 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 21:03:42.418764 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:03:42.418728 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 21:03:49.223990 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:03:49.223957 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:03:49.717045 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:03:49.717006 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:04:00.914320 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:04:00.914236 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 21:04:01.439010 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:04:01.438976 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:04:10.318552 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:04:10.318517 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 21:04:24.627071 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:04:24.627038 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:04:28.812245 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:04:28.812207 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 21:04:29.423580 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:04:29.423546 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:04:58.314110 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:04:58.314074 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 21:05:02.513140 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:05:02.513104 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:15.523036 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:05:15.523000 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 21:05:36.219029 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:05:36.218955 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 21:05:42.859148 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:05:42.859116 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:43.810041 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:05:43.809975 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:49.713025 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:05:49.712990 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 21:06:03.690134 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:03.690092 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:04.030414 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:04.030379 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:04.547750 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:04.547711 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:06.961221 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:06.961179 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:07.061421 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:07.061393 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:07.130248 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:07.130214 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:07.500551 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:07.500520 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:07.657659 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:07.657628 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:07.753032 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:07.752947 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:07.757577 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:07.757553 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-6d6a46-cf4c59bbd-vqx8x"] Jul 27 21:06:07.760517 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:07.760503 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6d6a46-cf4c59bbd-vqx8x" Jul 27 21:06:07.763060 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:07.763043 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-6d6a46\"" Jul 27 21:06:07.763840 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:07.763825 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-6d6a46-dockercfg-qpqhx\"" Jul 27 21:06:07.770533 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:07.770509 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-6d6a46-cf4c59bbd-vqx8x"] Jul 27 21:06:07.788852 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:07.788828 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-6d6a46-6b85c84cb-7kj4p"] Jul 27 21:06:07.791865 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:07.791850 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-6d6a46-6b85c84cb-7kj4p" Jul 27 21:06:07.800069 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:07.800047 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-6d6a46-6b85c84cb-7kj4p"] Jul 27 21:06:07.866093 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:07.866059 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2x8t\" (UniqueName: \"kubernetes.io/projected/d0fce8de-7559-4dab-b301-40903a1d3276-kube-api-access-h2x8t\") pod \"payload-pre-processing-e2e-ipp-a-6d6a46-cf4c59bbd-vqx8x\" (UID: \"d0fce8de-7559-4dab-b301-40903a1d3276\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6d6a46-cf4c59bbd-vqx8x" Jul 27 21:06:07.866253 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:07.866108 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0fce8de-7559-4dab-b301-40903a1d3276-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-6d6a46-cf4c59bbd-vqx8x\" (UID: \"d0fce8de-7559-4dab-b301-40903a1d3276\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6d6a46-cf4c59bbd-vqx8x" Jul 27 21:06:07.967345 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:07.967316 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3b11f065-a081-4528-b646-37d833839345-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-6d6a46-6b85c84cb-7kj4p\" (UID: \"3b11f065-a081-4528-b646-37d833839345\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-6d6a46-6b85c84cb-7kj4p" Jul 27 21:06:07.967801 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:07.967350 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0fce8de-7559-4dab-b301-40903a1d3276-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-6d6a46-cf4c59bbd-vqx8x\" (UID: \"d0fce8de-7559-4dab-b301-40903a1d3276\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6d6a46-cf4c59bbd-vqx8x" Jul 27 21:06:07.967801 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:07.967376 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5j6ss\" (UniqueName: \"kubernetes.io/projected/3b11f065-a081-4528-b646-37d833839345-kube-api-access-5j6ss\") pod \"payload-processing-e2e-ipp-a-6d6a46-6b85c84cb-7kj4p\" (UID: \"3b11f065-a081-4528-b646-37d833839345\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-6d6a46-6b85c84cb-7kj4p" Jul 27 21:06:07.967801 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:07.967549 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2x8t\" (UniqueName: \"kubernetes.io/projected/d0fce8de-7559-4dab-b301-40903a1d3276-kube-api-access-h2x8t\") pod \"payload-pre-processing-e2e-ipp-a-6d6a46-cf4c59bbd-vqx8x\" (UID: \"d0fce8de-7559-4dab-b301-40903a1d3276\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6d6a46-cf4c59bbd-vqx8x" Jul 27 21:06:07.968010 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:07.967993 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0fce8de-7559-4dab-b301-40903a1d3276-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-6d6a46-cf4c59bbd-vqx8x\" (UID: \"d0fce8de-7559-4dab-b301-40903a1d3276\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6d6a46-cf4c59bbd-vqx8x" Jul 27 21:06:07.975649 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:07.975632 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2x8t\" (UniqueName: \"kubernetes.io/projected/d0fce8de-7559-4dab-b301-40903a1d3276-kube-api-access-h2x8t\") pod \"payload-pre-processing-e2e-ipp-a-6d6a46-cf4c59bbd-vqx8x\" (UID: \"d0fce8de-7559-4dab-b301-40903a1d3276\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6d6a46-cf4c59bbd-vqx8x" Jul 27 21:06:08.069019 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:08.068926 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5j6ss\" (UniqueName: \"kubernetes.io/projected/3b11f065-a081-4528-b646-37d833839345-kube-api-access-5j6ss\") pod \"payload-processing-e2e-ipp-a-6d6a46-6b85c84cb-7kj4p\" (UID: \"3b11f065-a081-4528-b646-37d833839345\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-6d6a46-6b85c84cb-7kj4p" Jul 27 21:06:08.069182 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:08.069082 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3b11f065-a081-4528-b646-37d833839345-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-6d6a46-6b85c84cb-7kj4p\" (UID: \"3b11f065-a081-4528-b646-37d833839345\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-6d6a46-6b85c84cb-7kj4p" Jul 27 21:06:08.069764 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:08.069742 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3b11f065-a081-4528-b646-37d833839345-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-6d6a46-6b85c84cb-7kj4p\" (UID: \"3b11f065-a081-4528-b646-37d833839345\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-6d6a46-6b85c84cb-7kj4p" Jul 27 21:06:08.070867 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:08.070852 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6d6a46-cf4c59bbd-vqx8x" Jul 27 21:06:08.078603 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:08.078576 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j6ss\" (UniqueName: \"kubernetes.io/projected/3b11f065-a081-4528-b646-37d833839345-kube-api-access-5j6ss\") pod \"payload-processing-e2e-ipp-a-6d6a46-6b85c84cb-7kj4p\" (UID: \"3b11f065-a081-4528-b646-37d833839345\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-6d6a46-6b85c84cb-7kj4p" Jul 27 21:06:08.102499 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:08.102476 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-6d6a46-6b85c84cb-7kj4p" Jul 27 21:06:08.208645 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:08.208593 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-6d6a46-cf4c59bbd-vqx8x"] Jul 27 21:06:08.209907 ip-10-0-132-12 kubenswrapper[2558]: W0727 21:06:08.209876 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0fce8de_7559_4dab_b301_40903a1d3276.slice/crio-658c035637050dc817e02174396de00f07c36af386698aab5a8f1947d4729b31 WatchSource:0}: Error finding container 658c035637050dc817e02174396de00f07c36af386698aab5a8f1947d4729b31: Status 404 returned error can't find the container with id 658c035637050dc817e02174396de00f07c36af386698aab5a8f1947d4729b31 Jul 27 21:06:08.244037 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:08.244012 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-6d6a46-6b85c84cb-7kj4p"] Jul 27 21:06:08.245654 ip-10-0-132-12 kubenswrapper[2558]: W0727 21:06:08.245631 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b11f065_a081_4528_b646_37d833839345.slice/crio-0506bd724258d497eccb191b785e3d746a5e8436a1dbbb6ddbdaa36be6158aff WatchSource:0}: Error finding container 0506bd724258d497eccb191b785e3d746a5e8436a1dbbb6ddbdaa36be6158aff: Status 404 returned error can't find the container with id 0506bd724258d497eccb191b785e3d746a5e8436a1dbbb6ddbdaa36be6158aff Jul 27 21:06:08.372080 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:08.371996 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6d6a46-cf4c59bbd-vqx8x" event={"ID":"d0fce8de-7559-4dab-b301-40903a1d3276","Type":"ContainerStarted","Data":"2dbc31f4052c418fd4a4bb4adec0697a27dc050de872fefc1bafae41968e9efd"} Jul 27 21:06:08.372080 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:08.372064 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6d6a46-cf4c59bbd-vqx8x" event={"ID":"d0fce8de-7559-4dab-b301-40903a1d3276","Type":"ContainerStarted","Data":"658c035637050dc817e02174396de00f07c36af386698aab5a8f1947d4729b31"} Jul 27 21:06:08.372297 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:08.372204 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6d6a46-cf4c59bbd-vqx8x" Jul 27 21:06:08.373870 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:08.373838 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-6d6a46-6b85c84cb-7kj4p" event={"ID":"3b11f065-a081-4528-b646-37d833839345","Type":"ContainerStarted","Data":"79595acc2cfa476bbc13c3e30d0be09515fc5b143f893a509d53af2d3f3918a0"} Jul 27 21:06:08.374030 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:08.373890 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-6d6a46-6b85c84cb-7kj4p" event={"ID":"3b11f065-a081-4528-b646-37d833839345","Type":"ContainerStarted","Data":"0506bd724258d497eccb191b785e3d746a5e8436a1dbbb6ddbdaa36be6158aff"} Jul 27 21:06:08.374030 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:08.373976 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-6d6a46-6b85c84cb-7kj4p" Jul 27 21:06:08.398742 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:08.398676 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6d6a46-cf4c59bbd-vqx8x" podStartSLOduration=1.398661827 podStartE2EDuration="1.398661827s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:06:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:06:08.397262801 +0000 UTC m=+2910.975836392" watchObservedRunningTime="2026-07-27 21:06:08.398661827 +0000 UTC m=+2910.977235416" Jul 27 21:06:08.436612 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:08.436558 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-6d6a46-6b85c84cb-7kj4p" podStartSLOduration=1.436543714 podStartE2EDuration="1.436543714s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:06:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:06:08.434388953 +0000 UTC m=+2911.012962542" watchObservedRunningTime="2026-07-27 21:06:08.436543714 +0000 UTC m=+2911.015117303" Jul 27 21:06:11.463106 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:11.463071 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:15.513158 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:15.513116 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 21:06:19.381224 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:19.381195 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-6d6a46-6b85c84cb-7kj4p" Jul 27 21:06:19.381713 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:19.381262 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6d6a46-cf4c59bbd-vqx8x" Jul 27 21:06:22.357941 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:22.357909 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:22.649156 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:22.649078 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:22.944407 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:22.944315 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:26.145078 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:26.145047 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:26.305344 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:26.305312 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:26.428938 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:26.428850 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:26.521826 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:26.521793 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:26.829045 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:26.829015 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:26.928198 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:26.928167 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:26.931667 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:26.931640 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-cae454-84f8c64fcb-m69lq"] Jul 27 21:06:26.934735 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:26.934721 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cae454-84f8c64fcb-m69lq" Jul 27 21:06:26.937303 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:26.937281 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-cae454\"" Jul 27 21:06:26.937440 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:26.937349 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-cae454-dockercfg-cq9vd\"" Jul 27 21:06:26.945670 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:26.945645 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-cae454-84f8c64fcb-m69lq"] Jul 27 21:06:26.959603 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:26.959582 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-cae454-845cf567b4-q6ldb"] Jul 27 21:06:26.962751 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:26.962734 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-cae454-845cf567b4-q6ldb" Jul 27 21:06:26.972457 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:26.972426 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-cae454-845cf567b4-q6ldb"] Jul 27 21:06:27.020973 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:27.020943 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w94jg\" (UniqueName: \"kubernetes.io/projected/d302059a-caec-4225-ae63-483501628fe9-kube-api-access-w94jg\") pod \"payload-processing-e2e-ipp-b-cae454-845cf567b4-q6ldb\" (UID: \"d302059a-caec-4225-ae63-483501628fe9\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-cae454-845cf567b4-q6ldb" Jul 27 21:06:27.021092 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:27.020998 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed2f9d2c-6473-4c4c-84dc-7b1298acf1b8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-cae454-84f8c64fcb-m69lq\" (UID: \"ed2f9d2c-6473-4c4c-84dc-7b1298acf1b8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cae454-84f8c64fcb-m69lq" Jul 27 21:06:27.021092 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:27.021058 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brgd2\" (UniqueName: \"kubernetes.io/projected/ed2f9d2c-6473-4c4c-84dc-7b1298acf1b8-kube-api-access-brgd2\") pod \"payload-pre-processing-e2e-ipp-b-cae454-84f8c64fcb-m69lq\" (UID: \"ed2f9d2c-6473-4c4c-84dc-7b1298acf1b8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cae454-84f8c64fcb-m69lq" Jul 27 21:06:27.021092 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:27.021085 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d302059a-caec-4225-ae63-483501628fe9-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-cae454-845cf567b4-q6ldb\" (UID: \"d302059a-caec-4225-ae63-483501628fe9\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-cae454-845cf567b4-q6ldb" Jul 27 21:06:27.121823 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:27.121752 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed2f9d2c-6473-4c4c-84dc-7b1298acf1b8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-cae454-84f8c64fcb-m69lq\" (UID: \"ed2f9d2c-6473-4c4c-84dc-7b1298acf1b8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cae454-84f8c64fcb-m69lq" Jul 27 21:06:27.121823 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:27.121799 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brgd2\" (UniqueName: \"kubernetes.io/projected/ed2f9d2c-6473-4c4c-84dc-7b1298acf1b8-kube-api-access-brgd2\") pod \"payload-pre-processing-e2e-ipp-b-cae454-84f8c64fcb-m69lq\" (UID: \"ed2f9d2c-6473-4c4c-84dc-7b1298acf1b8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cae454-84f8c64fcb-m69lq" Jul 27 21:06:27.121823 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:27.121820 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d302059a-caec-4225-ae63-483501628fe9-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-cae454-845cf567b4-q6ldb\" (UID: \"d302059a-caec-4225-ae63-483501628fe9\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-cae454-845cf567b4-q6ldb" Jul 27 21:06:27.122029 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:27.121866 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w94jg\" (UniqueName: \"kubernetes.io/projected/d302059a-caec-4225-ae63-483501628fe9-kube-api-access-w94jg\") pod \"payload-processing-e2e-ipp-b-cae454-845cf567b4-q6ldb\" (UID: \"d302059a-caec-4225-ae63-483501628fe9\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-cae454-845cf567b4-q6ldb" Jul 27 21:06:27.122510 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:27.122492 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d302059a-caec-4225-ae63-483501628fe9-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-cae454-845cf567b4-q6ldb\" (UID: \"d302059a-caec-4225-ae63-483501628fe9\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-cae454-845cf567b4-q6ldb" Jul 27 21:06:27.122554 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:27.122522 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed2f9d2c-6473-4c4c-84dc-7b1298acf1b8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-cae454-84f8c64fcb-m69lq\" (UID: \"ed2f9d2c-6473-4c4c-84dc-7b1298acf1b8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cae454-84f8c64fcb-m69lq" Jul 27 21:06:27.130006 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:27.129979 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w94jg\" (UniqueName: \"kubernetes.io/projected/d302059a-caec-4225-ae63-483501628fe9-kube-api-access-w94jg\") pod \"payload-processing-e2e-ipp-b-cae454-845cf567b4-q6ldb\" (UID: \"d302059a-caec-4225-ae63-483501628fe9\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-cae454-845cf567b4-q6ldb" Jul 27 21:06:27.130131 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:27.129982 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brgd2\" (UniqueName: \"kubernetes.io/projected/ed2f9d2c-6473-4c4c-84dc-7b1298acf1b8-kube-api-access-brgd2\") pod \"payload-pre-processing-e2e-ipp-b-cae454-84f8c64fcb-m69lq\" (UID: \"ed2f9d2c-6473-4c4c-84dc-7b1298acf1b8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cae454-84f8c64fcb-m69lq" Jul 27 21:06:27.245715 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:27.245677 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cae454-84f8c64fcb-m69lq" Jul 27 21:06:27.272621 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:27.272593 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-cae454-845cf567b4-q6ldb" Jul 27 21:06:27.390285 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:27.390258 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-cae454-84f8c64fcb-m69lq"] Jul 27 21:06:27.392627 ip-10-0-132-12 kubenswrapper[2558]: W0727 21:06:27.392083 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded2f9d2c_6473_4c4c_84dc_7b1298acf1b8.slice/crio-6b4cd797b37d443465c9430f9df375c2430a05f8c420a63113183f29941767b4 WatchSource:0}: Error finding container 6b4cd797b37d443465c9430f9df375c2430a05f8c420a63113183f29941767b4: Status 404 returned error can't find the container with id 6b4cd797b37d443465c9430f9df375c2430a05f8c420a63113183f29941767b4 Jul 27 21:06:27.413261 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:27.413239 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-cae454-845cf567b4-q6ldb"] Jul 27 21:06:27.425736 ip-10-0-132-12 kubenswrapper[2558]: W0727 21:06:27.425715 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd302059a_caec_4225_ae63_483501628fe9.slice/crio-6cd8adf11dcd1a82f42de991b5614f6a39adfcf4bacf143c420ff5ec775ff9f5 WatchSource:0}: Error finding container 6cd8adf11dcd1a82f42de991b5614f6a39adfcf4bacf143c420ff5ec775ff9f5: Status 404 returned error can't find the container with id 6cd8adf11dcd1a82f42de991b5614f6a39adfcf4bacf143c420ff5ec775ff9f5 Jul 27 21:06:27.457405 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:27.457373 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-cae454-845cf567b4-q6ldb" event={"ID":"d302059a-caec-4225-ae63-483501628fe9","Type":"ContainerStarted","Data":"6cd8adf11dcd1a82f42de991b5614f6a39adfcf4bacf143c420ff5ec775ff9f5"} Jul 27 21:06:27.458600 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:27.458579 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cae454-84f8c64fcb-m69lq" event={"ID":"ed2f9d2c-6473-4c4c-84dc-7b1298acf1b8","Type":"ContainerStarted","Data":"d6efba2953d1a00084cda55db219c6a60e1ae31652f4024f819d165fd6cc6c64"} Jul 27 21:06:27.458737 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:27.458625 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cae454-84f8c64fcb-m69lq" event={"ID":"ed2f9d2c-6473-4c4c-84dc-7b1298acf1b8","Type":"ContainerStarted","Data":"6b4cd797b37d443465c9430f9df375c2430a05f8c420a63113183f29941767b4"} Jul 27 21:06:27.458737 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:27.458701 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cae454-84f8c64fcb-m69lq" Jul 27 21:06:27.477015 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:27.476969 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cae454-84f8c64fcb-m69lq" podStartSLOduration=1.476953802 podStartE2EDuration="1.476953802s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:06:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:06:27.475852159 +0000 UTC m=+2930.054425749" watchObservedRunningTime="2026-07-27 21:06:27.476953802 +0000 UTC m=+2930.055527386" Jul 27 21:06:28.465559 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:28.465523 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-cae454-845cf567b4-q6ldb" event={"ID":"d302059a-caec-4225-ae63-483501628fe9","Type":"ContainerStarted","Data":"ac93fc50e23227d34259337252bd1045bf5f022217a1f7ab9527fa5bf9ab1900"} Jul 27 21:06:28.481317 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:28.481262 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-cae454-845cf567b4-q6ldb" podStartSLOduration=2.481245029 podStartE2EDuration="2.481245029s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:06:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:06:28.480614292 +0000 UTC m=+2931.059187884" watchObservedRunningTime="2026-07-27 21:06:28.481245029 +0000 UTC m=+2931.059818620" Jul 27 21:06:29.469938 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:29.469905 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-cae454-845cf567b4-q6ldb" Jul 27 21:06:30.584923 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:30.584888 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:36.016737 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:36.016706 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 21:06:38.467343 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:38.467317 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cae454-84f8c64fcb-m69lq" Jul 27 21:06:40.476639 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:40.476603 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-cae454-845cf567b4-q6ldb" Jul 27 21:06:47.716580 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:47.716549 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-cae454-845cf567b4-q6ldb_d302059a-caec-4225-ae63-483501628fe9/payload-processing/0.log" Jul 27 21:06:55.667090 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:06:55.667055 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:02.842270 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:07:02.842184 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:06.522326 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:07:06.522289 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 21:07:37.758102 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:07:37.758064 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 21:07:37.991913 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:07:37.991876 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rnj2b_c421dc44-8fcf-44f4-b483-8e0271833d10/ovn-acl-logging/0.log" Jul 27 21:07:37.993391 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:07:37.993370 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rnj2b_c421dc44-8fcf-44f4-b483-8e0271833d10/ovn-acl-logging/0.log" Jul 27 21:07:47.754677 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:07:47.754643 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-6d6a46-6b85c84cb-7kj4p_3b11f065-a081-4528-b646-37d833839345/payload-processing/0.log" Jul 27 21:07:48.006542 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:07:48.006465 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-cae454-845cf567b4-q6ldb_d302059a-caec-4225-ae63-483501628fe9/payload-processing/0.log" Jul 27 21:07:48.322166 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:07:48.322081 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:49.845740 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:07:49.845658 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:51.693358 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:07:51.693325 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:51.877362 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:07:51.877295 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:52.006899 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:07:52.006874 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:52.118895 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:07:52.118862 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:52.860853 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:07:52.860823 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:52.960389 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:07:52.960359 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:52.984765 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:07:52.984737 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1482c3-76f8cfc496-tswtd"] Jul 27 21:07:52.987970 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:07:52.987952 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1482c3-76f8cfc496-tswtd" Jul 27 21:07:52.990435 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:07:52.990417 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-1482c3\"" Jul 27 21:07:52.990899 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:07:52.990879 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-1482c3-dockercfg-85l7l\"" Jul 27 21:07:52.998484 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:07:52.998464 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1482c3-76f8cfc496-tswtd"] Jul 27 21:07:53.001441 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:07:53.001421 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-1482c3-7b48c556fd-q9r4k"] Jul 27 21:07:53.004594 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:07:53.004580 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1482c3-7b48c556fd-q9r4k" Jul 27 21:07:53.016371 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:07:53.016342 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-1482c3-7b48c556fd-q9r4k"] Jul 27 21:07:53.108335 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:07:53.108303 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5jq9\" (UniqueName: \"kubernetes.io/projected/31b7452b-c249-4520-aba4-fd6a16e712e2-kube-api-access-r5jq9\") pod \"payload-pre-processing-e2e-ipp-cleanup-1482c3-76f8cfc496-tswtd\" (UID: \"31b7452b-c249-4520-aba4-fd6a16e712e2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1482c3-76f8cfc496-tswtd" Jul 27 21:07:53.108495 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:07:53.108349 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/31b7452b-c249-4520-aba4-fd6a16e712e2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-1482c3-76f8cfc496-tswtd\" (UID: \"31b7452b-c249-4520-aba4-fd6a16e712e2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1482c3-76f8cfc496-tswtd" Jul 27 21:07:53.108495 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:07:53.108400 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f24e253-2c78-47ed-8049-15b3e17f22b9-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-1482c3-7b48c556fd-q9r4k\" (UID: \"2f24e253-2c78-47ed-8049-15b3e17f22b9\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1482c3-7b48c556fd-q9r4k" Jul 27 21:07:53.108495 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:07:53.108481 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg8dc\" (UniqueName: \"kubernetes.io/projected/2f24e253-2c78-47ed-8049-15b3e17f22b9-kube-api-access-fg8dc\") pod \"payload-processing-e2e-ipp-cleanup-1482c3-7b48c556fd-q9r4k\" (UID: \"2f24e253-2c78-47ed-8049-15b3e17f22b9\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1482c3-7b48c556fd-q9r4k" Jul 27 21:07:53.209841 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:07:53.209763 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fg8dc\" (UniqueName: \"kubernetes.io/projected/2f24e253-2c78-47ed-8049-15b3e17f22b9-kube-api-access-fg8dc\") pod \"payload-processing-e2e-ipp-cleanup-1482c3-7b48c556fd-q9r4k\" (UID: \"2f24e253-2c78-47ed-8049-15b3e17f22b9\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1482c3-7b48c556fd-q9r4k" Jul 27 21:07:53.209841 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:07:53.209804 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5jq9\" (UniqueName: \"kubernetes.io/projected/31b7452b-c249-4520-aba4-fd6a16e712e2-kube-api-access-r5jq9\") pod \"payload-pre-processing-e2e-ipp-cleanup-1482c3-76f8cfc496-tswtd\" (UID: \"31b7452b-c249-4520-aba4-fd6a16e712e2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1482c3-76f8cfc496-tswtd" Jul 27 21:07:53.210028 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:07:53.209853 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/31b7452b-c249-4520-aba4-fd6a16e712e2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-1482c3-76f8cfc496-tswtd\" (UID: \"31b7452b-c249-4520-aba4-fd6a16e712e2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1482c3-76f8cfc496-tswtd" Jul 27 21:07:53.210028 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:07:53.209879 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f24e253-2c78-47ed-8049-15b3e17f22b9-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-1482c3-7b48c556fd-q9r4k\" (UID: \"2f24e253-2c78-47ed-8049-15b3e17f22b9\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1482c3-7b48c556fd-q9r4k" Jul 27 21:07:53.210617 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:07:53.210599 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/31b7452b-c249-4520-aba4-fd6a16e712e2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-1482c3-76f8cfc496-tswtd\" (UID: \"31b7452b-c249-4520-aba4-fd6a16e712e2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1482c3-76f8cfc496-tswtd" Jul 27 21:07:53.210656 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:07:53.210601 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f24e253-2c78-47ed-8049-15b3e17f22b9-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-1482c3-7b48c556fd-q9r4k\" (UID: \"2f24e253-2c78-47ed-8049-15b3e17f22b9\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1482c3-7b48c556fd-q9r4k" Jul 27 21:07:53.220213 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:07:53.220175 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg8dc\" (UniqueName: \"kubernetes.io/projected/2f24e253-2c78-47ed-8049-15b3e17f22b9-kube-api-access-fg8dc\") pod \"payload-processing-e2e-ipp-cleanup-1482c3-7b48c556fd-q9r4k\" (UID: \"2f24e253-2c78-47ed-8049-15b3e17f22b9\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1482c3-7b48c556fd-q9r4k" Jul 27 21:07:53.220397 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:07:53.220377 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5jq9\" (UniqueName: \"kubernetes.io/projected/31b7452b-c249-4520-aba4-fd6a16e712e2-kube-api-access-r5jq9\") pod \"payload-pre-processing-e2e-ipp-cleanup-1482c3-76f8cfc496-tswtd\" (UID: \"31b7452b-c249-4520-aba4-fd6a16e712e2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1482c3-76f8cfc496-tswtd" Jul 27 21:07:53.299452 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:07:53.299427 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1482c3-76f8cfc496-tswtd" Jul 27 21:07:53.314191 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:07:53.314161 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1482c3-7b48c556fd-q9r4k" Jul 27 21:07:53.645606 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:07:53.645581 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1482c3-76f8cfc496-tswtd"] Jul 27 21:07:53.647431 ip-10-0-132-12 kubenswrapper[2558]: W0727 21:07:53.647406 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31b7452b_c249_4520_aba4_fd6a16e712e2.slice/crio-1cad8d9d013fc5dd77ede9a1c513919827f80daccbb06ecc5f7bfe0d601327ed WatchSource:0}: Error finding container 1cad8d9d013fc5dd77ede9a1c513919827f80daccbb06ecc5f7bfe0d601327ed: Status 404 returned error can't find the container with id 1cad8d9d013fc5dd77ede9a1c513919827f80daccbb06ecc5f7bfe0d601327ed Jul 27 21:07:53.675522 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:07:53.675498 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-1482c3-7b48c556fd-q9r4k"] Jul 27 21:07:53.679737 ip-10-0-132-12 kubenswrapper[2558]: W0727 21:07:53.679715 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f24e253_2c78_47ed_8049_15b3e17f22b9.slice/crio-a2d0462cbcf842ac8a74c91cafa09786ea79127b2582dc591e1d16f9cec44536 WatchSource:0}: Error finding container a2d0462cbcf842ac8a74c91cafa09786ea79127b2582dc591e1d16f9cec44536: Status 404 returned error can't find the container with id a2d0462cbcf842ac8a74c91cafa09786ea79127b2582dc591e1d16f9cec44536 Jul 27 21:07:53.833868 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:07:53.833831 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1482c3-7b48c556fd-q9r4k" event={"ID":"2f24e253-2c78-47ed-8049-15b3e17f22b9","Type":"ContainerStarted","Data":"6eabd0a367d789bd7a318e83a679cf659636e65a90727f42d217438f159ec76a"} Jul 27 21:07:53.834045 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:07:53.833890 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1482c3-7b48c556fd-q9r4k" event={"ID":"2f24e253-2c78-47ed-8049-15b3e17f22b9","Type":"ContainerStarted","Data":"a2d0462cbcf842ac8a74c91cafa09786ea79127b2582dc591e1d16f9cec44536"} Jul 27 21:07:53.834045 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:07:53.833916 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1482c3-7b48c556fd-q9r4k" Jul 27 21:07:53.835348 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:07:53.835327 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1482c3-76f8cfc496-tswtd" event={"ID":"31b7452b-c249-4520-aba4-fd6a16e712e2","Type":"ContainerStarted","Data":"44dce087a57007c472546fa89716d2a10de4e041ae71debd1b85f481e6dbb458"} Jul 27 21:07:53.835420 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:07:53.835367 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1482c3-76f8cfc496-tswtd" event={"ID":"31b7452b-c249-4520-aba4-fd6a16e712e2","Type":"ContainerStarted","Data":"1cad8d9d013fc5dd77ede9a1c513919827f80daccbb06ecc5f7bfe0d601327ed"} Jul 27 21:07:53.835493 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:07:53.835475 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1482c3-76f8cfc496-tswtd" Jul 27 21:07:53.859178 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:07:53.859136 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1482c3-7b48c556fd-q9r4k" podStartSLOduration=1.859123554 podStartE2EDuration="1.859123554s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:07:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:07:53.856705675 +0000 UTC m=+3016.435279259" watchObservedRunningTime="2026-07-27 21:07:53.859123554 +0000 UTC m=+3016.437697185" Jul 27 21:07:53.890938 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:07:53.890890 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1482c3-76f8cfc496-tswtd" podStartSLOduration=1.890874591 podStartE2EDuration="1.890874591s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:07:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:07:53.889775346 +0000 UTC m=+3016.468348935" watchObservedRunningTime="2026-07-27 21:07:53.890874591 +0000 UTC m=+3016.469448180" Jul 27 21:07:56.167502 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:07:56.167467 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:58.024742 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:07:58.024705 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 21:08:04.841740 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:04.841707 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1482c3-7b48c556fd-q9r4k" Jul 27 21:08:04.842113 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:04.841780 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1482c3-76f8cfc496-tswtd" Jul 27 21:08:17.531678 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:17.531646 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:08:17.549116 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:17.549085 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-1482c3-7b48c556fd-q9r4k"] Jul 27 21:08:17.549355 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:17.549328 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1482c3-7b48c556fd-q9r4k" podUID="2f24e253-2c78-47ed-8049-15b3e17f22b9" containerName="payload-processing" containerID="cri-o://6eabd0a367d789bd7a318e83a679cf659636e65a90727f42d217438f159ec76a" gracePeriod=30 Jul 27 21:08:17.556588 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:17.556559 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1482c3-76f8cfc496-tswtd"] Jul 27 21:08:17.556862 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:17.556817 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1482c3-76f8cfc496-tswtd" podUID="31b7452b-c249-4520-aba4-fd6a16e712e2" containerName="payload-pre-processing" containerID="cri-o://44dce087a57007c472546fa89716d2a10de4e041ae71debd1b85f481e6dbb458" gracePeriod=30 Jul 27 21:08:17.632106 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:17.632074 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:08:17.817449 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:17.817422 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1482c3-7b48c556fd-q9r4k" Jul 27 21:08:17.844369 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:17.844348 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1482c3-76f8cfc496-tswtd" Jul 27 21:08:17.905630 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:17.905599 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f24e253-2c78-47ed-8049-15b3e17f22b9-plugins-config-volume\") pod \"2f24e253-2c78-47ed-8049-15b3e17f22b9\" (UID: \"2f24e253-2c78-47ed-8049-15b3e17f22b9\") " Jul 27 21:08:17.905840 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:17.905712 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fg8dc\" (UniqueName: \"kubernetes.io/projected/2f24e253-2c78-47ed-8049-15b3e17f22b9-kube-api-access-fg8dc\") pod \"2f24e253-2c78-47ed-8049-15b3e17f22b9\" (UID: \"2f24e253-2c78-47ed-8049-15b3e17f22b9\") " Jul 27 21:08:17.906071 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:17.906043 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f24e253-2c78-47ed-8049-15b3e17f22b9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2f24e253-2c78-47ed-8049-15b3e17f22b9" (UID: "2f24e253-2c78-47ed-8049-15b3e17f22b9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 21:08:17.907728 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:17.907707 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f24e253-2c78-47ed-8049-15b3e17f22b9-kube-api-access-fg8dc" (OuterVolumeSpecName: "kube-api-access-fg8dc") pod "2f24e253-2c78-47ed-8049-15b3e17f22b9" (UID: "2f24e253-2c78-47ed-8049-15b3e17f22b9"). InnerVolumeSpecName "kube-api-access-fg8dc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 21:08:17.938032 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:17.938010 2558 generic.go:356] "Generic (PLEG): container finished" podID="31b7452b-c249-4520-aba4-fd6a16e712e2" containerID="44dce087a57007c472546fa89716d2a10de4e041ae71debd1b85f481e6dbb458" exitCode=0 Jul 27 21:08:17.938143 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:17.938048 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1482c3-76f8cfc496-tswtd" Jul 27 21:08:17.938143 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:17.938093 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1482c3-76f8cfc496-tswtd" event={"ID":"31b7452b-c249-4520-aba4-fd6a16e712e2","Type":"ContainerDied","Data":"44dce087a57007c472546fa89716d2a10de4e041ae71debd1b85f481e6dbb458"} Jul 27 21:08:17.938261 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:17.938147 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1482c3-76f8cfc496-tswtd" event={"ID":"31b7452b-c249-4520-aba4-fd6a16e712e2","Type":"ContainerDied","Data":"1cad8d9d013fc5dd77ede9a1c513919827f80daccbb06ecc5f7bfe0d601327ed"} Jul 27 21:08:17.938261 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:17.938176 2558 scope.go:117] "RemoveContainer" containerID="44dce087a57007c472546fa89716d2a10de4e041ae71debd1b85f481e6dbb458" Jul 27 21:08:17.939396 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:17.939374 2558 generic.go:356] "Generic (PLEG): container finished" podID="2f24e253-2c78-47ed-8049-15b3e17f22b9" containerID="6eabd0a367d789bd7a318e83a679cf659636e65a90727f42d217438f159ec76a" exitCode=0 Jul 27 21:08:17.939485 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:17.939411 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1482c3-7b48c556fd-q9r4k" Jul 27 21:08:17.939485 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:17.939460 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1482c3-7b48c556fd-q9r4k" event={"ID":"2f24e253-2c78-47ed-8049-15b3e17f22b9","Type":"ContainerDied","Data":"6eabd0a367d789bd7a318e83a679cf659636e65a90727f42d217438f159ec76a"} Jul 27 21:08:17.939563 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:17.939503 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1482c3-7b48c556fd-q9r4k" event={"ID":"2f24e253-2c78-47ed-8049-15b3e17f22b9","Type":"ContainerDied","Data":"a2d0462cbcf842ac8a74c91cafa09786ea79127b2582dc591e1d16f9cec44536"} Jul 27 21:08:17.947324 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:17.947304 2558 scope.go:117] "RemoveContainer" containerID="44dce087a57007c472546fa89716d2a10de4e041ae71debd1b85f481e6dbb458" Jul 27 21:08:17.947557 ip-10-0-132-12 kubenswrapper[2558]: E0727 21:08:17.947539 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44dce087a57007c472546fa89716d2a10de4e041ae71debd1b85f481e6dbb458\": container with ID starting with 44dce087a57007c472546fa89716d2a10de4e041ae71debd1b85f481e6dbb458 not found: ID does not exist" containerID="44dce087a57007c472546fa89716d2a10de4e041ae71debd1b85f481e6dbb458" Jul 27 21:08:17.947612 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:17.947565 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44dce087a57007c472546fa89716d2a10de4e041ae71debd1b85f481e6dbb458"} err="failed to get container status \"44dce087a57007c472546fa89716d2a10de4e041ae71debd1b85f481e6dbb458\": rpc error: code = NotFound desc = could not find container \"44dce087a57007c472546fa89716d2a10de4e041ae71debd1b85f481e6dbb458\": container with ID starting with 44dce087a57007c472546fa89716d2a10de4e041ae71debd1b85f481e6dbb458 not found: ID does not exist" Jul 27 21:08:17.947612 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:17.947581 2558 scope.go:117] "RemoveContainer" containerID="6eabd0a367d789bd7a318e83a679cf659636e65a90727f42d217438f159ec76a" Jul 27 21:08:17.954620 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:17.954605 2558 scope.go:117] "RemoveContainer" containerID="6eabd0a367d789bd7a318e83a679cf659636e65a90727f42d217438f159ec76a" Jul 27 21:08:17.954871 ip-10-0-132-12 kubenswrapper[2558]: E0727 21:08:17.954852 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6eabd0a367d789bd7a318e83a679cf659636e65a90727f42d217438f159ec76a\": container with ID starting with 6eabd0a367d789bd7a318e83a679cf659636e65a90727f42d217438f159ec76a not found: ID does not exist" containerID="6eabd0a367d789bd7a318e83a679cf659636e65a90727f42d217438f159ec76a" Jul 27 21:08:17.954934 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:17.954876 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6eabd0a367d789bd7a318e83a679cf659636e65a90727f42d217438f159ec76a"} err="failed to get container status \"6eabd0a367d789bd7a318e83a679cf659636e65a90727f42d217438f159ec76a\": rpc error: code = NotFound desc = could not find container \"6eabd0a367d789bd7a318e83a679cf659636e65a90727f42d217438f159ec76a\": container with ID starting with 6eabd0a367d789bd7a318e83a679cf659636e65a90727f42d217438f159ec76a not found: ID does not exist" Jul 27 21:08:17.957365 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:17.957340 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-1482c3-7b48c556fd-q9r4k"] Jul 27 21:08:17.964112 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:17.964093 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-1482c3-7b48c556fd-q9r4k"] Jul 27 21:08:18.006802 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:18.006781 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/31b7452b-c249-4520-aba4-fd6a16e712e2-plugins-config-volume\") pod \"31b7452b-c249-4520-aba4-fd6a16e712e2\" (UID: \"31b7452b-c249-4520-aba4-fd6a16e712e2\") " Jul 27 21:08:18.006877 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:18.006827 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5jq9\" (UniqueName: \"kubernetes.io/projected/31b7452b-c249-4520-aba4-fd6a16e712e2-kube-api-access-r5jq9\") pod \"31b7452b-c249-4520-aba4-fd6a16e712e2\" (UID: \"31b7452b-c249-4520-aba4-fd6a16e712e2\") " Jul 27 21:08:18.006963 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:18.006952 2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f24e253-2c78-47ed-8049-15b3e17f22b9-plugins-config-volume\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 21:08:18.007027 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:18.006965 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fg8dc\" (UniqueName: \"kubernetes.io/projected/2f24e253-2c78-47ed-8049-15b3e17f22b9-kube-api-access-fg8dc\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 21:08:18.007111 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:18.007091 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31b7452b-c249-4520-aba4-fd6a16e712e2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "31b7452b-c249-4520-aba4-fd6a16e712e2" (UID: "31b7452b-c249-4520-aba4-fd6a16e712e2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 21:08:18.008768 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:18.008748 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31b7452b-c249-4520-aba4-fd6a16e712e2-kube-api-access-r5jq9" (OuterVolumeSpecName: "kube-api-access-r5jq9") pod "31b7452b-c249-4520-aba4-fd6a16e712e2" (UID: "31b7452b-c249-4520-aba4-fd6a16e712e2"). InnerVolumeSpecName "kube-api-access-r5jq9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 21:08:18.108286 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:18.108217 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5jq9\" (UniqueName: \"kubernetes.io/projected/31b7452b-c249-4520-aba4-fd6a16e712e2-kube-api-access-r5jq9\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 21:08:18.108286 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:18.108243 2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/31b7452b-c249-4520-aba4-fd6a16e712e2-plugins-config-volume\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 21:08:18.258822 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:18.258792 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1482c3-76f8cfc496-tswtd"] Jul 27 21:08:18.264738 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:18.264713 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1482c3-76f8cfc496-tswtd"] Jul 27 21:08:19.941028 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:19.940995 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f24e253-2c78-47ed-8049-15b3e17f22b9" path="/var/lib/kubelet/pods/2f24e253-2c78-47ed-8049-15b3e17f22b9/volumes" Jul 27 21:08:19.941470 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:19.941453 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31b7452b-c249-4520-aba4-fd6a16e712e2" path="/var/lib/kubelet/pods/31b7452b-c249-4520-aba4-fd6a16e712e2/volumes" Jul 27 21:08:20.244936 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:20.244856 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:08:20.301060 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:20.301033 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:08:22.135055 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:22.135023 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:08:22.507597 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:22.507565 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:08:25.416685 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:25.416652 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 21:08:28.277217 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:28.277187 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:08:28.341150 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:28.341101 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:08:28.531521 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:28.531406 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:08:28.750675 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:28.750641 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:08:47.665791 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:47.665758 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:08:47.696184 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:47.696153 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-6d6a46-6b85c84cb-7kj4p"] Jul 27 21:08:47.696496 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:47.696465 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-6d6a46-6b85c84cb-7kj4p" podUID="3b11f065-a081-4528-b646-37d833839345" containerName="payload-processing" containerID="cri-o://79595acc2cfa476bbc13c3e30d0be09515fc5b143f893a509d53af2d3f3918a0" gracePeriod=30 Jul 27 21:08:47.702790 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:47.702763 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-6d6a46-cf4c59bbd-vqx8x"] Jul 27 21:08:47.703089 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:47.703063 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6d6a46-cf4c59bbd-vqx8x" podUID="d0fce8de-7559-4dab-b301-40903a1d3276" containerName="payload-pre-processing" containerID="cri-o://2dbc31f4052c418fd4a4bb4adec0697a27dc050de872fefc1bafae41968e9efd" gracePeriod=30 Jul 27 21:08:47.733554 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:47.733526 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:08:47.793883 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:47.793855 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:08:47.955443 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:47.955416 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-6d6a46-6b85c84cb-7kj4p" Jul 27 21:08:47.984777 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:47.984759 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6d6a46-cf4c59bbd-vqx8x" Jul 27 21:08:48.049009 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:48.048980 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2x8t\" (UniqueName: \"kubernetes.io/projected/d0fce8de-7559-4dab-b301-40903a1d3276-kube-api-access-h2x8t\") pod \"d0fce8de-7559-4dab-b301-40903a1d3276\" (UID: \"d0fce8de-7559-4dab-b301-40903a1d3276\") " Jul 27 21:08:48.049182 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:48.049025 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0fce8de-7559-4dab-b301-40903a1d3276-plugins-config-volume\") pod \"d0fce8de-7559-4dab-b301-40903a1d3276\" (UID: \"d0fce8de-7559-4dab-b301-40903a1d3276\") " Jul 27 21:08:48.049182 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:48.049047 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3b11f065-a081-4528-b646-37d833839345-plugins-config-volume\") pod \"3b11f065-a081-4528-b646-37d833839345\" (UID: \"3b11f065-a081-4528-b646-37d833839345\") " Jul 27 21:08:48.049182 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:48.049164 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5j6ss\" (UniqueName: \"kubernetes.io/projected/3b11f065-a081-4528-b646-37d833839345-kube-api-access-5j6ss\") pod \"3b11f065-a081-4528-b646-37d833839345\" (UID: \"3b11f065-a081-4528-b646-37d833839345\") " Jul 27 21:08:48.049383 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:48.049361 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b11f065-a081-4528-b646-37d833839345-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3b11f065-a081-4528-b646-37d833839345" (UID: "3b11f065-a081-4528-b646-37d833839345"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 21:08:48.049441 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:48.049400 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0fce8de-7559-4dab-b301-40903a1d3276-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d0fce8de-7559-4dab-b301-40903a1d3276" (UID: "d0fce8de-7559-4dab-b301-40903a1d3276"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 21:08:48.049578 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:48.049560 2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0fce8de-7559-4dab-b301-40903a1d3276-plugins-config-volume\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 21:08:48.049642 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:48.049583 2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3b11f065-a081-4528-b646-37d833839345-plugins-config-volume\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 21:08:48.052386 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:48.052351 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b11f065-a081-4528-b646-37d833839345-kube-api-access-5j6ss" (OuterVolumeSpecName: "kube-api-access-5j6ss") pod "3b11f065-a081-4528-b646-37d833839345" (UID: "3b11f065-a081-4528-b646-37d833839345"). InnerVolumeSpecName "kube-api-access-5j6ss". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 21:08:48.057248 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:48.057158 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0fce8de-7559-4dab-b301-40903a1d3276-kube-api-access-h2x8t" (OuterVolumeSpecName: "kube-api-access-h2x8t") pod "d0fce8de-7559-4dab-b301-40903a1d3276" (UID: "d0fce8de-7559-4dab-b301-40903a1d3276"). InnerVolumeSpecName "kube-api-access-h2x8t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 21:08:48.075087 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:48.075063 2558 generic.go:356] "Generic (PLEG): container finished" podID="3b11f065-a081-4528-b646-37d833839345" containerID="79595acc2cfa476bbc13c3e30d0be09515fc5b143f893a509d53af2d3f3918a0" exitCode=0 Jul 27 21:08:48.075189 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:48.075114 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-6d6a46-6b85c84cb-7kj4p" Jul 27 21:08:48.075189 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:48.075145 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-6d6a46-6b85c84cb-7kj4p" event={"ID":"3b11f065-a081-4528-b646-37d833839345","Type":"ContainerDied","Data":"79595acc2cfa476bbc13c3e30d0be09515fc5b143f893a509d53af2d3f3918a0"} Jul 27 21:08:48.075291 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:48.075231 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-6d6a46-6b85c84cb-7kj4p" event={"ID":"3b11f065-a081-4528-b646-37d833839345","Type":"ContainerDied","Data":"0506bd724258d497eccb191b785e3d746a5e8436a1dbbb6ddbdaa36be6158aff"} Jul 27 21:08:48.075291 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:48.075263 2558 scope.go:117] "RemoveContainer" containerID="79595acc2cfa476bbc13c3e30d0be09515fc5b143f893a509d53af2d3f3918a0" Jul 27 21:08:48.076548 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:48.076529 2558 generic.go:356] "Generic (PLEG): container finished" podID="d0fce8de-7559-4dab-b301-40903a1d3276" containerID="2dbc31f4052c418fd4a4bb4adec0697a27dc050de872fefc1bafae41968e9efd" exitCode=0 Jul 27 21:08:48.076638 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:48.076571 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6d6a46-cf4c59bbd-vqx8x" event={"ID":"d0fce8de-7559-4dab-b301-40903a1d3276","Type":"ContainerDied","Data":"2dbc31f4052c418fd4a4bb4adec0697a27dc050de872fefc1bafae41968e9efd"} Jul 27 21:08:48.076638 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:48.076588 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6d6a46-cf4c59bbd-vqx8x" Jul 27 21:08:48.076638 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:48.076609 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6d6a46-cf4c59bbd-vqx8x" event={"ID":"d0fce8de-7559-4dab-b301-40903a1d3276","Type":"ContainerDied","Data":"658c035637050dc817e02174396de00f07c36af386698aab5a8f1947d4729b31"} Jul 27 21:08:48.085095 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:48.085079 2558 scope.go:117] "RemoveContainer" containerID="79595acc2cfa476bbc13c3e30d0be09515fc5b143f893a509d53af2d3f3918a0" Jul 27 21:08:48.087102 ip-10-0-132-12 kubenswrapper[2558]: E0727 21:08:48.087053 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79595acc2cfa476bbc13c3e30d0be09515fc5b143f893a509d53af2d3f3918a0\": container with ID starting with 79595acc2cfa476bbc13c3e30d0be09515fc5b143f893a509d53af2d3f3918a0 not found: ID does not exist" containerID="79595acc2cfa476bbc13c3e30d0be09515fc5b143f893a509d53af2d3f3918a0" Jul 27 21:08:48.087102 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:48.087085 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79595acc2cfa476bbc13c3e30d0be09515fc5b143f893a509d53af2d3f3918a0"} err="failed to get container status \"79595acc2cfa476bbc13c3e30d0be09515fc5b143f893a509d53af2d3f3918a0\": rpc error: code = NotFound desc = could not find container \"79595acc2cfa476bbc13c3e30d0be09515fc5b143f893a509d53af2d3f3918a0\": container with ID starting with 79595acc2cfa476bbc13c3e30d0be09515fc5b143f893a509d53af2d3f3918a0 not found: ID does not exist" Jul 27 21:08:48.087250 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:48.087110 2558 scope.go:117] "RemoveContainer" containerID="2dbc31f4052c418fd4a4bb4adec0697a27dc050de872fefc1bafae41968e9efd" Jul 27 21:08:48.094588 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:48.094570 2558 scope.go:117] "RemoveContainer" containerID="2dbc31f4052c418fd4a4bb4adec0697a27dc050de872fefc1bafae41968e9efd" Jul 27 21:08:48.094856 ip-10-0-132-12 kubenswrapper[2558]: E0727 21:08:48.094838 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2dbc31f4052c418fd4a4bb4adec0697a27dc050de872fefc1bafae41968e9efd\": container with ID starting with 2dbc31f4052c418fd4a4bb4adec0697a27dc050de872fefc1bafae41968e9efd not found: ID does not exist" containerID="2dbc31f4052c418fd4a4bb4adec0697a27dc050de872fefc1bafae41968e9efd" Jul 27 21:08:48.094908 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:48.094862 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dbc31f4052c418fd4a4bb4adec0697a27dc050de872fefc1bafae41968e9efd"} err="failed to get container status \"2dbc31f4052c418fd4a4bb4adec0697a27dc050de872fefc1bafae41968e9efd\": rpc error: code = NotFound desc = could not find container \"2dbc31f4052c418fd4a4bb4adec0697a27dc050de872fefc1bafae41968e9efd\": container with ID starting with 2dbc31f4052c418fd4a4bb4adec0697a27dc050de872fefc1bafae41968e9efd not found: ID does not exist" Jul 27 21:08:48.102736 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:48.102643 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-6d6a46-cf4c59bbd-vqx8x"] Jul 27 21:08:48.104152 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:48.104135 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-6d6a46-cf4c59bbd-vqx8x"] Jul 27 21:08:48.117214 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:48.117191 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-6d6a46-6b85c84cb-7kj4p"] Jul 27 21:08:48.122821 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:48.122802 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-6d6a46-6b85c84cb-7kj4p"] Jul 27 21:08:48.136155 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:48.136137 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 21:08:48.150797 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:48.150777 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5j6ss\" (UniqueName: \"kubernetes.io/projected/3b11f065-a081-4528-b646-37d833839345-kube-api-access-5j6ss\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 21:08:48.150797 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:48.150796 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2x8t\" (UniqueName: \"kubernetes.io/projected/d0fce8de-7559-4dab-b301-40903a1d3276-kube-api-access-h2x8t\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 21:08:49.934132 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:49.934098 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b11f065-a081-4528-b646-37d833839345" path="/var/lib/kubelet/pods/3b11f065-a081-4528-b646-37d833839345/volumes" Jul 27 21:08:49.934612 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:49.934593 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0fce8de-7559-4dab-b301-40903a1d3276" path="/var/lib/kubelet/pods/d0fce8de-7559-4dab-b301-40903a1d3276/volumes" Jul 27 21:08:52.155239 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:52.155205 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:08:52.541890 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:52.541849 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:08:57.624434 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:57.624399 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:08:58.720853 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:08:58.720811 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 21:09:18.978022 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:18.977973 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:09:19.088959 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:19.088930 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:09:34.760872 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:34.760839 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:09:34.996920 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:34.996883 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:09:40.587658 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:40.587626 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:09:40.688124 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:40.688092 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:09:40.873034 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:40.872938 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:09:41.097937 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:41.097903 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:09:44.000364 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:44.000335 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:09:44.068392 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:44.068365 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:09:51.715868 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:51.715827 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:09:51.755640 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:51.755607 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-cae454-845cf567b4-q6ldb"] Jul 27 21:09:51.755883 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:51.755856 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-cae454-845cf567b4-q6ldb" podUID="d302059a-caec-4225-ae63-483501628fe9" containerName="payload-processing" containerID="cri-o://ac93fc50e23227d34259337252bd1045bf5f022217a1f7ab9527fa5bf9ab1900" gracePeriod=30 Jul 27 21:09:51.766807 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:51.766780 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-cae454-84f8c64fcb-m69lq"] Jul 27 21:09:51.767023 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:51.767000 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cae454-84f8c64fcb-m69lq" podUID="ed2f9d2c-6473-4c4c-84dc-7b1298acf1b8" containerName="payload-pre-processing" containerID="cri-o://d6efba2953d1a00084cda55db219c6a60e1ae31652f4024f819d165fd6cc6c64" gracePeriod=30 Jul 27 21:09:51.797517 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:51.797485 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:09:51.895009 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:51.894969 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:09:52.036904 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:52.036883 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-cae454-845cf567b4-q6ldb" Jul 27 21:09:52.039491 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:52.039471 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cae454-84f8c64fcb-m69lq" Jul 27 21:09:52.153954 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:52.153926 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed2f9d2c-6473-4c4c-84dc-7b1298acf1b8-plugins-config-volume\") pod \"ed2f9d2c-6473-4c4c-84dc-7b1298acf1b8\" (UID: \"ed2f9d2c-6473-4c4c-84dc-7b1298acf1b8\") " Jul 27 21:09:52.153954 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:52.153963 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w94jg\" (UniqueName: \"kubernetes.io/projected/d302059a-caec-4225-ae63-483501628fe9-kube-api-access-w94jg\") pod \"d302059a-caec-4225-ae63-483501628fe9\" (UID: \"d302059a-caec-4225-ae63-483501628fe9\") " Jul 27 21:09:52.154253 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:52.153991 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-brgd2\" (UniqueName: \"kubernetes.io/projected/ed2f9d2c-6473-4c4c-84dc-7b1298acf1b8-kube-api-access-brgd2\") pod \"ed2f9d2c-6473-4c4c-84dc-7b1298acf1b8\" (UID: \"ed2f9d2c-6473-4c4c-84dc-7b1298acf1b8\") " Jul 27 21:09:52.154253 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:52.154028 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d302059a-caec-4225-ae63-483501628fe9-plugins-config-volume\") pod \"d302059a-caec-4225-ae63-483501628fe9\" (UID: \"d302059a-caec-4225-ae63-483501628fe9\") " Jul 27 21:09:52.154427 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:52.154399 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d302059a-caec-4225-ae63-483501628fe9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d302059a-caec-4225-ae63-483501628fe9" (UID: "d302059a-caec-4225-ae63-483501628fe9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 21:09:52.154497 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:52.154471 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed2f9d2c-6473-4c4c-84dc-7b1298acf1b8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ed2f9d2c-6473-4c4c-84dc-7b1298acf1b8" (UID: "ed2f9d2c-6473-4c4c-84dc-7b1298acf1b8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 21:09:52.156121 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:52.156095 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed2f9d2c-6473-4c4c-84dc-7b1298acf1b8-kube-api-access-brgd2" (OuterVolumeSpecName: "kube-api-access-brgd2") pod "ed2f9d2c-6473-4c4c-84dc-7b1298acf1b8" (UID: "ed2f9d2c-6473-4c4c-84dc-7b1298acf1b8"). InnerVolumeSpecName "kube-api-access-brgd2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 21:09:52.156121 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:52.156104 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d302059a-caec-4225-ae63-483501628fe9-kube-api-access-w94jg" (OuterVolumeSpecName: "kube-api-access-w94jg") pod "d302059a-caec-4225-ae63-483501628fe9" (UID: "d302059a-caec-4225-ae63-483501628fe9"). InnerVolumeSpecName "kube-api-access-w94jg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 21:09:52.254667 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:52.254638 2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed2f9d2c-6473-4c4c-84dc-7b1298acf1b8-plugins-config-volume\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 21:09:52.254667 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:52.254663 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w94jg\" (UniqueName: \"kubernetes.io/projected/d302059a-caec-4225-ae63-483501628fe9-kube-api-access-w94jg\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 21:09:52.254667 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:52.254673 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brgd2\" (UniqueName: \"kubernetes.io/projected/ed2f9d2c-6473-4c4c-84dc-7b1298acf1b8-kube-api-access-brgd2\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 21:09:52.254906 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:52.254682 2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d302059a-caec-4225-ae63-483501628fe9-plugins-config-volume\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 21:09:52.345819 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:52.345788 2558 generic.go:356] "Generic (PLEG): container finished" podID="d302059a-caec-4225-ae63-483501628fe9" containerID="ac93fc50e23227d34259337252bd1045bf5f022217a1f7ab9527fa5bf9ab1900" exitCode=0 Jul 27 21:09:52.345962 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:52.345833 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-cae454-845cf567b4-q6ldb" Jul 27 21:09:52.345962 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:52.345866 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-cae454-845cf567b4-q6ldb" event={"ID":"d302059a-caec-4225-ae63-483501628fe9","Type":"ContainerDied","Data":"ac93fc50e23227d34259337252bd1045bf5f022217a1f7ab9527fa5bf9ab1900"} Jul 27 21:09:52.345962 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:52.345914 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-cae454-845cf567b4-q6ldb" event={"ID":"d302059a-caec-4225-ae63-483501628fe9","Type":"ContainerDied","Data":"6cd8adf11dcd1a82f42de991b5614f6a39adfcf4bacf143c420ff5ec775ff9f5"} Jul 27 21:09:52.345962 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:52.345944 2558 scope.go:117] "RemoveContainer" containerID="ac93fc50e23227d34259337252bd1045bf5f022217a1f7ab9527fa5bf9ab1900" Jul 27 21:09:52.347185 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:52.347151 2558 generic.go:356] "Generic (PLEG): container finished" podID="ed2f9d2c-6473-4c4c-84dc-7b1298acf1b8" containerID="d6efba2953d1a00084cda55db219c6a60e1ae31652f4024f819d165fd6cc6c64" exitCode=0 Jul 27 21:09:52.347305 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:52.347191 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cae454-84f8c64fcb-m69lq" Jul 27 21:09:52.347305 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:52.347201 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cae454-84f8c64fcb-m69lq" event={"ID":"ed2f9d2c-6473-4c4c-84dc-7b1298acf1b8","Type":"ContainerDied","Data":"d6efba2953d1a00084cda55db219c6a60e1ae31652f4024f819d165fd6cc6c64"} Jul 27 21:09:52.347422 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:52.347332 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cae454-84f8c64fcb-m69lq" event={"ID":"ed2f9d2c-6473-4c4c-84dc-7b1298acf1b8","Type":"ContainerDied","Data":"6b4cd797b37d443465c9430f9df375c2430a05f8c420a63113183f29941767b4"} Jul 27 21:09:52.354727 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:52.354557 2558 scope.go:117] "RemoveContainer" containerID="ac93fc50e23227d34259337252bd1045bf5f022217a1f7ab9527fa5bf9ab1900" Jul 27 21:09:52.355029 ip-10-0-132-12 kubenswrapper[2558]: E0727 21:09:52.354995 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac93fc50e23227d34259337252bd1045bf5f022217a1f7ab9527fa5bf9ab1900\": container with ID starting with ac93fc50e23227d34259337252bd1045bf5f022217a1f7ab9527fa5bf9ab1900 not found: ID does not exist" containerID="ac93fc50e23227d34259337252bd1045bf5f022217a1f7ab9527fa5bf9ab1900" Jul 27 21:09:52.355110 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:52.355034 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac93fc50e23227d34259337252bd1045bf5f022217a1f7ab9527fa5bf9ab1900"} err="failed to get container status \"ac93fc50e23227d34259337252bd1045bf5f022217a1f7ab9527fa5bf9ab1900\": rpc error: code = NotFound desc = could not find container \"ac93fc50e23227d34259337252bd1045bf5f022217a1f7ab9527fa5bf9ab1900\": container with ID starting with ac93fc50e23227d34259337252bd1045bf5f022217a1f7ab9527fa5bf9ab1900 not found: ID does not exist" Jul 27 21:09:52.355110 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:52.355051 2558 scope.go:117] "RemoveContainer" containerID="d6efba2953d1a00084cda55db219c6a60e1ae31652f4024f819d165fd6cc6c64" Jul 27 21:09:52.364724 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:52.364701 2558 scope.go:117] "RemoveContainer" containerID="d6efba2953d1a00084cda55db219c6a60e1ae31652f4024f819d165fd6cc6c64" Jul 27 21:09:52.364971 ip-10-0-132-12 kubenswrapper[2558]: E0727 21:09:52.364954 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6efba2953d1a00084cda55db219c6a60e1ae31652f4024f819d165fd6cc6c64\": container with ID starting with d6efba2953d1a00084cda55db219c6a60e1ae31652f4024f819d165fd6cc6c64 not found: ID does not exist" containerID="d6efba2953d1a00084cda55db219c6a60e1ae31652f4024f819d165fd6cc6c64" Jul 27 21:09:52.365040 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:52.364978 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6efba2953d1a00084cda55db219c6a60e1ae31652f4024f819d165fd6cc6c64"} err="failed to get container status \"d6efba2953d1a00084cda55db219c6a60e1ae31652f4024f819d165fd6cc6c64\": rpc error: code = NotFound desc = could not find container \"d6efba2953d1a00084cda55db219c6a60e1ae31652f4024f819d165fd6cc6c64\": container with ID starting with d6efba2953d1a00084cda55db219c6a60e1ae31652f4024f819d165fd6cc6c64 not found: ID does not exist" Jul 27 21:09:52.382428 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:52.382402 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-cae454-84f8c64fcb-m69lq"] Jul 27 21:09:52.388488 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:52.388464 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-cae454-84f8c64fcb-m69lq"] Jul 27 21:09:52.405326 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:52.405303 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-cae454-845cf567b4-q6ldb"] Jul 27 21:09:52.413479 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:52.413460 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-cae454-845cf567b4-q6ldb"] Jul 27 21:09:53.933762 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:53.933731 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d302059a-caec-4225-ae63-483501628fe9" path="/var/lib/kubelet/pods/d302059a-caec-4225-ae63-483501628fe9/volumes" Jul 27 21:09:53.934125 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:53.934083 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed2f9d2c-6473-4c4c-84dc-7b1298acf1b8" path="/var/lib/kubelet/pods/ed2f9d2c-6473-4c4c-84dc-7b1298acf1b8/volumes" Jul 27 21:09:54.926552 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:54.926514 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 21:09:56.303496 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:56.303457 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:09:56.672542 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:09:56.672468 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:10:02.848827 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:02.848748 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:10:02.946405 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:02.946370 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:10:03.020353 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:03.020315 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:10:03.179476 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:03.179403 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:10:13.808675 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:13.808643 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:10:13.837618 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:13.837580 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-132aad-57fd95965d-fntb4"] Jul 27 21:10:13.837878 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:13.837850 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-132aad-57fd95965d-fntb4" podUID="ea1fdbb2-05b0-4b61-87a3-b8039c9459ba" containerName="payload-processing" containerID="cri-o://d8ce44455bf7515360cc54db3cf21bc0462363511c85cd0760ed66aa94475c0b" gracePeriod=30 Jul 27 21:10:13.844613 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:13.844585 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-132aad-64bcff89f6-x5d4f"] Jul 27 21:10:13.845033 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:13.845006 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-132aad-64bcff89f6-x5d4f" podUID="9b0fce49-3066-427f-b908-d71e7f22030d" containerName="payload-pre-processing" containerID="cri-o://a1c04396d5359c9be6fbb89e7a4ad13a0d06d9babe6b3c7dc5b8fd7843c56648" gracePeriod=30 Jul 27 21:10:13.877175 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:13.877152 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:10:13.939021 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:13.938997 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:10:14.114984 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:14.114964 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-132aad-57fd95965d-fntb4" Jul 27 21:10:14.117504 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:14.117490 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-132aad-64bcff89f6-x5d4f" Jul 27 21:10:14.228159 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:14.228132 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea1fdbb2-05b0-4b61-87a3-b8039c9459ba-plugins-config-volume\") pod \"ea1fdbb2-05b0-4b61-87a3-b8039c9459ba\" (UID: \"ea1fdbb2-05b0-4b61-87a3-b8039c9459ba\") " Jul 27 21:10:14.228300 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:14.228191 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b0fce49-3066-427f-b908-d71e7f22030d-plugins-config-volume\") pod \"9b0fce49-3066-427f-b908-d71e7f22030d\" (UID: \"9b0fce49-3066-427f-b908-d71e7f22030d\") " Jul 27 21:10:14.228300 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:14.228233 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c99ck\" (UniqueName: \"kubernetes.io/projected/9b0fce49-3066-427f-b908-d71e7f22030d-kube-api-access-c99ck\") pod \"9b0fce49-3066-427f-b908-d71e7f22030d\" (UID: \"9b0fce49-3066-427f-b908-d71e7f22030d\") " Jul 27 21:10:14.228300 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:14.228262 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bmgm7\" (UniqueName: \"kubernetes.io/projected/ea1fdbb2-05b0-4b61-87a3-b8039c9459ba-kube-api-access-bmgm7\") pod \"ea1fdbb2-05b0-4b61-87a3-b8039c9459ba\" (UID: \"ea1fdbb2-05b0-4b61-87a3-b8039c9459ba\") " Jul 27 21:10:14.228551 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:14.228534 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea1fdbb2-05b0-4b61-87a3-b8039c9459ba-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ea1fdbb2-05b0-4b61-87a3-b8039c9459ba" (UID: "ea1fdbb2-05b0-4b61-87a3-b8039c9459ba"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 21:10:14.228590 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:14.228549 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b0fce49-3066-427f-b908-d71e7f22030d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9b0fce49-3066-427f-b908-d71e7f22030d" (UID: "9b0fce49-3066-427f-b908-d71e7f22030d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 21:10:14.230327 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:14.230298 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea1fdbb2-05b0-4b61-87a3-b8039c9459ba-kube-api-access-bmgm7" (OuterVolumeSpecName: "kube-api-access-bmgm7") pod "ea1fdbb2-05b0-4b61-87a3-b8039c9459ba" (UID: "ea1fdbb2-05b0-4b61-87a3-b8039c9459ba"). InnerVolumeSpecName "kube-api-access-bmgm7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 21:10:14.230464 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:14.230376 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b0fce49-3066-427f-b908-d71e7f22030d-kube-api-access-c99ck" (OuterVolumeSpecName: "kube-api-access-c99ck") pod "9b0fce49-3066-427f-b908-d71e7f22030d" (UID: "9b0fce49-3066-427f-b908-d71e7f22030d"). InnerVolumeSpecName "kube-api-access-c99ck". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 21:10:14.329590 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:14.329565 2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b0fce49-3066-427f-b908-d71e7f22030d-plugins-config-volume\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 21:10:14.329590 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:14.329590 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c99ck\" (UniqueName: \"kubernetes.io/projected/9b0fce49-3066-427f-b908-d71e7f22030d-kube-api-access-c99ck\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 21:10:14.329775 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:14.329600 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bmgm7\" (UniqueName: \"kubernetes.io/projected/ea1fdbb2-05b0-4b61-87a3-b8039c9459ba-kube-api-access-bmgm7\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 21:10:14.329775 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:14.329609 2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea1fdbb2-05b0-4b61-87a3-b8039c9459ba-plugins-config-volume\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 21:10:14.443282 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:14.443207 2558 generic.go:356] "Generic (PLEG): container finished" podID="ea1fdbb2-05b0-4b61-87a3-b8039c9459ba" containerID="d8ce44455bf7515360cc54db3cf21bc0462363511c85cd0760ed66aa94475c0b" exitCode=0 Jul 27 21:10:14.443282 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:14.443258 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-132aad-57fd95965d-fntb4" Jul 27 21:10:14.443282 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:14.443278 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-132aad-57fd95965d-fntb4" event={"ID":"ea1fdbb2-05b0-4b61-87a3-b8039c9459ba","Type":"ContainerDied","Data":"d8ce44455bf7515360cc54db3cf21bc0462363511c85cd0760ed66aa94475c0b"} Jul 27 21:10:14.443495 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:14.443356 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-132aad-57fd95965d-fntb4" event={"ID":"ea1fdbb2-05b0-4b61-87a3-b8039c9459ba","Type":"ContainerDied","Data":"12561bbe62194bbb62cedb9d6cc5d9938fbaff3e4bffafd0cfc62103c9176317"} Jul 27 21:10:14.443495 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:14.443389 2558 scope.go:117] "RemoveContainer" containerID="d8ce44455bf7515360cc54db3cf21bc0462363511c85cd0760ed66aa94475c0b" Jul 27 21:10:14.444478 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:14.444454 2558 generic.go:356] "Generic (PLEG): container finished" podID="9b0fce49-3066-427f-b908-d71e7f22030d" containerID="a1c04396d5359c9be6fbb89e7a4ad13a0d06d9babe6b3c7dc5b8fd7843c56648" exitCode=0 Jul 27 21:10:14.444563 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:14.444498 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-132aad-64bcff89f6-x5d4f" event={"ID":"9b0fce49-3066-427f-b908-d71e7f22030d","Type":"ContainerDied","Data":"a1c04396d5359c9be6fbb89e7a4ad13a0d06d9babe6b3c7dc5b8fd7843c56648"} Jul 27 21:10:14.444563 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:14.444512 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-132aad-64bcff89f6-x5d4f" Jul 27 21:10:14.444563 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:14.444546 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-132aad-64bcff89f6-x5d4f" event={"ID":"9b0fce49-3066-427f-b908-d71e7f22030d","Type":"ContainerDied","Data":"9ae7f80b9d3b4300b2f20426218bced4762f76cd9ec1e04b8ececb725f332618"} Jul 27 21:10:14.452379 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:14.452359 2558 scope.go:117] "RemoveContainer" containerID="d8ce44455bf7515360cc54db3cf21bc0462363511c85cd0760ed66aa94475c0b" Jul 27 21:10:14.452684 ip-10-0-132-12 kubenswrapper[2558]: E0727 21:10:14.452658 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8ce44455bf7515360cc54db3cf21bc0462363511c85cd0760ed66aa94475c0b\": container with ID starting with d8ce44455bf7515360cc54db3cf21bc0462363511c85cd0760ed66aa94475c0b not found: ID does not exist" containerID="d8ce44455bf7515360cc54db3cf21bc0462363511c85cd0760ed66aa94475c0b" Jul 27 21:10:14.452807 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:14.452719 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8ce44455bf7515360cc54db3cf21bc0462363511c85cd0760ed66aa94475c0b"} err="failed to get container status \"d8ce44455bf7515360cc54db3cf21bc0462363511c85cd0760ed66aa94475c0b\": rpc error: code = NotFound desc = could not find container \"d8ce44455bf7515360cc54db3cf21bc0462363511c85cd0760ed66aa94475c0b\": container with ID starting with d8ce44455bf7515360cc54db3cf21bc0462363511c85cd0760ed66aa94475c0b not found: ID does not exist" Jul 27 21:10:14.452807 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:14.452741 2558 scope.go:117] "RemoveContainer" containerID="a1c04396d5359c9be6fbb89e7a4ad13a0d06d9babe6b3c7dc5b8fd7843c56648" Jul 27 21:10:14.459958 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:14.459940 2558 scope.go:117] "RemoveContainer" containerID="a1c04396d5359c9be6fbb89e7a4ad13a0d06d9babe6b3c7dc5b8fd7843c56648" Jul 27 21:10:14.460184 ip-10-0-132-12 kubenswrapper[2558]: E0727 21:10:14.460167 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1c04396d5359c9be6fbb89e7a4ad13a0d06d9babe6b3c7dc5b8fd7843c56648\": container with ID starting with a1c04396d5359c9be6fbb89e7a4ad13a0d06d9babe6b3c7dc5b8fd7843c56648 not found: ID does not exist" containerID="a1c04396d5359c9be6fbb89e7a4ad13a0d06d9babe6b3c7dc5b8fd7843c56648" Jul 27 21:10:14.460234 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:14.460189 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1c04396d5359c9be6fbb89e7a4ad13a0d06d9babe6b3c7dc5b8fd7843c56648"} err="failed to get container status \"a1c04396d5359c9be6fbb89e7a4ad13a0d06d9babe6b3c7dc5b8fd7843c56648\": rpc error: code = NotFound desc = could not find container \"a1c04396d5359c9be6fbb89e7a4ad13a0d06d9babe6b3c7dc5b8fd7843c56648\": container with ID starting with a1c04396d5359c9be6fbb89e7a4ad13a0d06d9babe6b3c7dc5b8fd7843c56648 not found: ID does not exist" Jul 27 21:10:14.466086 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:14.466066 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-132aad-57fd95965d-fntb4"] Jul 27 21:10:14.470127 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:14.470104 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-132aad-57fd95965d-fntb4"] Jul 27 21:10:14.481009 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:14.480991 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-132aad-64bcff89f6-x5d4f"] Jul 27 21:10:14.485004 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:14.484984 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-132aad-64bcff89f6-x5d4f"] Jul 27 21:10:15.933388 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:15.933358 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b0fce49-3066-427f-b908-d71e7f22030d" path="/var/lib/kubelet/pods/9b0fce49-3066-427f-b908-d71e7f22030d/volumes" Jul 27 21:10:15.933759 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:15.933710 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea1fdbb2-05b0-4b61-87a3-b8039c9459ba" path="/var/lib/kubelet/pods/ea1fdbb2-05b0-4b61-87a3-b8039c9459ba/volumes" Jul 27 21:10:16.926511 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:16.926484 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 21:10:18.404641 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:18.404609 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:10:18.769187 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:18.769138 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:10:24.600066 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:24.600035 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:10:24.700471 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:24.700437 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:10:24.841482 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:24.841453 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:10:25.065368 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:25.065337 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:10:35.643374 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:35.643342 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:10:35.671257 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:35.671230 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-66b603-67887659b6-jrjk4"] Jul 27 21:10:35.671497 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:35.671465 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-66b603-67887659b6-jrjk4" podUID="2a23deac-be2d-4ddf-8dde-b4150430d650" containerName="payload-processing" containerID="cri-o://0c2afe002b4d365e341b4c64ac1a20e2042cd4235ad276d0a77cf24ad737b54b" gracePeriod=30 Jul 27 21:10:35.677893 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:35.677857 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-66b603-6fc59647b8-t42kr"] Jul 27 21:10:35.678637 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:35.678103 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-66b603-6fc59647b8-t42kr" podUID="1b202b8e-728d-4f81-aad5-f0b39552cb22" containerName="payload-pre-processing" containerID="cri-o://4c44e3c457604303e5d86d7a7c61e626f1f7841664553802141ef3b6afe74df0" gracePeriod=30 Jul 27 21:10:35.713951 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:35.713917 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:10:35.779640 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:35.779612 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:10:35.948559 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:35.948540 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-66b603-67887659b6-jrjk4" Jul 27 21:10:35.951310 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:35.951289 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-66b603-6fc59647b8-t42kr" Jul 27 21:10:36.095903 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:36.095877 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7nrhs\" (UniqueName: \"kubernetes.io/projected/1b202b8e-728d-4f81-aad5-f0b39552cb22-kube-api-access-7nrhs\") pod \"1b202b8e-728d-4f81-aad5-f0b39552cb22\" (UID: \"1b202b8e-728d-4f81-aad5-f0b39552cb22\") " Jul 27 21:10:36.096069 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:36.095917 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9n9d\" (UniqueName: \"kubernetes.io/projected/2a23deac-be2d-4ddf-8dde-b4150430d650-kube-api-access-c9n9d\") pod \"2a23deac-be2d-4ddf-8dde-b4150430d650\" (UID: \"2a23deac-be2d-4ddf-8dde-b4150430d650\") " Jul 27 21:10:36.096069 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:36.095938 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b202b8e-728d-4f81-aad5-f0b39552cb22-plugins-config-volume\") pod \"1b202b8e-728d-4f81-aad5-f0b39552cb22\" (UID: \"1b202b8e-728d-4f81-aad5-f0b39552cb22\") " Jul 27 21:10:36.096069 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:36.096018 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a23deac-be2d-4ddf-8dde-b4150430d650-plugins-config-volume\") pod \"2a23deac-be2d-4ddf-8dde-b4150430d650\" (UID: \"2a23deac-be2d-4ddf-8dde-b4150430d650\") " Jul 27 21:10:36.096382 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:36.096354 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b202b8e-728d-4f81-aad5-f0b39552cb22-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1b202b8e-728d-4f81-aad5-f0b39552cb22" (UID: "1b202b8e-728d-4f81-aad5-f0b39552cb22"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 21:10:36.096382 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:36.096366 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a23deac-be2d-4ddf-8dde-b4150430d650-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2a23deac-be2d-4ddf-8dde-b4150430d650" (UID: "2a23deac-be2d-4ddf-8dde-b4150430d650"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 21:10:36.097913 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:36.097891 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b202b8e-728d-4f81-aad5-f0b39552cb22-kube-api-access-7nrhs" (OuterVolumeSpecName: "kube-api-access-7nrhs") pod "1b202b8e-728d-4f81-aad5-f0b39552cb22" (UID: "1b202b8e-728d-4f81-aad5-f0b39552cb22"). InnerVolumeSpecName "kube-api-access-7nrhs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 21:10:36.097981 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:36.097941 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a23deac-be2d-4ddf-8dde-b4150430d650-kube-api-access-c9n9d" (OuterVolumeSpecName: "kube-api-access-c9n9d") pod "2a23deac-be2d-4ddf-8dde-b4150430d650" (UID: "2a23deac-be2d-4ddf-8dde-b4150430d650"). InnerVolumeSpecName "kube-api-access-c9n9d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 21:10:36.197169 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:36.197115 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7nrhs\" (UniqueName: \"kubernetes.io/projected/1b202b8e-728d-4f81-aad5-f0b39552cb22-kube-api-access-7nrhs\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 21:10:36.197169 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:36.197137 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9n9d\" (UniqueName: \"kubernetes.io/projected/2a23deac-be2d-4ddf-8dde-b4150430d650-kube-api-access-c9n9d\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 21:10:36.197169 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:36.197146 2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b202b8e-728d-4f81-aad5-f0b39552cb22-plugins-config-volume\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 21:10:36.197169 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:36.197155 2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a23deac-be2d-4ddf-8dde-b4150430d650-plugins-config-volume\") on node \"ip-10-0-132-12.ec2.internal\" DevicePath \"\"" Jul 27 21:10:36.539543 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:36.539509 2558 generic.go:356] "Generic (PLEG): container finished" podID="1b202b8e-728d-4f81-aad5-f0b39552cb22" containerID="4c44e3c457604303e5d86d7a7c61e626f1f7841664553802141ef3b6afe74df0" exitCode=0 Jul 27 21:10:36.539741 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:36.539557 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-66b603-6fc59647b8-t42kr" Jul 27 21:10:36.539741 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:36.539588 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-66b603-6fc59647b8-t42kr" event={"ID":"1b202b8e-728d-4f81-aad5-f0b39552cb22","Type":"ContainerDied","Data":"4c44e3c457604303e5d86d7a7c61e626f1f7841664553802141ef3b6afe74df0"} Jul 27 21:10:36.539741 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:36.539636 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-66b603-6fc59647b8-t42kr" event={"ID":"1b202b8e-728d-4f81-aad5-f0b39552cb22","Type":"ContainerDied","Data":"b965beeeb55315b0a16f0a9728a8340ff36b275fce2adb435e59dc7152adef43"} Jul 27 21:10:36.539741 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:36.539657 2558 scope.go:117] "RemoveContainer" containerID="4c44e3c457604303e5d86d7a7c61e626f1f7841664553802141ef3b6afe74df0" Jul 27 21:10:36.540950 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:36.540918 2558 generic.go:356] "Generic (PLEG): container finished" podID="2a23deac-be2d-4ddf-8dde-b4150430d650" containerID="0c2afe002b4d365e341b4c64ac1a20e2042cd4235ad276d0a77cf24ad737b54b" exitCode=0 Jul 27 21:10:36.541047 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:36.540948 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-66b603-67887659b6-jrjk4" Jul 27 21:10:36.541047 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:36.540964 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-66b603-67887659b6-jrjk4" event={"ID":"2a23deac-be2d-4ddf-8dde-b4150430d650","Type":"ContainerDied","Data":"0c2afe002b4d365e341b4c64ac1a20e2042cd4235ad276d0a77cf24ad737b54b"} Jul 27 21:10:36.541047 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:36.541014 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-66b603-67887659b6-jrjk4" event={"ID":"2a23deac-be2d-4ddf-8dde-b4150430d650","Type":"ContainerDied","Data":"b3e0c8859059b43e70c7430f96888cdd0550e93d6ad22abe37ada15a0dfdbd4b"} Jul 27 21:10:36.547681 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:36.547664 2558 scope.go:117] "RemoveContainer" containerID="4c44e3c457604303e5d86d7a7c61e626f1f7841664553802141ef3b6afe74df0" Jul 27 21:10:36.547985 ip-10-0-132-12 kubenswrapper[2558]: E0727 21:10:36.547956 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c44e3c457604303e5d86d7a7c61e626f1f7841664553802141ef3b6afe74df0\": container with ID starting with 4c44e3c457604303e5d86d7a7c61e626f1f7841664553802141ef3b6afe74df0 not found: ID does not exist" containerID="4c44e3c457604303e5d86d7a7c61e626f1f7841664553802141ef3b6afe74df0" Jul 27 21:10:36.548054 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:36.547998 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c44e3c457604303e5d86d7a7c61e626f1f7841664553802141ef3b6afe74df0"} err="failed to get container status \"4c44e3c457604303e5d86d7a7c61e626f1f7841664553802141ef3b6afe74df0\": rpc error: code = NotFound desc = could not find container \"4c44e3c457604303e5d86d7a7c61e626f1f7841664553802141ef3b6afe74df0\": container with ID starting with 4c44e3c457604303e5d86d7a7c61e626f1f7841664553802141ef3b6afe74df0 not found: ID does not exist" Jul 27 21:10:36.548054 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:36.548021 2558 scope.go:117] "RemoveContainer" containerID="0c2afe002b4d365e341b4c64ac1a20e2042cd4235ad276d0a77cf24ad737b54b" Jul 27 21:10:36.555511 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:36.555497 2558 scope.go:117] "RemoveContainer" containerID="0c2afe002b4d365e341b4c64ac1a20e2042cd4235ad276d0a77cf24ad737b54b" Jul 27 21:10:36.555757 ip-10-0-132-12 kubenswrapper[2558]: E0727 21:10:36.555741 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c2afe002b4d365e341b4c64ac1a20e2042cd4235ad276d0a77cf24ad737b54b\": container with ID starting with 0c2afe002b4d365e341b4c64ac1a20e2042cd4235ad276d0a77cf24ad737b54b not found: ID does not exist" containerID="0c2afe002b4d365e341b4c64ac1a20e2042cd4235ad276d0a77cf24ad737b54b" Jul 27 21:10:36.555807 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:36.555763 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c2afe002b4d365e341b4c64ac1a20e2042cd4235ad276d0a77cf24ad737b54b"} err="failed to get container status \"0c2afe002b4d365e341b4c64ac1a20e2042cd4235ad276d0a77cf24ad737b54b\": rpc error: code = NotFound desc = could not find container \"0c2afe002b4d365e341b4c64ac1a20e2042cd4235ad276d0a77cf24ad737b54b\": container with ID starting with 0c2afe002b4d365e341b4c64ac1a20e2042cd4235ad276d0a77cf24ad737b54b not found: ID does not exist" Jul 27 21:10:36.565774 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:36.565754 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-66b603-6fc59647b8-t42kr"] Jul 27 21:10:36.569203 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:36.569185 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-66b603-6fc59647b8-t42kr"] Jul 27 21:10:36.579090 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:36.579070 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-66b603-67887659b6-jrjk4"] Jul 27 21:10:36.584590 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:36.584568 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-66b603-67887659b6-jrjk4"] Jul 27 21:10:37.937990 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:37.934581 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b202b8e-728d-4f81-aad5-f0b39552cb22" path="/var/lib/kubelet/pods/1b202b8e-728d-4f81-aad5-f0b39552cb22/volumes" Jul 27 21:10:37.937990 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:37.935121 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a23deac-be2d-4ddf-8dde-b4150430d650" path="/var/lib/kubelet/pods/2a23deac-be2d-4ddf-8dde-b4150430d650/volumes" Jul 27 21:10:38.339783 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:38.339749 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s6zgw"] Jul 27 21:10:40.256668 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:40.256628 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:10:40.622018 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:40.621918 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:10:46.770074 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:46.770037 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:10:46.870199 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:46.870151 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:10:47.032109 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:47.032035 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:10:47.286510 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:47.286436 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:10:53.447046 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:53.447019 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-dm9lm_93f40186-af2d-4375-b40e-cb123c8dd5fa/server/0.log" Jul 27 21:10:53.929917 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:53.929886 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b8fd6b656-r8sps_905ed094-def8-467e-97e9-84bb97bdc92e/copy-manifests/0.log" Jul 27 21:10:53.943122 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:53.943096 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b8fd6b656-r8sps_905ed094-def8-467e-97e9-84bb97bdc92e/manager/0.log" Jul 27 21:10:56.661944 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:56.661912 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-s6zgw_2f3f099d-3f98-4cae-8820-6c4d5b411aa3/limitador/0.log" Jul 27 21:10:57.241023 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:57.240989 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-xf7v7_2e4c67bd-ff21-45b8-93de-0a2577a61f5f/discovery/0.log" Jul 27 21:10:58.713483 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:10:58.713451 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-5xm6m_0f1c9cd4-74a9-40d2-b7ce-36b4918132e3/main/0.log" Jul 27 21:11:04.110596 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:04.110540 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:11:04.206682 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:04.206644 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:11:06.951829 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:06.951797 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-57jqw_5db14a3f-0592-417e-8de6-a29bbe4cbfbd/global-pull-secret-syncer/0.log" Jul 27 21:11:07.090455 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:07.090426 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" Jul 27 21:11:07.199836 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:07.199809 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-12.ec2.internal_9500b4062bc35ffcbb05e58bd96d058d/haproxy/0.log" Jul 27 21:11:09.416963 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:09.416909 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:11:12.744385 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:12.744356 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-s6zgw_2f3f099d-3f98-4cae-8820-6c4d5b411aa3/limitador/0.log" Jul 27 21:11:15.028497 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:15.028464 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r66sh_c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2/node-exporter/0.log" Jul 27 21:11:15.050529 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:15.050505 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r66sh_c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2/kube-rbac-proxy/0.log" Jul 27 21:11:15.072265 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:15.072247 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r66sh_c3f6e5aa-dd33-4506-9bcd-b1b69e4eaaa2/init-textfile/0.log" Jul 27 21:11:17.107431 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.107400 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n5ws2/perf-node-gather-daemonset-5wdp7"] Jul 27 21:11:17.107852 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.107680 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d302059a-caec-4225-ae63-483501628fe9" containerName="payload-processing" Jul 27 21:11:17.107852 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.107705 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d302059a-caec-4225-ae63-483501628fe9" containerName="payload-processing" Jul 27 21:11:17.107852 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.107718 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b0fce49-3066-427f-b908-d71e7f22030d" containerName="payload-pre-processing" Jul 27 21:11:17.107852 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.107725 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b0fce49-3066-427f-b908-d71e7f22030d" containerName="payload-pre-processing" Jul 27 21:11:17.107852 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.107732 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a23deac-be2d-4ddf-8dde-b4150430d650" containerName="payload-processing" Jul 27 21:11:17.107852 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.107737 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a23deac-be2d-4ddf-8dde-b4150430d650" containerName="payload-processing" Jul 27 21:11:17.107852 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.107747 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea1fdbb2-05b0-4b61-87a3-b8039c9459ba" containerName="payload-processing" Jul 27 21:11:17.107852 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.107752 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea1fdbb2-05b0-4b61-87a3-b8039c9459ba" containerName="payload-processing" Jul 27 21:11:17.107852 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.107759 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31b7452b-c249-4520-aba4-fd6a16e712e2" containerName="payload-pre-processing" Jul 27 21:11:17.107852 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.107765 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="31b7452b-c249-4520-aba4-fd6a16e712e2" containerName="payload-pre-processing" Jul 27 21:11:17.107852 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.107773 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b202b8e-728d-4f81-aad5-f0b39552cb22" containerName="payload-pre-processing" Jul 27 21:11:17.107852 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.107778 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b202b8e-728d-4f81-aad5-f0b39552cb22" containerName="payload-pre-processing" Jul 27 21:11:17.107852 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.107783 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f24e253-2c78-47ed-8049-15b3e17f22b9" containerName="payload-processing" Jul 27 21:11:17.107852 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.107788 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f24e253-2c78-47ed-8049-15b3e17f22b9" containerName="payload-processing" Jul 27 21:11:17.107852 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.107798 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0fce8de-7559-4dab-b301-40903a1d3276" containerName="payload-pre-processing" Jul 27 21:11:17.107852 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.107803 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0fce8de-7559-4dab-b301-40903a1d3276" containerName="payload-pre-processing" Jul 27 21:11:17.107852 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.107807 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b11f065-a081-4528-b646-37d833839345" containerName="payload-processing" Jul 27 21:11:17.107852 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.107812 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b11f065-a081-4528-b646-37d833839345" containerName="payload-processing" Jul 27 21:11:17.107852 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.107819 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed2f9d2c-6473-4c4c-84dc-7b1298acf1b8" containerName="payload-pre-processing" Jul 27 21:11:17.107852 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.107823 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed2f9d2c-6473-4c4c-84dc-7b1298acf1b8" containerName="payload-pre-processing" Jul 27 21:11:17.108532 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.107868 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0fce8de-7559-4dab-b301-40903a1d3276" containerName="payload-pre-processing" Jul 27 21:11:17.108532 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.107876 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed2f9d2c-6473-4c4c-84dc-7b1298acf1b8" containerName="payload-pre-processing" Jul 27 21:11:17.108532 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.107882 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="31b7452b-c249-4520-aba4-fd6a16e712e2" containerName="payload-pre-processing" Jul 27 21:11:17.108532 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.107887 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f24e253-2c78-47ed-8049-15b3e17f22b9" containerName="payload-processing" Jul 27 21:11:17.108532 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.107893 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d302059a-caec-4225-ae63-483501628fe9" containerName="payload-processing" Jul 27 21:11:17.108532 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.107899 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea1fdbb2-05b0-4b61-87a3-b8039c9459ba" containerName="payload-processing" Jul 27 21:11:17.108532 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.107905 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a23deac-be2d-4ddf-8dde-b4150430d650" containerName="payload-processing" Jul 27 21:11:17.108532 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.107910 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b11f065-a081-4528-b646-37d833839345" containerName="payload-processing" Jul 27 21:11:17.108532 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.107915 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b0fce49-3066-427f-b908-d71e7f22030d" containerName="payload-pre-processing" Jul 27 21:11:17.108532 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.107919 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b202b8e-728d-4f81-aad5-f0b39552cb22" containerName="payload-pre-processing" Jul 27 21:11:17.110887 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.110870 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n5ws2/perf-node-gather-daemonset-5wdp7" Jul 27 21:11:17.113309 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.113283 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n5ws2\"/\"openshift-service-ca.crt\"" Jul 27 21:11:17.113419 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.113361 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-n5ws2\"/\"default-dockercfg-4f785\"" Jul 27 21:11:17.114498 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.114479 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n5ws2\"/\"kube-root-ca.crt\"" Jul 27 21:11:17.121269 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.121249 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n5ws2/perf-node-gather-daemonset-5wdp7"] Jul 27 21:11:17.218094 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.218053 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q85g5\" (UniqueName: \"kubernetes.io/projected/017519f3-43df-499c-808a-4e7072074d46-kube-api-access-q85g5\") pod \"perf-node-gather-daemonset-5wdp7\" (UID: \"017519f3-43df-499c-808a-4e7072074d46\") " pod="openshift-must-gather-n5ws2/perf-node-gather-daemonset-5wdp7" Jul 27 21:11:17.218094 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.218105 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/017519f3-43df-499c-808a-4e7072074d46-proc\") pod \"perf-node-gather-daemonset-5wdp7\" (UID: \"017519f3-43df-499c-808a-4e7072074d46\") " pod="openshift-must-gather-n5ws2/perf-node-gather-daemonset-5wdp7" Jul 27 21:11:17.218313 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.218123 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/017519f3-43df-499c-808a-4e7072074d46-podres\") pod \"perf-node-gather-daemonset-5wdp7\" (UID: \"017519f3-43df-499c-808a-4e7072074d46\") " pod="openshift-must-gather-n5ws2/perf-node-gather-daemonset-5wdp7" Jul 27 21:11:17.218313 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.218160 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/017519f3-43df-499c-808a-4e7072074d46-lib-modules\") pod \"perf-node-gather-daemonset-5wdp7\" (UID: \"017519f3-43df-499c-808a-4e7072074d46\") " pod="openshift-must-gather-n5ws2/perf-node-gather-daemonset-5wdp7" Jul 27 21:11:17.218313 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.218234 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/017519f3-43df-499c-808a-4e7072074d46-sys\") pod \"perf-node-gather-daemonset-5wdp7\" (UID: \"017519f3-43df-499c-808a-4e7072074d46\") " pod="openshift-must-gather-n5ws2/perf-node-gather-daemonset-5wdp7" Jul 27 21:11:17.319504 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.319458 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q85g5\" (UniqueName: \"kubernetes.io/projected/017519f3-43df-499c-808a-4e7072074d46-kube-api-access-q85g5\") pod \"perf-node-gather-daemonset-5wdp7\" (UID: \"017519f3-43df-499c-808a-4e7072074d46\") " pod="openshift-must-gather-n5ws2/perf-node-gather-daemonset-5wdp7" Jul 27 21:11:17.319504 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.319507 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/017519f3-43df-499c-808a-4e7072074d46-proc\") pod \"perf-node-gather-daemonset-5wdp7\" (UID: \"017519f3-43df-499c-808a-4e7072074d46\") " pod="openshift-must-gather-n5ws2/perf-node-gather-daemonset-5wdp7" Jul 27 21:11:17.319777 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.319526 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/017519f3-43df-499c-808a-4e7072074d46-podres\") pod \"perf-node-gather-daemonset-5wdp7\" (UID: \"017519f3-43df-499c-808a-4e7072074d46\") " pod="openshift-must-gather-n5ws2/perf-node-gather-daemonset-5wdp7" Jul 27 21:11:17.319777 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.319541 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/017519f3-43df-499c-808a-4e7072074d46-lib-modules\") pod \"perf-node-gather-daemonset-5wdp7\" (UID: \"017519f3-43df-499c-808a-4e7072074d46\") " pod="openshift-must-gather-n5ws2/perf-node-gather-daemonset-5wdp7" Jul 27 21:11:17.319777 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.319562 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/017519f3-43df-499c-808a-4e7072074d46-sys\") pod \"perf-node-gather-daemonset-5wdp7\" (UID: \"017519f3-43df-499c-808a-4e7072074d46\") " pod="openshift-must-gather-n5ws2/perf-node-gather-daemonset-5wdp7" Jul 27 21:11:17.319777 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.319615 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/017519f3-43df-499c-808a-4e7072074d46-proc\") pod \"perf-node-gather-daemonset-5wdp7\" (UID: \"017519f3-43df-499c-808a-4e7072074d46\") " pod="openshift-must-gather-n5ws2/perf-node-gather-daemonset-5wdp7" Jul 27 21:11:17.319777 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.319653 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/017519f3-43df-499c-808a-4e7072074d46-sys\") pod \"perf-node-gather-daemonset-5wdp7\" (UID: \"017519f3-43df-499c-808a-4e7072074d46\") " pod="openshift-must-gather-n5ws2/perf-node-gather-daemonset-5wdp7" Jul 27 21:11:17.319777 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.319664 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/017519f3-43df-499c-808a-4e7072074d46-podres\") pod \"perf-node-gather-daemonset-5wdp7\" (UID: \"017519f3-43df-499c-808a-4e7072074d46\") " pod="openshift-must-gather-n5ws2/perf-node-gather-daemonset-5wdp7" Jul 27 21:11:17.319777 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.319667 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/017519f3-43df-499c-808a-4e7072074d46-lib-modules\") pod \"perf-node-gather-daemonset-5wdp7\" (UID: \"017519f3-43df-499c-808a-4e7072074d46\") " pod="openshift-must-gather-n5ws2/perf-node-gather-daemonset-5wdp7" Jul 27 21:11:17.328379 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.328362 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q85g5\" (UniqueName: \"kubernetes.io/projected/017519f3-43df-499c-808a-4e7072074d46-kube-api-access-q85g5\") pod \"perf-node-gather-daemonset-5wdp7\" (UID: \"017519f3-43df-499c-808a-4e7072074d46\") " pod="openshift-must-gather-n5ws2/perf-node-gather-daemonset-5wdp7" Jul 27 21:11:17.420260 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.420183 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n5ws2/perf-node-gather-daemonset-5wdp7" Jul 27 21:11:17.543032 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.543008 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n5ws2/perf-node-gather-daemonset-5wdp7"] Jul 27 21:11:17.703027 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.702936 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n5ws2/perf-node-gather-daemonset-5wdp7" event={"ID":"017519f3-43df-499c-808a-4e7072074d46","Type":"ContainerStarted","Data":"b4c555c8e5cf5ef0e7ef6e709fc6bd36e447e889168935d7faa2022c619308ea"} Jul 27 21:11:17.703027 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.703002 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n5ws2/perf-node-gather-daemonset-5wdp7" event={"ID":"017519f3-43df-499c-808a-4e7072074d46","Type":"ContainerStarted","Data":"b364ff0e1a92129300f1f0a0677b7adf624fc8e94a1881537e849ebb66b13932"} Jul 27 21:11:17.703189 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.703032 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-n5ws2/perf-node-gather-daemonset-5wdp7" Jul 27 21:11:17.717863 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:17.717818 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-n5ws2/perf-node-gather-daemonset-5wdp7" podStartSLOduration=0.717800308 podStartE2EDuration="717.800308ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:11:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:11:17.717216501 +0000 UTC m=+3220.295790090" watchObservedRunningTime="2026-07-27 21:11:17.717800308 +0000 UTC m=+3220.296373898" Jul 27 21:11:19.837652 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:19.837626 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qkkjs_d4da60bc-259e-4bb0-a78f-f77bd712463b/dns/0.log" Jul 27 21:11:19.858313 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:19.858288 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qkkjs_d4da60bc-259e-4bb0-a78f-f77bd712463b/kube-rbac-proxy/0.log" Jul 27 21:11:19.882337 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:19.882314 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4xms6_52a8bfad-6457-45db-9d55-911c5aaa440f/dns-node-resolver/0.log" Jul 27 21:11:20.450197 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:20.450158 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-587c985c7b-jqrlj_10fb2e42-4182-43ec-b2e6-62589fe8e3df/registry/0.log" Jul 27 21:11:20.494198 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:20.494172 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k687z_47679d27-ef2f-4497-bb3d-996eb0dcfc9f/node-ca/0.log" Jul 27 21:11:21.584598 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:21.584568 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-xf7v7_2e4c67bd-ff21-45b8-93de-0a2577a61f5f/discovery/0.log" Jul 27 21:11:22.607951 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:22.607910 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dx6qd_bce7955d-df77-4709-a020-751de104fe28/serve-healthcheck-canary/0.log" Jul 27 21:11:23.129572 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:23.129529 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fl7pw_a93ca385-ba85-4450-92a8-568b7f2dd0f4/kube-rbac-proxy/0.log" Jul 27 21:11:23.150902 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:23.150886 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fl7pw_a93ca385-ba85-4450-92a8-568b7f2dd0f4/exporter/0.log" Jul 27 21:11:23.171614 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:23.171590 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fl7pw_a93ca385-ba85-4450-92a8-568b7f2dd0f4/extractor/0.log" Jul 27 21:11:23.715483 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:23.715459 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-n5ws2/perf-node-gather-daemonset-5wdp7" Jul 27 21:11:24.363341 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:24.363292 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qctb_cd020c9b-0313-4754-a8ca-5d79bdcf7d86/konnectivity-agent/0.log" limit=1024 Jul 27 21:11:26.002571 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:26.002548 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-dm9lm_93f40186-af2d-4375-b40e-cb123c8dd5fa/server/0.log" Jul 27 21:11:26.320241 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:26.320161 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b8fd6b656-r8sps_905ed094-def8-467e-97e9-84bb97bdc92e/manager/0.log" Jul 27 21:11:26.340368 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:26.340343 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b8fd6b656-r8sps_905ed094-def8-467e-97e9-84bb97bdc92e/copy-manifests/0.log" Jul 27 21:11:27.729701 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:27.729651 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-57bc674ff4-p65gg_575834d5-72af-432d-939f-ac1c257d7e2d/manager/0.log" Jul 27 21:11:27.808277 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:27.808248 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-xf7v7_2e4c67bd-ff21-45b8-93de-0a2577a61f5f/discovery/0.log" Jul 27 21:11:29.559643 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:29.559552 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-xf7v7_2e4c67bd-ff21-45b8-93de-0a2577a61f5f/discovery/0.log" Jul 27 21:11:32.706141 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:32.706111 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-n9zq8_28bb4ec7-00e0-41f7-8dae-475d58c5ee6a/migrator/0.log" Jul 27 21:11:32.727235 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:32.727209 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-n9zq8_28bb4ec7-00e0-41f7-8dae-475d58c5ee6a/graceful-termination/0.log" Jul 27 21:11:34.165821 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:34.165792 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8lb48_f40c6f68-b52b-4f6e-9dae-94b4f8905907/kube-multus-additional-cni-plugins/0.log" Jul 27 21:11:34.188174 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:34.188153 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8lb48_f40c6f68-b52b-4f6e-9dae-94b4f8905907/egress-router-binary-copy/0.log" Jul 27 21:11:34.211254 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:34.211232 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8lb48_f40c6f68-b52b-4f6e-9dae-94b4f8905907/cni-plugins/0.log" Jul 27 21:11:34.231018 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:34.230999 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8lb48_f40c6f68-b52b-4f6e-9dae-94b4f8905907/bond-cni-plugin/0.log" Jul 27 21:11:34.252417 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:34.252393 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8lb48_f40c6f68-b52b-4f6e-9dae-94b4f8905907/routeoverride-cni/0.log" Jul 27 21:11:34.272630 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:34.272609 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8lb48_f40c6f68-b52b-4f6e-9dae-94b4f8905907/whereabouts-cni-bincopy/0.log" Jul 27 21:11:34.294021 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:34.294000 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8lb48_f40c6f68-b52b-4f6e-9dae-94b4f8905907/whereabouts-cni/0.log" Jul 27 21:11:34.586780 ip-10-0-132-12 kubenswrapper[2558]: I0727 21:11:34.586749 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-g4jc5_5192ecee-1724-47a3-9a8c-532390d18eae/kube-multus/0.log"