Sep 11 16:27:54.836472 ip-10-0-140-192 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 11 16:27:54.836483 ip-10-0-140-192 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 11 16:27:54.836490 ip-10-0-140-192 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 11 16:27:54.836647 ip-10-0-140-192 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 11 16:28:04.922332 ip-10-0-140-192 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 11 16:28:04.922353 ip-10-0-140-192 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 0e3777f397ca4f4f994be88ae209f12f --
Sep 11 16:30:00.267398 ip-10-0-140-192 systemd[1]: Starting Kubernetes Kubelet...
Sep 11 16:30:00.691414 ip-10-0-140-192 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 16:30:00.691414 ip-10-0-140-192 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 11 16:30:00.691414 ip-10-0-140-192 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 16:30:00.691414 ip-10-0-140-192 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 11 16:30:00.691414 ip-10-0-140-192 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 16:30:00.693263 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.693173    2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 11 16:30:00.699906 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.699891    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 16:30:00.699906 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.699906    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 16:30:00.699973 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.699911    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 16:30:00.699973 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.699914    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 16:30:00.699973 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.699917    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 16:30:00.699973 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.699920    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 16:30:00.699973 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.699923    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 16:30:00.699973 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.699926    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 16:30:00.699973 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.699929    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 16:30:00.699973 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.699932    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 16:30:00.699973 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.699935    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 16:30:00.699973 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.699938    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 16:30:00.699973 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.699941    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 16:30:00.699973 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.699949    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 16:30:00.699973 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.699951    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 16:30:00.699973 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.699954    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 16:30:00.699973 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.699957    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 16:30:00.699973 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.699959    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 16:30:00.699973 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.699962    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 16:30:00.699973 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.699964    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 16:30:00.699973 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.699967    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 16:30:00.699973 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.699969    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 16:30:00.700461 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.699972    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 16:30:00.700461 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.699974    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 16:30:00.700461 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.699977    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 16:30:00.700461 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.699980    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 16:30:00.700461 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.699982    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 16:30:00.700461 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.699985    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 16:30:00.700461 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.699988    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 16:30:00.700461 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.699990    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 16:30:00.700461 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.699993    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 16:30:00.700461 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.699995    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 16:30:00.700461 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.699998    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 16:30:00.700461 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700000    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 16:30:00.700461 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700002    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 16:30:00.700461 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700005    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 16:30:00.700461 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700007    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 16:30:00.700461 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700010    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 16:30:00.700461 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700012    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 16:30:00.700461 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700014    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 16:30:00.700461 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700017    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 16:30:00.700461 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700019    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 16:30:00.700998 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700022    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 16:30:00.700998 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700024    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 16:30:00.700998 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700027    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 16:30:00.700998 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700029    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 16:30:00.700998 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700032    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 16:30:00.700998 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700034    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 16:30:00.700998 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700037    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 16:30:00.700998 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700039    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 16:30:00.700998 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700042    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 16:30:00.700998 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700044    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 16:30:00.700998 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700046    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 16:30:00.700998 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700049    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 16:30:00.700998 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700051    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 16:30:00.700998 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700054    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 16:30:00.700998 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700057    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 16:30:00.700998 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700060    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 16:30:00.700998 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700064    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 16:30:00.700998 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700066    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 16:30:00.700998 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700070    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 16:30:00.701474 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700074    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 16:30:00.701474 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700078    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 16:30:00.701474 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700080    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 16:30:00.701474 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700083    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 16:30:00.701474 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700098    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 16:30:00.701474 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700101    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 16:30:00.701474 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700105    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 16:30:00.701474 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700110    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 16:30:00.701474 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700113    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 16:30:00.701474 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700116    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 16:30:00.701474 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700119    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 16:30:00.701474 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700122    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 16:30:00.701474 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700124    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 16:30:00.701474 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700128    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 16:30:00.701474 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700131    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 16:30:00.701474 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700134    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 16:30:00.701474 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700136    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 16:30:00.701474 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700139    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 16:30:00.701474 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700142    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 16:30:00.701976 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700145    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 16:30:00.701976 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700147    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 16:30:00.701976 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700150    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 16:30:00.701976 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700152    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 16:30:00.701976 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700155    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 16:30:00.701976 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700157    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 16:30:00.701976 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700160    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 16:30:00.701976 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700164    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 16:30:00.701976 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700166    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 16:30:00.701976 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700169    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 16:30:00.701976 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700171    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 16:30:00.701976 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700174    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 16:30:00.701976 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700177    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 16:30:00.701976 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700179    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 16:30:00.701976 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700182    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 16:30:00.701976 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700184    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 16:30:00.701976 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700187    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 16:30:00.701976 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700190    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 16:30:00.701976 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700192    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 16:30:00.701976 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700916    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 16:30:00.702480 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700923    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 16:30:00.702480 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700926    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 16:30:00.702480 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700929    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 16:30:00.702480 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700931    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 16:30:00.702480 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700935    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 16:30:00.702480 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700937    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 16:30:00.702480 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700940    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 16:30:00.702480 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700942    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 16:30:00.702480 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700945    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 16:30:00.702480 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700947    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 16:30:00.702480 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700950    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 16:30:00.702480 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700953    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 16:30:00.702480 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700956    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 16:30:00.702480 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700959    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 16:30:00.702480 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700962    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 16:30:00.702480 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700964    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 16:30:00.702480 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700966    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 16:30:00.702480 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700969    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 16:30:00.702480 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700971    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 16:30:00.702480 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700974    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 16:30:00.702979 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700977    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 16:30:00.702979 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700980    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 16:30:00.702979 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700982    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 16:30:00.702979 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700985    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 16:30:00.702979 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700987    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 16:30:00.702979 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700990    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 16:30:00.702979 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700994    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 16:30:00.702979 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.700998    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 16:30:00.702979 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701001    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 16:30:00.702979 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701003    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 16:30:00.702979 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701006    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 16:30:00.702979 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701008    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 16:30:00.702979 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701011    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 16:30:00.702979 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701014    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 16:30:00.702979 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701016    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 16:30:00.702979 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701019    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 16:30:00.702979 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701022    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 16:30:00.702979 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701027    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 16:30:00.702979 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701029    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 16:30:00.702979 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701032    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 16:30:00.703492 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701034    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 16:30:00.703492 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701037    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 16:30:00.703492 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701039    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 16:30:00.703492 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701042    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 16:30:00.703492 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701044    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 16:30:00.703492 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701047    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 16:30:00.703492 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701049    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 16:30:00.703492 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701052    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 16:30:00.703492 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701054    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 16:30:00.703492 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701058    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 16:30:00.703492 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701060    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 16:30:00.703492 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701063    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 16:30:00.703492 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701066    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 16:30:00.703492 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701068    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 16:30:00.703492 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701071    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 16:30:00.703492 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701073    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 16:30:00.703492 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701075    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 16:30:00.703492 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701078    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 16:30:00.703492 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701081    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 16:30:00.703492 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701083    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 16:30:00.703987 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701085    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 16:30:00.703987 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701105    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 16:30:00.703987 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701107    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 16:30:00.703987 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701110    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 16:30:00.703987 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701112    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 16:30:00.703987 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701115    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 16:30:00.703987 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701117    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 16:30:00.703987 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701122    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 16:30:00.703987 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701126    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 16:30:00.703987 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701129    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 16:30:00.703987 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701132    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 16:30:00.703987 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701135    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 16:30:00.703987 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701137    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 16:30:00.703987 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701140    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 16:30:00.703987 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701143    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 16:30:00.703987 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701145    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 16:30:00.703987 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701147    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 16:30:00.703987 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701150    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 16:30:00.703987 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701152    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 16:30:00.704486 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701155    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 16:30:00.704486 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701157    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 16:30:00.704486 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701160    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 16:30:00.704486 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701163    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 16:30:00.704486 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701166    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 16:30:00.704486 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701169    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 16:30:00.704486 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701171    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 16:30:00.704486 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701174    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 16:30:00.704486 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701176    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 16:30:00.704486 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701179    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 16:30:00.704486 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701183    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 16:30:00.704486 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701187    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 16:30:00.704486 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701189    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 16:30:00.704486 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701192    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 16:30:00.704486 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701195    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 16:30:00.704486 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701197    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 16:30:00.704486 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701200    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 16:30:00.704486 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701202    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 16:30:00.704486 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701204    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 16:30:00.704486 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701607    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 16:30:00.704983 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701612    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 16:30:00.704983 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701615    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 16:30:00.704983 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701618    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 16:30:00.704983 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701621    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 16:30:00.704983 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701623    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 16:30:00.704983 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701626    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 16:30:00.704983 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701629    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 16:30:00.704983 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701631    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 16:30:00.704983 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701634    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 16:30:00.704983 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701636    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 16:30:00.704983 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701638    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 16:30:00.704983 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701641    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 16:30:00.704983 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701644    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 16:30:00.704983 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701649    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 16:30:00.704983 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701652    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 16:30:00.704983 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701655    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 16:30:00.704983 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701658    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 16:30:00.704983 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701660    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 16:30:00.704983 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701664    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 16:30:00.705476 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701668    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 16:30:00.705476 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701671    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 16:30:00.705476 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701674    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 16:30:00.705476 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701676    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 16:30:00.705476 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701679    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 16:30:00.705476 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701681    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 16:30:00.705476 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701683    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 16:30:00.705476 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701686    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 16:30:00.705476 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701688    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 16:30:00.705476 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701690    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 16:30:00.705476 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701693    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 16:30:00.705476 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701695    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 16:30:00.705476 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701698    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 16:30:00.705476 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701700    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 16:30:00.705476 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701703    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 16:30:00.705476 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701706    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 16:30:00.705476 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701709    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 16:30:00.705476 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701712    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 16:30:00.705476 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701714    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 16:30:00.705989 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701717    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 16:30:00.705989 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701719    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 16:30:00.705989 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701722    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 16:30:00.705989 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701724    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 16:30:00.705989 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701726    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 16:30:00.705989 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701729    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 16:30:00.705989 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701731    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 16:30:00.705989 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701735    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 16:30:00.705989 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701737    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 16:30:00.705989 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701739    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 16:30:00.705989 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701742    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 16:30:00.705989 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701745    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 16:30:00.705989 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701747    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 16:30:00.705989 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701749    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 16:30:00.705989 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701751    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 16:30:00.705989 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701754    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 16:30:00.705989 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701756    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 16:30:00.705989 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701759    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 16:30:00.705989 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701762    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 16:30:00.705989 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701764    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 16:30:00.706492 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701767    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 16:30:00.706492 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701769    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 16:30:00.706492 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701772    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 16:30:00.706492 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701774    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 16:30:00.706492 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701777    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 16:30:00.706492 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701779    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 16:30:00.706492 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701782    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 16:30:00.706492 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701784    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 16:30:00.706492 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701787    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 16:30:00.706492 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701789    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 16:30:00.706492 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701791    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 16:30:00.706492 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701794    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 16:30:00.706492 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701797    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 16:30:00.706492 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701799    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 16:30:00.706492 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701802    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 16:30:00.706492 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701805    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 16:30:00.706492 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701807    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 16:30:00.706492 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701809    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 16:30:00.706492 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701812    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 16:30:00.706492 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701815    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 16:30:00.707021 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701817    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 16:30:00.707021 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701820    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 16:30:00.707021 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701822    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 16:30:00.707021 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701824    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 16:30:00.707021 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701827    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 16:30:00.707021 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701829    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 16:30:00.707021 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701832    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 16:30:00.707021 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701834    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 16:30:00.707021 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701837    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 16:30:00.707021 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701839    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 16:30:00.707021 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701842    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 16:30:00.707021 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701844    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 16:30:00.707021 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701847    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 16:30:00.707021 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701849    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 16:30:00.707021 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701851    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 16:30:00.707021 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701854    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 16:30:00.707021 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701856    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 16:30:00.707021 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701858    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 16:30:00.707021 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701861    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 16:30:00.707021 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.701863    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 16:30:00.707542 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.701942    2581 flags.go:64] FLAG: --address="0.0.0.0"
Sep 11 16:30:00.707542 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.701978    2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 11 16:30:00.707542 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.701991    2581 flags.go:64] FLAG: --anonymous-auth="true"
Sep 11 16:30:00.707542 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.701995    2581 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 11 16:30:00.707542 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702001    2581 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 11 16:30:00.707542 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702004    2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 11 16:30:00.707542 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702008    2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 11 16:30:00.707542 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702012    2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 11 16:30:00.707542 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702015    2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 11 16:30:00.707542 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702018    2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 11 16:30:00.707542 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702022    2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 11 16:30:00.707542 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702026    2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 11 16:30:00.707542 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702029    2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 11 16:30:00.707542 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702031    2581 flags.go:64] FLAG: --cgroup-root=""
Sep 11 16:30:00.707542 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702035    2581 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 11 16:30:00.707542 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702038    2581 flags.go:64] FLAG: --client-ca-file=""
Sep 11 16:30:00.707542 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702040    2581 flags.go:64] FLAG: --cloud-provider="external"
Sep 11 16:30:00.707542 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702043    2581 flags.go:64] FLAG: --cluster-dns="[]"
Sep 11 16:30:00.707542 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702048    2581 flags.go:64] FLAG: --cluster-domain=""
Sep 11 16:30:00.707542 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702051    2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 11 16:30:00.707542 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702054    2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 11 16:30:00.707542 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702057    2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 11 16:30:00.707542 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702060    2581 flags.go:64] FLAG: --container-log-max-files="5"
Sep 11 16:30:00.707542 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702064    2581 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 11 16:30:00.708142 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702066    2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 11 16:30:00.708142 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702069    2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 11 16:30:00.708142 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702073    2581 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 11 16:30:00.708142 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702076    2581 flags.go:64] FLAG: --contention-profiling="false"
Sep 11 16:30:00.708142 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702079    2581 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 11 16:30:00.708142 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702081    2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 11 16:30:00.708142 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702085    2581 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 11 16:30:00.708142 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702103    2581 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 11 16:30:00.708142 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702107    2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 11 16:30:00.708142 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702110    2581 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 11 16:30:00.708142 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702113    2581 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 11 16:30:00.708142 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702116    2581 flags.go:64] FLAG: --enable-load-reader="false"
Sep 11 16:30:00.708142 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702119    2581 flags.go:64] FLAG: --enable-server="true"
Sep 11 16:30:00.708142 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702123    2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 11 16:30:00.708142 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702127    2581 flags.go:64] FLAG: --event-burst="100"
Sep 11 16:30:00.708142 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702130    2581 flags.go:64] FLAG: --event-qps="50"
Sep 11 16:30:00.708142 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702132    2581 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 11 16:30:00.708142 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702135    2581 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 11 16:30:00.708142 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702139    2581 flags.go:64] FLAG: --eviction-hard=""
Sep 11 16:30:00.708142 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702143    2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 11 16:30:00.708142 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702145    2581 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 11 16:30:00.708142 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702149    2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 11 16:30:00.708142 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702152    2581 flags.go:64] FLAG: --eviction-soft=""
Sep 11 16:30:00.708142 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702155    2581 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 11 16:30:00.708142 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702158    2581 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 11 16:30:00.708766 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702161    2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 11 16:30:00.708766 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702164    2581 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 11 16:30:00.708766 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702167    2581 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 11 16:30:00.708766 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702169    2581 flags.go:64] FLAG: --fail-swap-on="true"
Sep 11 16:30:00.708766 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702172    2581 flags.go:64] FLAG: --feature-gates=""
Sep 11 16:30:00.708766 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702176    2581 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 11 16:30:00.708766 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702179    2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 11 16:30:00.708766 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702182    2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 11 16:30:00.708766 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702185    2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 11 16:30:00.708766 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702188    2581 flags.go:64] FLAG: --healthz-port="10248"
Sep 11 16:30:00.708766 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702191    2581 flags.go:64] FLAG: --help="false"
Sep 11 16:30:00.708766 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702194    2581 flags.go:64] FLAG: --hostname-override="ip-10-0-140-192.ec2.internal"
Sep 11 16:30:00.708766 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702197    2581 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 11 16:30:00.708766 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702200    2581 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 11 16:30:00.708766 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702203    2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 11 16:30:00.708766 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702206    2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 11 16:30:00.708766 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702210    2581 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 11 16:30:00.708766 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702213    2581 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 11 16:30:00.708766 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702215    2581 flags.go:64] FLAG: --image-service-endpoint=""
Sep 11 16:30:00.708766 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702218    2581 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 11 16:30:00.708766 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702221    2581 flags.go:64] FLAG: --kube-api-burst="100"
Sep 11 16:30:00.708766 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702225    2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 11 16:30:00.708766 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702228    2581 flags.go:64] FLAG: --kube-api-qps="50"
Sep 11 16:30:00.708766 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702231    2581 flags.go:64] FLAG: --kube-reserved=""
Sep 11 16:30:00.709414 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702234    2581 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 11 16:30:00.709414 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702240    2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 11 16:30:00.709414 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702243    2581 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 11 16:30:00.709414 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702246    2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 11 16:30:00.709414 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702249    2581 flags.go:64] FLAG: --lock-file=""
Sep 11 16:30:00.709414 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702252    2581 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 11 16:30:00.709414 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702254    2581 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 11 16:30:00.709414 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702257    2581 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 11 16:30:00.709414 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702263    2581 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 11 16:30:00.709414 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702266    2581 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 11 16:30:00.709414 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702269    2581 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 11 16:30:00.709414 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702271    2581 flags.go:64] FLAG: --logging-format="text"
Sep 11 16:30:00.709414 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702274    2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 11 16:30:00.709414 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702278    2581 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 11 16:30:00.709414 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702281    2581 flags.go:64] FLAG: --manifest-url=""
Sep 11 16:30:00.709414 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702283    2581 flags.go:64] FLAG: --manifest-url-header=""
Sep 11 16:30:00.709414 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702287    2581 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 11 16:30:00.709414 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702290    2581 flags.go:64] FLAG: --max-open-files="1000000"
Sep 11 16:30:00.709414 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702294    2581 flags.go:64] FLAG: --max-pods="110"
Sep 11 16:30:00.709414 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702297    2581 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 11 16:30:00.709414 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702300    2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 11 16:30:00.709414 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702303    2581 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 11 16:30:00.709414 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702306    2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 11 16:30:00.709414 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702311    2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 11 16:30:00.709414 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702314    2581 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 11 16:30:00.710039 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702317    2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 11 16:30:00.710039 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702324    2581 flags.go:64] FLAG: --node-status-max-images="50"
Sep 11 16:30:00.710039 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702327    2581 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 11 16:30:00.710039 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702330    2581 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 11 16:30:00.710039 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702333    2581 flags.go:64] FLAG: --pod-cidr=""
Sep 11 16:30:00.710039 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702336    2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 11 16:30:00.710039 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702342    2581 flags.go:64] FLAG: --pod-manifest-path=""
Sep 11 16:30:00.710039 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702345    2581 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 11 16:30:00.710039 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702348    2581 flags.go:64] FLAG: --pods-per-core="0"
Sep 11 16:30:00.710039 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702352    2581 flags.go:64] FLAG: --port="10250"
Sep 11 16:30:00.710039 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702355    2581 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 11 16:30:00.710039 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702358    2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0bb66131bde8cfd06"
Sep 11 16:30:00.710039 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702361    2581 flags.go:64] FLAG: --qos-reserved=""
Sep 11 16:30:00.710039 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702364    2581 flags.go:64] FLAG: --read-only-port="10255"
Sep 11 16:30:00.710039 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702367    2581 flags.go:64] FLAG: --register-node="true"
Sep 11 16:30:00.710039 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702370    2581 flags.go:64] FLAG: --register-with-taints=""
Sep 11 16:30:00.710039 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702373    2581 flags.go:64] FLAG: --registry-burst="10"
Sep 11 16:30:00.710039 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702376    2581 flags.go:64] FLAG: --registry-qps="5"
Sep 11 16:30:00.710039 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702378    2581 flags.go:64] FLAG: --reserved-cpus=""
Sep 11 16:30:00.710039 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702381    2581 flags.go:64] FLAG: --reserved-memory=""
Sep 11 16:30:00.710039 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702385    2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 11 16:30:00.710039 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702388    2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 11 16:30:00.710039 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702391    2581 flags.go:64] FLAG: --rotate-certificates="false"
Sep 11 16:30:00.710039 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702394    2581 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 11 16:30:00.710039 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702396    2581 flags.go:64] FLAG: --runonce="false"
Sep 11 16:30:00.710774 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702399    2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 11 16:30:00.710774 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702402    2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 11 16:30:00.710774 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702405    2581 flags.go:64] FLAG: --seccomp-default="false"
Sep 11 16:30:00.710774 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702408    2581 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 11 16:30:00.710774 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702410    2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 11 16:30:00.710774 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702415    2581 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 11 16:30:00.710774 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702417    2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 11 16:30:00.710774 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702420    2581 flags.go:64] FLAG: --storage-driver-password="root"
Sep 11 16:30:00.710774 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702423    2581 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 11 16:30:00.710774 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702426    2581 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 11 16:30:00.710774 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702429    2581 flags.go:64] FLAG: --storage-driver-user="root"
Sep 11 16:30:00.710774 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702432    2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 11 16:30:00.710774 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702435    2581 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 11 16:30:00.710774 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702439    2581 flags.go:64] FLAG: --system-cgroups=""
Sep 11 16:30:00.710774 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702442    2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 11 16:30:00.710774 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702448    2581 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 11 16:30:00.710774 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702452    2581 flags.go:64] FLAG: --tls-cert-file=""
Sep 11 16:30:00.710774 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702454    2581 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 11 16:30:00.710774 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702459    2581 flags.go:64] FLAG: --tls-min-version=""
Sep 11 16:30:00.710774 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702462    2581 flags.go:64] FLAG: --tls-private-key-file=""
Sep 11 16:30:00.710774 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702465    2581 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 11 16:30:00.710774 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702467    2581 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 11 16:30:00.710774 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702470    2581 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 11 16:30:00.710774 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702473    2581 flags.go:64] FLAG: --v="2"
Sep 11 16:30:00.710774 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702477    2581 flags.go:64] FLAG: --version="false"
Sep 11 16:30:00.711419 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702481    2581 flags.go:64] FLAG: --vmodule=""
Sep 11 16:30:00.711419 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702485    2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 11 16:30:00.711419 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.702488    2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 11 16:30:00.711419 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702626    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 16:30:00.711419 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702630    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 16:30:00.711419 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702634    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 16:30:00.711419 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702638    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 16:30:00.711419 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702641    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 16:30:00.711419 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702644    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 16:30:00.711419 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702647    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 16:30:00.711419 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702650    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 16:30:00.711419 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702652    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 16:30:00.711419 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702656    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 16:30:00.711419 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702659    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 16:30:00.711419 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702662    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 16:30:00.711419 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702665    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 16:30:00.711419 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702668    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 16:30:00.711419 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702672    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 16:30:00.711419 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702676    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 16:30:00.711874 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702679    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 16:30:00.711874 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702682    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 16:30:00.711874 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702685    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 16:30:00.711874 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702688    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 16:30:00.711874 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702692    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 16:30:00.711874 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702694    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 16:30:00.711874 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702697    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 16:30:00.711874 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702700    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 16:30:00.711874 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702703    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 16:30:00.711874 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702706    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 16:30:00.711874 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702709    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 16:30:00.711874 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702712    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 16:30:00.711874 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702714    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 16:30:00.711874 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702717    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 16:30:00.711874 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702719    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 16:30:00.711874 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702722    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 16:30:00.711874 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702724    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 16:30:00.711874 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702727    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 16:30:00.711874 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702730    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 16:30:00.712367 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702732    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 16:30:00.712367 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702735    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 16:30:00.712367 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702737    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 16:30:00.712367 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702740    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 16:30:00.712367 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702742    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 16:30:00.712367 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702745    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 16:30:00.712367 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702749    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 16:30:00.712367 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702751    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 16:30:00.712367 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702754    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 16:30:00.712367 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702756    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 16:30:00.712367 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702759    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 16:30:00.712367 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702761    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 16:30:00.712367 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702764    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 16:30:00.712367 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702766    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 16:30:00.712367 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702769    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 16:30:00.712367 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702772    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 16:30:00.712367 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702775    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 16:30:00.712367 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702778    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 16:30:00.712367 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702781    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 16:30:00.712367 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702783    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 16:30:00.712871 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702786    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 16:30:00.712871 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702788    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 16:30:00.712871 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702791    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 16:30:00.712871 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702793    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 16:30:00.712871 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702796    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 16:30:00.712871 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702798    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 16:30:00.712871 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702801    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 16:30:00.712871 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702803    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 16:30:00.712871 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702806    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 16:30:00.712871 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702808    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 16:30:00.712871 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702811    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 16:30:00.712871 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702813    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 16:30:00.712871 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702816    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 16:30:00.712871 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702818    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 16:30:00.712871 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702821    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 16:30:00.712871 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702823    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 16:30:00.712871 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702826    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 16:30:00.712871 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702828    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 16:30:00.712871 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702832    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 16:30:00.713414 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702835    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 16:30:00.713414 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702839    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 16:30:00.713414 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702841    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 16:30:00.713414 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702844    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 16:30:00.713414 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702847    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 16:30:00.713414 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702849    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 16:30:00.713414 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702852    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 16:30:00.713414 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702855    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 16:30:00.713414 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702857    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 16:30:00.713414 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702860    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 16:30:00.713414 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702864    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 16:30:00.713414 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702867    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 16:30:00.713414 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702870    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 16:30:00.713414 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702873    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 16:30:00.713414 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702876    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 16:30:00.713414 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702879    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 16:30:00.713414 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702883    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 16:30:00.713414 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702887    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 16:30:00.713414 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702889    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 16:30:00.713887 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702892    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 16:30:00.713887 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702894    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 16:30:00.713887 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702897    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 16:30:00.713887 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702900    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 16:30:00.713887 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702902    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 16:30:00.713887 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.702904    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 16:30:00.713887 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.703715    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 16:30:00.713887 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.710881    2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 11 16:30:00.713887 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.710896    2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 11 16:30:00.713887 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.710913    2581 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 11 16:30:00.713887 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.710918    2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 11 16:30:00.713887 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.710976    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 16:30:00.713887 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.710981    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 16:30:00.713887 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.710984    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 16:30:00.714242 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.710987    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 16:30:00.714242 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.710990    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 16:30:00.714242 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.710993    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 16:30:00.714242 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.710996    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 16:30:00.714242 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.710999    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 16:30:00.714242 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711001    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 16:30:00.714242 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711004    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 16:30:00.714242 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711006    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 16:30:00.714242 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711009    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 16:30:00.714242 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711012    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 16:30:00.714242 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711014    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 16:30:00.714242 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711017    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 16:30:00.714242 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711021    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 16:30:00.714242 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711025    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 16:30:00.714242 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711028    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 16:30:00.714242 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711031    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 16:30:00.714242 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711034    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 16:30:00.714242 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711037    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 16:30:00.714242 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711040    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 16:30:00.714706 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711043    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 16:30:00.714706 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711046    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 16:30:00.714706 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711049    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 16:30:00.714706 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711052    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 16:30:00.714706 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711055    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 16:30:00.714706 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711058    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 16:30:00.714706 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711061    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 16:30:00.714706 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711065    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 16:30:00.714706 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711068    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 16:30:00.714706 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711071    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 16:30:00.714706 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711074    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 16:30:00.714706 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711076    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 16:30:00.714706 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711079    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 16:30:00.714706 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711082    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 16:30:00.714706 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711084    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 16:30:00.714706 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711107    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 16:30:00.714706 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711110    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 16:30:00.714706 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711113    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 16:30:00.714706 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711115    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 16:30:00.714706 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711119    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 16:30:00.715214 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711121    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 16:30:00.715214 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711124    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 16:30:00.715214 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711128    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 16:30:00.715214 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711131    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 16:30:00.715214 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711134    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 16:30:00.715214 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711137    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 16:30:00.715214 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711139    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 16:30:00.715214 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711142    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 16:30:00.715214 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711145    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 16:30:00.715214 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711147    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 16:30:00.715214 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711150    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 16:30:00.715214 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711152    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 16:30:00.715214 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711154    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 16:30:00.715214 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711157    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 16:30:00.715214 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711159    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 16:30:00.715214 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711162    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 16:30:00.715214 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711164    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 16:30:00.715214 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711167    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 16:30:00.715214 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711170    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 16:30:00.715689 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711174    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 16:30:00.715689 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711178    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 16:30:00.715689 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711180    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 16:30:00.715689 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711183    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 16:30:00.715689 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711185    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 16:30:00.715689 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711188    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 16:30:00.715689 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711190    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 16:30:00.715689 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711192    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 16:30:00.715689 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711195    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 16:30:00.715689 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711197    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 16:30:00.715689 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711200    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 16:30:00.715689 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711202    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 16:30:00.715689 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711205    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 16:30:00.715689 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711208    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 16:30:00.715689 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711210    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 16:30:00.715689 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711212    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 16:30:00.715689 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711215    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 16:30:00.715689 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711217    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 16:30:00.715689 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711220    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 16:30:00.715689 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711222    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 16:30:00.716195 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711225    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 16:30:00.716195 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711227    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 16:30:00.716195 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711230    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 16:30:00.716195 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711232    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 16:30:00.716195 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711235    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 16:30:00.716195 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711237    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 16:30:00.716195 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711240    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 16:30:00.716195 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711242    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 16:30:00.716195 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711245    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 16:30:00.716195 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711247    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 16:30:00.716195 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711249    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 16:30:00.716195 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711252    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 16:30:00.716195 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711255    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 16:30:00.716195 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711257    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 16:30:00.716195 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711260    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 16:30:00.716195 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711263    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 16:30:00.716195 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711265    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 16:30:00.716195 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711268    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 16:30:00.716648 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.711273    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 16:30:00.716648 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711389    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 16:30:00.716648 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711394    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 16:30:00.716648 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711397    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 16:30:00.716648 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711400    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 16:30:00.716648 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711402    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 16:30:00.716648 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711405    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 16:30:00.716648 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711407    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 16:30:00.716648 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711410    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 16:30:00.716648 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711413    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 16:30:00.716648 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711417    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 16:30:00.716648 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711420    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 16:30:00.716648 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711423    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 16:30:00.716648 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711426    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 16:30:00.716997 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711429    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 16:30:00.716997 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711432    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 16:30:00.716997 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711435    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 16:30:00.716997 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711437    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 16:30:00.716997 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711440    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 16:30:00.716997 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711443    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 16:30:00.716997 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711445    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 16:30:00.716997 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711448    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 16:30:00.716997 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711452    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 16:30:00.716997 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711455    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 16:30:00.716997 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711458    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 16:30:00.716997 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711461    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 16:30:00.716997 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711464    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 16:30:00.716997 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711467    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 16:30:00.716997 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711470    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 16:30:00.716997 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711473    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 16:30:00.716997 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711476    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 16:30:00.716997 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711478    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 16:30:00.716997 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711481    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 16:30:00.717604 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711483    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 16:30:00.717604 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711486    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 16:30:00.717604 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711488    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 16:30:00.717604 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711491    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 16:30:00.717604 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711493    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 16:30:00.717604 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711496    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 16:30:00.717604 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711498    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 16:30:00.717604 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711501    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 16:30:00.717604 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711503    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 16:30:00.717604 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711505    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 16:30:00.717604 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711508    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 16:30:00.717604 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711510    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 16:30:00.717604 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711513    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 16:30:00.717604 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711515    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 16:30:00.717604 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711517    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 16:30:00.717604 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711520    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 16:30:00.717604 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711522    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 16:30:00.717604 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711525    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 16:30:00.717604 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711527    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 16:30:00.717604 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711529    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 16:30:00.718084 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711532    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 16:30:00.718084 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711534    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 16:30:00.718084 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711536    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 16:30:00.718084 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711539    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 16:30:00.718084 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711542    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 16:30:00.718084 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711544    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 16:30:00.718084 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711547    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 16:30:00.718084 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711550    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 16:30:00.718084 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711552    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 16:30:00.718084 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711555    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 16:30:00.718084 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711558    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 16:30:00.718084 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711560    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 16:30:00.718084 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711563    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 16:30:00.718084 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711566    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 16:30:00.718084 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711569    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 16:30:00.718084 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711571    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 16:30:00.718084 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711574    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 16:30:00.718084 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711576    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 16:30:00.718084 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711579    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 16:30:00.718084 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711581    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 16:30:00.718592 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711584    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 16:30:00.718592 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711586    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 16:30:00.718592 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711589    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 16:30:00.718592 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711591    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 16:30:00.718592 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711593    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 16:30:00.718592 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711596    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 16:30:00.718592 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711598    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 16:30:00.718592 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711601    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 16:30:00.718592 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711603    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 16:30:00.718592 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711605    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 16:30:00.718592 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711608    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 16:30:00.718592 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711610    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 16:30:00.718592 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711613    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 16:30:00.718592 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711615    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 16:30:00.718592 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711617    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 16:30:00.718592 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711620    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 16:30:00.718592 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711622    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 16:30:00.718592 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711625    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 16:30:00.718592 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711627    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 16:30:00.719071 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711630    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 16:30:00.719071 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711632    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 16:30:00.719071 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711635    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 16:30:00.719071 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711638    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 16:30:00.719071 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711640    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 16:30:00.719071 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711642    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 16:30:00.719071 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711645    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 16:30:00.719071 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:00.711647    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 16:30:00.719071 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.711652    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 16:30:00.719071 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.711754    2581 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 11 16:30:00.719071 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.715295    2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 11 16:30:00.719071 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.716267    2581 server.go:1019] "Starting client certificate rotation"
Sep 11 16:30:00.719071 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.716371    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 16:30:00.719071 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.716410    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 16:30:00.721310 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.721281    2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 16:30:00.724564 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.724548    2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 16:30:00.734549 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.734529    2581 log.go:25] "Validated CRI v1 runtime API"
Sep 11 16:30:00.737576 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.737559    2581 log.go:25] "Validated CRI v1 image API"
Sep 11 16:30:00.738473 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.738456    2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 11 16:30:00.741508 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.741480    2581 fs.go:135] Filesystem UUIDs: map[5a80f048-97df-4347-930a-271df9702a70:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 e250aab2-d88b-4420-8d9b-193e33aaca65:/dev/nvme0n1p4]
Sep 11 16:30:00.741594 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.741505    2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 11 16:30:00.747000 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.746889    2581 manager.go:216] Machine: {Timestamp:2026-09-11 16:30:00.745568627 +0000 UTC m=+0.362325704 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3129040 MemoryCapacity:32812154880 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d5657a29473f17cf7584ebeb73078 SystemUUID:ec2d5657-a294-73f1-7cf7-584ebeb73078 BootID:0e3777f3-97ca-4f4f-994b-e88ae209f12f Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:73:7c:5d:97:7b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:73:7c:5d:97:7b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d2:a4:2f:6b:d9:0e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812154880 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 11 16:30:00.747000 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.746998    2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 11 16:30:00.747120 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.747080    2581 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 11 16:30:00.749993 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.749964    2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 11 16:30:00.750150 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.749998    2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-192.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 11 16:30:00.751155 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.751143    2581 topology_manager.go:138] "Creating topology manager with none policy"
Sep 11 16:30:00.751188 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.751158    2581 container_manager_linux.go:309] "Creating device plugin manager"
Sep 11 16:30:00.751188 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.751165    2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 16:30:00.751777 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.751767    2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 16:30:00.752551 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.752541    2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 11 16:30:00.752602 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.752586    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 16:30:00.755847 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.755834    2581 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 16:30:00.755964 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.755954    2581 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 11 16:30:00.755997 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.755986    2581 kubelet.go:486] "Attempting to sync node with API server"
Sep 11 16:30:00.755997 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.755996    2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 11 16:30:00.756051 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.756012    2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 11 16:30:00.756051 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.756022    2581 kubelet.go:398] "Adding apiserver pod source"
Sep 11 16:30:00.756051 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.756031    2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 11 16:30:00.756493 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.756481    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 16:30:00.756529 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.756501    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 16:30:00.761928 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.761899    2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 11 16:30:00.764163 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.764145    2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 11 16:30:00.764219 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.764180    2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 11 16:30:00.765915 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.765875    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 11 16:30:00.765915 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.765915    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 11 16:30:00.766044 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.765928    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 11 16:30:00.766044 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.765936    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 11 16:30:00.766044 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.765949    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 11 16:30:00.766044 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.765965    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 11 16:30:00.766044 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.765985    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 11 16:30:00.766044 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.765992    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 11 16:30:00.766044 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.766019    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 11 16:30:00.766044 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.766027    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 11 16:30:00.766044 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.766040    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 11 16:30:00.766044 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.766049    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 11 16:30:00.767031 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.767011    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 11 16:30:00.767155 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.767034    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 11 16:30:00.769248 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.769227    2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-192.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 11 16:30:00.769519 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:00.769493    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 11 16:30:00.769613 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:00.769549    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-192.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 11 16:30:00.771438 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.771420    2581 server.go:1268] "Started kubelet"
Sep 11 16:30:00.771522 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.771481    2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 11 16:30:00.771674 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.771620    2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 11 16:30:00.771755 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.771699    2581 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 11 16:30:00.772434 ip-10-0-140-192 systemd[1]: Started Kubernetes Kubelet.
Sep 11 16:30:00.773388 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.773364    2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 11 16:30:00.773971 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.773954    2581 server.go:310] "Adding debug handlers to kubelet server"
Sep 11 16:30:00.777319 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:00.776261    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-192.ec2.internal.18d4512bdaede418  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-192.ec2.internal,UID:ip-10-0-140-192.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-192.ec2.internal,},FirstTimestamp:2026-09-11 16:30:00.771396632 +0000 UTC m=+0.388153697,LastTimestamp:2026-09-11 16:30:00.771396632 +0000 UTC m=+0.388153697,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-192.ec2.internal,}"
Sep 11 16:30:00.777803 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:00.777787    2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 11 16:30:00.778824 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.778811    2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 11 16:30:00.778877 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.778826    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 11 16:30:00.778999 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:00.778982    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-192.ec2.internal\" not found"
Sep 11 16:30:00.779532 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.779515    2581 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 11 16:30:00.779532 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.779531    2581 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 11 16:30:00.779684 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.779514    2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 11 16:30:00.779684 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.779614    2581 reconstruct.go:97] "Volume reconstruction finished"
Sep 11 16:30:00.779684 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.779623    2581 reconciler.go:29] "Reconciler: start to sync state"
Sep 11 16:30:00.780823 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.780807    2581 factory.go:55] Registering systemd factory
Sep 11 16:30:00.780823 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.780826    2581 factory.go:223] Registration of the systemd container factory successfully
Sep 11 16:30:00.781053 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.781037    2581 factory.go:153] Registering CRI-O factory
Sep 11 16:30:00.781053 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.781051    2581 factory.go:223] Registration of the crio container factory successfully
Sep 11 16:30:00.781183 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.781119    2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 11 16:30:00.781183 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.781141    2581 factory.go:103] Registering Raw factory
Sep 11 16:30:00.781183 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.781156    2581 manager.go:1196] Started watching for new ooms in manager
Sep 11 16:30:00.781656 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.781638    2581 manager.go:349] Starting recovery of all containers
Sep 11 16:30:00.787128 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:00.787084    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 11 16:30:00.787346 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:00.787321    2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-192.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 11 16:30:00.788308 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.788282    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 11 16:30:00.791314 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.791287    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tkhw7"
Sep 11 16:30:00.793748 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.793726    2581 manager.go:354] Recovery completed
Sep 11 16:30:00.795857 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:00.795625    2581 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Sep 11 16:30:00.799346 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.799322    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tkhw7"
Sep 11 16:30:00.800020 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.800006    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 16:30:00.802651 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.802635    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 16:30:00.802710 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.802664    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 16:30:00.802710 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.802674    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasSufficientPID"
Sep 11 16:30:00.803250 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.803239    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 16:30:00.803302 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.803237    2581 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 11 16:30:00.803342 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.803309    2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 11 16:30:00.803342 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.803328    2581 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 16:30:00.804282 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.804271    2581 policy_none.go:49] "None policy: Start"
Sep 11 16:30:00.804319 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.804287    2581 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 11 16:30:00.804319 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.804299    2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 11 16:30:00.804724 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.804708    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 16:30:00.804795 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.804732    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 16:30:00.804795 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.804744    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasSufficientPID"
Sep 11 16:30:00.805187 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.805175    2581 policy_none.go:47] "Start"
Sep 11 16:30:00.805324 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:00.805235    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-192.ec2.internal.18d4512bdccac82c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-192.ec2.internal,UID:ip-10-0-140-192.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-192.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-192.ec2.internal,},FirstTimestamp:2026-09-11 16:30:00.802650156 +0000 UTC m=+0.419407217,LastTimestamp:2026-09-11 16:30:00.802650156 +0000 UTC m=+0.419407217,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-192.ec2.internal,}"
Sep 11 16:30:00.846693 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.846679    2581 manager.go:337] "Starting Device Plugin manager"
Sep 11 16:30:00.855469 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:00.846719    2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 11 16:30:00.855469 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.846734    2581 server.go:87] "Starting device plugin registration server"
Sep 11 16:30:00.855469 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.847039    2581 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 11 16:30:00.855469 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.847050    2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 11 16:30:00.855469 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.847164    2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 11 16:30:00.855469 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.847286    2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 11 16:30:00.855469 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.847296    2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 11 16:30:00.855469 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:00.847922    2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 11 16:30:00.855469 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:00.847981    2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-192.ec2.internal\" not found"
Sep 11 16:30:00.947986 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.947872    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 16:30:00.948967 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.948950    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 16:30:00.949108 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.949019    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 16:30:00.949108 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.949035    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasSufficientPID"
Sep 11 16:30:00.949108 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.949067    2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-192.ec2.internal"
Sep 11 16:30:00.957128 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.957110    2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-192.ec2.internal"
Sep 11 16:30:00.957179 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:00.957150    2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-192.ec2.internal\": node \"ip-10-0-140-192.ec2.internal\" not found"
Sep 11 16:30:00.973054 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:00.973031    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-192.ec2.internal\" not found"
Sep 11 16:30:00.980888 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.980862    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 11 16:30:00.980983 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.980915    2581 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 11 16:30:00.980983 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.980936    2581 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 11 16:30:00.981076 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:00.980991    2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 11 16:30:00.982723 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:00.982705    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 16:30:01.074192 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:01.074144    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-192.ec2.internal\" not found"
Sep 11 16:30:01.081484 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.081438    2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-140-192.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal"]
Sep 11 16:30:01.081543 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.081525    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 16:30:01.083166 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.083151    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 16:30:01.083244 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.083179    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 16:30:01.083244 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.083193    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasSufficientPID"
Sep 11 16:30:01.084373 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.084360    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 16:30:01.084501 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.084485    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-192.ec2.internal"
Sep 11 16:30:01.084543 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.084512    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 16:30:01.085135 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.085117    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 16:30:01.085233 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.085134    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 16:30:01.085233 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.085143    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 16:30:01.085233 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.085155    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasSufficientPID"
Sep 11 16:30:01.085233 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.085158    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 16:30:01.085233 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.085168    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasSufficientPID"
Sep 11 16:30:01.086387 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.086373    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal"
Sep 11 16:30:01.086425 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.086400    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 16:30:01.087067 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.087048    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 16:30:01.087181 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.087073    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 16:30:01.087181 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.087106    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasSufficientPID"
Sep 11 16:30:01.111920 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:01.111896    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-192.ec2.internal\" not found" node="ip-10-0-140-192.ec2.internal"
Sep 11 16:30:01.116324 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:01.116307    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-192.ec2.internal\" not found" node="ip-10-0-140-192.ec2.internal"
Sep 11 16:30:01.174339 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:01.174318    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-192.ec2.internal\" not found"
Sep 11 16:30:01.274830 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:01.274766    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-192.ec2.internal\" not found"
Sep 11 16:30:01.281054 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.281030    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c12b764bd8b3cb219479257da5703361-config\") pod \"kube-apiserver-proxy-ip-10-0-140-192.ec2.internal\" (UID: \"c12b764bd8b3cb219479257da5703361\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-192.ec2.internal"
Sep 11 16:30:01.281138 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.281061    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8a461122a1f6358acaf2534ef0387a00-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal\" (UID: \"8a461122a1f6358acaf2534ef0387a00\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal"
Sep 11 16:30:01.281138 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.281113    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a461122a1f6358acaf2534ef0387a00-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal\" (UID: \"8a461122a1f6358acaf2534ef0387a00\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal"
Sep 11 16:30:01.375266 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:01.375225    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-192.ec2.internal\" not found"
Sep 11 16:30:01.381573 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.381553    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c12b764bd8b3cb219479257da5703361-config\") pod \"kube-apiserver-proxy-ip-10-0-140-192.ec2.internal\" (UID: \"c12b764bd8b3cb219479257da5703361\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-192.ec2.internal"
Sep 11 16:30:01.381612 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.381581    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8a461122a1f6358acaf2534ef0387a00-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal\" (UID: \"8a461122a1f6358acaf2534ef0387a00\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal"
Sep 11 16:30:01.381612 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.381596    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a461122a1f6358acaf2534ef0387a00-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal\" (UID: \"8a461122a1f6358acaf2534ef0387a00\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal"
Sep 11 16:30:01.381716 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.381634    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a461122a1f6358acaf2534ef0387a00-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal\" (UID: \"8a461122a1f6358acaf2534ef0387a00\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal"
Sep 11 16:30:01.381716 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.381654    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c12b764bd8b3cb219479257da5703361-config\") pod \"kube-apiserver-proxy-ip-10-0-140-192.ec2.internal\" (UID: \"c12b764bd8b3cb219479257da5703361\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-192.ec2.internal"
Sep 11 16:30:01.381716 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.381685    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8a461122a1f6358acaf2534ef0387a00-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal\" (UID: \"8a461122a1f6358acaf2534ef0387a00\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal"
Sep 11 16:30:01.414765 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.414716    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-192.ec2.internal"
Sep 11 16:30:01.419600 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.419585    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal"
Sep 11 16:30:01.476245 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:01.476219    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-192.ec2.internal\" not found"
Sep 11 16:30:01.576884 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:01.576790    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-192.ec2.internal\" not found"
Sep 11 16:30:01.677156 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:01.677124    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-192.ec2.internal\" not found"
Sep 11 16:30:01.678008 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.677992    2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 16:30:01.679437 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.679423    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-192.ec2.internal"
Sep 11 16:30:01.689698 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.689680    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 16:30:01.691512 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.691500    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal"
Sep 11 16:30:01.702924 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.702911    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 16:30:01.716069 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.716051    2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 11 16:30:01.716201 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.716185    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 16:30:01.716248 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.716226    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 16:30:01.756310 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.756279    2581 apiserver.go:52] "Watching apiserver"
Sep 11 16:30:01.777969 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.777946    2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 11 16:30:01.778363 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.778341    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-22ws5","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pphqd","openshift-cluster-node-tuning-operator/tuned-7chqg","openshift-dns/node-resolver-nk4fp","openshift-image-registry/node-ca-xsfcb","openshift-multus/multus-7vx4s","openshift-multus/multus-additional-cni-plugins-4s7mv","openshift-multus/network-metrics-daemon-dnqst","kube-system/global-pull-secret-syncer-xkz2b","kube-system/kube-apiserver-proxy-ip-10-0-140-192.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal","openshift-network-diagnostics/network-check-target-qx7z8","openshift-network-operator/iptables-alerter-m462n","openshift-ovn-kubernetes/ovnkube-node-d6fww"]
Sep 11 16:30:01.778906 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.778894    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 11 16:30:01.779784 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.779768    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4s7mv"
Sep 11 16:30:01.782537 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.782505    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-m462n"
Sep 11 16:30:01.783639 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.783619    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 11 16:30:01.783639 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.783624    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 11 16:30:01.783798 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.783657    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 11 16:30:01.783798 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.783771    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f519b0e8-fff1-441a-9151-4d6c54437b2b-cnibin\") pod \"multus-additional-cni-plugins-4s7mv\" (UID: \"f519b0e8-fff1-441a-9151-4d6c54437b2b\") " pod="openshift-multus/multus-additional-cni-plugins-4s7mv"
Sep 11 16:30:01.783902 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.783798    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f519b0e8-fff1-441a-9151-4d6c54437b2b-cni-binary-copy\") pod \"multus-additional-cni-plugins-4s7mv\" (UID: \"f519b0e8-fff1-441a-9151-4d6c54437b2b\") " pod="openshift-multus/multus-additional-cni-plugins-4s7mv"
Sep 11 16:30:01.783902 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.783824    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f519b0e8-fff1-441a-9151-4d6c54437b2b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4s7mv\" (UID: \"f519b0e8-fff1-441a-9151-4d6c54437b2b\") " pod="openshift-multus/multus-additional-cni-plugins-4s7mv"
Sep 11 16:30:01.783902 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.783852    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f519b0e8-fff1-441a-9151-4d6c54437b2b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4s7mv\" (UID: \"f519b0e8-fff1-441a-9151-4d6c54437b2b\") " pod="openshift-multus/multus-additional-cni-plugins-4s7mv"
Sep 11 16:30:01.783902 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.783876    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 11 16:30:01.784068 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.783902    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f519b0e8-fff1-441a-9151-4d6c54437b2b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4s7mv\" (UID: \"f519b0e8-fff1-441a-9151-4d6c54437b2b\") " pod="openshift-multus/multus-additional-cni-plugins-4s7mv"
Sep 11 16:30:01.784068 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.783928    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6gfq\" (UniqueName: \"kubernetes.io/projected/f519b0e8-fff1-441a-9151-4d6c54437b2b-kube-api-access-r6gfq\") pod \"multus-additional-cni-plugins-4s7mv\" (UID: \"f519b0e8-fff1-441a-9151-4d6c54437b2b\") " pod="openshift-multus/multus-additional-cni-plugins-4s7mv"
Sep 11 16:30:01.784068 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.783946    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 11 16:30:01.784068 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.783952    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/524a886f-2ad6-4842-95bd-67870c33ad33-iptables-alerter-script\") pod \"iptables-alerter-m462n\" (UID: \"524a886f-2ad6-4842-95bd-67870c33ad33\") " pod="openshift-network-operator/iptables-alerter-m462n"
Sep 11 16:30:01.784068 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.783967    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-g98cr\""
Sep 11 16:30:01.784068 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.783983    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7chqg"
Sep 11 16:30:01.784068 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.783997    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/524a886f-2ad6-4842-95bd-67870c33ad33-host-slash\") pod \"iptables-alerter-m462n\" (UID: \"524a886f-2ad6-4842-95bd-67870c33ad33\") " pod="openshift-network-operator/iptables-alerter-m462n"
Sep 11 16:30:01.784068 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.784023    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq82s\" (UniqueName: \"kubernetes.io/projected/524a886f-2ad6-4842-95bd-67870c33ad33-kube-api-access-jq82s\") pod \"iptables-alerter-m462n\" (UID: \"524a886f-2ad6-4842-95bd-67870c33ad33\") " pod="openshift-network-operator/iptables-alerter-m462n"
Sep 11 16:30:01.784068 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.784050    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f519b0e8-fff1-441a-9151-4d6c54437b2b-system-cni-dir\") pod \"multus-additional-cni-plugins-4s7mv\" (UID: \"f519b0e8-fff1-441a-9151-4d6c54437b2b\") " pod="openshift-multus/multus-additional-cni-plugins-4s7mv"
Sep 11 16:30:01.786059 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.786043    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nk4fp"
Sep 11 16:30:01.787257 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.787243    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xsfcb"
Sep 11 16:30:01.787867 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.787853    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 11 16:30:01.788295 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.788280    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7vx4s"
Sep 11 16:30:01.788368 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.788355    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dq98t\""
Sep 11 16:30:01.788416 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.788382    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 11 16:30:01.788722 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.788707    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 11 16:30:01.789384 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.789372    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkz2b"
Sep 11 16:30:01.789450 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:01.789434    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkz2b" podUID="e52d92c8-b840-42dd-9e4b-ea9f196e7623"
Sep 11 16:30:01.790376 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.790361    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-22ws5"
Sep 11 16:30:01.791430 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.791415    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pphqd"
Sep 11 16:30:01.792603 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.792588    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.792927 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.792911    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 11 16:30:01.792993 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.792917    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 11 16:30:01.793842 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.793826    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnqst"
Sep 11 16:30:01.793995 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:01.793881    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnqst" podUID="97ffcc27-5973-418d-a29e-762556b9c3e0"
Sep 11 16:30:01.793995 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.793922    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 11 16:30:01.794227 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.794133    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 11 16:30:01.794227 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.794220    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 11 16:30:01.794314 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.794245    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-97wtp\""
Sep 11 16:30:01.794314 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.794305    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 11 16:30:01.794385 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.794319    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9cddb\""
Sep 11 16:30:01.794385 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.794349    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 11 16:30:01.794451 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.794430    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 11 16:30:01.795080 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.795067    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qx7z8"
Sep 11 16:30:01.795207 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:01.795132    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qx7z8" podUID="14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0"
Sep 11 16:30:01.795207 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.795196    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 11 16:30:01.795389 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.795299    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 11 16:30:01.795389 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.795364    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-f8jpd\""
Sep 11 16:30:01.795389 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.795377    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 11 16:30:01.795546 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.795495    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 11 16:30:01.795546 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.795506    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lzvtt\""
Sep 11 16:30:01.795618 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.795562    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5h4lq\""
Sep 11 16:30:01.795753 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.795738    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hvqvj\""
Sep 11 16:30:01.796608 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.796593    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 11 16:30:01.796722 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.796609    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-224kn\""
Sep 11 16:30:01.796722 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.796665    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 11 16:30:01.796722 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.796676    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 11 16:30:01.797226 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.797212    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 11 16:30:01.797828 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.797802    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 11 16:30:01.797828 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.797830    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 11 16:30:01.800176 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.800154    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 16:30:01.800296 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.800276    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 11 16:30:01.802600 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.802579    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-10 16:25:01 +0000 UTC" deadline="2028-03-24 14:43:07.201350507 +0000 UTC"
Sep 11 16:30:01.802673 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.802600    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13438h13m5.398752784s"
Sep 11 16:30:01.838478 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.837154    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qmhgx"
Sep 11 16:30:01.845153 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.845131    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qmhgx"
Sep 11 16:30:01.880500 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.880482    2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 11 16:30:01.884534 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.884515    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/af6fc84f-60b8-404c-b60d-3beea49842ef-host-cni-netd\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.884619 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.884546    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95f9914b-ed9b-4aa9-a3b9-44dee448edd8-system-cni-dir\") pod \"multus-7vx4s\" (UID: \"95f9914b-ed9b-4aa9-a3b9-44dee448edd8\") " pod="openshift-multus/multus-7vx4s"
Sep 11 16:30:01.884619 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.884570    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/95f9914b-ed9b-4aa9-a3b9-44dee448edd8-hostroot\") pod \"multus-7vx4s\" (UID: \"95f9914b-ed9b-4aa9-a3b9-44dee448edd8\") " pod="openshift-multus/multus-7vx4s"
Sep 11 16:30:01.884700 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.884613    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0acb3a32-feed-4107-9ee3-ca263fd887df-etc-selinux\") pod \"aws-ebs-csi-driver-node-pphqd\" (UID: \"0acb3a32-feed-4107-9ee3-ca263fd887df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pphqd"
Sep 11 16:30:01.884700 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.884638    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97ffcc27-5973-418d-a29e-762556b9c3e0-metrics-certs\") pod \"network-metrics-daemon-dnqst\" (UID: \"97ffcc27-5973-418d-a29e-762556b9c3e0\") " pod="openshift-multus/network-metrics-daemon-dnqst"
Sep 11 16:30:01.884700 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.884654    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/69e5eae6-9a55-49ac-a01c-70cbadab5acd-serviceca\") pod \"node-ca-xsfcb\" (UID: \"69e5eae6-9a55-49ac-a01c-70cbadab5acd\") " pod="openshift-image-registry/node-ca-xsfcb"
Sep 11 16:30:01.884700 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.884671    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/af6fc84f-60b8-404c-b60d-3beea49842ef-host-run-ovn-kubernetes\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.884700 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.884687    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgblx\" (UniqueName: \"kubernetes.io/projected/14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0-kube-api-access-wgblx\") pod \"network-check-target-qx7z8\" (UID: \"14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0\") " pod="openshift-network-diagnostics/network-check-target-qx7z8"
Sep 11 16:30:01.884700 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.884701    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/95f9914b-ed9b-4aa9-a3b9-44dee448edd8-host-var-lib-cni-bin\") pod \"multus-7vx4s\" (UID: \"95f9914b-ed9b-4aa9-a3b9-44dee448edd8\") " pod="openshift-multus/multus-7vx4s"
Sep 11 16:30:01.884903 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.884716    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/95f9914b-ed9b-4aa9-a3b9-44dee448edd8-multus-daemon-config\") pod \"multus-7vx4s\" (UID: \"95f9914b-ed9b-4aa9-a3b9-44dee448edd8\") " pod="openshift-multus/multus-7vx4s"
Sep 11 16:30:01.884903 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.884744    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0df191cd-baa5-4bd5-8806-becaccb21357-tmp\") pod \"tuned-7chqg\" (UID: \"0df191cd-baa5-4bd5-8806-becaccb21357\") " pod="openshift-cluster-node-tuning-operator/tuned-7chqg"
Sep 11 16:30:01.884903 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.884767    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e52d92c8-b840-42dd-9e4b-ea9f196e7623-kubelet-config\") pod \"global-pull-secret-syncer-xkz2b\" (UID: \"e52d92c8-b840-42dd-9e4b-ea9f196e7623\") " pod="kube-system/global-pull-secret-syncer-xkz2b"
Sep 11 16:30:01.884903 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.884782    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e52d92c8-b840-42dd-9e4b-ea9f196e7623-dbus\") pod \"global-pull-secret-syncer-xkz2b\" (UID: \"e52d92c8-b840-42dd-9e4b-ea9f196e7623\") " pod="kube-system/global-pull-secret-syncer-xkz2b"
Sep 11 16:30:01.884903 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.884797    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/af6fc84f-60b8-404c-b60d-3beea49842ef-ovn-node-metrics-cert\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.884903 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.884826    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px97j\" (UniqueName: \"kubernetes.io/projected/af6fc84f-60b8-404c-b60d-3beea49842ef-kube-api-access-px97j\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.884903 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.884863    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f519b0e8-fff1-441a-9151-4d6c54437b2b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4s7mv\" (UID: \"f519b0e8-fff1-441a-9151-4d6c54437b2b\") " pod="openshift-multus/multus-additional-cni-plugins-4s7mv"
Sep 11 16:30:01.884903 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.884880    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95f9914b-ed9b-4aa9-a3b9-44dee448edd8-multus-cni-dir\") pod \"multus-7vx4s\" (UID: \"95f9914b-ed9b-4aa9-a3b9-44dee448edd8\") " pod="openshift-multus/multus-7vx4s"
Sep 11 16:30:01.885281 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.884962    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/95f9914b-ed9b-4aa9-a3b9-44dee448edd8-multus-socket-dir-parent\") pod \"multus-7vx4s\" (UID: \"95f9914b-ed9b-4aa9-a3b9-44dee448edd8\") " pod="openshift-multus/multus-7vx4s"
Sep 11 16:30:01.885281 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.884992    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/95f9914b-ed9b-4aa9-a3b9-44dee448edd8-host-var-lib-cni-multus\") pod \"multus-7vx4s\" (UID: \"95f9914b-ed9b-4aa9-a3b9-44dee448edd8\") " pod="openshift-multus/multus-7vx4s"
Sep 11 16:30:01.885281 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.885019    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/95f9914b-ed9b-4aa9-a3b9-44dee448edd8-host-var-lib-kubelet\") pod \"multus-7vx4s\" (UID: \"95f9914b-ed9b-4aa9-a3b9-44dee448edd8\") " pod="openshift-multus/multus-7vx4s"
Sep 11 16:30:01.885281 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.885041    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41863045-9930-4c6f-a9a4-cb77f319ed93-tmp-dir\") pod \"node-resolver-nk4fp\" (UID: \"41863045-9930-4c6f-a9a4-cb77f319ed93\") " pod="openshift-dns/node-resolver-nk4fp"
Sep 11 16:30:01.885281 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.885064    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/af6fc84f-60b8-404c-b60d-3beea49842ef-log-socket\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.885281 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.885115    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/af6fc84f-60b8-404c-b60d-3beea49842ef-env-overrides\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.885281 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.885143    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0acb3a32-feed-4107-9ee3-ca263fd887df-registration-dir\") pod \"aws-ebs-csi-driver-node-pphqd\" (UID: \"0acb3a32-feed-4107-9ee3-ca263fd887df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pphqd"
Sep 11 16:30:01.885281 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.885165    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0df191cd-baa5-4bd5-8806-becaccb21357-etc-systemd\") pod \"tuned-7chqg\" (UID: \"0df191cd-baa5-4bd5-8806-becaccb21357\") " pod="openshift-cluster-node-tuning-operator/tuned-7chqg"
Sep 11 16:30:01.885281 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.885192    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-895gn\" (UniqueName: \"kubernetes.io/projected/41863045-9930-4c6f-a9a4-cb77f319ed93-kube-api-access-895gn\") pod \"node-resolver-nk4fp\" (UID: \"41863045-9930-4c6f-a9a4-cb77f319ed93\") " pod="openshift-dns/node-resolver-nk4fp"
Sep 11 16:30:01.885281 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.885221    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f519b0e8-fff1-441a-9151-4d6c54437b2b-cni-binary-copy\") pod \"multus-additional-cni-plugins-4s7mv\" (UID: \"f519b0e8-fff1-441a-9151-4d6c54437b2b\") " pod="openshift-multus/multus-additional-cni-plugins-4s7mv"
Sep 11 16:30:01.885281 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.885273    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/524a886f-2ad6-4842-95bd-67870c33ad33-host-slash\") pod \"iptables-alerter-m462n\" (UID: \"524a886f-2ad6-4842-95bd-67870c33ad33\") " pod="openshift-network-operator/iptables-alerter-m462n"
Sep 11 16:30:01.885604 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.885337    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/95f9914b-ed9b-4aa9-a3b9-44dee448edd8-host-run-multus-certs\") pod \"multus-7vx4s\" (UID: \"95f9914b-ed9b-4aa9-a3b9-44dee448edd8\") " pod="openshift-multus/multus-7vx4s"
Sep 11 16:30:01.885604 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.885353    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0acb3a32-feed-4107-9ee3-ca263fd887df-device-dir\") pod \"aws-ebs-csi-driver-node-pphqd\" (UID: \"0acb3a32-feed-4107-9ee3-ca263fd887df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pphqd"
Sep 11 16:30:01.885604 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.885381    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/524a886f-2ad6-4842-95bd-67870c33ad33-host-slash\") pod \"iptables-alerter-m462n\" (UID: \"524a886f-2ad6-4842-95bd-67870c33ad33\") " pod="openshift-network-operator/iptables-alerter-m462n"
Sep 11 16:30:01.885604 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.885439    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlzv8\" (UniqueName: \"kubernetes.io/projected/0acb3a32-feed-4107-9ee3-ca263fd887df-kube-api-access-dlzv8\") pod \"aws-ebs-csi-driver-node-pphqd\" (UID: \"0acb3a32-feed-4107-9ee3-ca263fd887df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pphqd"
Sep 11 16:30:01.885604 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.885462    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0df191cd-baa5-4bd5-8806-becaccb21357-etc-sysconfig\") pod \"tuned-7chqg\" (UID: \"0df191cd-baa5-4bd5-8806-becaccb21357\") " pod="openshift-cluster-node-tuning-operator/tuned-7chqg"
Sep 11 16:30:01.885604 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.885476    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0df191cd-baa5-4bd5-8806-becaccb21357-run\") pod \"tuned-7chqg\" (UID: \"0df191cd-baa5-4bd5-8806-becaccb21357\") " pod="openshift-cluster-node-tuning-operator/tuned-7chqg"
Sep 11 16:30:01.885604 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.885490    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsdhx\" (UniqueName: \"kubernetes.io/projected/69e5eae6-9a55-49ac-a01c-70cbadab5acd-kube-api-access-hsdhx\") pod \"node-ca-xsfcb\" (UID: \"69e5eae6-9a55-49ac-a01c-70cbadab5acd\") " pod="openshift-image-registry/node-ca-xsfcb"
Sep 11 16:30:01.885604 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.885502    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0df191cd-baa5-4bd5-8806-becaccb21357-etc-sysctl-conf\") pod \"tuned-7chqg\" (UID: \"0df191cd-baa5-4bd5-8806-becaccb21357\") " pod="openshift-cluster-node-tuning-operator/tuned-7chqg"
Sep 11 16:30:01.885604 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.885515    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0df191cd-baa5-4bd5-8806-becaccb21357-sys\") pod \"tuned-7chqg\" (UID: \"0df191cd-baa5-4bd5-8806-becaccb21357\") " pod="openshift-cluster-node-tuning-operator/tuned-7chqg"
Sep 11 16:30:01.885604 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.885539    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/41863045-9930-4c6f-a9a4-cb77f319ed93-hosts-file\") pod \"node-resolver-nk4fp\" (UID: \"41863045-9930-4c6f-a9a4-cb77f319ed93\") " pod="openshift-dns/node-resolver-nk4fp"
Sep 11 16:30:01.885604 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.885562    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d6754d1f-d663-4e69-aad4-a0c1523b1559-konnectivity-ca\") pod \"konnectivity-agent-22ws5\" (UID: \"d6754d1f-d663-4e69-aad4-a0c1523b1559\") " pod="kube-system/konnectivity-agent-22ws5"
Sep 11 16:30:01.885604 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.885577    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/af6fc84f-60b8-404c-b60d-3beea49842ef-host-cni-bin\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.885604 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.885593    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f519b0e8-fff1-441a-9151-4d6c54437b2b-cnibin\") pod \"multus-additional-cni-plugins-4s7mv\" (UID: \"f519b0e8-fff1-441a-9151-4d6c54437b2b\") " pod="openshift-multus/multus-additional-cni-plugins-4s7mv"
Sep 11 16:30:01.885986 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.885614    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f519b0e8-fff1-441a-9151-4d6c54437b2b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4s7mv\" (UID: \"f519b0e8-fff1-441a-9151-4d6c54437b2b\") " pod="openshift-multus/multus-additional-cni-plugins-4s7mv"
Sep 11 16:30:01.885986 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.885638    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/95f9914b-ed9b-4aa9-a3b9-44dee448edd8-cnibin\") pod \"multus-7vx4s\" (UID: \"95f9914b-ed9b-4aa9-a3b9-44dee448edd8\") " pod="openshift-multus/multus-7vx4s"
Sep 11 16:30:01.885986 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.885653    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0df191cd-baa5-4bd5-8806-becaccb21357-etc-tuned\") pod \"tuned-7chqg\" (UID: \"0df191cd-baa5-4bd5-8806-becaccb21357\") " pod="openshift-cluster-node-tuning-operator/tuned-7chqg"
Sep 11 16:30:01.885986 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.885639    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f519b0e8-fff1-441a-9151-4d6c54437b2b-cnibin\") pod \"multus-additional-cni-plugins-4s7mv\" (UID: \"f519b0e8-fff1-441a-9151-4d6c54437b2b\") " pod="openshift-multus/multus-additional-cni-plugins-4s7mv"
Sep 11 16:30:01.885986 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.885670    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d6754d1f-d663-4e69-aad4-a0c1523b1559-agent-certs\") pod \"konnectivity-agent-22ws5\" (UID: \"d6754d1f-d663-4e69-aad4-a0c1523b1559\") " pod="kube-system/konnectivity-agent-22ws5"
Sep 11 16:30:01.885986 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.885718    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/af6fc84f-60b8-404c-b60d-3beea49842ef-systemd-units\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.885986 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.885734    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0df191cd-baa5-4bd5-8806-becaccb21357-etc-kubernetes\") pod \"tuned-7chqg\" (UID: \"0df191cd-baa5-4bd5-8806-becaccb21357\") " pod="openshift-cluster-node-tuning-operator/tuned-7chqg"
Sep 11 16:30:01.885986 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.885749    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/95f9914b-ed9b-4aa9-a3b9-44dee448edd8-host-run-k8s-cni-cncf-io\") pod \"multus-7vx4s\" (UID: \"95f9914b-ed9b-4aa9-a3b9-44dee448edd8\") " pod="openshift-multus/multus-7vx4s"
Sep 11 16:30:01.885986 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.885763    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5hlq\" (UniqueName: \"kubernetes.io/projected/95f9914b-ed9b-4aa9-a3b9-44dee448edd8-kube-api-access-v5hlq\") pod \"multus-7vx4s\" (UID: \"95f9914b-ed9b-4aa9-a3b9-44dee448edd8\") " pod="openshift-multus/multus-7vx4s"
Sep 11 16:30:01.885986 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.885780    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0acb3a32-feed-4107-9ee3-ca263fd887df-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pphqd\" (UID: \"0acb3a32-feed-4107-9ee3-ca263fd887df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pphqd"
Sep 11 16:30:01.885986 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.885806    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0df191cd-baa5-4bd5-8806-becaccb21357-etc-modprobe-d\") pod \"tuned-7chqg\" (UID: \"0df191cd-baa5-4bd5-8806-becaccb21357\") " pod="openshift-cluster-node-tuning-operator/tuned-7chqg"
Sep 11 16:30:01.885986 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.885827    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/af6fc84f-60b8-404c-b60d-3beea49842ef-host-kubelet\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.885986 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.885841    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/af6fc84f-60b8-404c-b60d-3beea49842ef-var-lib-openvswitch\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.885986 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.885859    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f519b0e8-fff1-441a-9151-4d6c54437b2b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4s7mv\" (UID: \"f519b0e8-fff1-441a-9151-4d6c54437b2b\") " pod="openshift-multus/multus-additional-cni-plugins-4s7mv"
Sep 11 16:30:01.885986 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.885874    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kg5l\" (UniqueName: \"kubernetes.io/projected/97ffcc27-5973-418d-a29e-762556b9c3e0-kube-api-access-2kg5l\") pod \"network-metrics-daemon-dnqst\" (UID: \"97ffcc27-5973-418d-a29e-762556b9c3e0\") " pod="openshift-multus/network-metrics-daemon-dnqst"
Sep 11 16:30:01.885986 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.885889    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0df191cd-baa5-4bd5-8806-becaccb21357-lib-modules\") pod \"tuned-7chqg\" (UID: \"0df191cd-baa5-4bd5-8806-becaccb21357\") " pod="openshift-cluster-node-tuning-operator/tuned-7chqg"
Sep 11 16:30:01.886463 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.885903    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e52d92c8-b840-42dd-9e4b-ea9f196e7623-original-pull-secret\") pod \"global-pull-secret-syncer-xkz2b\" (UID: \"e52d92c8-b840-42dd-9e4b-ea9f196e7623\") " pod="kube-system/global-pull-secret-syncer-xkz2b"
Sep 11 16:30:01.886463 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.885917    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/af6fc84f-60b8-404c-b60d-3beea49842ef-host-run-netns\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.886463 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.885949    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/af6fc84f-60b8-404c-b60d-3beea49842ef-etc-openvswitch\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.886463 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.885967    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/af6fc84f-60b8-404c-b60d-3beea49842ef-node-log\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.886463 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.885981    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8k59q\" (UniqueName: \"kubernetes.io/projected/0df191cd-baa5-4bd5-8806-becaccb21357-kube-api-access-8k59q\") pod \"tuned-7chqg\" (UID: \"0df191cd-baa5-4bd5-8806-becaccb21357\") " pod="openshift-cluster-node-tuning-operator/tuned-7chqg"
Sep 11 16:30:01.886463 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.885995    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/af6fc84f-60b8-404c-b60d-3beea49842ef-host-slash\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.886463 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.886028    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/af6fc84f-60b8-404c-b60d-3beea49842ef-ovnkube-script-lib\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.886463 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.886042    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0df191cd-baa5-4bd5-8806-becaccb21357-var-lib-kubelet\") pod \"tuned-7chqg\" (UID: \"0df191cd-baa5-4bd5-8806-becaccb21357\") " pod="openshift-cluster-node-tuning-operator/tuned-7chqg"
Sep 11 16:30:01.886463 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.886062    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/af6fc84f-60b8-404c-b60d-3beea49842ef-run-ovn\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.886463 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.886079    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/95f9914b-ed9b-4aa9-a3b9-44dee448edd8-cni-binary-copy\") pod \"multus-7vx4s\" (UID: \"95f9914b-ed9b-4aa9-a3b9-44dee448edd8\") " pod="openshift-multus/multus-7vx4s"
Sep 11 16:30:01.886463 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.886113    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/69e5eae6-9a55-49ac-a01c-70cbadab5acd-host\") pod \"node-ca-xsfcb\" (UID: \"69e5eae6-9a55-49ac-a01c-70cbadab5acd\") " pod="openshift-image-registry/node-ca-xsfcb"
Sep 11 16:30:01.886463 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.886145    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/af6fc84f-60b8-404c-b60d-3beea49842ef-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.886463 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.886160    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95f9914b-ed9b-4aa9-a3b9-44dee448edd8-etc-kubernetes\") pod \"multus-7vx4s\" (UID: \"95f9914b-ed9b-4aa9-a3b9-44dee448edd8\") " pod="openshift-multus/multus-7vx4s"
Sep 11 16:30:01.886463 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.886174    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0df191cd-baa5-4bd5-8806-becaccb21357-host\") pod \"tuned-7chqg\" (UID: \"0df191cd-baa5-4bd5-8806-becaccb21357\") " pod="openshift-cluster-node-tuning-operator/tuned-7chqg"
Sep 11 16:30:01.886463 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.886207    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/af6fc84f-60b8-404c-b60d-3beea49842ef-run-openvswitch\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.886463 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.886241    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/af6fc84f-60b8-404c-b60d-3beea49842ef-ovnkube-config\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.886935 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.886269    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0acb3a32-feed-4107-9ee3-ca263fd887df-sys-fs\") pod \"aws-ebs-csi-driver-node-pphqd\" (UID: \"0acb3a32-feed-4107-9ee3-ca263fd887df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pphqd"
Sep 11 16:30:01.886935 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.886285    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0df191cd-baa5-4bd5-8806-becaccb21357-etc-sysctl-d\") pod \"tuned-7chqg\" (UID: \"0df191cd-baa5-4bd5-8806-becaccb21357\") " pod="openshift-cluster-node-tuning-operator/tuned-7chqg"
Sep 11 16:30:01.886935 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.886328    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f519b0e8-fff1-441a-9151-4d6c54437b2b-system-cni-dir\") pod \"multus-additional-cni-plugins-4s7mv\" (UID: \"f519b0e8-fff1-441a-9151-4d6c54437b2b\") " pod="openshift-multus/multus-additional-cni-plugins-4s7mv"
Sep 11 16:30:01.886935 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.886349    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6gfq\" (UniqueName: \"kubernetes.io/projected/f519b0e8-fff1-441a-9151-4d6c54437b2b-kube-api-access-r6gfq\") pod \"multus-additional-cni-plugins-4s7mv\" (UID: \"f519b0e8-fff1-441a-9151-4d6c54437b2b\") " pod="openshift-multus/multus-additional-cni-plugins-4s7mv"
Sep 11 16:30:01.886935 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.886400    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f519b0e8-fff1-441a-9151-4d6c54437b2b-system-cni-dir\") pod \"multus-additional-cni-plugins-4s7mv\" (UID: \"f519b0e8-fff1-441a-9151-4d6c54437b2b\") " pod="openshift-multus/multus-additional-cni-plugins-4s7mv"
Sep 11 16:30:01.886935 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.886419    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/af6fc84f-60b8-404c-b60d-3beea49842ef-run-systemd\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.886935 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.886444    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/524a886f-2ad6-4842-95bd-67870c33ad33-iptables-alerter-script\") pod \"iptables-alerter-m462n\" (UID: \"524a886f-2ad6-4842-95bd-67870c33ad33\") " pod="openshift-network-operator/iptables-alerter-m462n"
Sep 11 16:30:01.886935 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.886468    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq82s\" (UniqueName: \"kubernetes.io/projected/524a886f-2ad6-4842-95bd-67870c33ad33-kube-api-access-jq82s\") pod \"iptables-alerter-m462n\" (UID: \"524a886f-2ad6-4842-95bd-67870c33ad33\") " pod="openshift-network-operator/iptables-alerter-m462n"
Sep 11 16:30:01.886935 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.886491    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/95f9914b-ed9b-4aa9-a3b9-44dee448edd8-host-run-netns\") pod \"multus-7vx4s\" (UID: \"95f9914b-ed9b-4aa9-a3b9-44dee448edd8\") " pod="openshift-multus/multus-7vx4s"
Sep 11 16:30:01.886935 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.886514    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/95f9914b-ed9b-4aa9-a3b9-44dee448edd8-multus-conf-dir\") pod \"multus-7vx4s\" (UID: \"95f9914b-ed9b-4aa9-a3b9-44dee448edd8\") " pod="openshift-multus/multus-7vx4s"
Sep 11 16:30:01.886935 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.886539    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0acb3a32-feed-4107-9ee3-ca263fd887df-socket-dir\") pod \"aws-ebs-csi-driver-node-pphqd\" (UID: \"0acb3a32-feed-4107-9ee3-ca263fd887df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pphqd"
Sep 11 16:30:01.886935 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.886513    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f519b0e8-fff1-441a-9151-4d6c54437b2b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4s7mv\" (UID: \"f519b0e8-fff1-441a-9151-4d6c54437b2b\") " pod="openshift-multus/multus-additional-cni-plugins-4s7mv"
Sep 11 16:30:01.886935 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.886922    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/524a886f-2ad6-4842-95bd-67870c33ad33-iptables-alerter-script\") pod \"iptables-alerter-m462n\" (UID: \"524a886f-2ad6-4842-95bd-67870c33ad33\") " pod="openshift-network-operator/iptables-alerter-m462n"
Sep 11 16:30:01.887469 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.886949    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f519b0e8-fff1-441a-9151-4d6c54437b2b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4s7mv\" (UID: \"f519b0e8-fff1-441a-9151-4d6c54437b2b\") " pod="openshift-multus/multus-additional-cni-plugins-4s7mv"
Sep 11 16:30:01.887469 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.887415    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f519b0e8-fff1-441a-9151-4d6c54437b2b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4s7mv\" (UID: \"f519b0e8-fff1-441a-9151-4d6c54437b2b\") " pod="openshift-multus/multus-additional-cni-plugins-4s7mv"
Sep 11 16:30:01.887555 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.887481    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f519b0e8-fff1-441a-9151-4d6c54437b2b-cni-binary-copy\") pod \"multus-additional-cni-plugins-4s7mv\" (UID: \"f519b0e8-fff1-441a-9151-4d6c54437b2b\") " pod="openshift-multus/multus-additional-cni-plugins-4s7mv"
Sep 11 16:30:01.897585 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.897566    2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 11 16:30:01.901060 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.901036    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq82s\" (UniqueName: \"kubernetes.io/projected/524a886f-2ad6-4842-95bd-67870c33ad33-kube-api-access-jq82s\") pod \"iptables-alerter-m462n\" (UID: \"524a886f-2ad6-4842-95bd-67870c33ad33\") " pod="openshift-network-operator/iptables-alerter-m462n"
Sep 11 16:30:01.901160 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.901036    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6gfq\" (UniqueName: \"kubernetes.io/projected/f519b0e8-fff1-441a-9151-4d6c54437b2b-kube-api-access-r6gfq\") pod \"multus-additional-cni-plugins-4s7mv\" (UID: \"f519b0e8-fff1-441a-9151-4d6c54437b2b\") " pod="openshift-multus/multus-additional-cni-plugins-4s7mv"
Sep 11 16:30:01.987081 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.987049    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0df191cd-baa5-4bd5-8806-becaccb21357-etc-kubernetes\") pod \"tuned-7chqg\" (UID: \"0df191cd-baa5-4bd5-8806-becaccb21357\") " pod="openshift-cluster-node-tuning-operator/tuned-7chqg"
Sep 11 16:30:01.987081 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.987088    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/95f9914b-ed9b-4aa9-a3b9-44dee448edd8-host-run-k8s-cni-cncf-io\") pod \"multus-7vx4s\" (UID: \"95f9914b-ed9b-4aa9-a3b9-44dee448edd8\") " pod="openshift-multus/multus-7vx4s"
Sep 11 16:30:01.987304 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.987133    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5hlq\" (UniqueName: \"kubernetes.io/projected/95f9914b-ed9b-4aa9-a3b9-44dee448edd8-kube-api-access-v5hlq\") pod \"multus-7vx4s\" (UID: \"95f9914b-ed9b-4aa9-a3b9-44dee448edd8\") " pod="openshift-multus/multus-7vx4s"
Sep 11 16:30:01.987304 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.987155    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0acb3a32-feed-4107-9ee3-ca263fd887df-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pphqd\" (UID: \"0acb3a32-feed-4107-9ee3-ca263fd887df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pphqd"
Sep 11 16:30:01.987304 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.987178    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0df191cd-baa5-4bd5-8806-becaccb21357-etc-modprobe-d\") pod \"tuned-7chqg\" (UID: \"0df191cd-baa5-4bd5-8806-becaccb21357\") " pod="openshift-cluster-node-tuning-operator/tuned-7chqg"
Sep 11 16:30:01.987304 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.987204    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/af6fc84f-60b8-404c-b60d-3beea49842ef-host-kubelet\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.987304 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.987221    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0df191cd-baa5-4bd5-8806-becaccb21357-etc-kubernetes\") pod \"tuned-7chqg\" (UID: \"0df191cd-baa5-4bd5-8806-becaccb21357\") " pod="openshift-cluster-node-tuning-operator/tuned-7chqg"
Sep 11 16:30:01.987304 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.987237    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/95f9914b-ed9b-4aa9-a3b9-44dee448edd8-host-run-k8s-cni-cncf-io\") pod \"multus-7vx4s\" (UID: \"95f9914b-ed9b-4aa9-a3b9-44dee448edd8\") " pod="openshift-multus/multus-7vx4s"
Sep 11 16:30:01.987304 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.987226    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/af6fc84f-60b8-404c-b60d-3beea49842ef-var-lib-openvswitch\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.987304 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.987294    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/af6fc84f-60b8-404c-b60d-3beea49842ef-host-kubelet\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.987304 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.987285    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/af6fc84f-60b8-404c-b60d-3beea49842ef-var-lib-openvswitch\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.987713 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.987271    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0acb3a32-feed-4107-9ee3-ca263fd887df-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pphqd\" (UID: \"0acb3a32-feed-4107-9ee3-ca263fd887df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pphqd"
Sep 11 16:30:01.987713 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.987320    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kg5l\" (UniqueName: \"kubernetes.io/projected/97ffcc27-5973-418d-a29e-762556b9c3e0-kube-api-access-2kg5l\") pod \"network-metrics-daemon-dnqst\" (UID: \"97ffcc27-5973-418d-a29e-762556b9c3e0\") " pod="openshift-multus/network-metrics-daemon-dnqst"
Sep 11 16:30:01.987713 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.987367    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0df191cd-baa5-4bd5-8806-becaccb21357-lib-modules\") pod \"tuned-7chqg\" (UID: \"0df191cd-baa5-4bd5-8806-becaccb21357\") " pod="openshift-cluster-node-tuning-operator/tuned-7chqg"
Sep 11 16:30:01.987713 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.987393    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e52d92c8-b840-42dd-9e4b-ea9f196e7623-original-pull-secret\") pod \"global-pull-secret-syncer-xkz2b\" (UID: \"e52d92c8-b840-42dd-9e4b-ea9f196e7623\") " pod="kube-system/global-pull-secret-syncer-xkz2b"
Sep 11 16:30:01.987713 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.987334    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0df191cd-baa5-4bd5-8806-becaccb21357-etc-modprobe-d\") pod \"tuned-7chqg\" (UID: \"0df191cd-baa5-4bd5-8806-becaccb21357\") " pod="openshift-cluster-node-tuning-operator/tuned-7chqg"
Sep 11 16:30:01.987713 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:01.987477    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 16:30:01.987713 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.987521    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0df191cd-baa5-4bd5-8806-becaccb21357-lib-modules\") pod \"tuned-7chqg\" (UID: \"0df191cd-baa5-4bd5-8806-becaccb21357\") " pod="openshift-cluster-node-tuning-operator/tuned-7chqg"
Sep 11 16:30:01.987713 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.987527    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/af6fc84f-60b8-404c-b60d-3beea49842ef-host-run-netns\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.987713 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:01.987541    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e52d92c8-b840-42dd-9e4b-ea9f196e7623-original-pull-secret podName:e52d92c8-b840-42dd-9e4b-ea9f196e7623 nodeName:}" failed. No retries permitted until 2026-09-11 16:30:02.487518439 +0000 UTC m=+2.104275505 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e52d92c8-b840-42dd-9e4b-ea9f196e7623-original-pull-secret") pod "global-pull-secret-syncer-xkz2b" (UID: "e52d92c8-b840-42dd-9e4b-ea9f196e7623") : object "kube-system"/"original-pull-secret" not registered
Sep 11 16:30:01.987713 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.987568    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/af6fc84f-60b8-404c-b60d-3beea49842ef-host-run-netns\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.987713 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.987586    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/af6fc84f-60b8-404c-b60d-3beea49842ef-etc-openvswitch\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.987713 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.987616    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/af6fc84f-60b8-404c-b60d-3beea49842ef-node-log\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.987713 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.987645    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k59q\" (UniqueName: \"kubernetes.io/projected/0df191cd-baa5-4bd5-8806-becaccb21357-kube-api-access-8k59q\") pod \"tuned-7chqg\" (UID: \"0df191cd-baa5-4bd5-8806-becaccb21357\") " pod="openshift-cluster-node-tuning-operator/tuned-7chqg"
Sep 11 16:30:01.987713 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.987689    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/af6fc84f-60b8-404c-b60d-3beea49842ef-etc-openvswitch\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.987713 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.987689    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/af6fc84f-60b8-404c-b60d-3beea49842ef-node-log\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.987713 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.987710    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/af6fc84f-60b8-404c-b60d-3beea49842ef-host-slash\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.988510 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.987735    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/af6fc84f-60b8-404c-b60d-3beea49842ef-host-slash\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.988510 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.987733    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/af6fc84f-60b8-404c-b60d-3beea49842ef-ovnkube-script-lib\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.988510 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.987771    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0df191cd-baa5-4bd5-8806-becaccb21357-var-lib-kubelet\") pod \"tuned-7chqg\" (UID: \"0df191cd-baa5-4bd5-8806-becaccb21357\") " pod="openshift-cluster-node-tuning-operator/tuned-7chqg"
Sep 11 16:30:01.988510 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.987788    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/af6fc84f-60b8-404c-b60d-3beea49842ef-run-ovn\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.988510 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.987809    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/95f9914b-ed9b-4aa9-a3b9-44dee448edd8-cni-binary-copy\") pod \"multus-7vx4s\" (UID: \"95f9914b-ed9b-4aa9-a3b9-44dee448edd8\") " pod="openshift-multus/multus-7vx4s"
Sep 11 16:30:01.988510 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.987834    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/69e5eae6-9a55-49ac-a01c-70cbadab5acd-host\") pod \"node-ca-xsfcb\" (UID: \"69e5eae6-9a55-49ac-a01c-70cbadab5acd\") " pod="openshift-image-registry/node-ca-xsfcb"
Sep 11 16:30:01.988510 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.987858    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0df191cd-baa5-4bd5-8806-becaccb21357-var-lib-kubelet\") pod \"tuned-7chqg\" (UID: \"0df191cd-baa5-4bd5-8806-becaccb21357\") " pod="openshift-cluster-node-tuning-operator/tuned-7chqg"
Sep 11 16:30:01.988510 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.987869    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/af6fc84f-60b8-404c-b60d-3beea49842ef-run-ovn\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.988510 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.987860    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/af6fc84f-60b8-404c-b60d-3beea49842ef-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.988510 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.987897    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/af6fc84f-60b8-404c-b60d-3beea49842ef-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.988510 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.987903    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/69e5eae6-9a55-49ac-a01c-70cbadab5acd-host\") pod \"node-ca-xsfcb\" (UID: \"69e5eae6-9a55-49ac-a01c-70cbadab5acd\") " pod="openshift-image-registry/node-ca-xsfcb"
Sep 11 16:30:01.988510 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.987915    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95f9914b-ed9b-4aa9-a3b9-44dee448edd8-etc-kubernetes\") pod \"multus-7vx4s\" (UID: \"95f9914b-ed9b-4aa9-a3b9-44dee448edd8\") " pod="openshift-multus/multus-7vx4s"
Sep 11 16:30:01.988510 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.987942    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0df191cd-baa5-4bd5-8806-becaccb21357-host\") pod \"tuned-7chqg\" (UID: \"0df191cd-baa5-4bd5-8806-becaccb21357\") " pod="openshift-cluster-node-tuning-operator/tuned-7chqg"
Sep 11 16:30:01.988510 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.987968    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95f9914b-ed9b-4aa9-a3b9-44dee448edd8-etc-kubernetes\") pod \"multus-7vx4s\" (UID: \"95f9914b-ed9b-4aa9-a3b9-44dee448edd8\") " pod="openshift-multus/multus-7vx4s"
Sep 11 16:30:01.988510 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.987968    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/af6fc84f-60b8-404c-b60d-3beea49842ef-run-openvswitch\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.988510 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988009    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/af6fc84f-60b8-404c-b60d-3beea49842ef-ovnkube-config\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.988510 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988009    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/af6fc84f-60b8-404c-b60d-3beea49842ef-run-openvswitch\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.988510 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988015    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0df191cd-baa5-4bd5-8806-becaccb21357-host\") pod \"tuned-7chqg\" (UID: \"0df191cd-baa5-4bd5-8806-becaccb21357\") " pod="openshift-cluster-node-tuning-operator/tuned-7chqg"
Sep 11 16:30:01.989420 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988038    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0acb3a32-feed-4107-9ee3-ca263fd887df-sys-fs\") pod \"aws-ebs-csi-driver-node-pphqd\" (UID: \"0acb3a32-feed-4107-9ee3-ca263fd887df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pphqd"
Sep 11 16:30:01.989420 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988055    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0df191cd-baa5-4bd5-8806-becaccb21357-etc-sysctl-d\") pod \"tuned-7chqg\" (UID: \"0df191cd-baa5-4bd5-8806-becaccb21357\") " pod="openshift-cluster-node-tuning-operator/tuned-7chqg"
Sep 11 16:30:01.989420 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988072    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/af6fc84f-60b8-404c-b60d-3beea49842ef-run-systemd\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.989420 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988087    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/95f9914b-ed9b-4aa9-a3b9-44dee448edd8-host-run-netns\") pod \"multus-7vx4s\" (UID: \"95f9914b-ed9b-4aa9-a3b9-44dee448edd8\") " pod="openshift-multus/multus-7vx4s"
Sep 11 16:30:01.989420 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988117    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/95f9914b-ed9b-4aa9-a3b9-44dee448edd8-multus-conf-dir\") pod \"multus-7vx4s\" (UID: \"95f9914b-ed9b-4aa9-a3b9-44dee448edd8\") " pod="openshift-multus/multus-7vx4s"
Sep 11 16:30:01.989420 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988142    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0acb3a32-feed-4107-9ee3-ca263fd887df-socket-dir\") pod \"aws-ebs-csi-driver-node-pphqd\" (UID: \"0acb3a32-feed-4107-9ee3-ca263fd887df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pphqd"
Sep 11 16:30:01.989420 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988159    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/af6fc84f-60b8-404c-b60d-3beea49842ef-run-systemd\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.989420 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988166    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/af6fc84f-60b8-404c-b60d-3beea49842ef-host-cni-netd\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.989420 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988177    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/95f9914b-ed9b-4aa9-a3b9-44dee448edd8-host-run-netns\") pod \"multus-7vx4s\" (UID: \"95f9914b-ed9b-4aa9-a3b9-44dee448edd8\") " pod="openshift-multus/multus-7vx4s"
Sep 11 16:30:01.989420 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988195    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95f9914b-ed9b-4aa9-a3b9-44dee448edd8-system-cni-dir\") pod \"multus-7vx4s\" (UID: \"95f9914b-ed9b-4aa9-a3b9-44dee448edd8\") " pod="openshift-multus/multus-7vx4s"
Sep 11 16:30:01.989420 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988218    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/95f9914b-ed9b-4aa9-a3b9-44dee448edd8-hostroot\") pod \"multus-7vx4s\" (UID: \"95f9914b-ed9b-4aa9-a3b9-44dee448edd8\") " pod="openshift-multus/multus-7vx4s"
Sep 11 16:30:01.989420 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988223    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0df191cd-baa5-4bd5-8806-becaccb21357-etc-sysctl-d\") pod \"tuned-7chqg\" (UID: \"0df191cd-baa5-4bd5-8806-becaccb21357\") " pod="openshift-cluster-node-tuning-operator/tuned-7chqg"
Sep 11 16:30:01.989420 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988242    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0acb3a32-feed-4107-9ee3-ca263fd887df-etc-selinux\") pod \"aws-ebs-csi-driver-node-pphqd\" (UID: \"0acb3a32-feed-4107-9ee3-ca263fd887df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pphqd"
Sep 11 16:30:01.989420 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988261    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95f9914b-ed9b-4aa9-a3b9-44dee448edd8-system-cni-dir\") pod \"multus-7vx4s\" (UID: \"95f9914b-ed9b-4aa9-a3b9-44dee448edd8\") " pod="openshift-multus/multus-7vx4s"
Sep 11 16:30:01.989420 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988269    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97ffcc27-5973-418d-a29e-762556b9c3e0-metrics-certs\") pod \"network-metrics-daemon-dnqst\" (UID: \"97ffcc27-5973-418d-a29e-762556b9c3e0\") " pod="openshift-multus/network-metrics-daemon-dnqst"
Sep 11 16:30:01.989420 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988275    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/95f9914b-ed9b-4aa9-a3b9-44dee448edd8-hostroot\") pod \"multus-7vx4s\" (UID: \"95f9914b-ed9b-4aa9-a3b9-44dee448edd8\") " pod="openshift-multus/multus-7vx4s"
Sep 11 16:30:01.989420 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988221    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0acb3a32-feed-4107-9ee3-ca263fd887df-sys-fs\") pod \"aws-ebs-csi-driver-node-pphqd\" (UID: \"0acb3a32-feed-4107-9ee3-ca263fd887df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pphqd"
Sep 11 16:30:01.989420 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988297    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/69e5eae6-9a55-49ac-a01c-70cbadab5acd-serviceca\") pod \"node-ca-xsfcb\" (UID: \"69e5eae6-9a55-49ac-a01c-70cbadab5acd\") " pod="openshift-image-registry/node-ca-xsfcb"
Sep 11 16:30:01.990279 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988310    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0acb3a32-feed-4107-9ee3-ca263fd887df-socket-dir\") pod \"aws-ebs-csi-driver-node-pphqd\" (UID: \"0acb3a32-feed-4107-9ee3-ca263fd887df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pphqd"
Sep 11 16:30:01.990279 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988330    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/af6fc84f-60b8-404c-b60d-3beea49842ef-host-run-ovn-kubernetes\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.990279 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988344    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/af6fc84f-60b8-404c-b60d-3beea49842ef-host-cni-netd\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.990279 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988359    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgblx\" (UniqueName: \"kubernetes.io/projected/14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0-kube-api-access-wgblx\") pod \"network-check-target-qx7z8\" (UID: \"14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0\") " pod="openshift-network-diagnostics/network-check-target-qx7z8"
Sep 11 16:30:01.990279 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988364    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/95f9914b-ed9b-4aa9-a3b9-44dee448edd8-multus-conf-dir\") pod \"multus-7vx4s\" (UID: \"95f9914b-ed9b-4aa9-a3b9-44dee448edd8\") " pod="openshift-multus/multus-7vx4s"
Sep 11 16:30:01.990279 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988389    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/95f9914b-ed9b-4aa9-a3b9-44dee448edd8-host-var-lib-cni-bin\") pod \"multus-7vx4s\" (UID: \"95f9914b-ed9b-4aa9-a3b9-44dee448edd8\") " pod="openshift-multus/multus-7vx4s"
Sep 11 16:30:01.990279 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988419    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/95f9914b-ed9b-4aa9-a3b9-44dee448edd8-multus-daemon-config\") pod \"multus-7vx4s\" (UID: \"95f9914b-ed9b-4aa9-a3b9-44dee448edd8\") " pod="openshift-multus/multus-7vx4s"
Sep 11 16:30:01.990279 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988434    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0acb3a32-feed-4107-9ee3-ca263fd887df-etc-selinux\") pod \"aws-ebs-csi-driver-node-pphqd\" (UID: \"0acb3a32-feed-4107-9ee3-ca263fd887df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pphqd"
Sep 11 16:30:01.990279 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988447    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0df191cd-baa5-4bd5-8806-becaccb21357-tmp\") pod \"tuned-7chqg\" (UID: \"0df191cd-baa5-4bd5-8806-becaccb21357\") " pod="openshift-cluster-node-tuning-operator/tuned-7chqg"
Sep 11 16:30:01.990279 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988458    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/95f9914b-ed9b-4aa9-a3b9-44dee448edd8-cni-binary-copy\") pod \"multus-7vx4s\" (UID: \"95f9914b-ed9b-4aa9-a3b9-44dee448edd8\") " pod="openshift-multus/multus-7vx4s"
Sep 11 16:30:01.990279 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:01.988468    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:30:01.990279 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988472    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e52d92c8-b840-42dd-9e4b-ea9f196e7623-kubelet-config\") pod \"global-pull-secret-syncer-xkz2b\" (UID: \"e52d92c8-b840-42dd-9e4b-ea9f196e7623\") " pod="kube-system/global-pull-secret-syncer-xkz2b"
Sep 11 16:30:01.990279 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988482    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/af6fc84f-60b8-404c-b60d-3beea49842ef-host-run-ovn-kubernetes\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.990279 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988522    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e52d92c8-b840-42dd-9e4b-ea9f196e7623-dbus\") pod \"global-pull-secret-syncer-xkz2b\" (UID: \"e52d92c8-b840-42dd-9e4b-ea9f196e7623\") " pod="kube-system/global-pull-secret-syncer-xkz2b"
Sep 11 16:30:01.990279 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988554    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/af6fc84f-60b8-404c-b60d-3beea49842ef-ovn-node-metrics-cert\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.990279 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988589    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px97j\" (UniqueName: \"kubernetes.io/projected/af6fc84f-60b8-404c-b60d-3beea49842ef-kube-api-access-px97j\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.990279 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988420    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/af6fc84f-60b8-404c-b60d-3beea49842ef-ovnkube-script-lib\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.990279 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988522    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/95f9914b-ed9b-4aa9-a3b9-44dee448edd8-host-var-lib-cni-bin\") pod \"multus-7vx4s\" (UID: \"95f9914b-ed9b-4aa9-a3b9-44dee448edd8\") " pod="openshift-multus/multus-7vx4s"
Sep 11 16:30:01.991113 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:01.988696    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97ffcc27-5973-418d-a29e-762556b9c3e0-metrics-certs podName:97ffcc27-5973-418d-a29e-762556b9c3e0 nodeName:}" failed. No retries permitted until 2026-09-11 16:30:02.488674626 +0000 UTC m=+2.105431691 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/97ffcc27-5973-418d-a29e-762556b9c3e0-metrics-certs") pod "network-metrics-daemon-dnqst" (UID: "97ffcc27-5973-418d-a29e-762556b9c3e0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:30:01.991113 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988675    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95f9914b-ed9b-4aa9-a3b9-44dee448edd8-multus-cni-dir\") pod \"multus-7vx4s\" (UID: \"95f9914b-ed9b-4aa9-a3b9-44dee448edd8\") " pod="openshift-multus/multus-7vx4s"
Sep 11 16:30:01.991113 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988712    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e52d92c8-b840-42dd-9e4b-ea9f196e7623-kubelet-config\") pod \"global-pull-secret-syncer-xkz2b\" (UID: \"e52d92c8-b840-42dd-9e4b-ea9f196e7623\") " pod="kube-system/global-pull-secret-syncer-xkz2b"
Sep 11 16:30:01.991113 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988730    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/95f9914b-ed9b-4aa9-a3b9-44dee448edd8-multus-socket-dir-parent\") pod \"multus-7vx4s\" (UID: \"95f9914b-ed9b-4aa9-a3b9-44dee448edd8\") " pod="openshift-multus/multus-7vx4s"
Sep 11 16:30:01.991113 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988748    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95f9914b-ed9b-4aa9-a3b9-44dee448edd8-multus-cni-dir\") pod \"multus-7vx4s\" (UID: \"95f9914b-ed9b-4aa9-a3b9-44dee448edd8\") " pod="openshift-multus/multus-7vx4s"
Sep 11 16:30:01.991113 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988756    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/95f9914b-ed9b-4aa9-a3b9-44dee448edd8-host-var-lib-cni-multus\") pod \"multus-7vx4s\" (UID: \"95f9914b-ed9b-4aa9-a3b9-44dee448edd8\") " pod="openshift-multus/multus-7vx4s"
Sep 11 16:30:01.991113 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988772    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e52d92c8-b840-42dd-9e4b-ea9f196e7623-dbus\") pod \"global-pull-secret-syncer-xkz2b\" (UID: \"e52d92c8-b840-42dd-9e4b-ea9f196e7623\") " pod="kube-system/global-pull-secret-syncer-xkz2b"
Sep 11 16:30:01.991113 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988783    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/95f9914b-ed9b-4aa9-a3b9-44dee448edd8-host-var-lib-kubelet\") pod \"multus-7vx4s\" (UID: \"95f9914b-ed9b-4aa9-a3b9-44dee448edd8\") " pod="openshift-multus/multus-7vx4s"
Sep 11 16:30:01.991113 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988781    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/af6fc84f-60b8-404c-b60d-3beea49842ef-ovnkube-config\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.991113 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988813    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41863045-9930-4c6f-a9a4-cb77f319ed93-tmp-dir\") pod \"node-resolver-nk4fp\" (UID: \"41863045-9930-4c6f-a9a4-cb77f319ed93\") " pod="openshift-dns/node-resolver-nk4fp"
Sep 11 16:30:01.991113 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988821    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/95f9914b-ed9b-4aa9-a3b9-44dee448edd8-multus-socket-dir-parent\") pod \"multus-7vx4s\" (UID: \"95f9914b-ed9b-4aa9-a3b9-44dee448edd8\") " pod="openshift-multus/multus-7vx4s"
Sep 11 16:30:01.991113 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988838    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/69e5eae6-9a55-49ac-a01c-70cbadab5acd-serviceca\") pod \"node-ca-xsfcb\" (UID: \"69e5eae6-9a55-49ac-a01c-70cbadab5acd\") " pod="openshift-image-registry/node-ca-xsfcb"
Sep 11 16:30:01.991113 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988867    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/95f9914b-ed9b-4aa9-a3b9-44dee448edd8-host-var-lib-kubelet\") pod \"multus-7vx4s\" (UID: \"95f9914b-ed9b-4aa9-a3b9-44dee448edd8\") " pod="openshift-multus/multus-7vx4s"
Sep 11 16:30:01.991113 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988886    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/af6fc84f-60b8-404c-b60d-3beea49842ef-log-socket\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.991113 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988894    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/95f9914b-ed9b-4aa9-a3b9-44dee448edd8-host-var-lib-cni-multus\") pod \"multus-7vx4s\" (UID: \"95f9914b-ed9b-4aa9-a3b9-44dee448edd8\") " pod="openshift-multus/multus-7vx4s"
Sep 11 16:30:01.991113 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.988986    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/95f9914b-ed9b-4aa9-a3b9-44dee448edd8-multus-daemon-config\") pod \"multus-7vx4s\" (UID: \"95f9914b-ed9b-4aa9-a3b9-44dee448edd8\") " pod="openshift-multus/multus-7vx4s"
Sep 11 16:30:01.991113 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.989048    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/af6fc84f-60b8-404c-b60d-3beea49842ef-log-socket\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.994586 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.989069    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/af6fc84f-60b8-404c-b60d-3beea49842ef-env-overrides\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.994586 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.989127    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0acb3a32-feed-4107-9ee3-ca263fd887df-registration-dir\") pod \"aws-ebs-csi-driver-node-pphqd\" (UID: \"0acb3a32-feed-4107-9ee3-ca263fd887df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pphqd"
Sep 11 16:30:01.994586 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.989152    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0df191cd-baa5-4bd5-8806-becaccb21357-etc-systemd\") pod \"tuned-7chqg\" (UID: \"0df191cd-baa5-4bd5-8806-becaccb21357\") " pod="openshift-cluster-node-tuning-operator/tuned-7chqg"
Sep 11 16:30:01.994586 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.989152    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41863045-9930-4c6f-a9a4-cb77f319ed93-tmp-dir\") pod \"node-resolver-nk4fp\" (UID: \"41863045-9930-4c6f-a9a4-cb77f319ed93\") " pod="openshift-dns/node-resolver-nk4fp"
Sep 11 16:30:01.994586 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.989196    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-895gn\" (UniqueName: \"kubernetes.io/projected/41863045-9930-4c6f-a9a4-cb77f319ed93-kube-api-access-895gn\") pod \"node-resolver-nk4fp\" (UID: \"41863045-9930-4c6f-a9a4-cb77f319ed93\") " pod="openshift-dns/node-resolver-nk4fp"
Sep 11 16:30:01.994586 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.989226    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/95f9914b-ed9b-4aa9-a3b9-44dee448edd8-host-run-multus-certs\") pod \"multus-7vx4s\" (UID: \"95f9914b-ed9b-4aa9-a3b9-44dee448edd8\") " pod="openshift-multus/multus-7vx4s"
Sep 11 16:30:01.994586 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.989242    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0acb3a32-feed-4107-9ee3-ca263fd887df-registration-dir\") pod \"aws-ebs-csi-driver-node-pphqd\" (UID: \"0acb3a32-feed-4107-9ee3-ca263fd887df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pphqd"
Sep 11 16:30:01.994586 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.989248    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0df191cd-baa5-4bd5-8806-becaccb21357-etc-systemd\") pod \"tuned-7chqg\" (UID: \"0df191cd-baa5-4bd5-8806-becaccb21357\") " pod="openshift-cluster-node-tuning-operator/tuned-7chqg"
Sep 11 16:30:01.994586 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.989299    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/95f9914b-ed9b-4aa9-a3b9-44dee448edd8-host-run-multus-certs\") pod \"multus-7vx4s\" (UID: \"95f9914b-ed9b-4aa9-a3b9-44dee448edd8\") " pod="openshift-multus/multus-7vx4s"
Sep 11 16:30:01.994586 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.989251    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0acb3a32-feed-4107-9ee3-ca263fd887df-device-dir\") pod \"aws-ebs-csi-driver-node-pphqd\" (UID: \"0acb3a32-feed-4107-9ee3-ca263fd887df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pphqd"
Sep 11 16:30:01.994586 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.989478    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlzv8\" (UniqueName: \"kubernetes.io/projected/0acb3a32-feed-4107-9ee3-ca263fd887df-kube-api-access-dlzv8\") pod \"aws-ebs-csi-driver-node-pphqd\" (UID: \"0acb3a32-feed-4107-9ee3-ca263fd887df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pphqd"
Sep 11 16:30:01.994586 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.989499    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/af6fc84f-60b8-404c-b60d-3beea49842ef-env-overrides\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.994586 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.989890    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0df191cd-baa5-4bd5-8806-becaccb21357-etc-sysconfig\") pod \"tuned-7chqg\" (UID: \"0df191cd-baa5-4bd5-8806-becaccb21357\") " pod="openshift-cluster-node-tuning-operator/tuned-7chqg"
Sep 11 16:30:01.994586 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.989903    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0acb3a32-feed-4107-9ee3-ca263fd887df-device-dir\") pod \"aws-ebs-csi-driver-node-pphqd\" (UID: \"0acb3a32-feed-4107-9ee3-ca263fd887df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pphqd"
Sep 11 16:30:01.994586 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.989984    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0df191cd-baa5-4bd5-8806-becaccb21357-run\") pod \"tuned-7chqg\" (UID: \"0df191cd-baa5-4bd5-8806-becaccb21357\") " pod="openshift-cluster-node-tuning-operator/tuned-7chqg"
Sep 11 16:30:01.994586 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.990034    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsdhx\" (UniqueName: \"kubernetes.io/projected/69e5eae6-9a55-49ac-a01c-70cbadab5acd-kube-api-access-hsdhx\") pod \"node-ca-xsfcb\" (UID: \"69e5eae6-9a55-49ac-a01c-70cbadab5acd\") " pod="openshift-image-registry/node-ca-xsfcb"
Sep 11 16:30:01.994586 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.990071    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0df191cd-baa5-4bd5-8806-becaccb21357-etc-sysctl-conf\") pod \"tuned-7chqg\" (UID: \"0df191cd-baa5-4bd5-8806-becaccb21357\") " pod="openshift-cluster-node-tuning-operator/tuned-7chqg"
Sep 11 16:30:01.995506 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.990085    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0df191cd-baa5-4bd5-8806-becaccb21357-etc-sysconfig\") pod \"tuned-7chqg\" (UID: \"0df191cd-baa5-4bd5-8806-becaccb21357\") " pod="openshift-cluster-node-tuning-operator/tuned-7chqg"
Sep 11 16:30:01.995506 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.990102    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0df191cd-baa5-4bd5-8806-becaccb21357-sys\") pod \"tuned-7chqg\" (UID: \"0df191cd-baa5-4bd5-8806-becaccb21357\") " pod="openshift-cluster-node-tuning-operator/tuned-7chqg"
Sep 11 16:30:01.995506 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.990282    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0df191cd-baa5-4bd5-8806-becaccb21357-etc-sysctl-conf\") pod \"tuned-7chqg\" (UID: \"0df191cd-baa5-4bd5-8806-becaccb21357\") " pod="openshift-cluster-node-tuning-operator/tuned-7chqg"
Sep 11 16:30:01.995506 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.990309    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0df191cd-baa5-4bd5-8806-becaccb21357-run\") pod \"tuned-7chqg\" (UID: \"0df191cd-baa5-4bd5-8806-becaccb21357\") " pod="openshift-cluster-node-tuning-operator/tuned-7chqg"
Sep 11 16:30:01.995506 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.990330    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/41863045-9930-4c6f-a9a4-cb77f319ed93-hosts-file\") pod \"node-resolver-nk4fp\" (UID: \"41863045-9930-4c6f-a9a4-cb77f319ed93\") " pod="openshift-dns/node-resolver-nk4fp"
Sep 11 16:30:01.995506 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.990360    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0df191cd-baa5-4bd5-8806-becaccb21357-sys\") pod \"tuned-7chqg\" (UID: \"0df191cd-baa5-4bd5-8806-becaccb21357\") " pod="openshift-cluster-node-tuning-operator/tuned-7chqg"
Sep 11 16:30:01.995506 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.990368    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d6754d1f-d663-4e69-aad4-a0c1523b1559-konnectivity-ca\") pod \"konnectivity-agent-22ws5\" (UID: \"d6754d1f-d663-4e69-aad4-a0c1523b1559\") " pod="kube-system/konnectivity-agent-22ws5"
Sep 11 16:30:01.995506 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.990419    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/41863045-9930-4c6f-a9a4-cb77f319ed93-hosts-file\") pod \"node-resolver-nk4fp\" (UID: \"41863045-9930-4c6f-a9a4-cb77f319ed93\") " pod="openshift-dns/node-resolver-nk4fp"
Sep 11 16:30:01.995506 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.990451    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/af6fc84f-60b8-404c-b60d-3beea49842ef-host-cni-bin\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.995506 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.991560    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/af6fc84f-60b8-404c-b60d-3beea49842ef-host-cni-bin\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.995506 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.991621    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/95f9914b-ed9b-4aa9-a3b9-44dee448edd8-cnibin\") pod \"multus-7vx4s\" (UID: \"95f9914b-ed9b-4aa9-a3b9-44dee448edd8\") " pod="openshift-multus/multus-7vx4s"
Sep 11 16:30:01.995506 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.991674    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0df191cd-baa5-4bd5-8806-becaccb21357-etc-tuned\") pod \"tuned-7chqg\" (UID: \"0df191cd-baa5-4bd5-8806-becaccb21357\") " pod="openshift-cluster-node-tuning-operator/tuned-7chqg"
Sep 11 16:30:01.995506 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.991707    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d6754d1f-d663-4e69-aad4-a0c1523b1559-agent-certs\") pod \"konnectivity-agent-22ws5\" (UID: \"d6754d1f-d663-4e69-aad4-a0c1523b1559\") " pod="kube-system/konnectivity-agent-22ws5"
Sep 11 16:30:01.995506 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.991723    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d6754d1f-d663-4e69-aad4-a0c1523b1559-konnectivity-ca\") pod \"konnectivity-agent-22ws5\" (UID: \"d6754d1f-d663-4e69-aad4-a0c1523b1559\") " pod="kube-system/konnectivity-agent-22ws5"
Sep 11 16:30:01.995506 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.991735    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/af6fc84f-60b8-404c-b60d-3beea49842ef-systemd-units\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.995506 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.991781    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0df191cd-baa5-4bd5-8806-becaccb21357-tmp\") pod \"tuned-7chqg\" (UID: \"0df191cd-baa5-4bd5-8806-becaccb21357\") " pod="openshift-cluster-node-tuning-operator/tuned-7chqg"
Sep 11 16:30:01.995506 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.991861    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/95f9914b-ed9b-4aa9-a3b9-44dee448edd8-cnibin\") pod \"multus-7vx4s\" (UID: \"95f9914b-ed9b-4aa9-a3b9-44dee448edd8\") " pod="openshift-multus/multus-7vx4s"
Sep 11 16:30:01.995506 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.991992    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/af6fc84f-60b8-404c-b60d-3beea49842ef-ovn-node-metrics-cert\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.996420 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.992078    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/af6fc84f-60b8-404c-b60d-3beea49842ef-systemd-units\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:01.996420 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.994439    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0df191cd-baa5-4bd5-8806-becaccb21357-etc-tuned\") pod \"tuned-7chqg\" (UID: \"0df191cd-baa5-4bd5-8806-becaccb21357\") " pod="openshift-cluster-node-tuning-operator/tuned-7chqg"
Sep 11 16:30:01.996420 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:01.994658    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d6754d1f-d663-4e69-aad4-a0c1523b1559-agent-certs\") pod \"konnectivity-agent-22ws5\" (UID: \"d6754d1f-d663-4e69-aad4-a0c1523b1559\") " pod="kube-system/konnectivity-agent-22ws5"
Sep 11 16:30:02.001404 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:02.001381    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5hlq\" (UniqueName: \"kubernetes.io/projected/95f9914b-ed9b-4aa9-a3b9-44dee448edd8-kube-api-access-v5hlq\") pod \"multus-7vx4s\" (UID: \"95f9914b-ed9b-4aa9-a3b9-44dee448edd8\") " pod="openshift-multus/multus-7vx4s"
Sep 11 16:30:02.004938 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:02.004888    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-895gn\" (UniqueName: \"kubernetes.io/projected/41863045-9930-4c6f-a9a4-cb77f319ed93-kube-api-access-895gn\") pod \"node-resolver-nk4fp\" (UID: \"41863045-9930-4c6f-a9a4-cb77f319ed93\") " pod="openshift-dns/node-resolver-nk4fp"
Sep 11 16:30:02.005228 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:02.005125    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 16:30:02.005228 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:02.005146    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 16:30:02.005228 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:02.005159    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsdhx\" (UniqueName: \"kubernetes.io/projected/69e5eae6-9a55-49ac-a01c-70cbadab5acd-kube-api-access-hsdhx\") pod \"node-ca-xsfcb\" (UID: \"69e5eae6-9a55-49ac-a01c-70cbadab5acd\") " pod="openshift-image-registry/node-ca-xsfcb"
Sep 11 16:30:02.005228 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:02.005160    2581 projected.go:196] Error preparing data for projected volume kube-api-access-wgblx for pod openshift-network-diagnostics/network-check-target-qx7z8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:30:02.005476 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:02.005300    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0-kube-api-access-wgblx podName:14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0 nodeName:}" failed. No retries permitted until 2026-09-11 16:30:02.505281286 +0000 UTC m=+2.122038352 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wgblx" (UniqueName: "kubernetes.io/projected/14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0-kube-api-access-wgblx") pod "network-check-target-qx7z8" (UID: "14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:30:02.005618 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:02.005594    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlzv8\" (UniqueName: \"kubernetes.io/projected/0acb3a32-feed-4107-9ee3-ca263fd887df-kube-api-access-dlzv8\") pod \"aws-ebs-csi-driver-node-pphqd\" (UID: \"0acb3a32-feed-4107-9ee3-ca263fd887df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pphqd"
Sep 11 16:30:02.006428 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:02.006401    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kg5l\" (UniqueName: \"kubernetes.io/projected/97ffcc27-5973-418d-a29e-762556b9c3e0-kube-api-access-2kg5l\") pod \"network-metrics-daemon-dnqst\" (UID: \"97ffcc27-5973-418d-a29e-762556b9c3e0\") " pod="openshift-multus/network-metrics-daemon-dnqst"
Sep 11 16:30:02.007007 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:02.006978    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8k59q\" (UniqueName: \"kubernetes.io/projected/0df191cd-baa5-4bd5-8806-becaccb21357-kube-api-access-8k59q\") pod \"tuned-7chqg\" (UID: \"0df191cd-baa5-4bd5-8806-becaccb21357\") " pod="openshift-cluster-node-tuning-operator/tuned-7chqg"
Sep 11 16:30:02.007475 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:02.007456    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-px97j\" (UniqueName: \"kubernetes.io/projected/af6fc84f-60b8-404c-b60d-3beea49842ef-kube-api-access-px97j\") pod \"ovnkube-node-d6fww\" (UID: \"af6fc84f-60b8-404c-b60d-3beea49842ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:02.093539 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:02.093454    2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 16:30:02.115905 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:02.115877    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4s7mv"
Sep 11 16:30:02.122566 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:02.122547    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 16:30:02.141733 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:02.141706    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-m462n"
Sep 11 16:30:02.165075 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:02.165042    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7chqg"
Sep 11 16:30:02.166203 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:02.166184    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nk4fp"
Sep 11 16:30:02.192480 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:02.192456    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xsfcb"
Sep 11 16:30:02.210736 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:02.210705    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7vx4s"
Sep 11 16:30:02.225620 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:02.225598    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-22ws5"
Sep 11 16:30:02.230592 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:02.230570    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pphqd"
Sep 11 16:30:02.234794 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:02.234774    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:02.481037 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:02.480860    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a461122a1f6358acaf2534ef0387a00.slice/crio-37092a25f811137539fb3ba2175b0fe3a0d4b3ece01ba7aa1a96cb46933b2858 WatchSource:0}: Error finding container 37092a25f811137539fb3ba2175b0fe3a0d4b3ece01ba7aa1a96cb46933b2858: Status 404 returned error can't find the container with id 37092a25f811137539fb3ba2175b0fe3a0d4b3ece01ba7aa1a96cb46933b2858
Sep 11 16:30:02.481236 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:02.481212    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc12b764bd8b3cb219479257da5703361.slice/crio-8118d4b0f8b014c5bb4055ed55dd298731c68c2d51b115fda36f65571bd1e267 WatchSource:0}: Error finding container 8118d4b0f8b014c5bb4055ed55dd298731c68c2d51b115fda36f65571bd1e267: Status 404 returned error can't find the container with id 8118d4b0f8b014c5bb4055ed55dd298731c68c2d51b115fda36f65571bd1e267
Sep 11 16:30:02.487359 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:02.487342    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 16:30:02.495226 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:02.495205    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97ffcc27-5973-418d-a29e-762556b9c3e0-metrics-certs\") pod \"network-metrics-daemon-dnqst\" (UID: \"97ffcc27-5973-418d-a29e-762556b9c3e0\") " pod="openshift-multus/network-metrics-daemon-dnqst"
Sep 11 16:30:02.495304 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:02.495265    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e52d92c8-b840-42dd-9e4b-ea9f196e7623-original-pull-secret\") pod \"global-pull-secret-syncer-xkz2b\" (UID: \"e52d92c8-b840-42dd-9e4b-ea9f196e7623\") " pod="kube-system/global-pull-secret-syncer-xkz2b"
Sep 11 16:30:02.495361 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:02.495342    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:30:02.495405 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:02.495364    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 16:30:02.495441 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:02.495403    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97ffcc27-5973-418d-a29e-762556b9c3e0-metrics-certs podName:97ffcc27-5973-418d-a29e-762556b9c3e0 nodeName:}" failed. No retries permitted until 2026-09-11 16:30:03.495387878 +0000 UTC m=+3.112144925 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/97ffcc27-5973-418d-a29e-762556b9c3e0-metrics-certs") pod "network-metrics-daemon-dnqst" (UID: "97ffcc27-5973-418d-a29e-762556b9c3e0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:30:02.495441 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:02.495418    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e52d92c8-b840-42dd-9e4b-ea9f196e7623-original-pull-secret podName:e52d92c8-b840-42dd-9e4b-ea9f196e7623 nodeName:}" failed. No retries permitted until 2026-09-11 16:30:03.495411582 +0000 UTC m=+3.112168628 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e52d92c8-b840-42dd-9e4b-ea9f196e7623-original-pull-secret") pod "global-pull-secret-syncer-xkz2b" (UID: "e52d92c8-b840-42dd-9e4b-ea9f196e7623") : object "kube-system"/"original-pull-secret" not registered
Sep 11 16:30:02.563139 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:02.563112    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf519b0e8_fff1_441a_9151_4d6c54437b2b.slice/crio-283154920a6b9da089e09b77f08619d839c51838143194d61bdacc91d6404285 WatchSource:0}: Error finding container 283154920a6b9da089e09b77f08619d839c51838143194d61bdacc91d6404285: Status 404 returned error can't find the container with id 283154920a6b9da089e09b77f08619d839c51838143194d61bdacc91d6404285
Sep 11 16:30:02.595856 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:02.595827    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgblx\" (UniqueName: \"kubernetes.io/projected/14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0-kube-api-access-wgblx\") pod \"network-check-target-qx7z8\" (UID: \"14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0\") " pod="openshift-network-diagnostics/network-check-target-qx7z8"
Sep 11 16:30:02.595983 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:02.595970    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 16:30:02.595983 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:02.595983    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 16:30:02.596073 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:02.595993    2581 projected.go:196] Error preparing data for projected volume kube-api-access-wgblx for pod openshift-network-diagnostics/network-check-target-qx7z8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:30:02.596073 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:02.596051    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0-kube-api-access-wgblx podName:14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0 nodeName:}" failed. No retries permitted until 2026-09-11 16:30:03.596032884 +0000 UTC m=+3.212789931 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wgblx" (UniqueName: "kubernetes.io/projected/14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0-kube-api-access-wgblx") pod "network-check-target-qx7z8" (UID: "14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:30:02.764545 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:02.764512    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95f9914b_ed9b_4aa9_a3b9_44dee448edd8.slice/crio-cc5ae94f1e2161a4fbee76963cce9b09c1232836d5f5a00635fe8b3ee22e86cf WatchSource:0}: Error finding container cc5ae94f1e2161a4fbee76963cce9b09c1232836d5f5a00635fe8b3ee22e86cf: Status 404 returned error can't find the container with id cc5ae94f1e2161a4fbee76963cce9b09c1232836d5f5a00635fe8b3ee22e86cf
Sep 11 16:30:02.765305 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:02.765280    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0df191cd_baa5_4bd5_8806_becaccb21357.slice/crio-8c6f5258f34fcb1f901fa94f08ea2f155d02c6a3885a8d60a1bf62e966fb4dc5 WatchSource:0}: Error finding container 8c6f5258f34fcb1f901fa94f08ea2f155d02c6a3885a8d60a1bf62e966fb4dc5: Status 404 returned error can't find the container with id 8c6f5258f34fcb1f901fa94f08ea2f155d02c6a3885a8d60a1bf62e966fb4dc5
Sep 11 16:30:02.848109 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:02.848072    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 16:25:02 +0000 UTC" deadline="2028-06-20 08:38:05.636723402 +0000 UTC"
Sep 11 16:30:02.848109 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:02.848114    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15544h8m2.788612737s"
Sep 11 16:30:02.935203 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:02.935165    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 16:30:02.964490 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:02.964456    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0acb3a32_feed_4107_9ee3_ca263fd887df.slice/crio-1d27b7e944daebe08c21dac5ff21ad92b80fd0cc455824a7d915dc21313be566 WatchSource:0}: Error finding container 1d27b7e944daebe08c21dac5ff21ad92b80fd0cc455824a7d915dc21313be566: Status 404 returned error can't find the container with id 1d27b7e944daebe08c21dac5ff21ad92b80fd0cc455824a7d915dc21313be566
Sep 11 16:30:02.982130 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:02.982092    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkz2b"
Sep 11 16:30:02.982265 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:02.982227    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkz2b" podUID="e52d92c8-b840-42dd-9e4b-ea9f196e7623"
Sep 11 16:30:02.987474 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:02.987419    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7vx4s" event={"ID":"95f9914b-ed9b-4aa9-a3b9-44dee448edd8","Type":"ContainerStarted","Data":"cc5ae94f1e2161a4fbee76963cce9b09c1232836d5f5a00635fe8b3ee22e86cf"}
Sep 11 16:30:02.988840 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:02.988784    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4s7mv" event={"ID":"f519b0e8-fff1-441a-9151-4d6c54437b2b","Type":"ContainerStarted","Data":"283154920a6b9da089e09b77f08619d839c51838143194d61bdacc91d6404285"}
Sep 11 16:30:02.990250 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:02.990223    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-192.ec2.internal" event={"ID":"c12b764bd8b3cb219479257da5703361","Type":"ContainerStarted","Data":"8118d4b0f8b014c5bb4055ed55dd298731c68c2d51b115fda36f65571bd1e267"}
Sep 11 16:30:02.991493 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:02.991462    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal" event={"ID":"8a461122a1f6358acaf2534ef0387a00","Type":"ContainerStarted","Data":"37092a25f811137539fb3ba2175b0fe3a0d4b3ece01ba7aa1a96cb46933b2858"}
Sep 11 16:30:02.992725 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:02.992697    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pphqd" event={"ID":"0acb3a32-feed-4107-9ee3-ca263fd887df","Type":"ContainerStarted","Data":"1d27b7e944daebe08c21dac5ff21ad92b80fd0cc455824a7d915dc21313be566"}
Sep 11 16:30:02.994057 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:02.994032    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7chqg" event={"ID":"0df191cd-baa5-4bd5-8806-becaccb21357","Type":"ContainerStarted","Data":"8c6f5258f34fcb1f901fa94f08ea2f155d02c6a3885a8d60a1bf62e966fb4dc5"}
Sep 11 16:30:03.032182 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:03.032133    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod524a886f_2ad6_4842_95bd_67870c33ad33.slice/crio-f43b60542c66bd328a5074722cdfdeac7ec3bf22420210a4e3b247d227a4dfac WatchSource:0}: Error finding container f43b60542c66bd328a5074722cdfdeac7ec3bf22420210a4e3b247d227a4dfac: Status 404 returned error can't find the container with id f43b60542c66bd328a5074722cdfdeac7ec3bf22420210a4e3b247d227a4dfac
Sep 11 16:30:03.220418 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:03.220382    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6754d1f_d663_4e69_aad4_a0c1523b1559.slice/crio-347ec3f77d37a6a77c62492d6370fb41196503694464cd491064df960dd5cc33 WatchSource:0}: Error finding container 347ec3f77d37a6a77c62492d6370fb41196503694464cd491064df960dd5cc33: Status 404 returned error can't find the container with id 347ec3f77d37a6a77c62492d6370fb41196503694464cd491064df960dd5cc33
Sep 11 16:30:03.318887 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:03.318849    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41863045_9930_4c6f_a9a4_cb77f319ed93.slice/crio-f85fcbb378b4748fe8a8a99a5c893bcbc50e21fe1e757cea1e8037e1b6371136 WatchSource:0}: Error finding container f85fcbb378b4748fe8a8a99a5c893bcbc50e21fe1e757cea1e8037e1b6371136: Status 404 returned error can't find the container with id f85fcbb378b4748fe8a8a99a5c893bcbc50e21fe1e757cea1e8037e1b6371136
Sep 11 16:30:03.412957 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:03.412925    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf6fc84f_60b8_404c_b60d_3beea49842ef.slice/crio-9f21a8efd24860e67142a88a17b0afa65086a88daa497adffa2e8d40aae55dcf WatchSource:0}: Error finding container 9f21a8efd24860e67142a88a17b0afa65086a88daa497adffa2e8d40aae55dcf: Status 404 returned error can't find the container with id 9f21a8efd24860e67142a88a17b0afa65086a88daa497adffa2e8d40aae55dcf
Sep 11 16:30:03.426435 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:03.426407    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69e5eae6_9a55_49ac_a01c_70cbadab5acd.slice/crio-da53f6b74b0cd8f25919992487b18cedfcff02e0ea076d6cf177aba8476e01c9 WatchSource:0}: Error finding container da53f6b74b0cd8f25919992487b18cedfcff02e0ea076d6cf177aba8476e01c9: Status 404 returned error can't find the container with id da53f6b74b0cd8f25919992487b18cedfcff02e0ea076d6cf177aba8476e01c9
Sep 11 16:30:03.503514 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:03.503470    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e52d92c8-b840-42dd-9e4b-ea9f196e7623-original-pull-secret\") pod \"global-pull-secret-syncer-xkz2b\" (UID: \"e52d92c8-b840-42dd-9e4b-ea9f196e7623\") " pod="kube-system/global-pull-secret-syncer-xkz2b"
Sep 11 16:30:03.503685 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:03.503530    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97ffcc27-5973-418d-a29e-762556b9c3e0-metrics-certs\") pod \"network-metrics-daemon-dnqst\" (UID: \"97ffcc27-5973-418d-a29e-762556b9c3e0\") " pod="openshift-multus/network-metrics-daemon-dnqst"
Sep 11 16:30:03.503685 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:03.503651    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:30:03.503802 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:03.503715    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97ffcc27-5973-418d-a29e-762556b9c3e0-metrics-certs podName:97ffcc27-5973-418d-a29e-762556b9c3e0 nodeName:}" failed. No retries permitted until 2026-09-11 16:30:05.503697338 +0000 UTC m=+5.120454385 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/97ffcc27-5973-418d-a29e-762556b9c3e0-metrics-certs") pod "network-metrics-daemon-dnqst" (UID: "97ffcc27-5973-418d-a29e-762556b9c3e0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:30:03.503802 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:03.503793    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 16:30:03.503923 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:03.503853    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e52d92c8-b840-42dd-9e4b-ea9f196e7623-original-pull-secret podName:e52d92c8-b840-42dd-9e4b-ea9f196e7623 nodeName:}" failed. No retries permitted until 2026-09-11 16:30:05.503839626 +0000 UTC m=+5.120596672 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e52d92c8-b840-42dd-9e4b-ea9f196e7623-original-pull-secret") pod "global-pull-secret-syncer-xkz2b" (UID: "e52d92c8-b840-42dd-9e4b-ea9f196e7623") : object "kube-system"/"original-pull-secret" not registered
Sep 11 16:30:03.604886 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:03.604791    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgblx\" (UniqueName: \"kubernetes.io/projected/14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0-kube-api-access-wgblx\") pod \"network-check-target-qx7z8\" (UID: \"14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0\") " pod="openshift-network-diagnostics/network-check-target-qx7z8"
Sep 11 16:30:03.605047 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:03.604977    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 16:30:03.605047 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:03.605003    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 16:30:03.605047 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:03.605016    2581 projected.go:196] Error preparing data for projected volume kube-api-access-wgblx for pod openshift-network-diagnostics/network-check-target-qx7z8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:30:03.605203 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:03.605075    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0-kube-api-access-wgblx podName:14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0 nodeName:}" failed. No retries permitted until 2026-09-11 16:30:05.605059365 +0000 UTC m=+5.221816436 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wgblx" (UniqueName: "kubernetes.io/projected/14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0-kube-api-access-wgblx") pod "network-check-target-qx7z8" (UID: "14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:30:03.849174 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:03.849076    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 16:25:02 +0000 UTC" deadline="2028-05-05 20:22:56.097054302 +0000 UTC"
Sep 11 16:30:03.849174 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:03.849163    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14451h52m52.247897089s"
Sep 11 16:30:03.872392 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:03.872306    2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 16:30:03.981566 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:03.981524    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnqst"
Sep 11 16:30:03.981755 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:03.981690    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnqst" podUID="97ffcc27-5973-418d-a29e-762556b9c3e0"
Sep 11 16:30:03.982129 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:03.982110    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qx7z8"
Sep 11 16:30:03.982273 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:03.982236    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qx7z8" podUID="14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0"
Sep 11 16:30:04.001994 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:04.001951    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d6fww" event={"ID":"af6fc84f-60b8-404c-b60d-3beea49842ef","Type":"ContainerStarted","Data":"9f21a8efd24860e67142a88a17b0afa65086a88daa497adffa2e8d40aae55dcf"}
Sep 11 16:30:04.010471 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:04.010431    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-22ws5" event={"ID":"d6754d1f-d663-4e69-aad4-a0c1523b1559","Type":"ContainerStarted","Data":"347ec3f77d37a6a77c62492d6370fb41196503694464cd491064df960dd5cc33"}
Sep 11 16:30:04.012921 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:04.012889    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-m462n" event={"ID":"524a886f-2ad6-4842-95bd-67870c33ad33","Type":"ContainerStarted","Data":"f43b60542c66bd328a5074722cdfdeac7ec3bf22420210a4e3b247d227a4dfac"}
Sep 11 16:30:04.018622 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:04.018580    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xsfcb" event={"ID":"69e5eae6-9a55-49ac-a01c-70cbadab5acd","Type":"ContainerStarted","Data":"da53f6b74b0cd8f25919992487b18cedfcff02e0ea076d6cf177aba8476e01c9"}
Sep 11 16:30:04.028472 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:04.028439    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nk4fp" event={"ID":"41863045-9930-4c6f-a9a4-cb77f319ed93","Type":"ContainerStarted","Data":"f85fcbb378b4748fe8a8a99a5c893bcbc50e21fe1e757cea1e8037e1b6371136"}
Sep 11 16:30:04.981939 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:04.981899    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkz2b"
Sep 11 16:30:04.982434 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:04.982053    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkz2b" podUID="e52d92c8-b840-42dd-9e4b-ea9f196e7623"
Sep 11 16:30:05.520427 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:05.520384    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e52d92c8-b840-42dd-9e4b-ea9f196e7623-original-pull-secret\") pod \"global-pull-secret-syncer-xkz2b\" (UID: \"e52d92c8-b840-42dd-9e4b-ea9f196e7623\") " pod="kube-system/global-pull-secret-syncer-xkz2b"
Sep 11 16:30:05.520641 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:05.520460    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97ffcc27-5973-418d-a29e-762556b9c3e0-metrics-certs\") pod \"network-metrics-daemon-dnqst\" (UID: \"97ffcc27-5973-418d-a29e-762556b9c3e0\") " pod="openshift-multus/network-metrics-daemon-dnqst"
Sep 11 16:30:05.520641 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:05.520610    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:30:05.520761 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:05.520677    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97ffcc27-5973-418d-a29e-762556b9c3e0-metrics-certs podName:97ffcc27-5973-418d-a29e-762556b9c3e0 nodeName:}" failed. No retries permitted until 2026-09-11 16:30:09.520657253 +0000 UTC m=+9.137414315 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/97ffcc27-5973-418d-a29e-762556b9c3e0-metrics-certs") pod "network-metrics-daemon-dnqst" (UID: "97ffcc27-5973-418d-a29e-762556b9c3e0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:30:05.521110 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:05.521088    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 16:30:05.521235 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:05.521148    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e52d92c8-b840-42dd-9e4b-ea9f196e7623-original-pull-secret podName:e52d92c8-b840-42dd-9e4b-ea9f196e7623 nodeName:}" failed. No retries permitted until 2026-09-11 16:30:09.521130688 +0000 UTC m=+9.137887749 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e52d92c8-b840-42dd-9e4b-ea9f196e7623-original-pull-secret") pod "global-pull-secret-syncer-xkz2b" (UID: "e52d92c8-b840-42dd-9e4b-ea9f196e7623") : object "kube-system"/"original-pull-secret" not registered
Sep 11 16:30:05.620966 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:05.620924    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgblx\" (UniqueName: \"kubernetes.io/projected/14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0-kube-api-access-wgblx\") pod \"network-check-target-qx7z8\" (UID: \"14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0\") " pod="openshift-network-diagnostics/network-check-target-qx7z8"
Sep 11 16:30:05.621179 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:05.621141    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 16:30:05.621179 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:05.621172    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 16:30:05.621292 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:05.621186    2581 projected.go:196] Error preparing data for projected volume kube-api-access-wgblx for pod openshift-network-diagnostics/network-check-target-qx7z8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:30:05.621292 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:05.621257    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0-kube-api-access-wgblx podName:14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0 nodeName:}" failed. No retries permitted until 2026-09-11 16:30:09.621236073 +0000 UTC m=+9.237993141 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wgblx" (UniqueName: "kubernetes.io/projected/14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0-kube-api-access-wgblx") pod "network-check-target-qx7z8" (UID: "14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:30:05.982235 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:05.981910    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnqst"
Sep 11 16:30:05.982235 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:05.982112    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnqst" podUID="97ffcc27-5973-418d-a29e-762556b9c3e0"
Sep 11 16:30:05.982658 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:05.982579    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qx7z8"
Sep 11 16:30:05.982694 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:05.982669    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qx7z8" podUID="14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0"
Sep 11 16:30:06.981500 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:06.981463    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkz2b"
Sep 11 16:30:06.981685 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:06.981659    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkz2b" podUID="e52d92c8-b840-42dd-9e4b-ea9f196e7623"
Sep 11 16:30:07.982467 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:07.981786    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnqst"
Sep 11 16:30:07.982467 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:07.981944    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnqst" podUID="97ffcc27-5973-418d-a29e-762556b9c3e0"
Sep 11 16:30:07.982467 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:07.981783    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qx7z8"
Sep 11 16:30:07.982467 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:07.982417    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qx7z8" podUID="14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0"
Sep 11 16:30:08.986200 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:08.985659    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkz2b"
Sep 11 16:30:08.986200 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:08.985797    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkz2b" podUID="e52d92c8-b840-42dd-9e4b-ea9f196e7623"
Sep 11 16:30:09.561014 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:09.560975    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97ffcc27-5973-418d-a29e-762556b9c3e0-metrics-certs\") pod \"network-metrics-daemon-dnqst\" (UID: \"97ffcc27-5973-418d-a29e-762556b9c3e0\") " pod="openshift-multus/network-metrics-daemon-dnqst"
Sep 11 16:30:09.561233 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:09.561063    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e52d92c8-b840-42dd-9e4b-ea9f196e7623-original-pull-secret\") pod \"global-pull-secret-syncer-xkz2b\" (UID: \"e52d92c8-b840-42dd-9e4b-ea9f196e7623\") " pod="kube-system/global-pull-secret-syncer-xkz2b"
Sep 11 16:30:09.561233 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:09.561199    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 16:30:09.561233 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:09.561205    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:30:09.561493 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:09.561286    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e52d92c8-b840-42dd-9e4b-ea9f196e7623-original-pull-secret podName:e52d92c8-b840-42dd-9e4b-ea9f196e7623 nodeName:}" failed. No retries permitted until 2026-09-11 16:30:17.561263482 +0000 UTC m=+17.178020541 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e52d92c8-b840-42dd-9e4b-ea9f196e7623-original-pull-secret") pod "global-pull-secret-syncer-xkz2b" (UID: "e52d92c8-b840-42dd-9e4b-ea9f196e7623") : object "kube-system"/"original-pull-secret" not registered
Sep 11 16:30:09.561493 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:09.561308    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97ffcc27-5973-418d-a29e-762556b9c3e0-metrics-certs podName:97ffcc27-5973-418d-a29e-762556b9c3e0 nodeName:}" failed. No retries permitted until 2026-09-11 16:30:17.561297305 +0000 UTC m=+17.178054351 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/97ffcc27-5973-418d-a29e-762556b9c3e0-metrics-certs") pod "network-metrics-daemon-dnqst" (UID: "97ffcc27-5973-418d-a29e-762556b9c3e0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:30:09.662189 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:09.662080    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgblx\" (UniqueName: \"kubernetes.io/projected/14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0-kube-api-access-wgblx\") pod \"network-check-target-qx7z8\" (UID: \"14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0\") " pod="openshift-network-diagnostics/network-check-target-qx7z8"
Sep 11 16:30:09.662366 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:09.662287    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 16:30:09.662366 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:09.662313    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 16:30:09.662366 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:09.662327    2581 projected.go:196] Error preparing data for projected volume kube-api-access-wgblx for pod openshift-network-diagnostics/network-check-target-qx7z8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:30:09.662533 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:09.662379    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0-kube-api-access-wgblx podName:14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0 nodeName:}" failed. No retries permitted until 2026-09-11 16:30:17.662365766 +0000 UTC m=+17.279122813 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wgblx" (UniqueName: "kubernetes.io/projected/14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0-kube-api-access-wgblx") pod "network-check-target-qx7z8" (UID: "14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:30:09.981333 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:09.981248    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnqst"
Sep 11 16:30:09.981497 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:09.981393    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnqst" podUID="97ffcc27-5973-418d-a29e-762556b9c3e0"
Sep 11 16:30:09.981951 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:09.981777    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qx7z8"
Sep 11 16:30:09.981951 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:09.981899    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qx7z8" podUID="14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0"
Sep 11 16:30:10.987256 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:10.987224    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkz2b"
Sep 11 16:30:10.987743 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:10.987364    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkz2b" podUID="e52d92c8-b840-42dd-9e4b-ea9f196e7623"
Sep 11 16:30:11.981216 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:11.981183    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qx7z8"
Sep 11 16:30:11.981400 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:11.981312    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qx7z8" podUID="14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0"
Sep 11 16:30:11.981802 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:11.981641    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnqst"
Sep 11 16:30:11.981802 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:11.981757    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnqst" podUID="97ffcc27-5973-418d-a29e-762556b9c3e0"
Sep 11 16:30:12.985077 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:12.984999    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkz2b"
Sep 11 16:30:12.985555 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:12.985124    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkz2b" podUID="e52d92c8-b840-42dd-9e4b-ea9f196e7623"
Sep 11 16:30:13.982111 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:13.982019    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qx7z8"
Sep 11 16:30:13.982111 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:13.982054    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnqst"
Sep 11 16:30:13.982288 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:13.982154    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qx7z8" podUID="14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0"
Sep 11 16:30:13.982331 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:13.982292    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnqst" podUID="97ffcc27-5973-418d-a29e-762556b9c3e0"
Sep 11 16:30:14.982129 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:14.982082    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkz2b"
Sep 11 16:30:14.982572 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:14.982231    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkz2b" podUID="e52d92c8-b840-42dd-9e4b-ea9f196e7623"
Sep 11 16:30:15.981333 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:15.981296    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qx7z8"
Sep 11 16:30:15.981524 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:15.981309    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnqst"
Sep 11 16:30:15.981524 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:15.981431    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qx7z8" podUID="14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0"
Sep 11 16:30:15.981524 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:15.981508    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnqst" podUID="97ffcc27-5973-418d-a29e-762556b9c3e0"
Sep 11 16:30:16.981765 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:16.981721    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkz2b"
Sep 11 16:30:16.982193 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:16.981853    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkz2b" podUID="e52d92c8-b840-42dd-9e4b-ea9f196e7623"
Sep 11 16:30:17.634531 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:17.634443    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e52d92c8-b840-42dd-9e4b-ea9f196e7623-original-pull-secret\") pod \"global-pull-secret-syncer-xkz2b\" (UID: \"e52d92c8-b840-42dd-9e4b-ea9f196e7623\") " pod="kube-system/global-pull-secret-syncer-xkz2b"
Sep 11 16:30:17.634531 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:17.634494    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97ffcc27-5973-418d-a29e-762556b9c3e0-metrics-certs\") pod \"network-metrics-daemon-dnqst\" (UID: \"97ffcc27-5973-418d-a29e-762556b9c3e0\") " pod="openshift-multus/network-metrics-daemon-dnqst"
Sep 11 16:30:17.634735 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:17.634620    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 16:30:17.634735 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:17.634626    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:30:17.634735 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:17.634696    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97ffcc27-5973-418d-a29e-762556b9c3e0-metrics-certs podName:97ffcc27-5973-418d-a29e-762556b9c3e0 nodeName:}" failed. No retries permitted until 2026-09-11 16:30:33.634676259 +0000 UTC m=+33.251433324 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/97ffcc27-5973-418d-a29e-762556b9c3e0-metrics-certs") pod "network-metrics-daemon-dnqst" (UID: "97ffcc27-5973-418d-a29e-762556b9c3e0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:30:17.634735 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:17.634722    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e52d92c8-b840-42dd-9e4b-ea9f196e7623-original-pull-secret podName:e52d92c8-b840-42dd-9e4b-ea9f196e7623 nodeName:}" failed. No retries permitted until 2026-09-11 16:30:33.634710234 +0000 UTC m=+33.251467285 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e52d92c8-b840-42dd-9e4b-ea9f196e7623-original-pull-secret") pod "global-pull-secret-syncer-xkz2b" (UID: "e52d92c8-b840-42dd-9e4b-ea9f196e7623") : object "kube-system"/"original-pull-secret" not registered
Sep 11 16:30:17.735520 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:17.735481    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgblx\" (UniqueName: \"kubernetes.io/projected/14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0-kube-api-access-wgblx\") pod \"network-check-target-qx7z8\" (UID: \"14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0\") " pod="openshift-network-diagnostics/network-check-target-qx7z8"
Sep 11 16:30:17.735692 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:17.735668    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 16:30:17.735753 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:17.735693    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 16:30:17.735753 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:17.735705    2581 projected.go:196] Error preparing data for projected volume kube-api-access-wgblx for pod openshift-network-diagnostics/network-check-target-qx7z8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:30:17.735853 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:17.735772    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0-kube-api-access-wgblx podName:14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0 nodeName:}" failed. No retries permitted until 2026-09-11 16:30:33.735753823 +0000 UTC m=+33.352510886 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wgblx" (UniqueName: "kubernetes.io/projected/14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0-kube-api-access-wgblx") pod "network-check-target-qx7z8" (UID: "14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:30:17.981681 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:17.981605    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qx7z8"
Sep 11 16:30:17.981681 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:17.981641    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnqst"
Sep 11 16:30:17.982300 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:17.981712    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qx7z8" podUID="14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0"
Sep 11 16:30:17.982300 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:17.981817    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnqst" podUID="97ffcc27-5973-418d-a29e-762556b9c3e0"
Sep 11 16:30:18.985201 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:18.985168    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkz2b"
Sep 11 16:30:18.985602 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:18.985303    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkz2b" podUID="e52d92c8-b840-42dd-9e4b-ea9f196e7623"
Sep 11 16:30:19.981815 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:19.981783    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnqst"
Sep 11 16:30:19.981989 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:19.981832    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qx7z8"
Sep 11 16:30:19.981989 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:19.981925    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnqst" podUID="97ffcc27-5973-418d-a29e-762556b9c3e0"
Sep 11 16:30:19.982109 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:19.982053    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qx7z8" podUID="14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0"
Sep 11 16:30:20.982537 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:20.982505    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkz2b"
Sep 11 16:30:20.982984 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:20.982619    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkz2b" podUID="e52d92c8-b840-42dd-9e4b-ea9f196e7623"
Sep 11 16:30:21.981609 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:21.981420    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnqst"
Sep 11 16:30:21.981709 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:21.981468    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qx7z8"
Sep 11 16:30:21.981774 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:21.981731    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnqst" podUID="97ffcc27-5973-418d-a29e-762556b9c3e0"
Sep 11 16:30:21.981848 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:21.981827    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qx7z8" podUID="14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0"
Sep 11 16:30:22.066346 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:22.066230    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7chqg" event={"ID":"0df191cd-baa5-4bd5-8806-becaccb21357","Type":"ContainerStarted","Data":"46c12236d84d70f82ebd072660e717b193050f984a8fa8a1fbde316033b1cd67"}
Sep 11 16:30:22.069936 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:22.069912    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-192.ec2.internal" event={"ID":"c12b764bd8b3cb219479257da5703361","Type":"ContainerStarted","Data":"05bd47fd2c62b2ca68d655a71274ca4923634be3ab1cfa6a6d15ed0ed64ecffb"}
Sep 11 16:30:22.085589 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:22.085465    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7chqg" podStartSLOduration=2.038316401 podStartE2EDuration="21.085439351s" totalImagesPullingTime="19.04712295s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:30:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:30:22.085140569 +0000 UTC m=+21.701897656" watchObservedRunningTime="2026-09-11 16:30:22.085439351 +0000 UTC m=+21.702196419"
Sep 11 16:30:22.099416 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:22.099311    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-192.ec2.internal" podStartSLOduration=20.099292067 podStartE2EDuration="20.099292067s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:30:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:30:22.099153007 +0000 UTC m=+21.715910095" watchObservedRunningTime="2026-09-11 16:30:22.099292067 +0000 UTC m=+21.716049136"
Sep 11 16:30:22.981794 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:22.981549    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkz2b"
Sep 11 16:30:22.982074 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:22.981905    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkz2b" podUID="e52d92c8-b840-42dd-9e4b-ea9f196e7623"
Sep 11 16:30:23.073518 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:23.073479    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pphqd" event={"ID":"0acb3a32-feed-4107-9ee3-ca263fd887df","Type":"ContainerStarted","Data":"c4ab6928c73c98dc16f532fdba135904ee6ba2dda6f018344bf2639fbfa586c2"}
Sep 11 16:30:23.075009 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:23.074985    2581 generic.go:356] "Generic (PLEG): container finished" podID="f519b0e8-fff1-441a-9151-4d6c54437b2b" containerID="d264ca8723087e3d6d7846b1972b92330ac34b27554912a34f6df20e6da11c2f" exitCode=0
Sep 11 16:30:23.075128 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:23.075054    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4s7mv" event={"ID":"f519b0e8-fff1-441a-9151-4d6c54437b2b","Type":"ContainerDied","Data":"d264ca8723087e3d6d7846b1972b92330ac34b27554912a34f6df20e6da11c2f"}
Sep 11 16:30:23.076645 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:23.076579    2581 generic.go:356] "Generic (PLEG): container finished" podID="8a461122a1f6358acaf2534ef0387a00" containerID="e6bdf4502f8d0b57d2b53c7d9abafc8c160ca2a81f4eec55929f3a2e93b283f6" exitCode=0
Sep 11 16:30:23.076714 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:23.076652    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal" event={"ID":"8a461122a1f6358acaf2534ef0387a00","Type":"ContainerDied","Data":"e6bdf4502f8d0b57d2b53c7d9abafc8c160ca2a81f4eec55929f3a2e93b283f6"}
Sep 11 16:30:23.080191 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:23.080168    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d6fww" event={"ID":"af6fc84f-60b8-404c-b60d-3beea49842ef","Type":"ContainerStarted","Data":"70dbd19cef7349014dc661bdfa19b064589c55bdbdb35edaddd05c6cf9d1e428"}
Sep 11 16:30:23.080293 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:23.080231    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d6fww" event={"ID":"af6fc84f-60b8-404c-b60d-3beea49842ef","Type":"ContainerStarted","Data":"dcdbd038e5614925c72cc438e1ff8e007d920f22dce8200e5d9112b86b6c9ad0"}
Sep 11 16:30:23.080293 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:23.080281    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d6fww" event={"ID":"af6fc84f-60b8-404c-b60d-3beea49842ef","Type":"ContainerStarted","Data":"3756b37c8d64eadd64b0cb064aca4892a7bafa10c17cdc2173ff18aac35531c8"}
Sep 11 16:30:23.080402 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:23.080312    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d6fww" event={"ID":"af6fc84f-60b8-404c-b60d-3beea49842ef","Type":"ContainerStarted","Data":"7b9d7c84d97bd0e609c348f443f6eeb77b464b321db045e83be77726dc887887"}
Sep 11 16:30:23.080402 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:23.080339    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d6fww" event={"ID":"af6fc84f-60b8-404c-b60d-3beea49842ef","Type":"ContainerStarted","Data":"fedf76f178d4c258c3be72944ee111b093148ba6ecd724cf2642743f86ed5468"}
Sep 11 16:30:23.080402 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:23.080373    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d6fww" event={"ID":"af6fc84f-60b8-404c-b60d-3beea49842ef","Type":"ContainerStarted","Data":"d0b4f759580f13b6596d5404e8596a95cf73538227f740d17203e45db7ecda5d"}
Sep 11 16:30:23.081691 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:23.081670    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-22ws5" event={"ID":"d6754d1f-d663-4e69-aad4-a0c1523b1559","Type":"ContainerStarted","Data":"b48897e51c68c8ad894808cbdef3c8ea1ed615d90609f54c407c5a5f7cbaf049"}
Sep 11 16:30:23.083182 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:23.083161    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7vx4s" event={"ID":"95f9914b-ed9b-4aa9-a3b9-44dee448edd8","Type":"ContainerStarted","Data":"81bb14df6f03f6bdbe29324baf1eb079d2bf44954fc0d71367343e6e67d3d370"}
Sep 11 16:30:23.084557 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:23.084536    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xsfcb" event={"ID":"69e5eae6-9a55-49ac-a01c-70cbadab5acd","Type":"ContainerStarted","Data":"e64423c3b90784d7bd4f6b806cbb2bacce988f9d0c6a397b120975c81dda19f1"}
Sep 11 16:30:23.085978 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:23.085957    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nk4fp" event={"ID":"41863045-9930-4c6f-a9a4-cb77f319ed93","Type":"ContainerStarted","Data":"9b428c8f63c410cc6454d1d7c99877ec1cc1594113bcae40bb7a252ec3dbc57c"}
Sep 11 16:30:23.113481 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:23.113424    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xsfcb" podStartSLOduration=3.711783829 podStartE2EDuration="22.113408642s" totalImagesPullingTime="18.401624813s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:30:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:30:23.11302492 +0000 UTC m=+22.729782016" watchObservedRunningTime="2026-09-11 16:30:23.113408642 +0000 UTC m=+22.730165708"
Sep 11 16:30:23.144236 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:23.144148    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-22ws5" podStartSLOduration=8.02428971 podStartE2EDuration="22.144124844s" totalImagesPullingTime="14.119835134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:30:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:30:23.12833946 +0000 UTC m=+22.745096544" watchObservedRunningTime="2026-09-11 16:30:23.144124844 +0000 UTC m=+22.760881911"
Sep 11 16:30:23.163225 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:23.163185    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7vx4s" podStartSLOduration=3.066071085 podStartE2EDuration="22.163168692s" totalImagesPullingTime="19.097097607s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:30:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:30:23.162927452 +0000 UTC m=+22.779684535" watchObservedRunningTime="2026-09-11 16:30:23.163168692 +0000 UTC m=+22.779925758"
Sep 11 16:30:23.180203 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:23.180163    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-nk4fp" podStartSLOduration=3.671666139 podStartE2EDuration="22.180148247s" totalImagesPullingTime="18.508482108s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:30:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:30:23.17969553 +0000 UTC m=+22.796452597" watchObservedRunningTime="2026-09-11 16:30:23.180148247 +0000 UTC m=+22.796905314"
Sep 11 16:30:23.228761 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:23.228730    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:30:23.305038 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:23.305005    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:30:23.374648 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:23.374575    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:30:23.422180 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:23.422147    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-22ws5"
Sep 11 16:30:23.422773 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:23.422750    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-22ws5"
Sep 11 16:30:23.446948 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:23.446924    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:30:23.591158 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:23.590966    2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 11 16:30:23.862469 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:23.862235    2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-11T16:30:23.591155028Z","UUID":"3d3268fd-24e4-46df-a605-7396b61b91e2","Handler":null,"Name":"","Endpoint":""}
Sep 11 16:30:23.863753 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:23.863734    2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 11 16:30:23.863853 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:23.863767    2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 11 16:30:23.981622 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:23.981587    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnqst"
Sep 11 16:30:23.981795 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:23.981632    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qx7z8"
Sep 11 16:30:23.981795 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:23.981703    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnqst" podUID="97ffcc27-5973-418d-a29e-762556b9c3e0"
Sep 11 16:30:23.981904 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:23.981825    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qx7z8" podUID="14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0"
Sep 11 16:30:24.091213 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:24.091177    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pphqd" event={"ID":"0acb3a32-feed-4107-9ee3-ca263fd887df","Type":"ContainerStarted","Data":"19c8efbd292d7c8c68ae723128e10448eaeda5533c7687e20b79dd5512d0c09a"}
Sep 11 16:30:24.093878 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:24.093837    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal" event={"ID":"8a461122a1f6358acaf2534ef0387a00","Type":"ContainerStarted","Data":"06756be2dc3f22f60485f0a6d0453e9ae1d2cbc4c4ac8d7ea2081420b917ccc8"}
Sep 11 16:30:24.096278 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:24.096246    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-m462n" event={"ID":"524a886f-2ad6-4842-95bd-67870c33ad33","Type":"ContainerStarted","Data":"2f1fb6df35c7d165e5fe64d0a1bbf6d9851eb0ab05b383d62d955e28ef45ed87"}
Sep 11 16:30:24.096901 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:24.096879    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-22ws5"
Sep 11 16:30:24.097012 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:24.096940    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-22ws5"
Sep 11 16:30:24.110665 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:24.110611    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal" podStartSLOduration=22.110595491 podStartE2EDuration="22.110595491s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:30:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:30:24.110481084 +0000 UTC m=+23.727238152" watchObservedRunningTime="2026-09-11 16:30:24.110595491 +0000 UTC m=+23.727352558"
Sep 11 16:30:24.140111 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:24.140004    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-m462n" podStartSLOduration=4.34657332 podStartE2EDuration="23.139989288s" totalImagesPullingTime="18.793415968s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:30:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:30:24.125028303 +0000 UTC m=+23.741785385" watchObservedRunningTime="2026-09-11 16:30:24.139989288 +0000 UTC m=+23.756746354"
Sep 11 16:30:24.189878 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:24.189844    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:30:24.290205 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:24.290180    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:30:24.391248 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:24.391155    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:30:24.981576 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:24.981545    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkz2b"
Sep 11 16:30:24.981687 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:24.981665    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkz2b" podUID="e52d92c8-b840-42dd-9e4b-ea9f196e7623"
Sep 11 16:30:25.100908 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:25.100875    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pphqd" event={"ID":"0acb3a32-feed-4107-9ee3-ca263fd887df","Type":"ContainerStarted","Data":"8e3f796f1dc6bc5481005c59f5570dbac67971268e90a38dec9e5c05083c770e"}
Sep 11 16:30:25.104729 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:25.104703    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d6fww" event={"ID":"af6fc84f-60b8-404c-b60d-3beea49842ef","Type":"ContainerStarted","Data":"f994bef6f330448881d94d3d22ef0219bfebb391b5f8b7e18eb5296e46daea2a"}
Sep 11 16:30:25.121732 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:25.121667    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pphqd" podStartSLOduration=3.345295209 podStartE2EDuration="24.121643577s" totalImagesPullingTime="20.776348368s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:30:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:30:25.121123453 +0000 UTC m=+24.737880539" watchObservedRunningTime="2026-09-11 16:30:25.121643577 +0000 UTC m=+24.738400645"
Sep 11 16:30:25.981351 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:25.981310    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnqst"
Sep 11 16:30:25.981563 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:25.981317    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qx7z8"
Sep 11 16:30:25.981563 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:25.981455    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnqst" podUID="97ffcc27-5973-418d-a29e-762556b9c3e0"
Sep 11 16:30:25.981563 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:25.981529    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qx7z8" podUID="14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0"
Sep 11 16:30:26.981482 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:26.981452    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkz2b"
Sep 11 16:30:26.981920 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:26.981588    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkz2b" podUID="e52d92c8-b840-42dd-9e4b-ea9f196e7623"
Sep 11 16:30:27.981411 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:27.981373    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qx7z8"
Sep 11 16:30:27.981643 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:27.981372    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnqst"
Sep 11 16:30:27.981643 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:27.981509    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qx7z8" podUID="14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0"
Sep 11 16:30:27.981643 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:27.981610    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnqst" podUID="97ffcc27-5973-418d-a29e-762556b9c3e0"
Sep 11 16:30:28.982227 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:28.982027    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkz2b"
Sep 11 16:30:28.982695 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:28.982309    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkz2b" podUID="e52d92c8-b840-42dd-9e4b-ea9f196e7623"
Sep 11 16:30:29.116255 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:29.116217    2581 generic.go:356] "Generic (PLEG): container finished" podID="f519b0e8-fff1-441a-9151-4d6c54437b2b" containerID="814cbc2863db9ecf671562f4f7b0799ab178fe47b12d4a94d8071dc2b160c546" exitCode=0
Sep 11 16:30:29.116437 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:29.116302    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4s7mv" event={"ID":"f519b0e8-fff1-441a-9151-4d6c54437b2b","Type":"ContainerDied","Data":"814cbc2863db9ecf671562f4f7b0799ab178fe47b12d4a94d8071dc2b160c546"}
Sep 11 16:30:29.119955 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:29.119932    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d6fww" event={"ID":"af6fc84f-60b8-404c-b60d-3beea49842ef","Type":"ContainerStarted","Data":"e06abd4c8491638516ef2ec1b14ca6d940a5199e26974d8f80963996ffc255ab"}
Sep 11 16:30:29.120296 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:29.120278    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:29.120421 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:29.120343    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:29.120421 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:29.120378    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:29.136053 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:29.136026    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:29.136222 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:29.136156    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:30:29.167469 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:29.167419    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-d6fww" podStartSLOduration=9.349433906 podStartE2EDuration="28.167403134s" totalImagesPullingTime="18.817969228s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:30:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:30:29.166202835 +0000 UTC m=+28.782959917" watchObservedRunningTime="2026-09-11 16:30:29.167403134 +0000 UTC m=+28.784160201"
Sep 11 16:30:29.896755 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:29.894237    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:30:29.981874 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:29.981841    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnqst"
Sep 11 16:30:29.982018 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:29.981955    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnqst" podUID="97ffcc27-5973-418d-a29e-762556b9c3e0"
Sep 11 16:30:29.982067 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:29.982012    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qx7z8"
Sep 11 16:30:29.982158 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:29.982139    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qx7z8" podUID="14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0"
Sep 11 16:30:29.994047 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:29.994020    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:30:30.124680 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:30.124490    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4s7mv" event={"ID":"f519b0e8-fff1-441a-9151-4d6c54437b2b","Type":"ContainerStarted","Data":"7590c04e11d56785437ea5967a38131c29911236e6e8f3bfba66e36bc522accd"}
Sep 11 16:30:30.314674 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:30.314591    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qx7z8"]
Sep 11 16:30:30.314821 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:30.314710    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qx7z8"
Sep 11 16:30:30.314887 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:30.314832    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qx7z8" podUID="14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0"
Sep 11 16:30:30.318971 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:30.318943    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dnqst"]
Sep 11 16:30:30.319144 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:30.319050    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnqst"
Sep 11 16:30:30.319225 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:30.319178    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnqst" podUID="97ffcc27-5973-418d-a29e-762556b9c3e0"
Sep 11 16:30:30.344663 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:30.344592    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xkz2b"]
Sep 11 16:30:30.344804 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:30.344741    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkz2b"
Sep 11 16:30:30.344874 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:30.344850    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkz2b" podUID="e52d92c8-b840-42dd-9e4b-ea9f196e7623"
Sep 11 16:30:31.129473 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:31.129434    2581 generic.go:356] "Generic (PLEG): container finished" podID="f519b0e8-fff1-441a-9151-4d6c54437b2b" containerID="7590c04e11d56785437ea5967a38131c29911236e6e8f3bfba66e36bc522accd" exitCode=0
Sep 11 16:30:31.130019 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:31.129508    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4s7mv" event={"ID":"f519b0e8-fff1-441a-9151-4d6c54437b2b","Type":"ContainerDied","Data":"7590c04e11d56785437ea5967a38131c29911236e6e8f3bfba66e36bc522accd"}
Sep 11 16:30:31.981223 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:31.981186    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnqst"
Sep 11 16:30:31.981359 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:31.981192    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qx7z8"
Sep 11 16:30:31.981359 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:31.981312    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnqst" podUID="97ffcc27-5973-418d-a29e-762556b9c3e0"
Sep 11 16:30:31.981437 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:31.981200    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkz2b"
Sep 11 16:30:31.981437 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:31.981361    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qx7z8" podUID="14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0"
Sep 11 16:30:31.981503 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:31.981448    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkz2b" podUID="e52d92c8-b840-42dd-9e4b-ea9f196e7623"
Sep 11 16:30:32.134443 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:32.134409    2581 generic.go:356] "Generic (PLEG): container finished" podID="f519b0e8-fff1-441a-9151-4d6c54437b2b" containerID="92fe58dfcdf06e66ff5b25668d02bc6d46dfe668ce96f61e293a884f04ce69b3" exitCode=0
Sep 11 16:30:32.134827 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:32.134472    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4s7mv" event={"ID":"f519b0e8-fff1-441a-9151-4d6c54437b2b","Type":"ContainerDied","Data":"92fe58dfcdf06e66ff5b25668d02bc6d46dfe668ce96f61e293a884f04ce69b3"}
Sep 11 16:30:33.650013 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:33.649927    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e52d92c8-b840-42dd-9e4b-ea9f196e7623-original-pull-secret\") pod \"global-pull-secret-syncer-xkz2b\" (UID: \"e52d92c8-b840-42dd-9e4b-ea9f196e7623\") " pod="kube-system/global-pull-secret-syncer-xkz2b"
Sep 11 16:30:33.650013 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:33.649979    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97ffcc27-5973-418d-a29e-762556b9c3e0-metrics-certs\") pod \"network-metrics-daemon-dnqst\" (UID: \"97ffcc27-5973-418d-a29e-762556b9c3e0\") " pod="openshift-multus/network-metrics-daemon-dnqst"
Sep 11 16:30:33.650485 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:33.650077    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:30:33.650485 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:33.650078    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 16:30:33.650485 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:33.650149    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97ffcc27-5973-418d-a29e-762556b9c3e0-metrics-certs podName:97ffcc27-5973-418d-a29e-762556b9c3e0 nodeName:}" failed. No retries permitted until 2026-09-11 16:31:05.650135496 +0000 UTC m=+65.266892540 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/97ffcc27-5973-418d-a29e-762556b9c3e0-metrics-certs") pod "network-metrics-daemon-dnqst" (UID: "97ffcc27-5973-418d-a29e-762556b9c3e0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:30:33.650485 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:33.650162    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e52d92c8-b840-42dd-9e4b-ea9f196e7623-original-pull-secret podName:e52d92c8-b840-42dd-9e4b-ea9f196e7623 nodeName:}" failed. No retries permitted until 2026-09-11 16:31:05.650156504 +0000 UTC m=+65.266913550 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e52d92c8-b840-42dd-9e4b-ea9f196e7623-original-pull-secret") pod "global-pull-secret-syncer-xkz2b" (UID: "e52d92c8-b840-42dd-9e4b-ea9f196e7623") : object "kube-system"/"original-pull-secret" not registered
Sep 11 16:30:33.751331 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:33.751287    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgblx\" (UniqueName: \"kubernetes.io/projected/14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0-kube-api-access-wgblx\") pod \"network-check-target-qx7z8\" (UID: \"14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0\") " pod="openshift-network-diagnostics/network-check-target-qx7z8"
Sep 11 16:30:33.751504 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:33.751442    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 16:30:33.751504 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:33.751470    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 16:30:33.751504 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:33.751481    2581 projected.go:196] Error preparing data for projected volume kube-api-access-wgblx for pod openshift-network-diagnostics/network-check-target-qx7z8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:30:33.751627 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:33.751539    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0-kube-api-access-wgblx podName:14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0 nodeName:}" failed. No retries permitted until 2026-09-11 16:31:05.751525084 +0000 UTC m=+65.368282129 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wgblx" (UniqueName: "kubernetes.io/projected/14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0-kube-api-access-wgblx") pod "network-check-target-qx7z8" (UID: "14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:30:33.981425 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:33.981336    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qx7z8"
Sep 11 16:30:33.981425 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:33.981388    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkz2b"
Sep 11 16:30:33.981639 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:33.981447    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qx7z8" podUID="14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0"
Sep 11 16:30:33.981639 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:33.981388    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnqst"
Sep 11 16:30:33.981639 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:33.981483    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkz2b" podUID="e52d92c8-b840-42dd-9e4b-ea9f196e7623"
Sep 11 16:30:33.981639 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:33.981583    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnqst" podUID="97ffcc27-5973-418d-a29e-762556b9c3e0"
Sep 11 16:30:35.232236 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:35.232204    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeReady"
Sep 11 16:30:35.232697 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:35.232358    2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 11 16:30:35.280038 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:35.280001    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-nt2jf"]
Sep 11 16:30:35.303643 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:35.303603    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jwnrd"]
Sep 11 16:30:35.303827 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:35.303748    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nt2jf"
Sep 11 16:30:35.306573 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:35.306548    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 11 16:30:35.306706 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:35.306650    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-55n2r\""
Sep 11 16:30:35.306772 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:35.306549    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 11 16:30:35.319344 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:35.319319    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nt2jf"]
Sep 11 16:30:35.319478 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:35.319361    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jwnrd"]
Sep 11 16:30:35.319478 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:35.319390    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jwnrd"
Sep 11 16:30:35.321980 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:35.321955    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 11 16:30:35.322129 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:35.322015    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-t57kr\""
Sep 11 16:30:35.322129 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:35.322033    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 11 16:30:35.322339 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:35.322322    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 11 16:30:35.413662 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:35.413632    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:30:35.463725 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:35.463624    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m8rg\" (UniqueName: \"kubernetes.io/projected/ea2d453f-d6ae-437a-a922-140017dedf14-kube-api-access-6m8rg\") pod \"dns-default-nt2jf\" (UID: \"ea2d453f-d6ae-437a-a922-140017dedf14\") " pod="openshift-dns/dns-default-nt2jf"
Sep 11 16:30:35.463725 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:35.463687    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ea2d453f-d6ae-437a-a922-140017dedf14-config-volume\") pod \"dns-default-nt2jf\" (UID: \"ea2d453f-d6ae-437a-a922-140017dedf14\") " pod="openshift-dns/dns-default-nt2jf"
Sep 11 16:30:35.463955 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:35.463738    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea2d453f-d6ae-437a-a922-140017dedf14-tmp-dir\") pod \"dns-default-nt2jf\" (UID: \"ea2d453f-d6ae-437a-a922-140017dedf14\") " pod="openshift-dns/dns-default-nt2jf"
Sep 11 16:30:35.463955 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:35.463775    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e231c84-f297-44d1-bb39-b4cbea4c48b5-cert\") pod \"ingress-canary-jwnrd\" (UID: \"2e231c84-f297-44d1-bb39-b4cbea4c48b5\") " pod="openshift-ingress-canary/ingress-canary-jwnrd"
Sep 11 16:30:35.463955 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:35.463799    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8pxx\" (UniqueName: \"kubernetes.io/projected/2e231c84-f297-44d1-bb39-b4cbea4c48b5-kube-api-access-f8pxx\") pod \"ingress-canary-jwnrd\" (UID: \"2e231c84-f297-44d1-bb39-b4cbea4c48b5\") " pod="openshift-ingress-canary/ingress-canary-jwnrd"
Sep 11 16:30:35.463955 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:35.463819    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ea2d453f-d6ae-437a-a922-140017dedf14-metrics-tls\") pod \"dns-default-nt2jf\" (UID: \"ea2d453f-d6ae-437a-a922-140017dedf14\") " pod="openshift-dns/dns-default-nt2jf"
Sep 11 16:30:35.485797 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:35.485765    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:30:35.564677 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:35.564632    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m8rg\" (UniqueName: \"kubernetes.io/projected/ea2d453f-d6ae-437a-a922-140017dedf14-kube-api-access-6m8rg\") pod \"dns-default-nt2jf\" (UID: \"ea2d453f-d6ae-437a-a922-140017dedf14\") " pod="openshift-dns/dns-default-nt2jf"
Sep 11 16:30:35.564865 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:35.564695    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ea2d453f-d6ae-437a-a922-140017dedf14-config-volume\") pod \"dns-default-nt2jf\" (UID: \"ea2d453f-d6ae-437a-a922-140017dedf14\") " pod="openshift-dns/dns-default-nt2jf"
Sep 11 16:30:35.564865 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:35.564722    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea2d453f-d6ae-437a-a922-140017dedf14-tmp-dir\") pod \"dns-default-nt2jf\" (UID: \"ea2d453f-d6ae-437a-a922-140017dedf14\") " pod="openshift-dns/dns-default-nt2jf"
Sep 11 16:30:35.564865 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:35.564759    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e231c84-f297-44d1-bb39-b4cbea4c48b5-cert\") pod \"ingress-canary-jwnrd\" (UID: \"2e231c84-f297-44d1-bb39-b4cbea4c48b5\") " pod="openshift-ingress-canary/ingress-canary-jwnrd"
Sep 11 16:30:35.564865 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:35.564790    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8pxx\" (UniqueName: \"kubernetes.io/projected/2e231c84-f297-44d1-bb39-b4cbea4c48b5-kube-api-access-f8pxx\") pod \"ingress-canary-jwnrd\" (UID: \"2e231c84-f297-44d1-bb39-b4cbea4c48b5\") " pod="openshift-ingress-canary/ingress-canary-jwnrd"
Sep 11 16:30:35.564865 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:35.564814    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ea2d453f-d6ae-437a-a922-140017dedf14-metrics-tls\") pod \"dns-default-nt2jf\" (UID: \"ea2d453f-d6ae-437a-a922-140017dedf14\") " pod="openshift-dns/dns-default-nt2jf"
Sep 11 16:30:35.565158 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:35.564930    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 16:30:35.565158 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:35.565016    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea2d453f-d6ae-437a-a922-140017dedf14-metrics-tls podName:ea2d453f-d6ae-437a-a922-140017dedf14 nodeName:}" failed. No retries permitted until 2026-09-11 16:30:36.064981803 +0000 UTC m=+35.681738866 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ea2d453f-d6ae-437a-a922-140017dedf14-metrics-tls") pod "dns-default-nt2jf" (UID: "ea2d453f-d6ae-437a-a922-140017dedf14") : secret "dns-default-metrics-tls" not found
Sep 11 16:30:35.565413 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:35.565387    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ea2d453f-d6ae-437a-a922-140017dedf14-config-volume\") pod \"dns-default-nt2jf\" (UID: \"ea2d453f-d6ae-437a-a922-140017dedf14\") " pod="openshift-dns/dns-default-nt2jf"
Sep 11 16:30:35.565679 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:35.565648    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea2d453f-d6ae-437a-a922-140017dedf14-tmp-dir\") pod \"dns-default-nt2jf\" (UID: \"ea2d453f-d6ae-437a-a922-140017dedf14\") " pod="openshift-dns/dns-default-nt2jf"
Sep 11 16:30:35.570304 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:35.570278    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e231c84-f297-44d1-bb39-b4cbea4c48b5-cert\") pod \"ingress-canary-jwnrd\" (UID: \"2e231c84-f297-44d1-bb39-b4cbea4c48b5\") " pod="openshift-ingress-canary/ingress-canary-jwnrd"
Sep 11 16:30:35.575671 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:35.575645    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m8rg\" (UniqueName: \"kubernetes.io/projected/ea2d453f-d6ae-437a-a922-140017dedf14-kube-api-access-6m8rg\") pod \"dns-default-nt2jf\" (UID: \"ea2d453f-d6ae-437a-a922-140017dedf14\") " pod="openshift-dns/dns-default-nt2jf"
Sep 11 16:30:35.575938 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:35.575915    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8pxx\" (UniqueName: \"kubernetes.io/projected/2e231c84-f297-44d1-bb39-b4cbea4c48b5-kube-api-access-f8pxx\") pod \"ingress-canary-jwnrd\" (UID: \"2e231c84-f297-44d1-bb39-b4cbea4c48b5\") " pod="openshift-ingress-canary/ingress-canary-jwnrd"
Sep 11 16:30:35.628917 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:35.628874    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jwnrd"
Sep 11 16:30:35.981824 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:35.981781    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkz2b"
Sep 11 16:30:35.982018 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:35.981835    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnqst"
Sep 11 16:30:35.982018 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:35.981791    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qx7z8"
Sep 11 16:30:35.985846 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:35.985810    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 16:30:35.985846 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:35.985836    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5vm65\""
Sep 11 16:30:35.986084 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:35.985810    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cczvg\""
Sep 11 16:30:35.986084 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:35.985815    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 16:30:35.986084 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:35.985810    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 16:30:35.986300 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:35.985810    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 16:30:36.069925 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:36.069877    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ea2d453f-d6ae-437a-a922-140017dedf14-metrics-tls\") pod \"dns-default-nt2jf\" (UID: \"ea2d453f-d6ae-437a-a922-140017dedf14\") " pod="openshift-dns/dns-default-nt2jf"
Sep 11 16:30:36.070130 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:36.070035    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 16:30:36.070189 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:36.070130    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea2d453f-d6ae-437a-a922-140017dedf14-metrics-tls podName:ea2d453f-d6ae-437a-a922-140017dedf14 nodeName:}" failed. No retries permitted until 2026-09-11 16:30:37.070113275 +0000 UTC m=+36.686870319 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ea2d453f-d6ae-437a-a922-140017dedf14-metrics-tls") pod "dns-default-nt2jf" (UID: "ea2d453f-d6ae-437a-a922-140017dedf14") : secret "dns-default-metrics-tls" not found
Sep 11 16:30:37.062150 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:37.061903    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jwnrd"]
Sep 11 16:30:37.068843 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:30:37.068055    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e231c84_f297_44d1_bb39_b4cbea4c48b5.slice/crio-a281eda6236605bb24649265cf079dbbf7c8c8e7d718359f1ea12b59c2820bc5 WatchSource:0}: Error finding container a281eda6236605bb24649265cf079dbbf7c8c8e7d718359f1ea12b59c2820bc5: Status 404 returned error can't find the container with id a281eda6236605bb24649265cf079dbbf7c8c8e7d718359f1ea12b59c2820bc5
Sep 11 16:30:37.076982 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:37.076954    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ea2d453f-d6ae-437a-a922-140017dedf14-metrics-tls\") pod \"dns-default-nt2jf\" (UID: \"ea2d453f-d6ae-437a-a922-140017dedf14\") " pod="openshift-dns/dns-default-nt2jf"
Sep 11 16:30:37.077119 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:37.077102    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 16:30:37.077171 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:37.077162    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea2d453f-d6ae-437a-a922-140017dedf14-metrics-tls podName:ea2d453f-d6ae-437a-a922-140017dedf14 nodeName:}" failed. No retries permitted until 2026-09-11 16:30:39.077146222 +0000 UTC m=+38.693903268 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ea2d453f-d6ae-437a-a922-140017dedf14-metrics-tls") pod "dns-default-nt2jf" (UID: "ea2d453f-d6ae-437a-a922-140017dedf14") : secret "dns-default-metrics-tls" not found
Sep 11 16:30:37.148819 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:37.148776    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jwnrd" event={"ID":"2e231c84-f297-44d1-bb39-b4cbea4c48b5","Type":"ContainerStarted","Data":"a281eda6236605bb24649265cf079dbbf7c8c8e7d718359f1ea12b59c2820bc5"}
Sep 11 16:30:38.154796 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:38.154756    2581 generic.go:356] "Generic (PLEG): container finished" podID="f519b0e8-fff1-441a-9151-4d6c54437b2b" containerID="88533b8b8555d595e4e2638badfac72a098939878f8ff57c05e326037b0e3626" exitCode=0
Sep 11 16:30:38.155421 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:38.154807    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4s7mv" event={"ID":"f519b0e8-fff1-441a-9151-4d6c54437b2b","Type":"ContainerDied","Data":"88533b8b8555d595e4e2638badfac72a098939878f8ff57c05e326037b0e3626"}
Sep 11 16:30:39.093688 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:39.093639    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ea2d453f-d6ae-437a-a922-140017dedf14-metrics-tls\") pod \"dns-default-nt2jf\" (UID: \"ea2d453f-d6ae-437a-a922-140017dedf14\") " pod="openshift-dns/dns-default-nt2jf"
Sep 11 16:30:39.093864 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:39.093813    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 16:30:39.093905 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:39.093899    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea2d453f-d6ae-437a-a922-140017dedf14-metrics-tls podName:ea2d453f-d6ae-437a-a922-140017dedf14 nodeName:}" failed. No retries permitted until 2026-09-11 16:30:43.093873965 +0000 UTC m=+42.710631024 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ea2d453f-d6ae-437a-a922-140017dedf14-metrics-tls") pod "dns-default-nt2jf" (UID: "ea2d453f-d6ae-437a-a922-140017dedf14") : secret "dns-default-metrics-tls" not found
Sep 11 16:30:39.161236 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:39.161184    2581 generic.go:356] "Generic (PLEG): container finished" podID="f519b0e8-fff1-441a-9151-4d6c54437b2b" containerID="c46c880a75a1ea5e8fcc79bbf326abcc7f1332006eb58e81d62bc34ba1eb476a" exitCode=0
Sep 11 16:30:39.161879 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:39.161261    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4s7mv" event={"ID":"f519b0e8-fff1-441a-9151-4d6c54437b2b","Type":"ContainerDied","Data":"c46c880a75a1ea5e8fcc79bbf326abcc7f1332006eb58e81d62bc34ba1eb476a"}
Sep 11 16:30:40.165018 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:40.164981    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jwnrd" event={"ID":"2e231c84-f297-44d1-bb39-b4cbea4c48b5","Type":"ContainerStarted","Data":"9806cf497ade7c8f65152e439e34e1138d58eda520e131492955006317c31875"}
Sep 11 16:30:40.168792 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:40.168762    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4s7mv" event={"ID":"f519b0e8-fff1-441a-9151-4d6c54437b2b","Type":"ContainerStarted","Data":"9423ee168cf8fb674495ba3cfc337d1b97c8235ff4c882caf6c34af141cae17a"}
Sep 11 16:30:40.183756 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:40.183558    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jwnrd" podStartSLOduration=2.2893362809999998 podStartE2EDuration="5.183538766s" totalImagesPullingTime="2.894202485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:30:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:30:40.18301051 +0000 UTC m=+39.799767577" watchObservedRunningTime="2026-09-11 16:30:40.183538766 +0000 UTC m=+39.800295832"
Sep 11 16:30:40.206250 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:40.206184    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4s7mv" podStartSLOduration=16.346258794 podStartE2EDuration="39.206163986s" totalImagesPullingTime="22.859905192s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:30:01 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:30:40.204014842 +0000 UTC m=+39.820771907" watchObservedRunningTime="2026-09-11 16:30:40.206163986 +0000 UTC m=+39.822921053"
Sep 11 16:30:40.331494 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:40.331381    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:30:41.731852 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:41.731818    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:30:42.280260 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:42.280224    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:30:42.377894 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:42.377858    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:30:42.483488 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:42.483457    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:30:42.572617 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:42.572536    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:30:43.123642 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:43.123597    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ea2d453f-d6ae-437a-a922-140017dedf14-metrics-tls\") pod \"dns-default-nt2jf\" (UID: \"ea2d453f-d6ae-437a-a922-140017dedf14\") " pod="openshift-dns/dns-default-nt2jf"
Sep 11 16:30:43.124047 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:43.123753    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 16:30:43.124047 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:43.123829    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea2d453f-d6ae-437a-a922-140017dedf14-metrics-tls podName:ea2d453f-d6ae-437a-a922-140017dedf14 nodeName:}" failed. No retries permitted until 2026-09-11 16:30:51.123814716 +0000 UTC m=+50.740571760 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ea2d453f-d6ae-437a-a922-140017dedf14-metrics-tls") pod "dns-default-nt2jf" (UID: "ea2d453f-d6ae-437a-a922-140017dedf14") : secret "dns-default-metrics-tls" not found
Sep 11 16:30:51.176349 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:30:51.176304    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ea2d453f-d6ae-437a-a922-140017dedf14-metrics-tls\") pod \"dns-default-nt2jf\" (UID: \"ea2d453f-d6ae-437a-a922-140017dedf14\") " pod="openshift-dns/dns-default-nt2jf"
Sep 11 16:30:51.176766 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:51.176454    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 16:30:51.176766 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:30:51.176514    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea2d453f-d6ae-437a-a922-140017dedf14-metrics-tls podName:ea2d453f-d6ae-437a-a922-140017dedf14 nodeName:}" failed. No retries permitted until 2026-09-11 16:31:07.176498907 +0000 UTC m=+66.793255953 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ea2d453f-d6ae-437a-a922-140017dedf14-metrics-tls") pod "dns-default-nt2jf" (UID: "ea2d453f-d6ae-437a-a922-140017dedf14") : secret "dns-default-metrics-tls" not found
Sep 11 16:31:01.141174 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:01.141144    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d6fww"
Sep 11 16:31:01.280834 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:01.280801    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:01.359067 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:01.359039    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:05.672663 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:05.672606    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97ffcc27-5973-418d-a29e-762556b9c3e0-metrics-certs\") pod \"network-metrics-daemon-dnqst\" (UID: \"97ffcc27-5973-418d-a29e-762556b9c3e0\") " pod="openshift-multus/network-metrics-daemon-dnqst"
Sep 11 16:31:05.673196 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:05.672695    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e52d92c8-b840-42dd-9e4b-ea9f196e7623-original-pull-secret\") pod \"global-pull-secret-syncer-xkz2b\" (UID: \"e52d92c8-b840-42dd-9e4b-ea9f196e7623\") " pod="kube-system/global-pull-secret-syncer-xkz2b"
Sep 11 16:31:05.677694 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:05.677676    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 16:31:05.678645 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:05.678628    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 16:31:05.683818 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:05.683801    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 11 16:31:05.683875 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:05.683865    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97ffcc27-5973-418d-a29e-762556b9c3e0-metrics-certs podName:97ffcc27-5973-418d-a29e-762556b9c3e0 nodeName:}" failed. No retries permitted until 2026-09-11 16:32:09.683849257 +0000 UTC m=+129.300606302 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/97ffcc27-5973-418d-a29e-762556b9c3e0-metrics-certs") pod "network-metrics-daemon-dnqst" (UID: "97ffcc27-5973-418d-a29e-762556b9c3e0") : secret "metrics-daemon-secret" not found
Sep 11 16:31:05.687166 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:05.687142    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e52d92c8-b840-42dd-9e4b-ea9f196e7623-original-pull-secret\") pod \"global-pull-secret-syncer-xkz2b\" (UID: \"e52d92c8-b840-42dd-9e4b-ea9f196e7623\") " pod="kube-system/global-pull-secret-syncer-xkz2b"
Sep 11 16:31:05.694195 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:05.694160    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkz2b"
Sep 11 16:31:05.773767 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:05.773736    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgblx\" (UniqueName: \"kubernetes.io/projected/14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0-kube-api-access-wgblx\") pod \"network-check-target-qx7z8\" (UID: \"14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0\") " pod="openshift-network-diagnostics/network-check-target-qx7z8"
Sep 11 16:31:05.776501 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:05.776481    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 16:31:05.787226 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:05.787202    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 16:31:05.797958 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:05.797922    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgblx\" (UniqueName: \"kubernetes.io/projected/14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0-kube-api-access-wgblx\") pod \"network-check-target-qx7z8\" (UID: \"14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0\") " pod="openshift-network-diagnostics/network-check-target-qx7z8"
Sep 11 16:31:05.965111 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:05.965069    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xkz2b"]
Sep 11 16:31:05.967772 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:31:05.967747    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode52d92c8_b840_42dd_9e4b_ea9f196e7623.slice/crio-3676551c86d6e0fdb5edfaacbc73f3df4b3576afb6595138fcb6b24ba562c22e WatchSource:0}: Error finding container 3676551c86d6e0fdb5edfaacbc73f3df4b3576afb6595138fcb6b24ba562c22e: Status 404 returned error can't find the container with id 3676551c86d6e0fdb5edfaacbc73f3df4b3576afb6595138fcb6b24ba562c22e
Sep 11 16:31:06.011381 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:06.011347    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cczvg\""
Sep 11 16:31:06.018641 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:06.018619    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qx7z8"
Sep 11 16:31:06.229789 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:06.229703    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xkz2b" event={"ID":"e52d92c8-b840-42dd-9e4b-ea9f196e7623","Type":"ContainerStarted","Data":"3676551c86d6e0fdb5edfaacbc73f3df4b3576afb6595138fcb6b24ba562c22e"}
Sep 11 16:31:06.287659 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:06.287633    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qx7z8"]
Sep 11 16:31:06.290602 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:31:06.290577    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14b8f88e_b4a1_4bac_b3b1_8f3b86fcd0f0.slice/crio-55746a5a2ff8e6638de9500a41bc6768cd2b7660d93c4c1e0446e8886bce817e WatchSource:0}: Error finding container 55746a5a2ff8e6638de9500a41bc6768cd2b7660d93c4c1e0446e8886bce817e: Status 404 returned error can't find the container with id 55746a5a2ff8e6638de9500a41bc6768cd2b7660d93c4c1e0446e8886bce817e
Sep 11 16:31:07.183337 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:07.183293    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ea2d453f-d6ae-437a-a922-140017dedf14-metrics-tls\") pod \"dns-default-nt2jf\" (UID: \"ea2d453f-d6ae-437a-a922-140017dedf14\") " pod="openshift-dns/dns-default-nt2jf"
Sep 11 16:31:07.183799 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:07.183474    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 16:31:07.183799 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:07.183550    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea2d453f-d6ae-437a-a922-140017dedf14-metrics-tls podName:ea2d453f-d6ae-437a-a922-140017dedf14 nodeName:}" failed. No retries permitted until 2026-09-11 16:31:39.183527205 +0000 UTC m=+98.800284264 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ea2d453f-d6ae-437a-a922-140017dedf14-metrics-tls") pod "dns-default-nt2jf" (UID: "ea2d453f-d6ae-437a-a922-140017dedf14") : secret "dns-default-metrics-tls" not found
Sep 11 16:31:07.234238 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:07.234195    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qx7z8" event={"ID":"14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0","Type":"ContainerStarted","Data":"55746a5a2ff8e6638de9500a41bc6768cd2b7660d93c4c1e0446e8886bce817e"}
Sep 11 16:31:12.247892 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:12.247858    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xkz2b" event={"ID":"e52d92c8-b840-42dd-9e4b-ea9f196e7623","Type":"ContainerStarted","Data":"b864630bab85a82b971bf340ebd7b496277e9f95df003aa499e3ba1d3c481a92"}
Sep 11 16:31:12.249394 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:12.249363    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qx7z8" event={"ID":"14b8f88e-b4a1-4bac-b3b1-8f3b86fcd0f0","Type":"ContainerStarted","Data":"b9c7c4f155cafbb00d814c671aae995ad12ac64be752d7502785958692f954ab"}
Sep 11 16:31:12.249521 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:12.249488    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qx7z8"
Sep 11 16:31:12.266102 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:12.266055    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xkz2b" podStartSLOduration=65.918328643 podStartE2EDuration="1m11.266042917s" totalImagesPullingTime="5.347714274s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:30:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:31:12.265666512 +0000 UTC m=+71.882423578" watchObservedRunningTime="2026-09-11 16:31:12.266042917 +0000 UTC m=+71.882800033"
Sep 11 16:31:12.283669 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:12.283620    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qx7z8" podStartSLOduration=66.249273542 podStartE2EDuration="1m11.283606567s" totalImagesPullingTime="5.034333025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:30:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:31:12.282783254 +0000 UTC m=+71.899540341" watchObservedRunningTime="2026-09-11 16:31:12.283606567 +0000 UTC m=+71.900363633"
Sep 11 16:31:15.596024 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.595978    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-h2rkv"]
Sep 11 16:31:15.597914 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.597896    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-8ld7f"]
Sep 11 16:31:15.598038 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.598019    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-h2rkv"
Sep 11 16:31:15.599736 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.599713    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-8ld7f"
Sep 11 16:31:15.601187 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.601164    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 11 16:31:15.601323 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.601207    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 11 16:31:15.601464 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.601448    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 11 16:31:15.601507 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.601479    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 11 16:31:15.601963 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.601948    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-7rlmk\""
Sep 11 16:31:15.602207 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.602186    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 11 16:31:15.602207 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.602202    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 11 16:31:15.602385 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.602295    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 11 16:31:15.603372 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.603347    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-gfdrg\""
Sep 11 16:31:15.603440 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.603414    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 11 16:31:15.610213 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.610192    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 11 16:31:15.611929 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.611909    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-h2rkv"]
Sep 11 16:31:15.614783 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.614760    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-8ld7f"]
Sep 11 16:31:15.640750 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.640715    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ac113fb-7b10-4927-87e6-a28c635d5f3c-tmp\") pod \"insights-operator-5844b856db-h2rkv\" (UID: \"4ac113fb-7b10-4927-87e6-a28c635d5f3c\") " pod="openshift-insights/insights-operator-5844b856db-h2rkv"
Sep 11 16:31:15.640750 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.640749    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ac113fb-7b10-4927-87e6-a28c635d5f3c-trusted-ca-bundle\") pod \"insights-operator-5844b856db-h2rkv\" (UID: \"4ac113fb-7b10-4927-87e6-a28c635d5f3c\") " pod="openshift-insights/insights-operator-5844b856db-h2rkv"
Sep 11 16:31:15.640948 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.640767    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e93a3486-b35e-4746-951c-24f6bdb25182-serving-cert\") pod \"service-ca-operator-cf7c776b7-8ld7f\" (UID: \"e93a3486-b35e-4746-951c-24f6bdb25182\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-8ld7f"
Sep 11 16:31:15.640948 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.640784    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ac113fb-7b10-4927-87e6-a28c635d5f3c-service-ca-bundle\") pod \"insights-operator-5844b856db-h2rkv\" (UID: \"4ac113fb-7b10-4927-87e6-a28c635d5f3c\") " pod="openshift-insights/insights-operator-5844b856db-h2rkv"
Sep 11 16:31:15.640948 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.640831    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jml7c\" (UniqueName: \"kubernetes.io/projected/4ac113fb-7b10-4927-87e6-a28c635d5f3c-kube-api-access-jml7c\") pod \"insights-operator-5844b856db-h2rkv\" (UID: \"4ac113fb-7b10-4927-87e6-a28c635d5f3c\") " pod="openshift-insights/insights-operator-5844b856db-h2rkv"
Sep 11 16:31:15.640948 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.640870    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4ac113fb-7b10-4927-87e6-a28c635d5f3c-serving-cert\") pod \"insights-operator-5844b856db-h2rkv\" (UID: \"4ac113fb-7b10-4927-87e6-a28c635d5f3c\") " pod="openshift-insights/insights-operator-5844b856db-h2rkv"
Sep 11 16:31:15.640948 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.640922    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnrlg\" (UniqueName: \"kubernetes.io/projected/e93a3486-b35e-4746-951c-24f6bdb25182-kube-api-access-rnrlg\") pod \"service-ca-operator-cf7c776b7-8ld7f\" (UID: \"e93a3486-b35e-4746-951c-24f6bdb25182\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-8ld7f"
Sep 11 16:31:15.641140 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.640993    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e93a3486-b35e-4746-951c-24f6bdb25182-config\") pod \"service-ca-operator-cf7c776b7-8ld7f\" (UID: \"e93a3486-b35e-4746-951c-24f6bdb25182\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-8ld7f"
Sep 11 16:31:15.641140 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.641026    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4ac113fb-7b10-4927-87e6-a28c635d5f3c-snapshots\") pod \"insights-operator-5844b856db-h2rkv\" (UID: \"4ac113fb-7b10-4927-87e6-a28c635d5f3c\") " pod="openshift-insights/insights-operator-5844b856db-h2rkv"
Sep 11 16:31:15.727670 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.727633    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-vckn9"]
Sep 11 16:31:15.729445 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.729429    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-vckn9"
Sep 11 16:31:15.735246 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.734931    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 11 16:31:15.735246 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.735037    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 11 16:31:15.739559 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.739540    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 11 16:31:15.739759 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.739742    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-jktvk\""
Sep 11 16:31:15.739835 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.739798    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 11 16:31:15.741449 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.741432    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ac113fb-7b10-4927-87e6-a28c635d5f3c-service-ca-bundle\") pod \"insights-operator-5844b856db-h2rkv\" (UID: \"4ac113fb-7b10-4927-87e6-a28c635d5f3c\") " pod="openshift-insights/insights-operator-5844b856db-h2rkv"
Sep 11 16:31:15.741519 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.741464    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jml7c\" (UniqueName: \"kubernetes.io/projected/4ac113fb-7b10-4927-87e6-a28c635d5f3c-kube-api-access-jml7c\") pod \"insights-operator-5844b856db-h2rkv\" (UID: \"4ac113fb-7b10-4927-87e6-a28c635d5f3c\") " pod="openshift-insights/insights-operator-5844b856db-h2rkv"
Sep 11 16:31:15.741519 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.741483    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4ac113fb-7b10-4927-87e6-a28c635d5f3c-serving-cert\") pod \"insights-operator-5844b856db-h2rkv\" (UID: \"4ac113fb-7b10-4927-87e6-a28c635d5f3c\") " pod="openshift-insights/insights-operator-5844b856db-h2rkv"
Sep 11 16:31:15.741519 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.741512    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnrlg\" (UniqueName: \"kubernetes.io/projected/e93a3486-b35e-4746-951c-24f6bdb25182-kube-api-access-rnrlg\") pod \"service-ca-operator-cf7c776b7-8ld7f\" (UID: \"e93a3486-b35e-4746-951c-24f6bdb25182\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-8ld7f"
Sep 11 16:31:15.741641 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.741559    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e93a3486-b35e-4746-951c-24f6bdb25182-config\") pod \"service-ca-operator-cf7c776b7-8ld7f\" (UID: \"e93a3486-b35e-4746-951c-24f6bdb25182\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-8ld7f"
Sep 11 16:31:15.741641 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.741590    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4ac113fb-7b10-4927-87e6-a28c635d5f3c-snapshots\") pod \"insights-operator-5844b856db-h2rkv\" (UID: \"4ac113fb-7b10-4927-87e6-a28c635d5f3c\") " pod="openshift-insights/insights-operator-5844b856db-h2rkv"
Sep 11 16:31:15.741641 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.741631    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ac113fb-7b10-4927-87e6-a28c635d5f3c-tmp\") pod \"insights-operator-5844b856db-h2rkv\" (UID: \"4ac113fb-7b10-4927-87e6-a28c635d5f3c\") " pod="openshift-insights/insights-operator-5844b856db-h2rkv"
Sep 11 16:31:15.741783 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.741659    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ac113fb-7b10-4927-87e6-a28c635d5f3c-trusted-ca-bundle\") pod \"insights-operator-5844b856db-h2rkv\" (UID: \"4ac113fb-7b10-4927-87e6-a28c635d5f3c\") " pod="openshift-insights/insights-operator-5844b856db-h2rkv"
Sep 11 16:31:15.741783 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.741684    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e93a3486-b35e-4746-951c-24f6bdb25182-serving-cert\") pod \"service-ca-operator-cf7c776b7-8ld7f\" (UID: \"e93a3486-b35e-4746-951c-24f6bdb25182\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-8ld7f"
Sep 11 16:31:15.742103 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.742065    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ac113fb-7b10-4927-87e6-a28c635d5f3c-service-ca-bundle\") pod \"insights-operator-5844b856db-h2rkv\" (UID: \"4ac113fb-7b10-4927-87e6-a28c635d5f3c\") " pod="openshift-insights/insights-operator-5844b856db-h2rkv"
Sep 11 16:31:15.742341 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.742316    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ac113fb-7b10-4927-87e6-a28c635d5f3c-tmp\") pod \"insights-operator-5844b856db-h2rkv\" (UID: \"4ac113fb-7b10-4927-87e6-a28c635d5f3c\") " pod="openshift-insights/insights-operator-5844b856db-h2rkv"
Sep 11 16:31:15.742493 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.742406    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4ac113fb-7b10-4927-87e6-a28c635d5f3c-snapshots\") pod \"insights-operator-5844b856db-h2rkv\" (UID: \"4ac113fb-7b10-4927-87e6-a28c635d5f3c\") " pod="openshift-insights/insights-operator-5844b856db-h2rkv"
Sep 11 16:31:15.742589 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.742567    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ac113fb-7b10-4927-87e6-a28c635d5f3c-trusted-ca-bundle\") pod \"insights-operator-5844b856db-h2rkv\" (UID: \"4ac113fb-7b10-4927-87e6-a28c635d5f3c\") " pod="openshift-insights/insights-operator-5844b856db-h2rkv"
Sep 11 16:31:15.742589 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.742462    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e93a3486-b35e-4746-951c-24f6bdb25182-config\") pod \"service-ca-operator-cf7c776b7-8ld7f\" (UID: \"e93a3486-b35e-4746-951c-24f6bdb25182\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-8ld7f"
Sep 11 16:31:15.743973 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.743950    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e93a3486-b35e-4746-951c-24f6bdb25182-serving-cert\") pod \"service-ca-operator-cf7c776b7-8ld7f\" (UID: \"e93a3486-b35e-4746-951c-24f6bdb25182\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-8ld7f"
Sep 11 16:31:15.744044 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.743994    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4ac113fb-7b10-4927-87e6-a28c635d5f3c-serving-cert\") pod \"insights-operator-5844b856db-h2rkv\" (UID: \"4ac113fb-7b10-4927-87e6-a28c635d5f3c\") " pod="openshift-insights/insights-operator-5844b856db-h2rkv"
Sep 11 16:31:15.768770 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.768745    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-vckn9"]
Sep 11 16:31:15.777572 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.777549    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jml7c\" (UniqueName: \"kubernetes.io/projected/4ac113fb-7b10-4927-87e6-a28c635d5f3c-kube-api-access-jml7c\") pod \"insights-operator-5844b856db-h2rkv\" (UID: \"4ac113fb-7b10-4927-87e6-a28c635d5f3c\") " pod="openshift-insights/insights-operator-5844b856db-h2rkv"
Sep 11 16:31:15.794815 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.794787    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnrlg\" (UniqueName: \"kubernetes.io/projected/e93a3486-b35e-4746-951c-24f6bdb25182-kube-api-access-rnrlg\") pod \"service-ca-operator-cf7c776b7-8ld7f\" (UID: \"e93a3486-b35e-4746-951c-24f6bdb25182\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-8ld7f"
Sep 11 16:31:15.842283 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.842253    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5rz4\" (UniqueName: \"kubernetes.io/projected/6599cc8f-4bf4-402f-941b-86ae7d47633b-kube-api-access-j5rz4\") pod \"cluster-monitoring-operator-6cd954b897-vckn9\" (UID: \"6599cc8f-4bf4-402f-941b-86ae7d47633b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-vckn9"
Sep 11 16:31:15.842421 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.842311    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6599cc8f-4bf4-402f-941b-86ae7d47633b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-vckn9\" (UID: \"6599cc8f-4bf4-402f-941b-86ae7d47633b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-vckn9"
Sep 11 16:31:15.842421 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.842354    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6599cc8f-4bf4-402f-941b-86ae7d47633b-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-vckn9\" (UID: \"6599cc8f-4bf4-402f-941b-86ae7d47633b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-vckn9"
Sep 11 16:31:15.843290 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.843271    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-fbfb97c5b-bzcrd"]
Sep 11 16:31:15.845490 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.845476    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-fbfb97c5b-bzcrd"
Sep 11 16:31:15.849528 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.849478    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 11 16:31:15.850715 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.850691    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 11 16:31:15.850809 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.850719    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 11 16:31:15.850809 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.850740    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 11 16:31:15.850809 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.850791    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 11 16:31:15.851502 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.851490    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 11 16:31:15.851837 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.851820    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-srrl2\""
Sep 11 16:31:15.878129 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.878108    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-fbfb97c5b-bzcrd"]
Sep 11 16:31:15.910374 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.910348    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-h2rkv"
Sep 11 16:31:15.915951 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.915928    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-8ld7f"
Sep 11 16:31:15.942999 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.942964    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6599cc8f-4bf4-402f-941b-86ae7d47633b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-vckn9\" (UID: \"6599cc8f-4bf4-402f-941b-86ae7d47633b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-vckn9"
Sep 11 16:31:15.943194 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.943023    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5b8288f-0e0e-430e-b78d-d4d9b565ad4b-metrics-certs\") pod \"router-default-fbfb97c5b-bzcrd\" (UID: \"b5b8288f-0e0e-430e-b78d-d4d9b565ad4b\") " pod="openshift-ingress/router-default-fbfb97c5b-bzcrd"
Sep 11 16:31:15.943194 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.943055    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6599cc8f-4bf4-402f-941b-86ae7d47633b-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-vckn9\" (UID: \"6599cc8f-4bf4-402f-941b-86ae7d47633b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-vckn9"
Sep 11 16:31:15.943194 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.943078    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5b8288f-0e0e-430e-b78d-d4d9b565ad4b-service-ca-bundle\") pod \"router-default-fbfb97c5b-bzcrd\" (UID: \"b5b8288f-0e0e-430e-b78d-d4d9b565ad4b\") " pod="openshift-ingress/router-default-fbfb97c5b-bzcrd"
Sep 11 16:31:15.943194 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.943126    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b5b8288f-0e0e-430e-b78d-d4d9b565ad4b-default-certificate\") pod \"router-default-fbfb97c5b-bzcrd\" (UID: \"b5b8288f-0e0e-430e-b78d-d4d9b565ad4b\") " pod="openshift-ingress/router-default-fbfb97c5b-bzcrd"
Sep 11 16:31:15.943194 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:15.943129    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 16:31:15.943194 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.943178    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-826sh\" (UniqueName: \"kubernetes.io/projected/b5b8288f-0e0e-430e-b78d-d4d9b565ad4b-kube-api-access-826sh\") pod \"router-default-fbfb97c5b-bzcrd\" (UID: \"b5b8288f-0e0e-430e-b78d-d4d9b565ad4b\") " pod="openshift-ingress/router-default-fbfb97c5b-bzcrd"
Sep 11 16:31:15.943194 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:15.943193    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6599cc8f-4bf4-402f-941b-86ae7d47633b-cluster-monitoring-operator-tls podName:6599cc8f-4bf4-402f-941b-86ae7d47633b nodeName:}" failed. No retries permitted until 2026-09-11 16:31:16.443172164 +0000 UTC m=+76.059929225 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6599cc8f-4bf4-402f-941b-86ae7d47633b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-vckn9" (UID: "6599cc8f-4bf4-402f-941b-86ae7d47633b") : secret "cluster-monitoring-operator-tls" not found
Sep 11 16:31:15.943590 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.943263    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5rz4\" (UniqueName: \"kubernetes.io/projected/6599cc8f-4bf4-402f-941b-86ae7d47633b-kube-api-access-j5rz4\") pod \"cluster-monitoring-operator-6cd954b897-vckn9\" (UID: \"6599cc8f-4bf4-402f-941b-86ae7d47633b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-vckn9"
Sep 11 16:31:15.943590 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.943294    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b5b8288f-0e0e-430e-b78d-d4d9b565ad4b-stats-auth\") pod \"router-default-fbfb97c5b-bzcrd\" (UID: \"b5b8288f-0e0e-430e-b78d-d4d9b565ad4b\") " pod="openshift-ingress/router-default-fbfb97c5b-bzcrd"
Sep 11 16:31:15.943839 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.943817    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6599cc8f-4bf4-402f-941b-86ae7d47633b-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-vckn9\" (UID: \"6599cc8f-4bf4-402f-941b-86ae7d47633b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-vckn9"
Sep 11 16:31:15.955294 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:15.955259    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5rz4\" (UniqueName: \"kubernetes.io/projected/6599cc8f-4bf4-402f-941b-86ae7d47633b-kube-api-access-j5rz4\") pod \"cluster-monitoring-operator-6cd954b897-vckn9\" (UID: \"6599cc8f-4bf4-402f-941b-86ae7d47633b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-vckn9"
Sep 11 16:31:16.043739 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:16.043705    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b5b8288f-0e0e-430e-b78d-d4d9b565ad4b-stats-auth\") pod \"router-default-fbfb97c5b-bzcrd\" (UID: \"b5b8288f-0e0e-430e-b78d-d4d9b565ad4b\") " pod="openshift-ingress/router-default-fbfb97c5b-bzcrd"
Sep 11 16:31:16.043909 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:16.043783    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5b8288f-0e0e-430e-b78d-d4d9b565ad4b-metrics-certs\") pod \"router-default-fbfb97c5b-bzcrd\" (UID: \"b5b8288f-0e0e-430e-b78d-d4d9b565ad4b\") " pod="openshift-ingress/router-default-fbfb97c5b-bzcrd"
Sep 11 16:31:16.043909 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:16.043810    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5b8288f-0e0e-430e-b78d-d4d9b565ad4b-service-ca-bundle\") pod \"router-default-fbfb97c5b-bzcrd\" (UID: \"b5b8288f-0e0e-430e-b78d-d4d9b565ad4b\") " pod="openshift-ingress/router-default-fbfb97c5b-bzcrd"
Sep 11 16:31:16.043909 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:16.043838    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b5b8288f-0e0e-430e-b78d-d4d9b565ad4b-default-certificate\") pod \"router-default-fbfb97c5b-bzcrd\" (UID: \"b5b8288f-0e0e-430e-b78d-d4d9b565ad4b\") " pod="openshift-ingress/router-default-fbfb97c5b-bzcrd"
Sep 11 16:31:16.043909 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:16.043860    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-826sh\" (UniqueName: \"kubernetes.io/projected/b5b8288f-0e0e-430e-b78d-d4d9b565ad4b-kube-api-access-826sh\") pod \"router-default-fbfb97c5b-bzcrd\" (UID: \"b5b8288f-0e0e-430e-b78d-d4d9b565ad4b\") " pod="openshift-ingress/router-default-fbfb97c5b-bzcrd"
Sep 11 16:31:16.044133 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:16.043935    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 16:31:16.044133 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:16.043994    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5b8288f-0e0e-430e-b78d-d4d9b565ad4b-metrics-certs podName:b5b8288f-0e0e-430e-b78d-d4d9b565ad4b nodeName:}" failed. No retries permitted until 2026-09-11 16:31:16.543975605 +0000 UTC m=+76.160732684 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5b8288f-0e0e-430e-b78d-d4d9b565ad4b-metrics-certs") pod "router-default-fbfb97c5b-bzcrd" (UID: "b5b8288f-0e0e-430e-b78d-d4d9b565ad4b") : secret "router-metrics-certs-default" not found
Sep 11 16:31:16.044133 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:16.044020    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b5b8288f-0e0e-430e-b78d-d4d9b565ad4b-service-ca-bundle podName:b5b8288f-0e0e-430e-b78d-d4d9b565ad4b nodeName:}" failed. No retries permitted until 2026-09-11 16:31:16.544009577 +0000 UTC m=+76.160766622 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b5b8288f-0e0e-430e-b78d-d4d9b565ad4b-service-ca-bundle") pod "router-default-fbfb97c5b-bzcrd" (UID: "b5b8288f-0e0e-430e-b78d-d4d9b565ad4b") : configmap references non-existent config key: service-ca.crt
Sep 11 16:31:16.045002 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:16.044963    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:16.046319 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:16.046296    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b5b8288f-0e0e-430e-b78d-d4d9b565ad4b-stats-auth\") pod \"router-default-fbfb97c5b-bzcrd\" (UID: \"b5b8288f-0e0e-430e-b78d-d4d9b565ad4b\") " pod="openshift-ingress/router-default-fbfb97c5b-bzcrd"
Sep 11 16:31:16.046420 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:16.046361    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b5b8288f-0e0e-430e-b78d-d4d9b565ad4b-default-certificate\") pod \"router-default-fbfb97c5b-bzcrd\" (UID: \"b5b8288f-0e0e-430e-b78d-d4d9b565ad4b\") " pod="openshift-ingress/router-default-fbfb97c5b-bzcrd"
Sep 11 16:31:16.055523 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:16.055504    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-826sh\" (UniqueName: \"kubernetes.io/projected/b5b8288f-0e0e-430e-b78d-d4d9b565ad4b-kube-api-access-826sh\") pod \"router-default-fbfb97c5b-bzcrd\" (UID: \"b5b8288f-0e0e-430e-b78d-d4d9b565ad4b\") " pod="openshift-ingress/router-default-fbfb97c5b-bzcrd"
Sep 11 16:31:16.146292 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:16.146209    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:16.186421 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:16.186255    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-h2rkv"]
Sep 11 16:31:16.188509 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:16.188487    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-8ld7f"]
Sep 11 16:31:16.189285 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:31:16.189182    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ac113fb_7b10_4927_87e6_a28c635d5f3c.slice/crio-8273bbe8e623b9d2a4644feecc79982e7ab8509cec14620ef0386b6f45e47593 WatchSource:0}: Error finding container 8273bbe8e623b9d2a4644feecc79982e7ab8509cec14620ef0386b6f45e47593: Status 404 returned error can't find the container with id 8273bbe8e623b9d2a4644feecc79982e7ab8509cec14620ef0386b6f45e47593
Sep 11 16:31:16.191656 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:31:16.191631    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode93a3486_b35e_4746_951c_24f6bdb25182.slice/crio-231b845bdceced2ba65ec50ed551d8a937b52aded3f2496c30f201811986627c WatchSource:0}: Error finding container 231b845bdceced2ba65ec50ed551d8a937b52aded3f2496c30f201811986627c: Status 404 returned error can't find the container with id 231b845bdceced2ba65ec50ed551d8a937b52aded3f2496c30f201811986627c
Sep 11 16:31:16.259210 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:16.259177    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-8ld7f" event={"ID":"e93a3486-b35e-4746-951c-24f6bdb25182","Type":"ContainerStarted","Data":"231b845bdceced2ba65ec50ed551d8a937b52aded3f2496c30f201811986627c"}
Sep 11 16:31:16.260309 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:16.260289    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-h2rkv" event={"ID":"4ac113fb-7b10-4927-87e6-a28c635d5f3c","Type":"ContainerStarted","Data":"8273bbe8e623b9d2a4644feecc79982e7ab8509cec14620ef0386b6f45e47593"}
Sep 11 16:31:16.448459 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:16.448427    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6599cc8f-4bf4-402f-941b-86ae7d47633b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-vckn9\" (UID: \"6599cc8f-4bf4-402f-941b-86ae7d47633b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-vckn9"
Sep 11 16:31:16.448601 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:16.448580    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 16:31:16.448650 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:16.448639    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6599cc8f-4bf4-402f-941b-86ae7d47633b-cluster-monitoring-operator-tls podName:6599cc8f-4bf4-402f-941b-86ae7d47633b nodeName:}" failed. No retries permitted until 2026-09-11 16:31:17.448625142 +0000 UTC m=+77.065382187 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6599cc8f-4bf4-402f-941b-86ae7d47633b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-vckn9" (UID: "6599cc8f-4bf4-402f-941b-86ae7d47633b") : secret "cluster-monitoring-operator-tls" not found
Sep 11 16:31:16.549436 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:16.549401    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5b8288f-0e0e-430e-b78d-d4d9b565ad4b-metrics-certs\") pod \"router-default-fbfb97c5b-bzcrd\" (UID: \"b5b8288f-0e0e-430e-b78d-d4d9b565ad4b\") " pod="openshift-ingress/router-default-fbfb97c5b-bzcrd"
Sep 11 16:31:16.549436 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:16.549438    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5b8288f-0e0e-430e-b78d-d4d9b565ad4b-service-ca-bundle\") pod \"router-default-fbfb97c5b-bzcrd\" (UID: \"b5b8288f-0e0e-430e-b78d-d4d9b565ad4b\") " pod="openshift-ingress/router-default-fbfb97c5b-bzcrd"
Sep 11 16:31:16.549618 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:16.549545    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b5b8288f-0e0e-430e-b78d-d4d9b565ad4b-service-ca-bundle podName:b5b8288f-0e0e-430e-b78d-d4d9b565ad4b nodeName:}" failed. No retries permitted until 2026-09-11 16:31:17.54953188 +0000 UTC m=+77.166288939 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b5b8288f-0e0e-430e-b78d-d4d9b565ad4b-service-ca-bundle") pod "router-default-fbfb97c5b-bzcrd" (UID: "b5b8288f-0e0e-430e-b78d-d4d9b565ad4b") : configmap references non-existent config key: service-ca.crt
Sep 11 16:31:16.549618 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:16.549545    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 16:31:16.549618 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:16.549597    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5b8288f-0e0e-430e-b78d-d4d9b565ad4b-metrics-certs podName:b5b8288f-0e0e-430e-b78d-d4d9b565ad4b nodeName:}" failed. No retries permitted until 2026-09-11 16:31:17.549583471 +0000 UTC m=+77.166340516 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5b8288f-0e0e-430e-b78d-d4d9b565ad4b-metrics-certs") pod "router-default-fbfb97c5b-bzcrd" (UID: "b5b8288f-0e0e-430e-b78d-d4d9b565ad4b") : secret "router-metrics-certs-default" not found
Sep 11 16:31:17.456698 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:17.456664    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6599cc8f-4bf4-402f-941b-86ae7d47633b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-vckn9\" (UID: \"6599cc8f-4bf4-402f-941b-86ae7d47633b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-vckn9"
Sep 11 16:31:17.457178 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:17.456857    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 16:31:17.457178 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:17.456942    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6599cc8f-4bf4-402f-941b-86ae7d47633b-cluster-monitoring-operator-tls podName:6599cc8f-4bf4-402f-941b-86ae7d47633b nodeName:}" failed. No retries permitted until 2026-09-11 16:31:19.456919557 +0000 UTC m=+79.073676619 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6599cc8f-4bf4-402f-941b-86ae7d47633b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-vckn9" (UID: "6599cc8f-4bf4-402f-941b-86ae7d47633b") : secret "cluster-monitoring-operator-tls" not found
Sep 11 16:31:17.557573 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:17.557525    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5b8288f-0e0e-430e-b78d-d4d9b565ad4b-metrics-certs\") pod \"router-default-fbfb97c5b-bzcrd\" (UID: \"b5b8288f-0e0e-430e-b78d-d4d9b565ad4b\") " pod="openshift-ingress/router-default-fbfb97c5b-bzcrd"
Sep 11 16:31:17.557719 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:17.557605    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5b8288f-0e0e-430e-b78d-d4d9b565ad4b-service-ca-bundle\") pod \"router-default-fbfb97c5b-bzcrd\" (UID: \"b5b8288f-0e0e-430e-b78d-d4d9b565ad4b\") " pod="openshift-ingress/router-default-fbfb97c5b-bzcrd"
Sep 11 16:31:17.557719 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:17.557643    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 16:31:17.557719 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:17.557717    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5b8288f-0e0e-430e-b78d-d4d9b565ad4b-metrics-certs podName:b5b8288f-0e0e-430e-b78d-d4d9b565ad4b nodeName:}" failed. No retries permitted until 2026-09-11 16:31:19.557699777 +0000 UTC m=+79.174456845 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5b8288f-0e0e-430e-b78d-d4d9b565ad4b-metrics-certs") pod "router-default-fbfb97c5b-bzcrd" (UID: "b5b8288f-0e0e-430e-b78d-d4d9b565ad4b") : secret "router-metrics-certs-default" not found
Sep 11 16:31:17.557825 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:17.557748    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b5b8288f-0e0e-430e-b78d-d4d9b565ad4b-service-ca-bundle podName:b5b8288f-0e0e-430e-b78d-d4d9b565ad4b nodeName:}" failed. No retries permitted until 2026-09-11 16:31:19.557734722 +0000 UTC m=+79.174491768 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b5b8288f-0e0e-430e-b78d-d4d9b565ad4b-service-ca-bundle") pod "router-default-fbfb97c5b-bzcrd" (UID: "b5b8288f-0e0e-430e-b78d-d4d9b565ad4b") : configmap references non-existent config key: service-ca.crt
Sep 11 16:31:18.400785 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:18.400756    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:18.486630 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:18.486589    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:18.546132 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:18.546083    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-676cf99488-srct9"]
Sep 11 16:31:18.550044 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:18.550020    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-676cf99488-srct9"
Sep 11 16:31:18.552572 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:18.552553    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 11 16:31:18.553477 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:18.553461    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 11 16:31:18.553980 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:18.553928    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6rbz9\""
Sep 11 16:31:18.555024 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:18.555008    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 11 16:31:18.558903 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:18.558886    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 11 16:31:18.562631 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:18.562603    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-676cf99488-srct9"]
Sep 11 16:31:18.667477 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:18.667454    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/06f8ba29-d5d1-4375-8b41-d900e0738e70-trusted-ca\") pod \"image-registry-676cf99488-srct9\" (UID: \"06f8ba29-d5d1-4375-8b41-d900e0738e70\") " pod="openshift-image-registry/image-registry-676cf99488-srct9"
Sep 11 16:31:18.667606 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:18.667487    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zb2ns\" (UniqueName: \"kubernetes.io/projected/06f8ba29-d5d1-4375-8b41-d900e0738e70-kube-api-access-zb2ns\") pod \"image-registry-676cf99488-srct9\" (UID: \"06f8ba29-d5d1-4375-8b41-d900e0738e70\") " pod="openshift-image-registry/image-registry-676cf99488-srct9"
Sep 11 16:31:18.667606 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:18.667517    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06f8ba29-d5d1-4375-8b41-d900e0738e70-registry-tls\") pod \"image-registry-676cf99488-srct9\" (UID: \"06f8ba29-d5d1-4375-8b41-d900e0738e70\") " pod="openshift-image-registry/image-registry-676cf99488-srct9"
Sep 11 16:31:18.667606 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:18.667534    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/06f8ba29-d5d1-4375-8b41-d900e0738e70-registry-certificates\") pod \"image-registry-676cf99488-srct9\" (UID: \"06f8ba29-d5d1-4375-8b41-d900e0738e70\") " pod="openshift-image-registry/image-registry-676cf99488-srct9"
Sep 11 16:31:18.667606 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:18.667558    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/06f8ba29-d5d1-4375-8b41-d900e0738e70-ca-trust-extracted\") pod \"image-registry-676cf99488-srct9\" (UID: \"06f8ba29-d5d1-4375-8b41-d900e0738e70\") " pod="openshift-image-registry/image-registry-676cf99488-srct9"
Sep 11 16:31:18.667606 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:18.667603    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/06f8ba29-d5d1-4375-8b41-d900e0738e70-installation-pull-secrets\") pod \"image-registry-676cf99488-srct9\" (UID: \"06f8ba29-d5d1-4375-8b41-d900e0738e70\") " pod="openshift-image-registry/image-registry-676cf99488-srct9"
Sep 11 16:31:18.667880 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:18.667624    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/06f8ba29-d5d1-4375-8b41-d900e0738e70-image-registry-private-configuration\") pod \"image-registry-676cf99488-srct9\" (UID: \"06f8ba29-d5d1-4375-8b41-d900e0738e70\") " pod="openshift-image-registry/image-registry-676cf99488-srct9"
Sep 11 16:31:18.667880 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:18.667644    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/06f8ba29-d5d1-4375-8b41-d900e0738e70-bound-sa-token\") pod \"image-registry-676cf99488-srct9\" (UID: \"06f8ba29-d5d1-4375-8b41-d900e0738e70\") " pod="openshift-image-registry/image-registry-676cf99488-srct9"
Sep 11 16:31:18.768872 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:18.768833    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/06f8ba29-d5d1-4375-8b41-d900e0738e70-installation-pull-secrets\") pod \"image-registry-676cf99488-srct9\" (UID: \"06f8ba29-d5d1-4375-8b41-d900e0738e70\") " pod="openshift-image-registry/image-registry-676cf99488-srct9"
Sep 11 16:31:18.768872 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:18.768876    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/06f8ba29-d5d1-4375-8b41-d900e0738e70-image-registry-private-configuration\") pod \"image-registry-676cf99488-srct9\" (UID: \"06f8ba29-d5d1-4375-8b41-d900e0738e70\") " pod="openshift-image-registry/image-registry-676cf99488-srct9"
Sep 11 16:31:18.769172 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:18.768896    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/06f8ba29-d5d1-4375-8b41-d900e0738e70-bound-sa-token\") pod \"image-registry-676cf99488-srct9\" (UID: \"06f8ba29-d5d1-4375-8b41-d900e0738e70\") " pod="openshift-image-registry/image-registry-676cf99488-srct9"
Sep 11 16:31:18.769172 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:18.769082    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/06f8ba29-d5d1-4375-8b41-d900e0738e70-trusted-ca\") pod \"image-registry-676cf99488-srct9\" (UID: \"06f8ba29-d5d1-4375-8b41-d900e0738e70\") " pod="openshift-image-registry/image-registry-676cf99488-srct9"
Sep 11 16:31:18.769172 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:18.769139    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zb2ns\" (UniqueName: \"kubernetes.io/projected/06f8ba29-d5d1-4375-8b41-d900e0738e70-kube-api-access-zb2ns\") pod \"image-registry-676cf99488-srct9\" (UID: \"06f8ba29-d5d1-4375-8b41-d900e0738e70\") " pod="openshift-image-registry/image-registry-676cf99488-srct9"
Sep 11 16:31:18.769172 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:18.769171    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06f8ba29-d5d1-4375-8b41-d900e0738e70-registry-tls\") pod \"image-registry-676cf99488-srct9\" (UID: \"06f8ba29-d5d1-4375-8b41-d900e0738e70\") " pod="openshift-image-registry/image-registry-676cf99488-srct9"
Sep 11 16:31:18.769373 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:18.769196    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/06f8ba29-d5d1-4375-8b41-d900e0738e70-registry-certificates\") pod \"image-registry-676cf99488-srct9\" (UID: \"06f8ba29-d5d1-4375-8b41-d900e0738e70\") " pod="openshift-image-registry/image-registry-676cf99488-srct9"
Sep 11 16:31:18.769373 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:18.769229    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/06f8ba29-d5d1-4375-8b41-d900e0738e70-ca-trust-extracted\") pod \"image-registry-676cf99488-srct9\" (UID: \"06f8ba29-d5d1-4375-8b41-d900e0738e70\") " pod="openshift-image-registry/image-registry-676cf99488-srct9"
Sep 11 16:31:18.769571 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:18.769546    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 16:31:18.769737 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:18.769722    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-676cf99488-srct9: secret "image-registry-tls" not found
Sep 11 16:31:18.769889 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:18.769876    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06f8ba29-d5d1-4375-8b41-d900e0738e70-registry-tls podName:06f8ba29-d5d1-4375-8b41-d900e0738e70 nodeName:}" failed. No retries permitted until 2026-09-11 16:31:19.269856579 +0000 UTC m=+78.886613626 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/06f8ba29-d5d1-4375-8b41-d900e0738e70-registry-tls") pod "image-registry-676cf99488-srct9" (UID: "06f8ba29-d5d1-4375-8b41-d900e0738e70") : secret "image-registry-tls" not found
Sep 11 16:31:18.770016 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:18.769988    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/06f8ba29-d5d1-4375-8b41-d900e0738e70-trusted-ca\") pod \"image-registry-676cf99488-srct9\" (UID: \"06f8ba29-d5d1-4375-8b41-d900e0738e70\") " pod="openshift-image-registry/image-registry-676cf99488-srct9"
Sep 11 16:31:18.770124 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:18.769767    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/06f8ba29-d5d1-4375-8b41-d900e0738e70-registry-certificates\") pod \"image-registry-676cf99488-srct9\" (UID: \"06f8ba29-d5d1-4375-8b41-d900e0738e70\") " pod="openshift-image-registry/image-registry-676cf99488-srct9"
Sep 11 16:31:18.770202 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:18.770123    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/06f8ba29-d5d1-4375-8b41-d900e0738e70-ca-trust-extracted\") pod \"image-registry-676cf99488-srct9\" (UID: \"06f8ba29-d5d1-4375-8b41-d900e0738e70\") " pod="openshift-image-registry/image-registry-676cf99488-srct9"
Sep 11 16:31:18.771671 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:18.771639    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/06f8ba29-d5d1-4375-8b41-d900e0738e70-installation-pull-secrets\") pod \"image-registry-676cf99488-srct9\" (UID: \"06f8ba29-d5d1-4375-8b41-d900e0738e70\") " pod="openshift-image-registry/image-registry-676cf99488-srct9"
Sep 11 16:31:18.771805 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:18.771789    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/06f8ba29-d5d1-4375-8b41-d900e0738e70-image-registry-private-configuration\") pod \"image-registry-676cf99488-srct9\" (UID: \"06f8ba29-d5d1-4375-8b41-d900e0738e70\") " pod="openshift-image-registry/image-registry-676cf99488-srct9"
Sep 11 16:31:18.782830 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:18.782809    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb2ns\" (UniqueName: \"kubernetes.io/projected/06f8ba29-d5d1-4375-8b41-d900e0738e70-kube-api-access-zb2ns\") pod \"image-registry-676cf99488-srct9\" (UID: \"06f8ba29-d5d1-4375-8b41-d900e0738e70\") " pod="openshift-image-registry/image-registry-676cf99488-srct9"
Sep 11 16:31:18.783190 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:18.783168    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/06f8ba29-d5d1-4375-8b41-d900e0738e70-bound-sa-token\") pod \"image-registry-676cf99488-srct9\" (UID: \"06f8ba29-d5d1-4375-8b41-d900e0738e70\") " pod="openshift-image-registry/image-registry-676cf99488-srct9"
Sep 11 16:31:19.271023 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:19.270983    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-8ld7f" event={"ID":"e93a3486-b35e-4746-951c-24f6bdb25182","Type":"ContainerStarted","Data":"17f2d90fef89e1083f934f219f32c3805ff8a7abb8e8a42b56713c651bef82ca"}
Sep 11 16:31:19.272582 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:19.272498    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06f8ba29-d5d1-4375-8b41-d900e0738e70-registry-tls\") pod \"image-registry-676cf99488-srct9\" (UID: \"06f8ba29-d5d1-4375-8b41-d900e0738e70\") " pod="openshift-image-registry/image-registry-676cf99488-srct9"
Sep 11 16:31:19.272715 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:19.272623    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 16:31:19.272715 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:19.272637    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-676cf99488-srct9: secret "image-registry-tls" not found
Sep 11 16:31:19.272715 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:19.272685    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06f8ba29-d5d1-4375-8b41-d900e0738e70-registry-tls podName:06f8ba29-d5d1-4375-8b41-d900e0738e70 nodeName:}" failed. No retries permitted until 2026-09-11 16:31:20.272671737 +0000 UTC m=+79.889428782 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/06f8ba29-d5d1-4375-8b41-d900e0738e70-registry-tls") pod "image-registry-676cf99488-srct9" (UID: "06f8ba29-d5d1-4375-8b41-d900e0738e70") : secret "image-registry-tls" not found
Sep 11 16:31:19.272715 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:19.272675    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-h2rkv" event={"ID":"4ac113fb-7b10-4927-87e6-a28c635d5f3c","Type":"ContainerStarted","Data":"91b65fa64bba4212c7a68d9ea7a668ffe52f2b9d36b0a8d6d21d2805d54e9421"}
Sep 11 16:31:19.290348 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:19.290295    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-8ld7f" podStartSLOduration=1.952582832 podStartE2EDuration="4.29027613s" totalImagesPullingTime="2.337693298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:31:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:31:19.290193977 +0000 UTC m=+78.906951069" watchObservedRunningTime="2026-09-11 16:31:19.29027613 +0000 UTC m=+78.907033217"
Sep 11 16:31:19.319033 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:19.318972    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-h2rkv" podStartSLOduration=1.9782568999999999 podStartE2EDuration="4.318954606s" totalImagesPullingTime="2.340697706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:31:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:31:19.318189189 +0000 UTC m=+78.934946282" watchObservedRunningTime="2026-09-11 16:31:19.318954606 +0000 UTC m=+78.935711673"
Sep 11 16:31:19.474843 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:19.474808    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6599cc8f-4bf4-402f-941b-86ae7d47633b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-vckn9\" (UID: \"6599cc8f-4bf4-402f-941b-86ae7d47633b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-vckn9"
Sep 11 16:31:19.475051 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:19.475027    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 16:31:19.475141 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:19.475130    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6599cc8f-4bf4-402f-941b-86ae7d47633b-cluster-monitoring-operator-tls podName:6599cc8f-4bf4-402f-941b-86ae7d47633b nodeName:}" failed. No retries permitted until 2026-09-11 16:31:23.475108437 +0000 UTC m=+83.091865489 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6599cc8f-4bf4-402f-941b-86ae7d47633b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-vckn9" (UID: "6599cc8f-4bf4-402f-941b-86ae7d47633b") : secret "cluster-monitoring-operator-tls" not found
Sep 11 16:31:19.579604 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:19.579499    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5b8288f-0e0e-430e-b78d-d4d9b565ad4b-service-ca-bundle\") pod \"router-default-fbfb97c5b-bzcrd\" (UID: \"b5b8288f-0e0e-430e-b78d-d4d9b565ad4b\") " pod="openshift-ingress/router-default-fbfb97c5b-bzcrd"
Sep 11 16:31:19.580085 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:19.579942    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5b8288f-0e0e-430e-b78d-d4d9b565ad4b-metrics-certs\") pod \"router-default-fbfb97c5b-bzcrd\" (UID: \"b5b8288f-0e0e-430e-b78d-d4d9b565ad4b\") " pod="openshift-ingress/router-default-fbfb97c5b-bzcrd"
Sep 11 16:31:19.580085 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:19.579980    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b5b8288f-0e0e-430e-b78d-d4d9b565ad4b-service-ca-bundle podName:b5b8288f-0e0e-430e-b78d-d4d9b565ad4b nodeName:}" failed. No retries permitted until 2026-09-11 16:31:23.579959995 +0000 UTC m=+83.196717040 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b5b8288f-0e0e-430e-b78d-d4d9b565ad4b-service-ca-bundle") pod "router-default-fbfb97c5b-bzcrd" (UID: "b5b8288f-0e0e-430e-b78d-d4d9b565ad4b") : configmap references non-existent config key: service-ca.crt
Sep 11 16:31:19.580085 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:19.580044    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 16:31:19.580296 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:19.580123    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5b8288f-0e0e-430e-b78d-d4d9b565ad4b-metrics-certs podName:b5b8288f-0e0e-430e-b78d-d4d9b565ad4b nodeName:}" failed. No retries permitted until 2026-09-11 16:31:23.580085281 +0000 UTC m=+83.196842339 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5b8288f-0e0e-430e-b78d-d4d9b565ad4b-metrics-certs") pod "router-default-fbfb97c5b-bzcrd" (UID: "b5b8288f-0e0e-430e-b78d-d4d9b565ad4b") : secret "router-metrics-certs-default" not found
Sep 11 16:31:20.117173 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:20.117134    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2bzlp"]
Sep 11 16:31:20.120591 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:20.120574    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2bzlp"
Sep 11 16:31:20.125508 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:20.125485    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 11 16:31:20.125806 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:20.125787    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 11 16:31:20.125967 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:20.125937    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vrmx6\""
Sep 11 16:31:20.128870 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:20.128846    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:20.141875 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:20.141848    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2bzlp"]
Sep 11 16:31:20.185898 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:20.185860    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9sdh\" (UniqueName: \"kubernetes.io/projected/41052c18-7556-4976-9d93-c504e6dbfb2c-kube-api-access-h9sdh\") pod \"insights-runtime-extractor-2bzlp\" (UID: \"41052c18-7556-4976-9d93-c504e6dbfb2c\") " pod="openshift-insights/insights-runtime-extractor-2bzlp"
Sep 11 16:31:20.186072 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:20.185954    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/41052c18-7556-4976-9d93-c504e6dbfb2c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2bzlp\" (UID: \"41052c18-7556-4976-9d93-c504e6dbfb2c\") " pod="openshift-insights/insights-runtime-extractor-2bzlp"
Sep 11 16:31:20.186072 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:20.186007    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/41052c18-7556-4976-9d93-c504e6dbfb2c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2bzlp\" (UID: \"41052c18-7556-4976-9d93-c504e6dbfb2c\") " pod="openshift-insights/insights-runtime-extractor-2bzlp"
Sep 11 16:31:20.186179 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:20.186136    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/41052c18-7556-4976-9d93-c504e6dbfb2c-data-volume\") pod \"insights-runtime-extractor-2bzlp\" (UID: \"41052c18-7556-4976-9d93-c504e6dbfb2c\") " pod="openshift-insights/insights-runtime-extractor-2bzlp"
Sep 11 16:31:20.186179 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:20.186166    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/41052c18-7556-4976-9d93-c504e6dbfb2c-crio-socket\") pod \"insights-runtime-extractor-2bzlp\" (UID: \"41052c18-7556-4976-9d93-c504e6dbfb2c\") " pod="openshift-insights/insights-runtime-extractor-2bzlp"
Sep 11 16:31:20.220298 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:20.220253    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:20.287365 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:20.287331    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/41052c18-7556-4976-9d93-c504e6dbfb2c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2bzlp\" (UID: \"41052c18-7556-4976-9d93-c504e6dbfb2c\") " pod="openshift-insights/insights-runtime-extractor-2bzlp"
Sep 11 16:31:20.287521 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:20.287396    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06f8ba29-d5d1-4375-8b41-d900e0738e70-registry-tls\") pod \"image-registry-676cf99488-srct9\" (UID: \"06f8ba29-d5d1-4375-8b41-d900e0738e70\") " pod="openshift-image-registry/image-registry-676cf99488-srct9"
Sep 11 16:31:20.287521 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:20.287429    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/41052c18-7556-4976-9d93-c504e6dbfb2c-data-volume\") pod \"insights-runtime-extractor-2bzlp\" (UID: \"41052c18-7556-4976-9d93-c504e6dbfb2c\") " pod="openshift-insights/insights-runtime-extractor-2bzlp"
Sep 11 16:31:20.287521 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:20.287435    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 16:31:20.287521 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:20.287453    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/41052c18-7556-4976-9d93-c504e6dbfb2c-crio-socket\") pod \"insights-runtime-extractor-2bzlp\" (UID: \"41052c18-7556-4976-9d93-c504e6dbfb2c\") " pod="openshift-insights/insights-runtime-extractor-2bzlp"
Sep 11 16:31:20.287521 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:20.287492    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9sdh\" (UniqueName: \"kubernetes.io/projected/41052c18-7556-4976-9d93-c504e6dbfb2c-kube-api-access-h9sdh\") pod \"insights-runtime-extractor-2bzlp\" (UID: \"41052c18-7556-4976-9d93-c504e6dbfb2c\") " pod="openshift-insights/insights-runtime-extractor-2bzlp"
Sep 11 16:31:20.287521 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:20.287506    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41052c18-7556-4976-9d93-c504e6dbfb2c-insights-runtime-extractor-tls podName:41052c18-7556-4976-9d93-c504e6dbfb2c nodeName:}" failed. No retries permitted until 2026-09-11 16:31:20.787488752 +0000 UTC m=+80.404245796 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/41052c18-7556-4976-9d93-c504e6dbfb2c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2bzlp" (UID: "41052c18-7556-4976-9d93-c504e6dbfb2c") : secret "insights-runtime-extractor-tls" not found
Sep 11 16:31:20.287847 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:20.287546    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 16:31:20.287847 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:20.287562    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-676cf99488-srct9: secret "image-registry-tls" not found
Sep 11 16:31:20.287847 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:20.287586    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/41052c18-7556-4976-9d93-c504e6dbfb2c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2bzlp\" (UID: \"41052c18-7556-4976-9d93-c504e6dbfb2c\") " pod="openshift-insights/insights-runtime-extractor-2bzlp"
Sep 11 16:31:20.287847 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:20.287586    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/41052c18-7556-4976-9d93-c504e6dbfb2c-crio-socket\") pod \"insights-runtime-extractor-2bzlp\" (UID: \"41052c18-7556-4976-9d93-c504e6dbfb2c\") " pod="openshift-insights/insights-runtime-extractor-2bzlp"
Sep 11 16:31:20.287847 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:20.287607    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06f8ba29-d5d1-4375-8b41-d900e0738e70-registry-tls podName:06f8ba29-d5d1-4375-8b41-d900e0738e70 nodeName:}" failed. No retries permitted until 2026-09-11 16:31:22.287591791 +0000 UTC m=+81.904348854 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/06f8ba29-d5d1-4375-8b41-d900e0738e70-registry-tls") pod "image-registry-676cf99488-srct9" (UID: "06f8ba29-d5d1-4375-8b41-d900e0738e70") : secret "image-registry-tls" not found
Sep 11 16:31:20.287847 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:20.287637    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 16:31:20.287847 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:20.287670    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/41052c18-7556-4976-9d93-c504e6dbfb2c-kube-rbac-proxy-cm podName:41052c18-7556-4976-9d93-c504e6dbfb2c nodeName:}" failed. No retries permitted until 2026-09-11 16:31:20.787657601 +0000 UTC m=+80.404414646 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/41052c18-7556-4976-9d93-c504e6dbfb2c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2bzlp" (UID: "41052c18-7556-4976-9d93-c504e6dbfb2c") : configmap "kube-rbac-proxy" not found
Sep 11 16:31:20.287847 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:20.287828    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/41052c18-7556-4976-9d93-c504e6dbfb2c-data-volume\") pod \"insights-runtime-extractor-2bzlp\" (UID: \"41052c18-7556-4976-9d93-c504e6dbfb2c\") " pod="openshift-insights/insights-runtime-extractor-2bzlp"
Sep 11 16:31:20.301505 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:20.301465    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9sdh\" (UniqueName: \"kubernetes.io/projected/41052c18-7556-4976-9d93-c504e6dbfb2c-kube-api-access-h9sdh\") pod \"insights-runtime-extractor-2bzlp\" (UID: \"41052c18-7556-4976-9d93-c504e6dbfb2c\") " pod="openshift-insights/insights-runtime-extractor-2bzlp"
Sep 11 16:31:20.558792 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:20.558756    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:20.622766 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:20.622738    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:20.792848 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:20.792809    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/41052c18-7556-4976-9d93-c504e6dbfb2c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2bzlp\" (UID: \"41052c18-7556-4976-9d93-c504e6dbfb2c\") " pod="openshift-insights/insights-runtime-extractor-2bzlp"
Sep 11 16:31:20.793012 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:20.792864    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/41052c18-7556-4976-9d93-c504e6dbfb2c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2bzlp\" (UID: \"41052c18-7556-4976-9d93-c504e6dbfb2c\") " pod="openshift-insights/insights-runtime-extractor-2bzlp"
Sep 11 16:31:20.793012 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:20.792918    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 16:31:20.793012 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:20.792967    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 16:31:20.793012 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:20.792977    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/41052c18-7556-4976-9d93-c504e6dbfb2c-kube-rbac-proxy-cm podName:41052c18-7556-4976-9d93-c504e6dbfb2c nodeName:}" failed. No retries permitted until 2026-09-11 16:31:21.792962788 +0000 UTC m=+81.409719832 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/41052c18-7556-4976-9d93-c504e6dbfb2c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2bzlp" (UID: "41052c18-7556-4976-9d93-c504e6dbfb2c") : configmap "kube-rbac-proxy" not found
Sep 11 16:31:20.793219 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:20.793019    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41052c18-7556-4976-9d93-c504e6dbfb2c-insights-runtime-extractor-tls podName:41052c18-7556-4976-9d93-c504e6dbfb2c nodeName:}" failed. No retries permitted until 2026-09-11 16:31:21.79300709 +0000 UTC m=+81.409764135 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/41052c18-7556-4976-9d93-c504e6dbfb2c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2bzlp" (UID: "41052c18-7556-4976-9d93-c504e6dbfb2c") : secret "insights-runtime-extractor-tls" not found
Sep 11 16:31:21.005733 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:21.005698    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:21.112923 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:21.112886    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:21.225951 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:21.225922    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:21.308180 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:21.308104    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:21.439709 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:21.439676    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:21.800971 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:21.800929    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/41052c18-7556-4976-9d93-c504e6dbfb2c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2bzlp\" (UID: \"41052c18-7556-4976-9d93-c504e6dbfb2c\") " pod="openshift-insights/insights-runtime-extractor-2bzlp"
Sep 11 16:31:21.801467 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:21.800985    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/41052c18-7556-4976-9d93-c504e6dbfb2c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2bzlp\" (UID: \"41052c18-7556-4976-9d93-c504e6dbfb2c\") " pod="openshift-insights/insights-runtime-extractor-2bzlp"
Sep 11 16:31:21.801467 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:21.801073    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 16:31:21.801467 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:21.801128    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 16:31:21.801467 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:21.801181    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/41052c18-7556-4976-9d93-c504e6dbfb2c-kube-rbac-proxy-cm podName:41052c18-7556-4976-9d93-c504e6dbfb2c nodeName:}" failed. No retries permitted until 2026-09-11 16:31:23.801155858 +0000 UTC m=+83.417912918 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/41052c18-7556-4976-9d93-c504e6dbfb2c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2bzlp" (UID: "41052c18-7556-4976-9d93-c504e6dbfb2c") : configmap "kube-rbac-proxy" not found
Sep 11 16:31:21.801467 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:21.801201    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41052c18-7556-4976-9d93-c504e6dbfb2c-insights-runtime-extractor-tls podName:41052c18-7556-4976-9d93-c504e6dbfb2c nodeName:}" failed. No retries permitted until 2026-09-11 16:31:23.801191582 +0000 UTC m=+83.417948628 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/41052c18-7556-4976-9d93-c504e6dbfb2c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2bzlp" (UID: "41052c18-7556-4976-9d93-c504e6dbfb2c") : secret "insights-runtime-extractor-tls" not found
Sep 11 16:31:22.040247 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:22.040217    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nk4fp_41863045-9930-4c6f-a9a4-cb77f319ed93/dns-node-resolver/0.log"
Sep 11 16:31:22.309062 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:22.306240    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06f8ba29-d5d1-4375-8b41-d900e0738e70-registry-tls\") pod \"image-registry-676cf99488-srct9\" (UID: \"06f8ba29-d5d1-4375-8b41-d900e0738e70\") " pod="openshift-image-registry/image-registry-676cf99488-srct9"
Sep 11 16:31:22.309062 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:22.306434    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 16:31:22.309062 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:22.306450    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-676cf99488-srct9: secret "image-registry-tls" not found
Sep 11 16:31:22.309062 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:22.306516    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06f8ba29-d5d1-4375-8b41-d900e0738e70-registry-tls podName:06f8ba29-d5d1-4375-8b41-d900e0738e70 nodeName:}" failed. No retries permitted until 2026-09-11 16:31:26.306497362 +0000 UTC m=+85.923254408 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/06f8ba29-d5d1-4375-8b41-d900e0738e70-registry-tls") pod "image-registry-676cf99488-srct9" (UID: "06f8ba29-d5d1-4375-8b41-d900e0738e70") : secret "image-registry-tls" not found
Sep 11 16:31:22.914819 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:22.914779    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:23.016007 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:23.015965    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:23.240706 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:23.240679    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xsfcb_69e5eae6-9a55-49ac-a01c-70cbadab5acd/node-ca/0.log"
Sep 11 16:31:23.440854 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:23.440822    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:23.516054 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:23.515955    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6599cc8f-4bf4-402f-941b-86ae7d47633b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-vckn9\" (UID: \"6599cc8f-4bf4-402f-941b-86ae7d47633b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-vckn9"
Sep 11 16:31:23.516236 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:23.516125    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 16:31:23.516236 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:23.516193    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6599cc8f-4bf4-402f-941b-86ae7d47633b-cluster-monitoring-operator-tls podName:6599cc8f-4bf4-402f-941b-86ae7d47633b nodeName:}" failed. No retries permitted until 2026-09-11 16:31:31.51617545 +0000 UTC m=+91.132932495 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6599cc8f-4bf4-402f-941b-86ae7d47633b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-vckn9" (UID: "6599cc8f-4bf4-402f-941b-86ae7d47633b") : secret "cluster-monitoring-operator-tls" not found
Sep 11 16:31:23.609437 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:23.609407    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:23.616830 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:23.616803    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5b8288f-0e0e-430e-b78d-d4d9b565ad4b-service-ca-bundle\") pod \"router-default-fbfb97c5b-bzcrd\" (UID: \"b5b8288f-0e0e-430e-b78d-d4d9b565ad4b\") " pod="openshift-ingress/router-default-fbfb97c5b-bzcrd"
Sep 11 16:31:23.616925 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:23.616856    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5b8288f-0e0e-430e-b78d-d4d9b565ad4b-metrics-certs\") pod \"router-default-fbfb97c5b-bzcrd\" (UID: \"b5b8288f-0e0e-430e-b78d-d4d9b565ad4b\") " pod="openshift-ingress/router-default-fbfb97c5b-bzcrd"
Sep 11 16:31:23.616980 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:23.616945    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 16:31:23.617040 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:23.616996    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b5b8288f-0e0e-430e-b78d-d4d9b565ad4b-service-ca-bundle podName:b5b8288f-0e0e-430e-b78d-d4d9b565ad4b nodeName:}" failed. No retries permitted until 2026-09-11 16:31:31.616973095 +0000 UTC m=+91.233730156 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b5b8288f-0e0e-430e-b78d-d4d9b565ad4b-service-ca-bundle") pod "router-default-fbfb97c5b-bzcrd" (UID: "b5b8288f-0e0e-430e-b78d-d4d9b565ad4b") : configmap references non-existent config key: service-ca.crt
Sep 11 16:31:23.617040 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:23.617030    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5b8288f-0e0e-430e-b78d-d4d9b565ad4b-metrics-certs podName:b5b8288f-0e0e-430e-b78d-d4d9b565ad4b nodeName:}" failed. No retries permitted until 2026-09-11 16:31:31.61701861 +0000 UTC m=+91.233775677 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5b8288f-0e0e-430e-b78d-d4d9b565ad4b-metrics-certs") pod "router-default-fbfb97c5b-bzcrd" (UID: "b5b8288f-0e0e-430e-b78d-d4d9b565ad4b") : secret "router-metrics-certs-default" not found
Sep 11 16:31:23.818389 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:23.818303    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/41052c18-7556-4976-9d93-c504e6dbfb2c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2bzlp\" (UID: \"41052c18-7556-4976-9d93-c504e6dbfb2c\") " pod="openshift-insights/insights-runtime-extractor-2bzlp"
Sep 11 16:31:23.818547 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:23.818462    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/41052c18-7556-4976-9d93-c504e6dbfb2c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2bzlp\" (UID: \"41052c18-7556-4976-9d93-c504e6dbfb2c\") " pod="openshift-insights/insights-runtime-extractor-2bzlp"
Sep 11 16:31:23.818547 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:23.818468    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 16:31:23.818547 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:23.818506    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 16:31:23.818654 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:23.818559    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/41052c18-7556-4976-9d93-c504e6dbfb2c-kube-rbac-proxy-cm podName:41052c18-7556-4976-9d93-c504e6dbfb2c nodeName:}" failed. No retries permitted until 2026-09-11 16:31:27.818540904 +0000 UTC m=+87.435297964 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/41052c18-7556-4976-9d93-c504e6dbfb2c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2bzlp" (UID: "41052c18-7556-4976-9d93-c504e6dbfb2c") : configmap "kube-rbac-proxy" not found
Sep 11 16:31:23.818654 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:23.818573    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41052c18-7556-4976-9d93-c504e6dbfb2c-insights-runtime-extractor-tls podName:41052c18-7556-4976-9d93-c504e6dbfb2c nodeName:}" failed. No retries permitted until 2026-09-11 16:31:27.818567378 +0000 UTC m=+87.435324423 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/41052c18-7556-4976-9d93-c504e6dbfb2c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2bzlp" (UID: "41052c18-7556-4976-9d93-c504e6dbfb2c") : secret "insights-runtime-extractor-tls" not found
Sep 11 16:31:23.852290 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:23.852258    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:24.040776 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:24.040748    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jwnrd_2e231c84-f297-44d1-bb39-b4cbea4c48b5/serve-healthcheck-canary/0.log"
Sep 11 16:31:26.340040 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:26.340000    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06f8ba29-d5d1-4375-8b41-d900e0738e70-registry-tls\") pod \"image-registry-676cf99488-srct9\" (UID: \"06f8ba29-d5d1-4375-8b41-d900e0738e70\") " pod="openshift-image-registry/image-registry-676cf99488-srct9"
Sep 11 16:31:26.340511 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:26.340201    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 16:31:26.340511 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:26.340220    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-676cf99488-srct9: secret "image-registry-tls" not found
Sep 11 16:31:26.340511 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:26.340280    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06f8ba29-d5d1-4375-8b41-d900e0738e70-registry-tls podName:06f8ba29-d5d1-4375-8b41-d900e0738e70 nodeName:}" failed. No retries permitted until 2026-09-11 16:31:34.340262851 +0000 UTC m=+93.957019897 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/06f8ba29-d5d1-4375-8b41-d900e0738e70-registry-tls") pod "image-registry-676cf99488-srct9" (UID: "06f8ba29-d5d1-4375-8b41-d900e0738e70") : secret "image-registry-tls" not found
Sep 11 16:31:27.031352 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:27.031319    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:27.139976 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:27.139942    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:27.417263 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:27.417066    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:27.564196 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:27.564159    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:27.671351 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:27.671270    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:27.749427 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:27.749390    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:27.854198 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:27.854161    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/41052c18-7556-4976-9d93-c504e6dbfb2c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2bzlp\" (UID: \"41052c18-7556-4976-9d93-c504e6dbfb2c\") " pod="openshift-insights/insights-runtime-extractor-2bzlp"
Sep 11 16:31:27.854393 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:27.854210    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/41052c18-7556-4976-9d93-c504e6dbfb2c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2bzlp\" (UID: \"41052c18-7556-4976-9d93-c504e6dbfb2c\") " pod="openshift-insights/insights-runtime-extractor-2bzlp"
Sep 11 16:31:27.854393 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:27.854296    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 16:31:27.854393 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:27.854317    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 16:31:27.854393 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:27.854373    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/41052c18-7556-4976-9d93-c504e6dbfb2c-kube-rbac-proxy-cm podName:41052c18-7556-4976-9d93-c504e6dbfb2c nodeName:}" failed. No retries permitted until 2026-09-11 16:31:35.854353315 +0000 UTC m=+95.471110374 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/41052c18-7556-4976-9d93-c504e6dbfb2c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2bzlp" (UID: "41052c18-7556-4976-9d93-c504e6dbfb2c") : configmap "kube-rbac-proxy" not found
Sep 11 16:31:27.854393 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:27.854391    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41052c18-7556-4976-9d93-c504e6dbfb2c-insights-runtime-extractor-tls podName:41052c18-7556-4976-9d93-c504e6dbfb2c nodeName:}" failed. No retries permitted until 2026-09-11 16:31:35.854382607 +0000 UTC m=+95.471139651 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/41052c18-7556-4976-9d93-c504e6dbfb2c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2bzlp" (UID: "41052c18-7556-4976-9d93-c504e6dbfb2c") : secret "insights-runtime-extractor-tls" not found
Sep 11 16:31:28.123305 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:28.123271    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:28.521713 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:28.521677    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:29.137122 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:29.137073    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:29.370038 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:29.369995    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:29.519415 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:29.519380    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:29.943736 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:29.943707    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:30.310059 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:30.309970    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:30.608397 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:30.608310    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:30.915292 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:30.915205    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:30.984145 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:30.984106    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:31.525581 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:31.525545    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:31.590459 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:31.590418    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6599cc8f-4bf4-402f-941b-86ae7d47633b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-vckn9\" (UID: \"6599cc8f-4bf4-402f-941b-86ae7d47633b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-vckn9"
Sep 11 16:31:31.590634 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:31.590544    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 16:31:31.590634 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:31.590605    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6599cc8f-4bf4-402f-941b-86ae7d47633b-cluster-monitoring-operator-tls podName:6599cc8f-4bf4-402f-941b-86ae7d47633b nodeName:}" failed. No retries permitted until 2026-09-11 16:31:47.59059091 +0000 UTC m=+107.207347955 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6599cc8f-4bf4-402f-941b-86ae7d47633b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-vckn9" (UID: "6599cc8f-4bf4-402f-941b-86ae7d47633b") : secret "cluster-monitoring-operator-tls" not found
Sep 11 16:31:31.614826 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:31.614796    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:31.691823 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:31.691786    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5b8288f-0e0e-430e-b78d-d4d9b565ad4b-service-ca-bundle\") pod \"router-default-fbfb97c5b-bzcrd\" (UID: \"b5b8288f-0e0e-430e-b78d-d4d9b565ad4b\") " pod="openshift-ingress/router-default-fbfb97c5b-bzcrd"
Sep 11 16:31:31.692002 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:31.691859    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5b8288f-0e0e-430e-b78d-d4d9b565ad4b-metrics-certs\") pod \"router-default-fbfb97c5b-bzcrd\" (UID: \"b5b8288f-0e0e-430e-b78d-d4d9b565ad4b\") " pod="openshift-ingress/router-default-fbfb97c5b-bzcrd"
Sep 11 16:31:31.692002 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:31.691972    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b5b8288f-0e0e-430e-b78d-d4d9b565ad4b-service-ca-bundle podName:b5b8288f-0e0e-430e-b78d-d4d9b565ad4b nodeName:}" failed. No retries permitted until 2026-09-11 16:31:47.691950727 +0000 UTC m=+107.308707782 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b5b8288f-0e0e-430e-b78d-d4d9b565ad4b-service-ca-bundle") pod "router-default-fbfb97c5b-bzcrd" (UID: "b5b8288f-0e0e-430e-b78d-d4d9b565ad4b") : configmap references non-existent config key: service-ca.crt
Sep 11 16:31:31.694500 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:31.694476    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5b8288f-0e0e-430e-b78d-d4d9b565ad4b-metrics-certs\") pod \"router-default-fbfb97c5b-bzcrd\" (UID: \"b5b8288f-0e0e-430e-b78d-d4d9b565ad4b\") " pod="openshift-ingress/router-default-fbfb97c5b-bzcrd"
Sep 11 16:31:31.715279 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:31.715251    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:32.130539 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:32.130503    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:32.329246 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:32.329210    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:32.718689 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:32.718654    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:33.271382 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:33.271345    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:33.495011 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:33.494973    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:33.649528 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:33.649450    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:33.747030 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:33.746986    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:34.119727 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:34.119695    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:34.373978 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:34.373899    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:34.416679 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:34.416650    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06f8ba29-d5d1-4375-8b41-d900e0738e70-registry-tls\") pod \"image-registry-676cf99488-srct9\" (UID: \"06f8ba29-d5d1-4375-8b41-d900e0738e70\") " pod="openshift-image-registry/image-registry-676cf99488-srct9"
Sep 11 16:31:34.419055 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:34.419028    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06f8ba29-d5d1-4375-8b41-d900e0738e70-registry-tls\") pod \"image-registry-676cf99488-srct9\" (UID: \"06f8ba29-d5d1-4375-8b41-d900e0738e70\") " pod="openshift-image-registry/image-registry-676cf99488-srct9"
Sep 11 16:31:34.568244 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:34.568208    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-676cf99488-srct9"
Sep 11 16:31:34.724039 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:34.724005    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:34.852515 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:34.852490    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-676cf99488-srct9"]
Sep 11 16:31:34.854384 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:31:34.854357    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06f8ba29_d5d1_4375_8b41_d900e0738e70.slice/crio-d7220bca5215a81fa478955407dc015d2cf8e2de3137a3f2d0684f964963ee25 WatchSource:0}: Error finding container d7220bca5215a81fa478955407dc015d2cf8e2de3137a3f2d0684f964963ee25: Status 404 returned error can't find the container with id d7220bca5215a81fa478955407dc015d2cf8e2de3137a3f2d0684f964963ee25
Sep 11 16:31:35.318153 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:35.318078    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-676cf99488-srct9" event={"ID":"06f8ba29-d5d1-4375-8b41-d900e0738e70","Type":"ContainerStarted","Data":"f134262a4ce9a545f394be6ff9869f6f9a58b43e2a5653fedf80f5d670036653"}
Sep 11 16:31:35.318345 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:35.318165    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-676cf99488-srct9" event={"ID":"06f8ba29-d5d1-4375-8b41-d900e0738e70","Type":"ContainerStarted","Data":"d7220bca5215a81fa478955407dc015d2cf8e2de3137a3f2d0684f964963ee25"}
Sep 11 16:31:35.318345 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:35.318193    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-676cf99488-srct9"
Sep 11 16:31:35.342023 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:35.341969    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-676cf99488-srct9" podStartSLOduration=17.341949661 podStartE2EDuration="17.341949661s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:31:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:31:35.341833264 +0000 UTC m=+94.958590342" watchObservedRunningTime="2026-09-11 16:31:35.341949661 +0000 UTC m=+94.958706728"
Sep 11 16:31:35.506071 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:35.506039    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:35.709961 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:35.709930    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:35.775387 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:35.775358    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:35.929906 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:35.929862    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/41052c18-7556-4976-9d93-c504e6dbfb2c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2bzlp\" (UID: \"41052c18-7556-4976-9d93-c504e6dbfb2c\") " pod="openshift-insights/insights-runtime-extractor-2bzlp"
Sep 11 16:31:35.930084 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:35.929915    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/41052c18-7556-4976-9d93-c504e6dbfb2c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2bzlp\" (UID: \"41052c18-7556-4976-9d93-c504e6dbfb2c\") " pod="openshift-insights/insights-runtime-extractor-2bzlp"
Sep 11 16:31:35.930084 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:35.930030    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 16:31:35.930204 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:31:35.930127    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41052c18-7556-4976-9d93-c504e6dbfb2c-insights-runtime-extractor-tls podName:41052c18-7556-4976-9d93-c504e6dbfb2c nodeName:}" failed. No retries permitted until 2026-09-11 16:31:51.930083306 +0000 UTC m=+111.546840351 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/41052c18-7556-4976-9d93-c504e6dbfb2c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2bzlp" (UID: "41052c18-7556-4976-9d93-c504e6dbfb2c") : secret "insights-runtime-extractor-tls" not found
Sep 11 16:31:35.930555 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:35.930537    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/41052c18-7556-4976-9d93-c504e6dbfb2c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2bzlp\" (UID: \"41052c18-7556-4976-9d93-c504e6dbfb2c\") " pod="openshift-insights/insights-runtime-extractor-2bzlp"
Sep 11 16:31:36.111490 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:36.111393    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:36.316691 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:36.316658    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:36.909669 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:36.909628    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:37.321764 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:37.321711    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:37.508301 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:37.508261    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:37.711471 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:37.711431    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:39.257159 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:39.257119    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ea2d453f-d6ae-437a-a922-140017dedf14-metrics-tls\") pod \"dns-default-nt2jf\" (UID: \"ea2d453f-d6ae-437a-a922-140017dedf14\") " pod="openshift-dns/dns-default-nt2jf"
Sep 11 16:31:39.259538 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:39.259516    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ea2d453f-d6ae-437a-a922-140017dedf14-metrics-tls\") pod \"dns-default-nt2jf\" (UID: \"ea2d453f-d6ae-437a-a922-140017dedf14\") " pod="openshift-dns/dns-default-nt2jf"
Sep 11 16:31:39.517925 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:39.517847    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-55n2r\""
Sep 11 16:31:39.526147 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:39.526127    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nt2jf"
Sep 11 16:31:39.797811 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:39.797764    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nt2jf"]
Sep 11 16:31:39.799898 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:31:39.799869    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea2d453f_d6ae_437a_a922_140017dedf14.slice/crio-c2933cecd42a446b083c108f34e92b80b8ebc70a8ff50a1af4645e97285c37b1 WatchSource:0}: Error finding container c2933cecd42a446b083c108f34e92b80b8ebc70a8ff50a1af4645e97285c37b1: Status 404 returned error can't find the container with id c2933cecd42a446b083c108f34e92b80b8ebc70a8ff50a1af4645e97285c37b1
Sep 11 16:31:40.335019 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:40.334988    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nt2jf" event={"ID":"ea2d453f-d6ae-437a-a922-140017dedf14","Type":"ContainerStarted","Data":"c2933cecd42a446b083c108f34e92b80b8ebc70a8ff50a1af4645e97285c37b1"}
Sep 11 16:31:42.343538 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:42.343495    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nt2jf" event={"ID":"ea2d453f-d6ae-437a-a922-140017dedf14","Type":"ContainerStarted","Data":"025367caf6366f34bceec050bd86b806992ed759dc48fd09799773e463d3f126"}
Sep 11 16:31:42.343931 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:42.343575    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nt2jf" event={"ID":"ea2d453f-d6ae-437a-a922-140017dedf14","Type":"ContainerStarted","Data":"ae769f4bf53879b5ee0789a1a54b9af85401d6f964f4cf4b343684208dfb8553"}
Sep 11 16:31:42.343931 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:42.343640    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-nt2jf"
Sep 11 16:31:42.364294 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:42.364246    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-nt2jf" podStartSLOduration=65.515514349 podStartE2EDuration="1m7.364231791s" totalImagesPullingTime="1.848717442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:30:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:31:42.362373536 +0000 UTC m=+101.979130602" watchObservedRunningTime="2026-09-11 16:31:42.364231791 +0000 UTC m=+101.980988858"
Sep 11 16:31:42.553443 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:42.553408    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:42.655130 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:42.655036    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:42.718837 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:42.718809    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:42.843727 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:42.843697    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:43.036726 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:43.036692    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:43.106760 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:43.106728    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:43.254341 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:43.254310    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qx7z8"
Sep 11 16:31:43.445076 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:43.445040    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:43.635407 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:43.635323    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:43.708110 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:43.708000    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:44.241569 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:44.241512    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:44.439273 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:44.439225    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:44.658045 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:44.657920    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:44.899073 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:44.899021    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:44.997675 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:44.997646    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:45.333554 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:45.333472    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-w7cgp"]
Sep 11 16:31:45.359233 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:45.359205    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-676cf99488-srct9"]
Sep 11 16:31:45.359383 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:45.359244    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-w7cgp"]
Sep 11 16:31:45.359383 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:45.359319    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-w7cgp"
Sep 11 16:31:45.361819 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:45.361764    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 11 16:31:45.362016 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:45.361998    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-98cqd\""
Sep 11 16:31:45.362137 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:45.362066    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 11 16:31:45.423341 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:45.423305    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-4wgq4"]
Sep 11 16:31:45.439175 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:45.439143    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-4wgq4"
Sep 11 16:31:45.442446 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:45.442409    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-4wgq4"]
Sep 11 16:31:45.448078 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:45.448059    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 11 16:31:45.448207 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:45.448155    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-k4q9p\""
Sep 11 16:31:45.453422 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:45.453403    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 11 16:31:45.513578 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:45.513542    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gskt\" (UniqueName: \"kubernetes.io/projected/7ac41677-2158-4c4b-98f0-af93b7524e0d-kube-api-access-7gskt\") pod \"downloads-76f99584f4-w7cgp\" (UID: \"7ac41677-2158-4c4b-98f0-af93b7524e0d\") " pod="openshift-console/downloads-76f99584f4-w7cgp"
Sep 11 16:31:45.524844 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:45.524812    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:45.614237 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:45.614145    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/27d75414-6608-4c7f-909d-35914483d31b-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-4wgq4\" (UID: \"27d75414-6608-4c7f-909d-35914483d31b\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-4wgq4"
Sep 11 16:31:45.614237 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:45.614215    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/27d75414-6608-4c7f-909d-35914483d31b-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-4wgq4\" (UID: \"27d75414-6608-4c7f-909d-35914483d31b\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-4wgq4"
Sep 11 16:31:45.614471 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:45.614270    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gskt\" (UniqueName: \"kubernetes.io/projected/7ac41677-2158-4c4b-98f0-af93b7524e0d-kube-api-access-7gskt\") pod \"downloads-76f99584f4-w7cgp\" (UID: \"7ac41677-2158-4c4b-98f0-af93b7524e0d\") " pod="openshift-console/downloads-76f99584f4-w7cgp"
Sep 11 16:31:45.642658 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:45.642621    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gskt\" (UniqueName: \"kubernetes.io/projected/7ac41677-2158-4c4b-98f0-af93b7524e0d-kube-api-access-7gskt\") pod \"downloads-76f99584f4-w7cgp\" (UID: \"7ac41677-2158-4c4b-98f0-af93b7524e0d\") " pod="openshift-console/downloads-76f99584f4-w7cgp"
Sep 11 16:31:45.669403 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:45.669353    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-w7cgp"
Sep 11 16:31:45.714662 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:45.714631    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/27d75414-6608-4c7f-909d-35914483d31b-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-4wgq4\" (UID: \"27d75414-6608-4c7f-909d-35914483d31b\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-4wgq4"
Sep 11 16:31:45.714805 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:45.714704    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/27d75414-6608-4c7f-909d-35914483d31b-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-4wgq4\" (UID: \"27d75414-6608-4c7f-909d-35914483d31b\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-4wgq4"
Sep 11 16:31:45.715428 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:45.715405    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/27d75414-6608-4c7f-909d-35914483d31b-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-4wgq4\" (UID: \"27d75414-6608-4c7f-909d-35914483d31b\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-4wgq4"
Sep 11 16:31:45.717260 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:45.717242    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/27d75414-6608-4c7f-909d-35914483d31b-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-4wgq4\" (UID: \"27d75414-6608-4c7f-909d-35914483d31b\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-4wgq4"
Sep 11 16:31:45.749344 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:45.749314    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-4wgq4"
Sep 11 16:31:45.751870 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:45.751829    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:45.864186 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:45.864157    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:45.963198 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:45.961233    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-w7cgp"]
Sep 11 16:31:46.045240 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:46.045217    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-4wgq4"]
Sep 11 16:31:46.047928 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:31:46.047905    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27d75414_6608_4c7f_909d_35914483d31b.slice/crio-f6438612712b3a7ec7d971f7be1db2b4372461aaebb7115d7dfbf47d9828c876 WatchSource:0}: Error finding container f6438612712b3a7ec7d971f7be1db2b4372461aaebb7115d7dfbf47d9828c876: Status 404 returned error can't find the container with id f6438612712b3a7ec7d971f7be1db2b4372461aaebb7115d7dfbf47d9828c876
Sep 11 16:31:46.357479 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:46.357368    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-w7cgp" event={"ID":"7ac41677-2158-4c4b-98f0-af93b7524e0d","Type":"ContainerStarted","Data":"0b7ef642efb27ad2ba5d2e843e903f943be47baba8c19df818b69bdda7912b25"}
Sep 11 16:31:46.358557 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:46.358527    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-4wgq4" event={"ID":"27d75414-6608-4c7f-909d-35914483d31b","Type":"ContainerStarted","Data":"f6438612712b3a7ec7d971f7be1db2b4372461aaebb7115d7dfbf47d9828c876"}
Sep 11 16:31:47.633318 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:47.633218    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6599cc8f-4bf4-402f-941b-86ae7d47633b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-vckn9\" (UID: \"6599cc8f-4bf4-402f-941b-86ae7d47633b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-vckn9"
Sep 11 16:31:47.636225 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:47.636197    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6599cc8f-4bf4-402f-941b-86ae7d47633b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-vckn9\" (UID: \"6599cc8f-4bf4-402f-941b-86ae7d47633b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-vckn9"
Sep 11 16:31:47.733860 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:47.733822    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5b8288f-0e0e-430e-b78d-d4d9b565ad4b-service-ca-bundle\") pod \"router-default-fbfb97c5b-bzcrd\" (UID: \"b5b8288f-0e0e-430e-b78d-d4d9b565ad4b\") " pod="openshift-ingress/router-default-fbfb97c5b-bzcrd"
Sep 11 16:31:47.734449 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:47.734421    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5b8288f-0e0e-430e-b78d-d4d9b565ad4b-service-ca-bundle\") pod \"router-default-fbfb97c5b-bzcrd\" (UID: \"b5b8288f-0e0e-430e-b78d-d4d9b565ad4b\") " pod="openshift-ingress/router-default-fbfb97c5b-bzcrd"
Sep 11 16:31:47.837819 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:47.837781    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-vckn9"
Sep 11 16:31:47.954135 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:47.954078    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-fbfb97c5b-bzcrd"
Sep 11 16:31:48.116069 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:48.115997    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-vckn9"]
Sep 11 16:31:48.120227 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:31:48.120199    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6599cc8f_4bf4_402f_941b_86ae7d47633b.slice/crio-5a498258e0a7fef86b088878b45de762c4678bfca5309f660bed11d38a9a8ec4 WatchSource:0}: Error finding container 5a498258e0a7fef86b088878b45de762c4678bfca5309f660bed11d38a9a8ec4: Status 404 returned error can't find the container with id 5a498258e0a7fef86b088878b45de762c4678bfca5309f660bed11d38a9a8ec4
Sep 11 16:31:48.234207 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:48.234170    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-fbfb97c5b-bzcrd"]
Sep 11 16:31:48.238036 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:31:48.238003    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5b8288f_0e0e_430e_b78d_d4d9b565ad4b.slice/crio-a6bc067e0a5475d0dfb81b486769182afeb661b5833de7b1a544d783dbf777b1 WatchSource:0}: Error finding container a6bc067e0a5475d0dfb81b486769182afeb661b5833de7b1a544d783dbf777b1: Status 404 returned error can't find the container with id a6bc067e0a5475d0dfb81b486769182afeb661b5833de7b1a544d783dbf777b1
Sep 11 16:31:48.368377 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:48.368342    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-vckn9" event={"ID":"6599cc8f-4bf4-402f-941b-86ae7d47633b","Type":"ContainerStarted","Data":"5a498258e0a7fef86b088878b45de762c4678bfca5309f660bed11d38a9a8ec4"}
Sep 11 16:31:48.370320 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:48.370285    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-4wgq4" event={"ID":"27d75414-6608-4c7f-909d-35914483d31b","Type":"ContainerStarted","Data":"c1c8b183fdfd0d60c2e7cf970f6555da2b2c7b5f85a340297356a1e35658ee14"}
Sep 11 16:31:48.372260 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:48.372232    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-fbfb97c5b-bzcrd" event={"ID":"b5b8288f-0e0e-430e-b78d-d4d9b565ad4b","Type":"ContainerStarted","Data":"55dc4bebc34b3dc40e90b50c522ac4f9a3fc8c03875b72c8ac4f7ce6068800bc"}
Sep 11 16:31:48.372385 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:48.372278    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-fbfb97c5b-bzcrd" event={"ID":"b5b8288f-0e0e-430e-b78d-d4d9b565ad4b","Type":"ContainerStarted","Data":"a6bc067e0a5475d0dfb81b486769182afeb661b5833de7b1a544d783dbf777b1"}
Sep 11 16:31:48.389811 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:48.389764    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-4wgq4" podStartSLOduration=2.119089309 podStartE2EDuration="3.389747234s" totalImagesPullingTime="1.270657925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:31:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:31:48.388388719 +0000 UTC m=+108.005145802" watchObservedRunningTime="2026-09-11 16:31:48.389747234 +0000 UTC m=+108.006504336"
Sep 11 16:31:48.416176 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:48.416126    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-fbfb97c5b-bzcrd" podStartSLOduration=33.416110174 podStartE2EDuration="33.416110174s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:31:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:31:48.415339738 +0000 UTC m=+108.032096826" watchObservedRunningTime="2026-09-11 16:31:48.416110174 +0000 UTC m=+108.032867231"
Sep 11 16:31:48.539818 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:48.539728    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:48.623951 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:48.623921    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:48.955260 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:48.955222    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-fbfb97c5b-bzcrd"
Sep 11 16:31:48.958287 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:48.958247    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-fbfb97c5b-bzcrd"
Sep 11 16:31:49.377291 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:49.377075    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-fbfb97c5b-bzcrd"
Sep 11 16:31:49.378628 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:49.378606    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-fbfb97c5b-bzcrd"
Sep 11 16:31:50.364560 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:50.364448    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:50.383747 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:50.383711    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-vckn9" event={"ID":"6599cc8f-4bf4-402f-941b-86ae7d47633b","Type":"ContainerStarted","Data":"b4b1b225d9ae28b5b868dd088d195ada4ccc26c7d0bde93a6b31d7c861dc062e"}
Sep 11 16:31:50.404682 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:50.404627    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-vckn9" podStartSLOduration=33.542592353 podStartE2EDuration="35.404605204s" totalImagesPullingTime="1.862012851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:31:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:31:50.402942848 +0000 UTC m=+110.019699943" watchObservedRunningTime="2026-09-11 16:31:50.404605204 +0000 UTC m=+110.021362272"
Sep 11 16:31:50.465782 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:50.465727    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:50.535066 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:50.535037    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-bbkt6"]
Sep 11 16:31:50.538481 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:50.538454    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-bbkt6"
Sep 11 16:31:50.541049 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:50.541015    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 11 16:31:50.541207 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:50.541076    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-xsfj6\""
Sep 11 16:31:50.548602 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:50.548579    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-bbkt6"]
Sep 11 16:31:50.556342 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:50.556317    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:50.557621 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:50.557594    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5218d2f0-919d-4d59-9596-25a64fcff283-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-bbkt6\" (UID: \"5218d2f0-919d-4d59-9596-25a64fcff283\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-bbkt6"
Sep 11 16:31:50.658463 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:50.658377    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5218d2f0-919d-4d59-9596-25a64fcff283-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-bbkt6\" (UID: \"5218d2f0-919d-4d59-9596-25a64fcff283\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-bbkt6"
Sep 11 16:31:50.661433 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:50.661395    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5218d2f0-919d-4d59-9596-25a64fcff283-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-bbkt6\" (UID: \"5218d2f0-919d-4d59-9596-25a64fcff283\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-bbkt6"
Sep 11 16:31:50.668289 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:50.668262    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:50.851229 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:50.851191    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-bbkt6"
Sep 11 16:31:51.132675 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:51.132644    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-bbkt6"]
Sep 11 16:31:51.136110 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:31:51.136046    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5218d2f0_919d_4d59_9596_25a64fcff283.slice/crio-9594c740e8109724440e0e6d73c7d49c171f21810b65a9f9800ce3d2871f8f21 WatchSource:0}: Error finding container 9594c740e8109724440e0e6d73c7d49c171f21810b65a9f9800ce3d2871f8f21: Status 404 returned error can't find the container with id 9594c740e8109724440e0e6d73c7d49c171f21810b65a9f9800ce3d2871f8f21
Sep 11 16:31:51.283119 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:51.283071    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-9f7478879-nbwmc"]
Sep 11 16:31:51.287124 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:51.287107    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9f7478879-nbwmc"
Sep 11 16:31:51.290900 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:51.290840    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 11 16:31:51.290900 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:51.290877    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 11 16:31:51.291105 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:51.290901    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 11 16:31:51.291105 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:51.290878    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 11 16:31:51.291105 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:51.290884    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 11 16:31:51.291105 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:51.290878    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-p2f27\""
Sep 11 16:31:51.300007 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:51.299985    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9f7478879-nbwmc"]
Sep 11 16:31:51.363896 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:51.363862    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d-console-oauth-config\") pod \"console-9f7478879-nbwmc\" (UID: \"f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d\") " pod="openshift-console/console-9f7478879-nbwmc"
Sep 11 16:31:51.363896 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:51.363907    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d-service-ca\") pod \"console-9f7478879-nbwmc\" (UID: \"f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d\") " pod="openshift-console/console-9f7478879-nbwmc"
Sep 11 16:31:51.364153 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:51.363932    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d-oauth-serving-cert\") pod \"console-9f7478879-nbwmc\" (UID: \"f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d\") " pod="openshift-console/console-9f7478879-nbwmc"
Sep 11 16:31:51.364153 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:51.364000    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d-console-config\") pod \"console-9f7478879-nbwmc\" (UID: \"f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d\") " pod="openshift-console/console-9f7478879-nbwmc"
Sep 11 16:31:51.364247 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:51.364172    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d-console-serving-cert\") pod \"console-9f7478879-nbwmc\" (UID: \"f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d\") " pod="openshift-console/console-9f7478879-nbwmc"
Sep 11 16:31:51.364247 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:51.364204    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv5fl\" (UniqueName: \"kubernetes.io/projected/f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d-kube-api-access-wv5fl\") pod \"console-9f7478879-nbwmc\" (UID: \"f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d\") " pod="openshift-console/console-9f7478879-nbwmc"
Sep 11 16:31:51.388331 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:51.388283    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-bbkt6" event={"ID":"5218d2f0-919d-4d59-9596-25a64fcff283","Type":"ContainerStarted","Data":"9594c740e8109724440e0e6d73c7d49c171f21810b65a9f9800ce3d2871f8f21"}
Sep 11 16:31:51.465243 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:51.465208    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d-console-oauth-config\") pod \"console-9f7478879-nbwmc\" (UID: \"f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d\") " pod="openshift-console/console-9f7478879-nbwmc"
Sep 11 16:31:51.465243 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:51.465256    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d-service-ca\") pod \"console-9f7478879-nbwmc\" (UID: \"f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d\") " pod="openshift-console/console-9f7478879-nbwmc"
Sep 11 16:31:51.465509 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:51.465276    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d-oauth-serving-cert\") pod \"console-9f7478879-nbwmc\" (UID: \"f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d\") " pod="openshift-console/console-9f7478879-nbwmc"
Sep 11 16:31:51.465664 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:51.465590    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d-console-config\") pod \"console-9f7478879-nbwmc\" (UID: \"f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d\") " pod="openshift-console/console-9f7478879-nbwmc"
Sep 11 16:31:51.465799 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:51.465691    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d-console-serving-cert\") pod \"console-9f7478879-nbwmc\" (UID: \"f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d\") " pod="openshift-console/console-9f7478879-nbwmc"
Sep 11 16:31:51.465799 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:51.465717    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv5fl\" (UniqueName: \"kubernetes.io/projected/f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d-kube-api-access-wv5fl\") pod \"console-9f7478879-nbwmc\" (UID: \"f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d\") " pod="openshift-console/console-9f7478879-nbwmc"
Sep 11 16:31:51.466037 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:51.466013    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d-service-ca\") pod \"console-9f7478879-nbwmc\" (UID: \"f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d\") " pod="openshift-console/console-9f7478879-nbwmc"
Sep 11 16:31:51.466149 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:51.466013    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d-oauth-serving-cert\") pod \"console-9f7478879-nbwmc\" (UID: \"f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d\") " pod="openshift-console/console-9f7478879-nbwmc"
Sep 11 16:31:51.466455 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:51.466428    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d-console-config\") pod \"console-9f7478879-nbwmc\" (UID: \"f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d\") " pod="openshift-console/console-9f7478879-nbwmc"
Sep 11 16:31:51.468597 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:51.468579    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d-console-oauth-config\") pod \"console-9f7478879-nbwmc\" (UID: \"f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d\") " pod="openshift-console/console-9f7478879-nbwmc"
Sep 11 16:31:51.468824 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:51.468800    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d-console-serving-cert\") pod \"console-9f7478879-nbwmc\" (UID: \"f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d\") " pod="openshift-console/console-9f7478879-nbwmc"
Sep 11 16:31:51.476031 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:51.476006    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv5fl\" (UniqueName: \"kubernetes.io/projected/f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d-kube-api-access-wv5fl\") pod \"console-9f7478879-nbwmc\" (UID: \"f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d\") " pod="openshift-console/console-9f7478879-nbwmc"
Sep 11 16:31:51.596800 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:51.596711    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9f7478879-nbwmc"
Sep 11 16:31:51.880032 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:51.880002    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9f7478879-nbwmc"]
Sep 11 16:31:51.882221 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:31:51.882192    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf39b4b9c_a5b7_41ae_8f22_8a8b48de9b2d.slice/crio-6010d5e497326ce733b2ba5769978a07d7622ffe4661349cf3ae8bbd40ee5a9e WatchSource:0}: Error finding container 6010d5e497326ce733b2ba5769978a07d7622ffe4661349cf3ae8bbd40ee5a9e: Status 404 returned error can't find the container with id 6010d5e497326ce733b2ba5769978a07d7622ffe4661349cf3ae8bbd40ee5a9e
Sep 11 16:31:51.971736 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:51.971695    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/41052c18-7556-4976-9d93-c504e6dbfb2c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2bzlp\" (UID: \"41052c18-7556-4976-9d93-c504e6dbfb2c\") " pod="openshift-insights/insights-runtime-extractor-2bzlp"
Sep 11 16:31:51.974616 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:51.974580    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/41052c18-7556-4976-9d93-c504e6dbfb2c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2bzlp\" (UID: \"41052c18-7556-4976-9d93-c504e6dbfb2c\") " pod="openshift-insights/insights-runtime-extractor-2bzlp"
Sep 11 16:31:52.230629 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:52.230582    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2bzlp"
Sep 11 16:31:52.350279 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:52.349371    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-nt2jf"
Sep 11 16:31:52.393032 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:52.393001    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9f7478879-nbwmc" event={"ID":"f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d","Type":"ContainerStarted","Data":"6010d5e497326ce733b2ba5769978a07d7622ffe4661349cf3ae8bbd40ee5a9e"}
Sep 11 16:31:52.567247 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:52.567068    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2bzlp"]
Sep 11 16:31:52.570369 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:31:52.570339    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41052c18_7556_4976_9d93_c504e6dbfb2c.slice/crio-a4673eb8de2aaaae5ba9711471afb12df383b38247e8661b1befdfc0852e9612 WatchSource:0}: Error finding container a4673eb8de2aaaae5ba9711471afb12df383b38247e8661b1befdfc0852e9612: Status 404 returned error can't find the container with id a4673eb8de2aaaae5ba9711471afb12df383b38247e8661b1befdfc0852e9612
Sep 11 16:31:53.401217 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:53.401178    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2bzlp" event={"ID":"41052c18-7556-4976-9d93-c504e6dbfb2c","Type":"ContainerStarted","Data":"b9a5308b32861fb511d5d22aee9e869182a048cfa61d8c08d4433be9338793f8"}
Sep 11 16:31:53.401682 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:53.401258    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2bzlp" event={"ID":"41052c18-7556-4976-9d93-c504e6dbfb2c","Type":"ContainerStarted","Data":"a4673eb8de2aaaae5ba9711471afb12df383b38247e8661b1befdfc0852e9612"}
Sep 11 16:31:53.403560 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:53.403497    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-bbkt6" event={"ID":"5218d2f0-919d-4d59-9596-25a64fcff283","Type":"ContainerStarted","Data":"d1b1f901bb494712950ac189d5ab9a2df73ac545682a3e8b8ed212e30987abc5"}
Sep 11 16:31:53.404799 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:53.404554    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-bbkt6"
Sep 11 16:31:53.410710 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:53.410687    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-bbkt6"
Sep 11 16:31:53.434403 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:53.434345    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-bbkt6" podStartSLOduration=2.220424606 podStartE2EDuration="3.434326949s" totalImagesPullingTime="1.213902343s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:31:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:31:53.43398375 +0000 UTC m=+113.050740834" watchObservedRunningTime="2026-09-11 16:31:53.434326949 +0000 UTC m=+113.051083994"
Sep 11 16:31:53.597561 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:53.597450    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:53.704142 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:53.704109    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:53.800318 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:53.800279    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:53.865649 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:53.865543    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:53.948237 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:53.948198    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:54.069642 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:54.069599    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:54.410132 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:54.410070    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2bzlp" event={"ID":"41052c18-7556-4976-9d93-c504e6dbfb2c","Type":"ContainerStarted","Data":"d82fb950d1c1fabde025404d9e0b11a53fdb3844afdab93231a3c71edc155ef2"}
Sep 11 16:31:55.366683 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:55.366365    2581 patch_prober.go:28] interesting pod/image-registry-676cf99488-srct9 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 11 16:31:55.366683 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:55.366430    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-676cf99488-srct9" podUID="06f8ba29-d5d1-4375-8b41-d900e0738e70" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 16:31:56.018796 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:56.018760    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:56.419391 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:56.419348    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9f7478879-nbwmc" event={"ID":"f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d","Type":"ContainerStarted","Data":"b1d8f8c4e9fe15036c9a3137954535d0fff8cce95ab1761c549ea682c6d5d7ef"}
Sep 11 16:31:56.421693 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:56.421650    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2bzlp" event={"ID":"41052c18-7556-4976-9d93-c504e6dbfb2c","Type":"ContainerStarted","Data":"271ed2412e7a2ad7a3c38ef40b1be03dbab52d86c3ebc196243df9471e25c85b"}
Sep 11 16:31:56.441278 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:56.441231    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-9f7478879-nbwmc" podStartSLOduration=1.528014497 podStartE2EDuration="5.441214539s" totalImagesPullingTime="3.913200042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:31:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:31:56.43913311 +0000 UTC m=+116.055890185" watchObservedRunningTime="2026-09-11 16:31:56.441214539 +0000 UTC m=+116.057971597"
Sep 11 16:31:56.466249 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:56.466196    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2bzlp" podStartSLOduration=33.444594371 podStartE2EDuration="36.466178584s" totalImagesPullingTime="3.021584213s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:31:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:31:56.465443295 +0000 UTC m=+116.082200363" watchObservedRunningTime="2026-09-11 16:31:56.466178584 +0000 UTC m=+116.082935650"
Sep 11 16:31:57.175514 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:57.175472    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:57.312321 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:57.312269    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:57.888816 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:57.888771    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:58.170520 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.170432    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:58.327764 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.327734    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:58.367239 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.367205    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-27xkj"]
Sep 11 16:31:58.371996 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.371973    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-4m2kg"]
Sep 11 16:31:58.372162 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.372142    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-27xkj"
Sep 11 16:31:58.375337 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.375316    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4m2kg"
Sep 11 16:31:58.383713 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.383691    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-mkx87\""
Sep 11 16:31:58.383713 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.383702    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 11 16:31:58.383713 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.383709    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 11 16:31:58.384883 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.384844    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 11 16:31:58.387994 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.387975    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 11 16:31:58.388629 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.388608    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-hr7p6\""
Sep 11 16:31:58.388880 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.388865    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 11 16:31:58.388880 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.388874    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 11 16:31:58.424632 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.424554    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-4m2kg"]
Sep 11 16:31:58.427346 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.427318    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-27xkj"]
Sep 11 16:31:58.436111 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.436063    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ab259bc-8df8-4940-93cc-16929031ec96-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-4m2kg\" (UID: \"1ab259bc-8df8-4940-93cc-16929031ec96\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4m2kg"
Sep 11 16:31:58.436252 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.436144    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pm9gh\" (UniqueName: \"kubernetes.io/projected/1ab259bc-8df8-4940-93cc-16929031ec96-kube-api-access-pm9gh\") pod \"kube-state-metrics-59fbdd77d-4m2kg\" (UID: \"1ab259bc-8df8-4940-93cc-16929031ec96\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4m2kg"
Sep 11 16:31:58.436252 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.436177    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1ab259bc-8df8-4940-93cc-16929031ec96-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-4m2kg\" (UID: \"1ab259bc-8df8-4940-93cc-16929031ec96\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4m2kg"
Sep 11 16:31:58.436252 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.436212    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1ab259bc-8df8-4940-93cc-16929031ec96-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-4m2kg\" (UID: \"1ab259bc-8df8-4940-93cc-16929031ec96\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4m2kg"
Sep 11 16:31:58.436391 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.436274    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ed1a5e93-70d7-4e4a-86fd-3bb38c5dcdb8-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-27xkj\" (UID: \"ed1a5e93-70d7-4e4a-86fd-3bb38c5dcdb8\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-27xkj"
Sep 11 16:31:58.436391 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.436298    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ab259bc-8df8-4940-93cc-16929031ec96-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-4m2kg\" (UID: \"1ab259bc-8df8-4940-93cc-16929031ec96\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4m2kg"
Sep 11 16:31:58.436391 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.436342    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed1a5e93-70d7-4e4a-86fd-3bb38c5dcdb8-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-27xkj\" (UID: \"ed1a5e93-70d7-4e4a-86fd-3bb38c5dcdb8\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-27xkj"
Sep 11 16:31:58.436391 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.436364    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2dcq\" (UniqueName: \"kubernetes.io/projected/ed1a5e93-70d7-4e4a-86fd-3bb38c5dcdb8-kube-api-access-s2dcq\") pod \"openshift-state-metrics-67dcf8c979-27xkj\" (UID: \"ed1a5e93-70d7-4e4a-86fd-3bb38c5dcdb8\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-27xkj"
Sep 11 16:31:58.436592 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.436402    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed1a5e93-70d7-4e4a-86fd-3bb38c5dcdb8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-27xkj\" (UID: \"ed1a5e93-70d7-4e4a-86fd-3bb38c5dcdb8\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-27xkj"
Sep 11 16:31:58.436592 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.436422    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1ab259bc-8df8-4940-93cc-16929031ec96-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-4m2kg\" (UID: \"1ab259bc-8df8-4940-93cc-16929031ec96\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4m2kg"
Sep 11 16:31:58.474313 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.474281    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bf9nx"]
Sep 11 16:31:58.477786 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.477761    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bf9nx"
Sep 11 16:31:58.482150 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.482127    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 11 16:31:58.492141 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.492119    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 11 16:31:58.492603 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.492584    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-775mx\""
Sep 11 16:31:58.493035 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.493018    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 11 16:31:58.537536 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.537501    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/655288ef-fded-482e-b887-f4426090b444-sys\") pod \"node-exporter-bf9nx\" (UID: \"655288ef-fded-482e-b887-f4426090b444\") " pod="openshift-monitoring/node-exporter-bf9nx"
Sep 11 16:31:58.537697 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.537547    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ab259bc-8df8-4940-93cc-16929031ec96-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-4m2kg\" (UID: \"1ab259bc-8df8-4940-93cc-16929031ec96\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4m2kg"
Sep 11 16:31:58.537697 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.537576    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pm9gh\" (UniqueName: \"kubernetes.io/projected/1ab259bc-8df8-4940-93cc-16929031ec96-kube-api-access-pm9gh\") pod \"kube-state-metrics-59fbdd77d-4m2kg\" (UID: \"1ab259bc-8df8-4940-93cc-16929031ec96\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4m2kg"
Sep 11 16:31:58.537697 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.537630    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/655288ef-fded-482e-b887-f4426090b444-node-exporter-wtmp\") pod \"node-exporter-bf9nx\" (UID: \"655288ef-fded-482e-b887-f4426090b444\") " pod="openshift-monitoring/node-exporter-bf9nx"
Sep 11 16:31:58.537697 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.537677    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1ab259bc-8df8-4940-93cc-16929031ec96-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-4m2kg\" (UID: \"1ab259bc-8df8-4940-93cc-16929031ec96\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4m2kg"
Sep 11 16:31:58.537904 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.537720    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1ab259bc-8df8-4940-93cc-16929031ec96-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-4m2kg\" (UID: \"1ab259bc-8df8-4940-93cc-16929031ec96\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4m2kg"
Sep 11 16:31:58.537904 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.537759    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/655288ef-fded-482e-b887-f4426090b444-node-exporter-textfile\") pod \"node-exporter-bf9nx\" (UID: \"655288ef-fded-482e-b887-f4426090b444\") " pod="openshift-monitoring/node-exporter-bf9nx"
Sep 11 16:31:58.537904 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.537792    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/655288ef-fded-482e-b887-f4426090b444-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bf9nx\" (UID: \"655288ef-fded-482e-b887-f4426090b444\") " pod="openshift-monitoring/node-exporter-bf9nx"
Sep 11 16:31:58.537904 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.537822    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/655288ef-fded-482e-b887-f4426090b444-root\") pod \"node-exporter-bf9nx\" (UID: \"655288ef-fded-482e-b887-f4426090b444\") " pod="openshift-monitoring/node-exporter-bf9nx"
Sep 11 16:31:58.537904 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.537847    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/655288ef-fded-482e-b887-f4426090b444-node-exporter-tls\") pod \"node-exporter-bf9nx\" (UID: \"655288ef-fded-482e-b887-f4426090b444\") " pod="openshift-monitoring/node-exporter-bf9nx"
Sep 11 16:31:58.538183 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.537902    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/655288ef-fded-482e-b887-f4426090b444-metrics-client-ca\") pod \"node-exporter-bf9nx\" (UID: \"655288ef-fded-482e-b887-f4426090b444\") " pod="openshift-monitoring/node-exporter-bf9nx"
Sep 11 16:31:58.538183 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.537943    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ed1a5e93-70d7-4e4a-86fd-3bb38c5dcdb8-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-27xkj\" (UID: \"ed1a5e93-70d7-4e4a-86fd-3bb38c5dcdb8\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-27xkj"
Sep 11 16:31:58.538183 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.537973    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ab259bc-8df8-4940-93cc-16929031ec96-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-4m2kg\" (UID: \"1ab259bc-8df8-4940-93cc-16929031ec96\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4m2kg"
Sep 11 16:31:58.538183 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.538002    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/655288ef-fded-482e-b887-f4426090b444-node-exporter-accelerators-collector-config\") pod \"node-exporter-bf9nx\" (UID: \"655288ef-fded-482e-b887-f4426090b444\") " pod="openshift-monitoring/node-exporter-bf9nx"
Sep 11 16:31:58.538183 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.538051    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed1a5e93-70d7-4e4a-86fd-3bb38c5dcdb8-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-27xkj\" (UID: \"ed1a5e93-70d7-4e4a-86fd-3bb38c5dcdb8\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-27xkj"
Sep 11 16:31:58.538183 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.538076    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2dcq\" (UniqueName: \"kubernetes.io/projected/ed1a5e93-70d7-4e4a-86fd-3bb38c5dcdb8-kube-api-access-s2dcq\") pod \"openshift-state-metrics-67dcf8c979-27xkj\" (UID: \"ed1a5e93-70d7-4e4a-86fd-3bb38c5dcdb8\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-27xkj"
Sep 11 16:31:58.538473 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.538187    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1ab259bc-8df8-4940-93cc-16929031ec96-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-4m2kg\" (UID: \"1ab259bc-8df8-4940-93cc-16929031ec96\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4m2kg"
Sep 11 16:31:58.538473 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.538192    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed1a5e93-70d7-4e4a-86fd-3bb38c5dcdb8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-27xkj\" (UID: \"ed1a5e93-70d7-4e4a-86fd-3bb38c5dcdb8\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-27xkj"
Sep 11 16:31:58.538473 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.538249    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1ab259bc-8df8-4940-93cc-16929031ec96-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-4m2kg\" (UID: \"1ab259bc-8df8-4940-93cc-16929031ec96\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4m2kg"
Sep 11 16:31:58.538473 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.538288    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxml9\" (UniqueName: \"kubernetes.io/projected/655288ef-fded-482e-b887-f4426090b444-kube-api-access-dxml9\") pod \"node-exporter-bf9nx\" (UID: \"655288ef-fded-482e-b887-f4426090b444\") " pod="openshift-monitoring/node-exporter-bf9nx"
Sep 11 16:31:58.538670 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.538493    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1ab259bc-8df8-4940-93cc-16929031ec96-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-4m2kg\" (UID: \"1ab259bc-8df8-4940-93cc-16929031ec96\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4m2kg"
Sep 11 16:31:58.539169 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.539123    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ab259bc-8df8-4940-93cc-16929031ec96-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-4m2kg\" (UID: \"1ab259bc-8df8-4940-93cc-16929031ec96\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4m2kg"
Sep 11 16:31:58.539281 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.539226    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed1a5e93-70d7-4e4a-86fd-3bb38c5dcdb8-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-27xkj\" (UID: \"ed1a5e93-70d7-4e4a-86fd-3bb38c5dcdb8\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-27xkj"
Sep 11 16:31:58.540898 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.540849    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ab259bc-8df8-4940-93cc-16929031ec96-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-4m2kg\" (UID: \"1ab259bc-8df8-4940-93cc-16929031ec96\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4m2kg"
Sep 11 16:31:58.541127 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.541062    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1ab259bc-8df8-4940-93cc-16929031ec96-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-4m2kg\" (UID: \"1ab259bc-8df8-4940-93cc-16929031ec96\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4m2kg"
Sep 11 16:31:58.541228 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.541143    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ed1a5e93-70d7-4e4a-86fd-3bb38c5dcdb8-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-27xkj\" (UID: \"ed1a5e93-70d7-4e4a-86fd-3bb38c5dcdb8\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-27xkj"
Sep 11 16:31:58.541449 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.541426    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed1a5e93-70d7-4e4a-86fd-3bb38c5dcdb8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-27xkj\" (UID: \"ed1a5e93-70d7-4e4a-86fd-3bb38c5dcdb8\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-27xkj"
Sep 11 16:31:58.565997 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.565974    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pm9gh\" (UniqueName: \"kubernetes.io/projected/1ab259bc-8df8-4940-93cc-16929031ec96-kube-api-access-pm9gh\") pod \"kube-state-metrics-59fbdd77d-4m2kg\" (UID: \"1ab259bc-8df8-4940-93cc-16929031ec96\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4m2kg"
Sep 11 16:31:58.567132 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.567080    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2dcq\" (UniqueName: \"kubernetes.io/projected/ed1a5e93-70d7-4e4a-86fd-3bb38c5dcdb8-kube-api-access-s2dcq\") pod \"openshift-state-metrics-67dcf8c979-27xkj\" (UID: \"ed1a5e93-70d7-4e4a-86fd-3bb38c5dcdb8\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-27xkj"
Sep 11 16:31:58.625049 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.625021    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:58.639135 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.639104    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/655288ef-fded-482e-b887-f4426090b444-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bf9nx\" (UID: \"655288ef-fded-482e-b887-f4426090b444\") " pod="openshift-monitoring/node-exporter-bf9nx"
Sep 11 16:31:58.639135 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.639147    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/655288ef-fded-482e-b887-f4426090b444-root\") pod \"node-exporter-bf9nx\" (UID: \"655288ef-fded-482e-b887-f4426090b444\") " pod="openshift-monitoring/node-exporter-bf9nx"
Sep 11 16:31:58.639135 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.639168    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/655288ef-fded-482e-b887-f4426090b444-node-exporter-tls\") pod \"node-exporter-bf9nx\" (UID: \"655288ef-fded-482e-b887-f4426090b444\") " pod="openshift-monitoring/node-exporter-bf9nx"
Sep 11 16:31:58.639493 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.639234    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/655288ef-fded-482e-b887-f4426090b444-metrics-client-ca\") pod \"node-exporter-bf9nx\" (UID: \"655288ef-fded-482e-b887-f4426090b444\") " pod="openshift-monitoring/node-exporter-bf9nx"
Sep 11 16:31:58.639493 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.639239    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/655288ef-fded-482e-b887-f4426090b444-root\") pod \"node-exporter-bf9nx\" (UID: \"655288ef-fded-482e-b887-f4426090b444\") " pod="openshift-monitoring/node-exporter-bf9nx"
Sep 11 16:31:58.639493 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.639284    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/655288ef-fded-482e-b887-f4426090b444-node-exporter-accelerators-collector-config\") pod \"node-exporter-bf9nx\" (UID: \"655288ef-fded-482e-b887-f4426090b444\") " pod="openshift-monitoring/node-exporter-bf9nx"
Sep 11 16:31:58.639493 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.639386    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxml9\" (UniqueName: \"kubernetes.io/projected/655288ef-fded-482e-b887-f4426090b444-kube-api-access-dxml9\") pod \"node-exporter-bf9nx\" (UID: \"655288ef-fded-482e-b887-f4426090b444\") " pod="openshift-monitoring/node-exporter-bf9nx"
Sep 11 16:31:58.639493 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.639409    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/655288ef-fded-482e-b887-f4426090b444-sys\") pod \"node-exporter-bf9nx\" (UID: \"655288ef-fded-482e-b887-f4426090b444\") " pod="openshift-monitoring/node-exporter-bf9nx"
Sep 11 16:31:58.639493 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.639445    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/655288ef-fded-482e-b887-f4426090b444-node-exporter-wtmp\") pod \"node-exporter-bf9nx\" (UID: \"655288ef-fded-482e-b887-f4426090b444\") " pod="openshift-monitoring/node-exporter-bf9nx"
Sep 11 16:31:58.639493 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.639491    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/655288ef-fded-482e-b887-f4426090b444-node-exporter-textfile\") pod \"node-exporter-bf9nx\" (UID: \"655288ef-fded-482e-b887-f4426090b444\") " pod="openshift-monitoring/node-exporter-bf9nx"
Sep 11 16:31:58.639813 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.639758    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/655288ef-fded-482e-b887-f4426090b444-node-exporter-textfile\") pod \"node-exporter-bf9nx\" (UID: \"655288ef-fded-482e-b887-f4426090b444\") " pod="openshift-monitoring/node-exporter-bf9nx"
Sep 11 16:31:58.639866 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.639819    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/655288ef-fded-482e-b887-f4426090b444-sys\") pod \"node-exporter-bf9nx\" (UID: \"655288ef-fded-482e-b887-f4426090b444\") " pod="openshift-monitoring/node-exporter-bf9nx"
Sep 11 16:31:58.639866 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.639822    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/655288ef-fded-482e-b887-f4426090b444-metrics-client-ca\") pod \"node-exporter-bf9nx\" (UID: \"655288ef-fded-482e-b887-f4426090b444\") " pod="openshift-monitoring/node-exporter-bf9nx"
Sep 11 16:31:58.639962 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.639924    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/655288ef-fded-482e-b887-f4426090b444-node-exporter-wtmp\") pod \"node-exporter-bf9nx\" (UID: \"655288ef-fded-482e-b887-f4426090b444\") " pod="openshift-monitoring/node-exporter-bf9nx"
Sep 11 16:31:58.640328 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.640294    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/655288ef-fded-482e-b887-f4426090b444-node-exporter-accelerators-collector-config\") pod \"node-exporter-bf9nx\" (UID: \"655288ef-fded-482e-b887-f4426090b444\") " pod="openshift-monitoring/node-exporter-bf9nx"
Sep 11 16:31:58.642121 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.642070    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/655288ef-fded-482e-b887-f4426090b444-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bf9nx\" (UID: \"655288ef-fded-482e-b887-f4426090b444\") " pod="openshift-monitoring/node-exporter-bf9nx"
Sep 11 16:31:58.642416 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.642393    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/655288ef-fded-482e-b887-f4426090b444-node-exporter-tls\") pod \"node-exporter-bf9nx\" (UID: \"655288ef-fded-482e-b887-f4426090b444\") " pod="openshift-monitoring/node-exporter-bf9nx"
Sep 11 16:31:58.656382 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.656343    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxml9\" (UniqueName: \"kubernetes.io/projected/655288ef-fded-482e-b887-f4426090b444-kube-api-access-dxml9\") pod \"node-exporter-bf9nx\" (UID: \"655288ef-fded-482e-b887-f4426090b444\") " pod="openshift-monitoring/node-exporter-bf9nx"
Sep 11 16:31:58.684280 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.684207    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-27xkj"
Sep 11 16:31:58.689686 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.689661    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4m2kg"
Sep 11 16:31:58.765497 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.765468    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c9765b6d6-wd7zp"]
Sep 11 16:31:58.768686 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.768662    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c9765b6d6-wd7zp"
Sep 11 16:31:58.778728 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.778707    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 11 16:31:58.789040 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.789003    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bf9nx"
Sep 11 16:31:58.793150 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.793127    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c9765b6d6-wd7zp"]
Sep 11 16:31:58.841433 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.841403    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a58412b0-2955-4fb1-bdda-f3b1eb8c92a1-console-serving-cert\") pod \"console-5c9765b6d6-wd7zp\" (UID: \"a58412b0-2955-4fb1-bdda-f3b1eb8c92a1\") " pod="openshift-console/console-5c9765b6d6-wd7zp"
Sep 11 16:31:58.841600 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.841445    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a58412b0-2955-4fb1-bdda-f3b1eb8c92a1-oauth-serving-cert\") pod \"console-5c9765b6d6-wd7zp\" (UID: \"a58412b0-2955-4fb1-bdda-f3b1eb8c92a1\") " pod="openshift-console/console-5c9765b6d6-wd7zp"
Sep 11 16:31:58.841600 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.841471    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a58412b0-2955-4fb1-bdda-f3b1eb8c92a1-console-config\") pod \"console-5c9765b6d6-wd7zp\" (UID: \"a58412b0-2955-4fb1-bdda-f3b1eb8c92a1\") " pod="openshift-console/console-5c9765b6d6-wd7zp"
Sep 11 16:31:58.841714 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.841623    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a58412b0-2955-4fb1-bdda-f3b1eb8c92a1-trusted-ca-bundle\") pod \"console-5c9765b6d6-wd7zp\" (UID: \"a58412b0-2955-4fb1-bdda-f3b1eb8c92a1\") " pod="openshift-console/console-5c9765b6d6-wd7zp"
Sep 11 16:31:58.841714 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.841660    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a58412b0-2955-4fb1-bdda-f3b1eb8c92a1-console-oauth-config\") pod \"console-5c9765b6d6-wd7zp\" (UID: \"a58412b0-2955-4fb1-bdda-f3b1eb8c92a1\") " pod="openshift-console/console-5c9765b6d6-wd7zp"
Sep 11 16:31:58.841714 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.841704    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jrhd\" (UniqueName: \"kubernetes.io/projected/a58412b0-2955-4fb1-bdda-f3b1eb8c92a1-kube-api-access-2jrhd\") pod \"console-5c9765b6d6-wd7zp\" (UID: \"a58412b0-2955-4fb1-bdda-f3b1eb8c92a1\") " pod="openshift-console/console-5c9765b6d6-wd7zp"
Sep 11 16:31:58.841842 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.841749    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a58412b0-2955-4fb1-bdda-f3b1eb8c92a1-service-ca\") pod \"console-5c9765b6d6-wd7zp\" (UID: \"a58412b0-2955-4fb1-bdda-f3b1eb8c92a1\") " pod="openshift-console/console-5c9765b6d6-wd7zp"
Sep 11 16:31:58.942665 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.942632    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a58412b0-2955-4fb1-bdda-f3b1eb8c92a1-trusted-ca-bundle\") pod \"console-5c9765b6d6-wd7zp\" (UID: \"a58412b0-2955-4fb1-bdda-f3b1eb8c92a1\") " pod="openshift-console/console-5c9765b6d6-wd7zp"
Sep 11 16:31:58.942665 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.942667    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a58412b0-2955-4fb1-bdda-f3b1eb8c92a1-console-oauth-config\") pod \"console-5c9765b6d6-wd7zp\" (UID: \"a58412b0-2955-4fb1-bdda-f3b1eb8c92a1\") " pod="openshift-console/console-5c9765b6d6-wd7zp"
Sep 11 16:31:58.942878 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.942705    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jrhd\" (UniqueName: \"kubernetes.io/projected/a58412b0-2955-4fb1-bdda-f3b1eb8c92a1-kube-api-access-2jrhd\") pod \"console-5c9765b6d6-wd7zp\" (UID: \"a58412b0-2955-4fb1-bdda-f3b1eb8c92a1\") " pod="openshift-console/console-5c9765b6d6-wd7zp"
Sep 11 16:31:58.942878 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.942793    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a58412b0-2955-4fb1-bdda-f3b1eb8c92a1-service-ca\") pod \"console-5c9765b6d6-wd7zp\" (UID: \"a58412b0-2955-4fb1-bdda-f3b1eb8c92a1\") " pod="openshift-console/console-5c9765b6d6-wd7zp"
Sep 11 16:31:58.943368 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.943180    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a58412b0-2955-4fb1-bdda-f3b1eb8c92a1-console-serving-cert\") pod \"console-5c9765b6d6-wd7zp\" (UID: \"a58412b0-2955-4fb1-bdda-f3b1eb8c92a1\") " pod="openshift-console/console-5c9765b6d6-wd7zp"
Sep 11 16:31:58.943557 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.943390    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a58412b0-2955-4fb1-bdda-f3b1eb8c92a1-oauth-serving-cert\") pod \"console-5c9765b6d6-wd7zp\" (UID: \"a58412b0-2955-4fb1-bdda-f3b1eb8c92a1\") " pod="openshift-console/console-5c9765b6d6-wd7zp"
Sep 11 16:31:58.943557 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.943424    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a58412b0-2955-4fb1-bdda-f3b1eb8c92a1-console-config\") pod \"console-5c9765b6d6-wd7zp\" (UID: \"a58412b0-2955-4fb1-bdda-f3b1eb8c92a1\") " pod="openshift-console/console-5c9765b6d6-wd7zp"
Sep 11 16:31:58.943954 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.943913    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a58412b0-2955-4fb1-bdda-f3b1eb8c92a1-service-ca\") pod \"console-5c9765b6d6-wd7zp\" (UID: \"a58412b0-2955-4fb1-bdda-f3b1eb8c92a1\") " pod="openshift-console/console-5c9765b6d6-wd7zp"
Sep 11 16:31:58.946305 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.944269    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a58412b0-2955-4fb1-bdda-f3b1eb8c92a1-trusted-ca-bundle\") pod \"console-5c9765b6d6-wd7zp\" (UID: \"a58412b0-2955-4fb1-bdda-f3b1eb8c92a1\") " pod="openshift-console/console-5c9765b6d6-wd7zp"
Sep 11 16:31:58.946305 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.944321    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a58412b0-2955-4fb1-bdda-f3b1eb8c92a1-console-config\") pod \"console-5c9765b6d6-wd7zp\" (UID: \"a58412b0-2955-4fb1-bdda-f3b1eb8c92a1\") " pod="openshift-console/console-5c9765b6d6-wd7zp"
Sep 11 16:31:58.946305 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.945046    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a58412b0-2955-4fb1-bdda-f3b1eb8c92a1-oauth-serving-cert\") pod \"console-5c9765b6d6-wd7zp\" (UID: \"a58412b0-2955-4fb1-bdda-f3b1eb8c92a1\") " pod="openshift-console/console-5c9765b6d6-wd7zp"
Sep 11 16:31:58.946959 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.946935    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a58412b0-2955-4fb1-bdda-f3b1eb8c92a1-console-serving-cert\") pod \"console-5c9765b6d6-wd7zp\" (UID: \"a58412b0-2955-4fb1-bdda-f3b1eb8c92a1\") " pod="openshift-console/console-5c9765b6d6-wd7zp"
Sep 11 16:31:58.949328 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.949303    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a58412b0-2955-4fb1-bdda-f3b1eb8c92a1-console-oauth-config\") pod \"console-5c9765b6d6-wd7zp\" (UID: \"a58412b0-2955-4fb1-bdda-f3b1eb8c92a1\") " pod="openshift-console/console-5c9765b6d6-wd7zp"
Sep 11 16:31:58.956680 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:58.956662    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jrhd\" (UniqueName: \"kubernetes.io/projected/a58412b0-2955-4fb1-bdda-f3b1eb8c92a1-kube-api-access-2jrhd\") pod \"console-5c9765b6d6-wd7zp\" (UID: \"a58412b0-2955-4fb1-bdda-f3b1eb8c92a1\") " pod="openshift-console/console-5c9765b6d6-wd7zp"
Sep 11 16:31:59.081406 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:59.081351    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c9765b6d6-wd7zp"
Sep 11 16:31:59.086956 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:59.086921    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:59.249491 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:59.249384    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:59.491554 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:59.491518    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:59.805018 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:31:59.804976    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:00.088718 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:00.088633    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:00.945783 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:00.945751    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:01.154421 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:01.154389    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:01.596871 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:01.596833    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9f7478879-nbwmc"
Sep 11 16:32:01.597077 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:01.596905    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-9f7478879-nbwmc"
Sep 11 16:32:01.603572 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:01.603531    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-9f7478879-nbwmc"
Sep 11 16:32:01.606588 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:01.606562    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-67d77dc547-r72tq"]
Sep 11 16:32:01.611793 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:01.611770    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-67d77dc547-r72tq"
Sep 11 16:32:01.619696 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:01.619619    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 11 16:32:01.619866 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:01.619845    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 11 16:32:01.620563 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:01.620002    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 11 16:32:01.621443 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:01.621038    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-98dgpgrl9mv6o\""
Sep 11 16:32:01.621443 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:01.621208    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 11 16:32:01.621443 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:01.621366    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 11 16:32:01.628534 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:01.628513    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-8mwkj\""
Sep 11 16:32:01.667998 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:01.667960    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/266e29d6-e342-434b-aec9-d4ce4240507d-secret-grpc-tls\") pod \"thanos-querier-67d77dc547-r72tq\" (UID: \"266e29d6-e342-434b-aec9-d4ce4240507d\") " pod="openshift-monitoring/thanos-querier-67d77dc547-r72tq"
Sep 11 16:32:01.668199 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:01.668016    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/266e29d6-e342-434b-aec9-d4ce4240507d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-67d77dc547-r72tq\" (UID: \"266e29d6-e342-434b-aec9-d4ce4240507d\") " pod="openshift-monitoring/thanos-querier-67d77dc547-r72tq"
Sep 11 16:32:01.668199 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:01.668072    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/266e29d6-e342-434b-aec9-d4ce4240507d-secret-thanos-querier-tls\") pod \"thanos-querier-67d77dc547-r72tq\" (UID: \"266e29d6-e342-434b-aec9-d4ce4240507d\") " pod="openshift-monitoring/thanos-querier-67d77dc547-r72tq"
Sep 11 16:32:01.668199 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:01.668179    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/266e29d6-e342-434b-aec9-d4ce4240507d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-67d77dc547-r72tq\" (UID: \"266e29d6-e342-434b-aec9-d4ce4240507d\") " pod="openshift-monitoring/thanos-querier-67d77dc547-r72tq"
Sep 11 16:32:01.668366 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:01.668324    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/266e29d6-e342-434b-aec9-d4ce4240507d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-67d77dc547-r72tq\" (UID: \"266e29d6-e342-434b-aec9-d4ce4240507d\") " pod="openshift-monitoring/thanos-querier-67d77dc547-r72tq"
Sep 11 16:32:01.668366 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:01.668357    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/266e29d6-e342-434b-aec9-d4ce4240507d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-67d77dc547-r72tq\" (UID: \"266e29d6-e342-434b-aec9-d4ce4240507d\") " pod="openshift-monitoring/thanos-querier-67d77dc547-r72tq"
Sep 11 16:32:01.668469 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:01.668384    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-db8x2\" (UniqueName: \"kubernetes.io/projected/266e29d6-e342-434b-aec9-d4ce4240507d-kube-api-access-db8x2\") pod \"thanos-querier-67d77dc547-r72tq\" (UID: \"266e29d6-e342-434b-aec9-d4ce4240507d\") " pod="openshift-monitoring/thanos-querier-67d77dc547-r72tq"
Sep 11 16:32:01.668469 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:01.668424    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/266e29d6-e342-434b-aec9-d4ce4240507d-metrics-client-ca\") pod \"thanos-querier-67d77dc547-r72tq\" (UID: \"266e29d6-e342-434b-aec9-d4ce4240507d\") " pod="openshift-monitoring/thanos-querier-67d77dc547-r72tq"
Sep 11 16:32:01.676557 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:01.676525    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-67d77dc547-r72tq"]
Sep 11 16:32:01.759414 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:01.759384    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:01.769483 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:01.769427    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/266e29d6-e342-434b-aec9-d4ce4240507d-metrics-client-ca\") pod \"thanos-querier-67d77dc547-r72tq\" (UID: \"266e29d6-e342-434b-aec9-d4ce4240507d\") " pod="openshift-monitoring/thanos-querier-67d77dc547-r72tq"
Sep 11 16:32:01.769635 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:01.769524    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/266e29d6-e342-434b-aec9-d4ce4240507d-secret-grpc-tls\") pod \"thanos-querier-67d77dc547-r72tq\" (UID: \"266e29d6-e342-434b-aec9-d4ce4240507d\") " pod="openshift-monitoring/thanos-querier-67d77dc547-r72tq"
Sep 11 16:32:01.769635 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:01.769561    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/266e29d6-e342-434b-aec9-d4ce4240507d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-67d77dc547-r72tq\" (UID: \"266e29d6-e342-434b-aec9-d4ce4240507d\") " pod="openshift-monitoring/thanos-querier-67d77dc547-r72tq"
Sep 11 16:32:01.769635 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:01.769587    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/266e29d6-e342-434b-aec9-d4ce4240507d-secret-thanos-querier-tls\") pod \"thanos-querier-67d77dc547-r72tq\" (UID: \"266e29d6-e342-434b-aec9-d4ce4240507d\") " pod="openshift-monitoring/thanos-querier-67d77dc547-r72tq"
Sep 11 16:32:01.769809 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:01.769735    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/266e29d6-e342-434b-aec9-d4ce4240507d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-67d77dc547-r72tq\" (UID: \"266e29d6-e342-434b-aec9-d4ce4240507d\") " pod="openshift-monitoring/thanos-querier-67d77dc547-r72tq"
Sep 11 16:32:01.769862 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:01.769807    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/266e29d6-e342-434b-aec9-d4ce4240507d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-67d77dc547-r72tq\" (UID: \"266e29d6-e342-434b-aec9-d4ce4240507d\") " pod="openshift-monitoring/thanos-querier-67d77dc547-r72tq"
Sep 11 16:32:01.769862 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:01.769833    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/266e29d6-e342-434b-aec9-d4ce4240507d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-67d77dc547-r72tq\" (UID: \"266e29d6-e342-434b-aec9-d4ce4240507d\") " pod="openshift-monitoring/thanos-querier-67d77dc547-r72tq"
Sep 11 16:32:01.769967 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:01.769858    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db8x2\" (UniqueName: \"kubernetes.io/projected/266e29d6-e342-434b-aec9-d4ce4240507d-kube-api-access-db8x2\") pod \"thanos-querier-67d77dc547-r72tq\" (UID: \"266e29d6-e342-434b-aec9-d4ce4240507d\") " pod="openshift-monitoring/thanos-querier-67d77dc547-r72tq"
Sep 11 16:32:01.770644 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:01.770249    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/266e29d6-e342-434b-aec9-d4ce4240507d-metrics-client-ca\") pod \"thanos-querier-67d77dc547-r72tq\" (UID: \"266e29d6-e342-434b-aec9-d4ce4240507d\") " pod="openshift-monitoring/thanos-querier-67d77dc547-r72tq"
Sep 11 16:32:01.772789 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:01.772760    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/266e29d6-e342-434b-aec9-d4ce4240507d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-67d77dc547-r72tq\" (UID: \"266e29d6-e342-434b-aec9-d4ce4240507d\") " pod="openshift-monitoring/thanos-querier-67d77dc547-r72tq"
Sep 11 16:32:01.772876 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:01.772843    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/266e29d6-e342-434b-aec9-d4ce4240507d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-67d77dc547-r72tq\" (UID: \"266e29d6-e342-434b-aec9-d4ce4240507d\") " pod="openshift-monitoring/thanos-querier-67d77dc547-r72tq"
Sep 11 16:32:01.773708 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:01.773468    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/266e29d6-e342-434b-aec9-d4ce4240507d-secret-grpc-tls\") pod \"thanos-querier-67d77dc547-r72tq\" (UID: \"266e29d6-e342-434b-aec9-d4ce4240507d\") " pod="openshift-monitoring/thanos-querier-67d77dc547-r72tq"
Sep 11 16:32:01.773708 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:01.773671    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/266e29d6-e342-434b-aec9-d4ce4240507d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-67d77dc547-r72tq\" (UID: \"266e29d6-e342-434b-aec9-d4ce4240507d\") " pod="openshift-monitoring/thanos-querier-67d77dc547-r72tq"
Sep 11 16:32:01.774252 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:01.774232    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/266e29d6-e342-434b-aec9-d4ce4240507d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-67d77dc547-r72tq\" (UID: \"266e29d6-e342-434b-aec9-d4ce4240507d\") " pod="openshift-monitoring/thanos-querier-67d77dc547-r72tq"
Sep 11 16:32:01.774318 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:01.774291    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/266e29d6-e342-434b-aec9-d4ce4240507d-secret-thanos-querier-tls\") pod \"thanos-querier-67d77dc547-r72tq\" (UID: \"266e29d6-e342-434b-aec9-d4ce4240507d\") " pod="openshift-monitoring/thanos-querier-67d77dc547-r72tq"
Sep 11 16:32:01.792590 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:01.792567    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-db8x2\" (UniqueName: \"kubernetes.io/projected/266e29d6-e342-434b-aec9-d4ce4240507d-kube-api-access-db8x2\") pod \"thanos-querier-67d77dc547-r72tq\" (UID: \"266e29d6-e342-434b-aec9-d4ce4240507d\") " pod="openshift-monitoring/thanos-querier-67d77dc547-r72tq"
Sep 11 16:32:01.907416 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:01.907343    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:01.925360 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:01.925332    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-67d77dc547-r72tq"
Sep 11 16:32:02.212757 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:02.212719    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:02.449225 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:02.448995    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-9f7478879-nbwmc"
Sep 11 16:32:02.931615 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:02.931577    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:03.106800 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:03.106764    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:03.317604 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:03.317559    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:03.784646 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:03.784609    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c9765b6d6-wd7zp"]
Sep 11 16:32:03.809509 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:03.809475    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:03.999023 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:03.998976    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:04.201228 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:32:04.201108    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod655288ef_fded_482e_b887_f4426090b444.slice/crio-9da4abdda0d592d73ce88f9d58d04e1c3bd4128f3365bd0c7a66875badaffe73 WatchSource:0}: Error finding container 9da4abdda0d592d73ce88f9d58d04e1c3bd4128f3365bd0c7a66875badaffe73: Status 404 returned error can't find the container with id 9da4abdda0d592d73ce88f9d58d04e1c3bd4128f3365bd0c7a66875badaffe73
Sep 11 16:32:04.454662 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:04.454577    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-w7cgp" event={"ID":"7ac41677-2158-4c4b-98f0-af93b7524e0d","Type":"ContainerStarted","Data":"cd99a7a6bce185faa36cc304de0a3e2fd8934a1c2017a11206e400079b4d290e"}
Sep 11 16:32:04.455068 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:04.455050    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-w7cgp"
Sep 11 16:32:04.457108 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:04.457044    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bf9nx" event={"ID":"655288ef-fded-482e-b887-f4426090b444","Type":"ContainerStarted","Data":"9da4abdda0d592d73ce88f9d58d04e1c3bd4128f3365bd0c7a66875badaffe73"}
Sep 11 16:32:04.457217 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:04.457129    2581 patch_prober.go:28] interesting pod/downloads-76f99584f4-w7cgp container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.14:8080/\": dial tcp 10.134.0.14:8080: connect: connection refused" start-of-body=
Sep 11 16:32:04.457217 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:04.457185    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-76f99584f4-w7cgp" podUID="7ac41677-2158-4c4b-98f0-af93b7524e0d" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.14:8080/\": dial tcp 10.134.0.14:8080: connect: connection refused"
Sep 11 16:32:04.524579 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:04.524519    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-w7cgp" podStartSLOduration=1.194110177 podStartE2EDuration="19.524496641s" totalImagesPullingTime="18.330386464s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:31:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:32:04.515471894 +0000 UTC m=+124.132228962" watchObservedRunningTime="2026-09-11 16:32:04.524496641 +0000 UTC m=+124.141253710"
Sep 11 16:32:04.524774 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:04.524755    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c9765b6d6-wd7zp"]
Sep 11 16:32:04.528539 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:32:04.528506    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda58412b0_2955_4fb1_bdda_f3b1eb8c92a1.slice/crio-a83ecae3599ebd39717213e07614046d879c24b78bfff789071a6c846f5b7bb9 WatchSource:0}: Error finding container a83ecae3599ebd39717213e07614046d879c24b78bfff789071a6c846f5b7bb9: Status 404 returned error can't find the container with id a83ecae3599ebd39717213e07614046d879c24b78bfff789071a6c846f5b7bb9
Sep 11 16:32:04.529064 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:04.529034    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-67d77dc547-r72tq"]
Sep 11 16:32:04.531960 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:32:04.531933    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod266e29d6_e342_434b_aec9_d4ce4240507d.slice/crio-bb27a54a0272cdcde29252f7027c6baad9c7a263100b757b40ab26cfe367f4df WatchSource:0}: Error finding container bb27a54a0272cdcde29252f7027c6baad9c7a263100b757b40ab26cfe367f4df: Status 404 returned error can't find the container with id bb27a54a0272cdcde29252f7027c6baad9c7a263100b757b40ab26cfe367f4df
Sep 11 16:32:04.561643 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:04.561110    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-27xkj"]
Sep 11 16:32:04.562759 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:04.562720    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-4m2kg"]
Sep 11 16:32:05.365689 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.365650    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-676cf99488-srct9"
Sep 11 16:32:05.391484 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.391269    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 16:32:05.396061 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.395982    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:05.400260 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.400234    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.417839 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.417791    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 11 16:32:05.418112 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.418063    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-6k2cd\""
Sep 11 16:32:05.419039 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.418249    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 11 16:32:05.419039 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.418791    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 11 16:32:05.419039 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.418926    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 11 16:32:05.419039 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.419004    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7nofbaqbboh63\""
Sep 11 16:32:05.419822 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.419464    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 11 16:32:05.419822 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.419672    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 11 16:32:05.420903 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.420706    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 11 16:32:05.421997 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.421816    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 11 16:32:05.442045 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.441557    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 11 16:32:05.442045 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.441868    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 11 16:32:05.442267 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.442222    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 11 16:32:05.442721 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.442699    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 11 16:32:05.442823 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.442728    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 11 16:32:05.443109 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.443073    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 11 16:32:05.455708 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.455078    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 11 16:32:05.464196 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.463839    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 16:32:05.470805 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.469965    2581 generic.go:356] "Generic (PLEG): container finished" podID="655288ef-fded-482e-b887-f4426090b444" containerID="3144bfa5aa0936538f9a42f3a665abee9bc02748f9e9189264fb247bd67dff81" exitCode=0
Sep 11 16:32:05.470805 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.470050    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bf9nx" event={"ID":"655288ef-fded-482e-b887-f4426090b444","Type":"ContainerDied","Data":"3144bfa5aa0936538f9a42f3a665abee9bc02748f9e9189264fb247bd67dff81"}
Sep 11 16:32:05.477444 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.477398    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67d77dc547-r72tq" event={"ID":"266e29d6-e342-434b-aec9-d4ce4240507d","Type":"ContainerStarted","Data":"bb27a54a0272cdcde29252f7027c6baad9c7a263100b757b40ab26cfe367f4df"}
Sep 11 16:32:05.486027 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.485963    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-27xkj" event={"ID":"ed1a5e93-70d7-4e4a-86fd-3bb38c5dcdb8","Type":"ContainerStarted","Data":"23ac89891bc86d1a00493e4b28e8d8e7fe1cc5bb68adfec6fc9228a4e37af696"}
Sep 11 16:32:05.486338 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.486247    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-27xkj" event={"ID":"ed1a5e93-70d7-4e4a-86fd-3bb38c5dcdb8","Type":"ContainerStarted","Data":"f1e498d9ab544c8eaf8879aba63b1fa80a91d3e14918ed386cf5fe82ddd84b19"}
Sep 11 16:32:05.486338 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.486292    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-27xkj" event={"ID":"ed1a5e93-70d7-4e4a-86fd-3bb38c5dcdb8","Type":"ContainerStarted","Data":"fd26793b79a435df5ef1d34ce394efa4f4264d2efdcf15cd0c77e811954f0dfc"}
Sep 11 16:32:05.491601 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.491576    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4m2kg" event={"ID":"1ab259bc-8df8-4940-93cc-16929031ec96","Type":"ContainerStarted","Data":"85d26d0059be71ac8e137e3374ca18d9c92dd4fb412c11ab6b0e80dcead1330b"}
Sep 11 16:32:05.502214 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.501818    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c9765b6d6-wd7zp" event={"ID":"a58412b0-2955-4fb1-bdda-f3b1eb8c92a1","Type":"ContainerStarted","Data":"738d484cb8a76aa1b122403af67ff418481d2a6750c5892c6b2cf83c6d8e82a6"}
Sep 11 16:32:05.504544 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.503053    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c9765b6d6-wd7zp" event={"ID":"a58412b0-2955-4fb1-bdda-f3b1eb8c92a1","Type":"ContainerStarted","Data":"a83ecae3599ebd39717213e07614046d879c24b78bfff789071a6c846f5b7bb9"}
Sep 11 16:32:05.509005 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.508975    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73e15b09-50ce-4799-87ca-ebe117cf68ea-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.509131 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.509109    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73e15b09-50ce-4799-87ca-ebe117cf68ea-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.509211 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.509143    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/73e15b09-50ce-4799-87ca-ebe117cf68ea-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.509211 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.509172    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73e15b09-50ce-4799-87ca-ebe117cf68ea-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.509322 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.509208    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73e15b09-50ce-4799-87ca-ebe117cf68ea-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.509322 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.509244    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.509322 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.509268    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.509322 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.509293    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.509515 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.509361    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-config\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.509515 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.509395    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.509515 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.509420    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/73e15b09-50ce-4799-87ca-ebe117cf68ea-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.509515 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.509459    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xshp\" (UniqueName: \"kubernetes.io/projected/73e15b09-50ce-4799-87ca-ebe117cf68ea-kube-api-access-8xshp\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.509515 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.509487    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.510673 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.509527    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.510673 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.509552    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-web-config\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.510673 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.509581    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/73e15b09-50ce-4799-87ca-ebe117cf68ea-config-out\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.510673 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.509607    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.510673 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.509659    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/73e15b09-50ce-4799-87ca-ebe117cf68ea-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.510673 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.509695    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/73e15b09-50ce-4799-87ca-ebe117cf68ea-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.510673 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.509723    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/73e15b09-50ce-4799-87ca-ebe117cf68ea-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.513127 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.513047    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-w7cgp"
Sep 11 16:32:05.610971 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.610645    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-config\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.610971 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.610681    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.610971 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.610697    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/73e15b09-50ce-4799-87ca-ebe117cf68ea-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.610971 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.610743    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xshp\" (UniqueName: \"kubernetes.io/projected/73e15b09-50ce-4799-87ca-ebe117cf68ea-kube-api-access-8xshp\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.610971 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.610761    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.610971 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.610795    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.610971 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.610819    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-web-config\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.610971 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.610843    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/73e15b09-50ce-4799-87ca-ebe117cf68ea-config-out\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.610971 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.610866    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.610971 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.610890    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/73e15b09-50ce-4799-87ca-ebe117cf68ea-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.610971 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.610922    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/73e15b09-50ce-4799-87ca-ebe117cf68ea-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.610971 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.610964    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/73e15b09-50ce-4799-87ca-ebe117cf68ea-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.611634 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.611004    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73e15b09-50ce-4799-87ca-ebe117cf68ea-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.611634 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.611044    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73e15b09-50ce-4799-87ca-ebe117cf68ea-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.611634 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.611073    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/73e15b09-50ce-4799-87ca-ebe117cf68ea-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.611950 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.611684    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73e15b09-50ce-4799-87ca-ebe117cf68ea-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.611950 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.611749    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73e15b09-50ce-4799-87ca-ebe117cf68ea-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.611950 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.611792    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.611950 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.611818    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.611950 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.611859    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.611950 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.612054    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/73e15b09-50ce-4799-87ca-ebe117cf68ea-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.614986 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.614187    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73e15b09-50ce-4799-87ca-ebe117cf68ea-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.614986 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.614638    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/73e15b09-50ce-4799-87ca-ebe117cf68ea-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.617115 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.615293    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73e15b09-50ce-4799-87ca-ebe117cf68ea-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.617115 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.616062    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73e15b09-50ce-4799-87ca-ebe117cf68ea-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.617115 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.616673    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73e15b09-50ce-4799-87ca-ebe117cf68ea-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.617972 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.617575    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.617972 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.617727    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/73e15b09-50ce-4799-87ca-ebe117cf68ea-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.621726 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.621702    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.621726 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.621828    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.624545 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.624523    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/73e15b09-50ce-4799-87ca-ebe117cf68ea-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.640176 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.638007    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.640176 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.639681    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.640401 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.640275    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/73e15b09-50ce-4799-87ca-ebe117cf68ea-config-out\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.641160 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.641031    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-web-config\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.642761 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.642713    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.645685 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.644852    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-config\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.645685 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.645601    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.646628 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.646473    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xshp\" (UniqueName: \"kubernetes.io/projected/73e15b09-50ce-4799-87ca-ebe117cf68ea-kube-api-access-8xshp\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.646628 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.646605    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/73e15b09-50ce-4799-87ca-ebe117cf68ea-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:05.679776 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.679458    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:05.716821 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.715714    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c9765b6d6-wd7zp" podStartSLOduration=7.715692326 podStartE2EDuration="7.715692326s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:31:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:32:05.714440319 +0000 UTC m=+125.331197388" watchObservedRunningTime="2026-09-11 16:32:05.715692326 +0000 UTC m=+125.332449395"
Sep 11 16:32:05.757963 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:05.757653    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:06.110665 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:06.110511    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 16:32:06.119975 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:32:06.119929    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73e15b09_50ce_4799_87ca_ebe117cf68ea.slice/crio-f4b0da885b7e5c2dfe3bda69642a4926da35c8386f58a8f5a08bf95706ea6df6 WatchSource:0}: Error finding container f4b0da885b7e5c2dfe3bda69642a4926da35c8386f58a8f5a08bf95706ea6df6: Status 404 returned error can't find the container with id f4b0da885b7e5c2dfe3bda69642a4926da35c8386f58a8f5a08bf95706ea6df6
Sep 11 16:32:06.509415 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:06.509331    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73e15b09-50ce-4799-87ca-ebe117cf68ea","Type":"ContainerStarted","Data":"f4b0da885b7e5c2dfe3bda69642a4926da35c8386f58a8f5a08bf95706ea6df6"}
Sep 11 16:32:06.514763 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:06.514652    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bf9nx" event={"ID":"655288ef-fded-482e-b887-f4426090b444","Type":"ContainerStarted","Data":"e1258b4a9ade98313571ab58089405b4fc3d4bb6293c47e966d3e74a08c21367"}
Sep 11 16:32:06.514763 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:06.514708    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bf9nx" event={"ID":"655288ef-fded-482e-b887-f4426090b444","Type":"ContainerStarted","Data":"8101950ee0c8765d89655fc7f1b4b5bbdd68e512532b0126e5d0d201c309d5fd"}
Sep 11 16:32:06.542853 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:06.542168    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bf9nx" podStartSLOduration=7.437795571 podStartE2EDuration="8.542146577s" totalImagesPullingTime="1.016289682s" totalInitContainerRuntime="88.061324ms" isStatefulPod=true podCreationTimestamp="2026-09-11 16:31:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:32:06.540756635 +0000 UTC m=+126.157513744" watchObservedRunningTime="2026-09-11 16:32:06.542146577 +0000 UTC m=+126.158903640"
Sep 11 16:32:07.649260 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:07.649219    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:07.774865 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:07.774790    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:07.891231 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:07.891131    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:09.083219 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:09.083192    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c9765b6d6-wd7zp"
Sep 11 16:32:09.534164 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:09.534125    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67d77dc547-r72tq" event={"ID":"266e29d6-e342-434b-aec9-d4ce4240507d","Type":"ContainerStarted","Data":"232ef93afbd6021edc16200f3199771d6172efe881c4a381156c906aa62a2d07"}
Sep 11 16:32:09.534480 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:09.534459    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67d77dc547-r72tq" event={"ID":"266e29d6-e342-434b-aec9-d4ce4240507d","Type":"ContainerStarted","Data":"148d1b7d64fed8a09c02cfacaed7d65db254e1212a956adfcbbe41bb92d162ae"}
Sep 11 16:32:09.534607 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:09.534593    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67d77dc547-r72tq" event={"ID":"266e29d6-e342-434b-aec9-d4ce4240507d","Type":"ContainerStarted","Data":"6c69c772363b9f74734bc8330afaeea6bfb950124bf2719ab8bd2555699ae40a"}
Sep 11 16:32:09.539587 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:09.538604    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-27xkj" event={"ID":"ed1a5e93-70d7-4e4a-86fd-3bb38c5dcdb8","Type":"ContainerStarted","Data":"e862902cb808a7b4c71089071db092d379f5ae9942e63382f896bda263c6805a"}
Sep 11 16:32:09.550388 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:09.549498    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4m2kg" event={"ID":"1ab259bc-8df8-4940-93cc-16929031ec96","Type":"ContainerStarted","Data":"af32b9eefacf788390d8f56b7a8a8fa78ef62b5bb903e849223b0ac0b75e6970"}
Sep 11 16:32:09.550388 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:09.549557    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4m2kg" event={"ID":"1ab259bc-8df8-4940-93cc-16929031ec96","Type":"ContainerStarted","Data":"52d8d5b137be671a974b852ef36fd0e80649b89398304dea68f351c283a6f1ab"}
Sep 11 16:32:09.550388 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:09.549584    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4m2kg" event={"ID":"1ab259bc-8df8-4940-93cc-16929031ec96","Type":"ContainerStarted","Data":"50e33ec12c486c86887326e028ca28870f8a981eff1cc80393dcbc9fd0a9da69"}
Sep 11 16:32:09.552034 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:09.551967    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73e15b09-50ce-4799-87ca-ebe117cf68ea","Type":"ContainerStarted","Data":"4f5eac5a30eb689a6afd82bf12d1c6af2341a155b71cc2b195df6af0088a0064"}
Sep 11 16:32:09.572023 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:09.571932    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-27xkj" podStartSLOduration=7.654649615 podStartE2EDuration="11.571913249s" totalImagesPullingTime="3.917263634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:31:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:32:09.570342257 +0000 UTC m=+129.187099337" watchObservedRunningTime="2026-09-11 16:32:09.571913249 +0000 UTC m=+129.188670316"
Sep 11 16:32:09.596943 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:09.596890    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4m2kg" podStartSLOduration=7.502559381 podStartE2EDuration="11.596875628s" totalImagesPullingTime="4.094316247s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:31:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:32:09.596140147 +0000 UTC m=+129.212897239" watchObservedRunningTime="2026-09-11 16:32:09.596875628 +0000 UTC m=+129.213632694"
Sep 11 16:32:09.761870 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:09.761828    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97ffcc27-5973-418d-a29e-762556b9c3e0-metrics-certs\") pod \"network-metrics-daemon-dnqst\" (UID: \"97ffcc27-5973-418d-a29e-762556b9c3e0\") " pod="openshift-multus/network-metrics-daemon-dnqst"
Sep 11 16:32:09.764756 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:09.764724    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97ffcc27-5973-418d-a29e-762556b9c3e0-metrics-certs\") pod \"network-metrics-daemon-dnqst\" (UID: \"97ffcc27-5973-418d-a29e-762556b9c3e0\") " pod="openshift-multus/network-metrics-daemon-dnqst"
Sep 11 16:32:09.904485 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:09.904403    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5vm65\""
Sep 11 16:32:09.911953 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:09.911927    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnqst"
Sep 11 16:32:10.000168 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:10.000007    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:10.093687 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:10.093646    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:10.241832 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:10.241801    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dnqst"]
Sep 11 16:32:10.244054 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:32:10.244027    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97ffcc27_5973_418d_a29e_762556b9c3e0.slice/crio-910ed8f66f2a64b192a7c914a6ae59442854d063ba945eb0b170a6112dc767ea WatchSource:0}: Error finding container 910ed8f66f2a64b192a7c914a6ae59442854d063ba945eb0b170a6112dc767ea: Status 404 returned error can't find the container with id 910ed8f66f2a64b192a7c914a6ae59442854d063ba945eb0b170a6112dc767ea
Sep 11 16:32:10.379642 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:10.379407    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-676cf99488-srct9" podUID="06f8ba29-d5d1-4375-8b41-d900e0738e70" containerName="registry" containerID="cri-o://f134262a4ce9a545f394be6ff9869f6f9a58b43e2a5653fedf80f5d670036653" gracePeriod=30
Sep 11 16:32:10.564081 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:10.564040    2581 generic.go:356] "Generic (PLEG): container finished" podID="06f8ba29-d5d1-4375-8b41-d900e0738e70" containerID="f134262a4ce9a545f394be6ff9869f6f9a58b43e2a5653fedf80f5d670036653" exitCode=0
Sep 11 16:32:10.564306 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:10.564123    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-676cf99488-srct9" event={"ID":"06f8ba29-d5d1-4375-8b41-d900e0738e70","Type":"ContainerDied","Data":"f134262a4ce9a545f394be6ff9869f6f9a58b43e2a5653fedf80f5d670036653"}
Sep 11 16:32:10.567471 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:10.566148    2581 generic.go:356] "Generic (PLEG): container finished" podID="73e15b09-50ce-4799-87ca-ebe117cf68ea" containerID="4f5eac5a30eb689a6afd82bf12d1c6af2341a155b71cc2b195df6af0088a0064" exitCode=0
Sep 11 16:32:10.567471 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:10.566256    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73e15b09-50ce-4799-87ca-ebe117cf68ea","Type":"ContainerDied","Data":"4f5eac5a30eb689a6afd82bf12d1c6af2341a155b71cc2b195df6af0088a0064"}
Sep 11 16:32:10.569476 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:10.569388    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dnqst" event={"ID":"97ffcc27-5973-418d-a29e-762556b9c3e0","Type":"ContainerStarted","Data":"910ed8f66f2a64b192a7c914a6ae59442854d063ba945eb0b170a6112dc767ea"}
Sep 11 16:32:10.887000 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:10.886966    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-676cf99488-srct9"
Sep 11 16:32:10.974509 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:10.974481    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/06f8ba29-d5d1-4375-8b41-d900e0738e70-ca-trust-extracted\") pod \"06f8ba29-d5d1-4375-8b41-d900e0738e70\" (UID: \"06f8ba29-d5d1-4375-8b41-d900e0738e70\") "
Sep 11 16:32:10.974652 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:10.974567    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zb2ns\" (UniqueName: \"kubernetes.io/projected/06f8ba29-d5d1-4375-8b41-d900e0738e70-kube-api-access-zb2ns\") pod \"06f8ba29-d5d1-4375-8b41-d900e0738e70\" (UID: \"06f8ba29-d5d1-4375-8b41-d900e0738e70\") "
Sep 11 16:32:10.974652 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:10.974600    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06f8ba29-d5d1-4375-8b41-d900e0738e70-registry-tls\") pod \"06f8ba29-d5d1-4375-8b41-d900e0738e70\" (UID: \"06f8ba29-d5d1-4375-8b41-d900e0738e70\") "
Sep 11 16:32:10.974652 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:10.974628    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/06f8ba29-d5d1-4375-8b41-d900e0738e70-trusted-ca\") pod \"06f8ba29-d5d1-4375-8b41-d900e0738e70\" (UID: \"06f8ba29-d5d1-4375-8b41-d900e0738e70\") "
Sep 11 16:32:10.974820 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:10.974659    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/06f8ba29-d5d1-4375-8b41-d900e0738e70-installation-pull-secrets\") pod \"06f8ba29-d5d1-4375-8b41-d900e0738e70\" (UID: \"06f8ba29-d5d1-4375-8b41-d900e0738e70\") "
Sep 11 16:32:10.974820 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:10.974723    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/06f8ba29-d5d1-4375-8b41-d900e0738e70-registry-certificates\") pod \"06f8ba29-d5d1-4375-8b41-d900e0738e70\" (UID: \"06f8ba29-d5d1-4375-8b41-d900e0738e70\") "
Sep 11 16:32:10.974820 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:10.974751    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/06f8ba29-d5d1-4375-8b41-d900e0738e70-bound-sa-token\") pod \"06f8ba29-d5d1-4375-8b41-d900e0738e70\" (UID: \"06f8ba29-d5d1-4375-8b41-d900e0738e70\") "
Sep 11 16:32:10.974820 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:10.974780    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/06f8ba29-d5d1-4375-8b41-d900e0738e70-image-registry-private-configuration\") pod \"06f8ba29-d5d1-4375-8b41-d900e0738e70\" (UID: \"06f8ba29-d5d1-4375-8b41-d900e0738e70\") "
Sep 11 16:32:10.976288 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:10.976256    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06f8ba29-d5d1-4375-8b41-d900e0738e70-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "06f8ba29-d5d1-4375-8b41-d900e0738e70" (UID: "06f8ba29-d5d1-4375-8b41-d900e0738e70"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:32:10.976933 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:10.976901    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06f8ba29-d5d1-4375-8b41-d900e0738e70-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "06f8ba29-d5d1-4375-8b41-d900e0738e70" (UID: "06f8ba29-d5d1-4375-8b41-d900e0738e70"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:32:10.979852 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:10.979792    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06f8ba29-d5d1-4375-8b41-d900e0738e70-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "06f8ba29-d5d1-4375-8b41-d900e0738e70" (UID: "06f8ba29-d5d1-4375-8b41-d900e0738e70"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:32:10.980032 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:10.980005    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06f8ba29-d5d1-4375-8b41-d900e0738e70-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "06f8ba29-d5d1-4375-8b41-d900e0738e70" (UID: "06f8ba29-d5d1-4375-8b41-d900e0738e70"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:32:10.984678 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:10.984311    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06f8ba29-d5d1-4375-8b41-d900e0738e70-kube-api-access-zb2ns" (OuterVolumeSpecName: "kube-api-access-zb2ns") pod "06f8ba29-d5d1-4375-8b41-d900e0738e70" (UID: "06f8ba29-d5d1-4375-8b41-d900e0738e70"). InnerVolumeSpecName "kube-api-access-zb2ns". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:32:10.984678 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:10.984393    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06f8ba29-d5d1-4375-8b41-d900e0738e70-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "06f8ba29-d5d1-4375-8b41-d900e0738e70" (UID: "06f8ba29-d5d1-4375-8b41-d900e0738e70"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:32:10.993347 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:10.989437    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06f8ba29-d5d1-4375-8b41-d900e0738e70-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "06f8ba29-d5d1-4375-8b41-d900e0738e70" (UID: "06f8ba29-d5d1-4375-8b41-d900e0738e70"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:32:10.993347 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:10.990209    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06f8ba29-d5d1-4375-8b41-d900e0738e70-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "06f8ba29-d5d1-4375-8b41-d900e0738e70" (UID: "06f8ba29-d5d1-4375-8b41-d900e0738e70"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:32:11.075628 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:11.075546    2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/06f8ba29-d5d1-4375-8b41-d900e0738e70-registry-certificates\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:32:11.075628 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:11.075579    2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/06f8ba29-d5d1-4375-8b41-d900e0738e70-bound-sa-token\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:32:11.075628 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:11.075596    2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/06f8ba29-d5d1-4375-8b41-d900e0738e70-image-registry-private-configuration\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:32:11.075628 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:11.075609    2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/06f8ba29-d5d1-4375-8b41-d900e0738e70-ca-trust-extracted\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:32:11.075628 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:11.075624    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zb2ns\" (UniqueName: \"kubernetes.io/projected/06f8ba29-d5d1-4375-8b41-d900e0738e70-kube-api-access-zb2ns\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:32:11.075984 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:11.075637    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06f8ba29-d5d1-4375-8b41-d900e0738e70-registry-tls\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:32:11.075984 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:11.075650    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/06f8ba29-d5d1-4375-8b41-d900e0738e70-trusted-ca\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:32:11.075984 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:11.075662    2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/06f8ba29-d5d1-4375-8b41-d900e0738e70-installation-pull-secrets\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:32:11.583329 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:11.583289    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67d77dc547-r72tq" event={"ID":"266e29d6-e342-434b-aec9-d4ce4240507d","Type":"ContainerStarted","Data":"289eb9082b6b7df65b0cc592b0414f8f28189c4f7bd17f8257b8a8ff8b353a5b"}
Sep 11 16:32:11.583820 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:11.583385    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67d77dc547-r72tq" event={"ID":"266e29d6-e342-434b-aec9-d4ce4240507d","Type":"ContainerStarted","Data":"985d8b2608369ad7b95fef5aedb8fea68a867fe9c33b94dfa4a0913e0c667711"}
Sep 11 16:32:11.583820 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:11.583429    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67d77dc547-r72tq" event={"ID":"266e29d6-e342-434b-aec9-d4ce4240507d","Type":"ContainerStarted","Data":"2be70f911ac714edc992d0b125102abf3720c64d6fe7dd779a6eaadc1a2267a1"}
Sep 11 16:32:11.584344 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:11.584278    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-67d77dc547-r72tq"
Sep 11 16:32:11.587482 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:11.587212    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-676cf99488-srct9" event={"ID":"06f8ba29-d5d1-4375-8b41-d900e0738e70","Type":"ContainerDied","Data":"d7220bca5215a81fa478955407dc015d2cf8e2de3137a3f2d0684f964963ee25"}
Sep 11 16:32:11.587482 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:11.587283    2581 scope.go:117] "RemoveContainer" containerID="f134262a4ce9a545f394be6ff9869f6f9a58b43e2a5653fedf80f5d670036653"
Sep 11 16:32:11.587482 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:11.587433    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-676cf99488-srct9"
Sep 11 16:32:11.633282 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:11.632752    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-67d77dc547-r72tq" podStartSLOduration=5.175289651 podStartE2EDuration="10.632724169s" totalImagesPullingTime="5.457434518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:32:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:32:11.613267151 +0000 UTC m=+131.230024256" watchObservedRunningTime="2026-09-11 16:32:11.632724169 +0000 UTC m=+131.249481236"
Sep 11 16:32:11.633282 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:11.633234    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-676cf99488-srct9"]
Sep 11 16:32:11.638547 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:11.638515    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-676cf99488-srct9"]
Sep 11 16:32:12.599695 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:12.599644    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dnqst" event={"ID":"97ffcc27-5973-418d-a29e-762556b9c3e0","Type":"ContainerStarted","Data":"fa8ab4854ddb1154f00226d490e22b8ed159cf66baafb05c05a8b54fe1579d42"}
Sep 11 16:32:12.599695 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:12.599687    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dnqst" event={"ID":"97ffcc27-5973-418d-a29e-762556b9c3e0","Type":"ContainerStarted","Data":"a205794975cc617f53428437e18aa70c0b28ff90b850af2e1770014f379f5bbc"}
Sep 11 16:32:12.758753 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:12.758721    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:12.853752 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:12.853711    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:12.988105 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:12.988055    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06f8ba29-d5d1-4375-8b41-d900e0738e70" path="/var/lib/kubelet/pods/06f8ba29-d5d1-4375-8b41-d900e0738e70/volumes"
Sep 11 16:32:15.614760 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:15.614726    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73e15b09-50ce-4799-87ca-ebe117cf68ea","Type":"ContainerStarted","Data":"f2c389ea3be52089f3a729d605ce9639edfc7ccd6f5247d67a072b45dc322fdc"}
Sep 11 16:32:15.615217 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:15.614792    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73e15b09-50ce-4799-87ca-ebe117cf68ea","Type":"ContainerStarted","Data":"d7a31c309a42570d474d77834a43d7471c2373f6968d0dea76ac3b16c31215f7"}
Sep 11 16:32:15.615217 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:15.614817    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73e15b09-50ce-4799-87ca-ebe117cf68ea","Type":"ContainerStarted","Data":"f1d6e0bb6c6f48a7374008dd4333f190f96b3f9c5066a9dd2fa25a8b13dd2d92"}
Sep 11 16:32:15.615217 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:15.614842    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73e15b09-50ce-4799-87ca-ebe117cf68ea","Type":"ContainerStarted","Data":"70569ff185520ec6660b36f076d8965a2d3c93c5f339624b8a702c04b20cc5e9"}
Sep 11 16:32:15.615217 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:15.614864    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73e15b09-50ce-4799-87ca-ebe117cf68ea","Type":"ContainerStarted","Data":"60d755e3dc3846bb1c54d3239f83a38ef36cf5da12995076f0326a1ef54bd528"}
Sep 11 16:32:15.615217 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:15.614887    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73e15b09-50ce-4799-87ca-ebe117cf68ea","Type":"ContainerStarted","Data":"efb35328c6dd5468e6a56924ca1fe7cbe726b8ecd6d6f6fc7000c025cb54bb8d"}
Sep 11 16:32:15.647444 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:15.647399    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.2732813419999998 podStartE2EDuration="10.64738324s" totalImagesPullingTime="7.350850161s" totalInitContainerRuntime="23.251737ms" isStatefulPod=false podCreationTimestamp="2026-09-11 16:32:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:32:15.646336394 +0000 UTC m=+135.263093476" watchObservedRunningTime="2026-09-11 16:32:15.64738324 +0000 UTC m=+135.264140301"
Sep 11 16:32:15.647657 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:15.647627    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dnqst" podStartSLOduration=132.790436696 podStartE2EDuration="2m14.647614015s" totalImagesPullingTime="1.857177319s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:30:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:32:12.621111232 +0000 UTC m=+132.237868298" watchObservedRunningTime="2026-09-11 16:32:15.647614015 +0000 UTC m=+135.264371082"
Sep 11 16:32:15.758411 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:15.758374    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:32:17.605714 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:17.605686    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-67d77dc547-r72tq"
Sep 11 16:32:19.236965 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:19.236938    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:19.343607 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:19.343580    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:19.670592 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:19.670510    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9f7478879-nbwmc"]
Sep 11 16:32:19.825710 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:19.825681    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:19.942986 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:19.942958    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:24.659469 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:24.659435    2581 generic.go:356] "Generic (PLEG): container finished" podID="e93a3486-b35e-4746-951c-24f6bdb25182" containerID="17f2d90fef89e1083f934f219f32c3805ff8a7abb8e8a42b56713c651bef82ca" exitCode=0
Sep 11 16:32:24.659967 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:24.659517    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-8ld7f" event={"ID":"e93a3486-b35e-4746-951c-24f6bdb25182","Type":"ContainerDied","Data":"17f2d90fef89e1083f934f219f32c3805ff8a7abb8e8a42b56713c651bef82ca"}
Sep 11 16:32:24.659967 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:24.659926    2581 scope.go:117] "RemoveContainer" containerID="17f2d90fef89e1083f934f219f32c3805ff8a7abb8e8a42b56713c651bef82ca"
Sep 11 16:32:25.665177 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:25.665139    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-8ld7f" event={"ID":"e93a3486-b35e-4746-951c-24f6bdb25182","Type":"ContainerStarted","Data":"9e2d38140b089260ab927078e5620e93f898edfd7fe347eeb59b80c3fa204b28"}
Sep 11 16:32:25.666907 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:25.666880    2581 generic.go:356] "Generic (PLEG): container finished" podID="4ac113fb-7b10-4927-87e6-a28c635d5f3c" containerID="91b65fa64bba4212c7a68d9ea7a668ffe52f2b9d36b0a8d6d21d2805d54e9421" exitCode=0
Sep 11 16:32:25.667023 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:25.666951    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-h2rkv" event={"ID":"4ac113fb-7b10-4927-87e6-a28c635d5f3c","Type":"ContainerDied","Data":"91b65fa64bba4212c7a68d9ea7a668ffe52f2b9d36b0a8d6d21d2805d54e9421"}
Sep 11 16:32:25.667271 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:25.667258    2581 scope.go:117] "RemoveContainer" containerID="91b65fa64bba4212c7a68d9ea7a668ffe52f2b9d36b0a8d6d21d2805d54e9421"
Sep 11 16:32:26.492766 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:26.492737    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nt2jf_ea2d453f-d6ae-437a-a922-140017dedf14/dns/0.log"
Sep 11 16:32:26.507327 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:26.507298    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nt2jf_ea2d453f-d6ae-437a-a922-140017dedf14/kube-rbac-proxy/0.log"
Sep 11 16:32:26.673070 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:26.673033    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-h2rkv" event={"ID":"4ac113fb-7b10-4927-87e6-a28c635d5f3c","Type":"ContainerStarted","Data":"81f6d492a114336ddf7811ba91bd7df83cd1a7db04989f7f9fe98c27230672d5"}
Sep 11 16:32:26.824945 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:26.824867    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nk4fp_41863045-9930-4c6f-a9a4-cb77f319ed93/dns-node-resolver/0.log"
Sep 11 16:32:29.894882 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:29.894851    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:29.995605 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:29.995571    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:30.546437 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:30.546385    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5c9765b6d6-wd7zp" podUID="a58412b0-2955-4fb1-bdda-f3b1eb8c92a1" containerName="console" containerID="cri-o://738d484cb8a76aa1b122403af67ff418481d2a6750c5892c6b2cf83c6d8e82a6" gracePeriod=15
Sep 11 16:32:30.691765 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:30.691732    2581 generic.go:356] "Generic (PLEG): container finished" podID="a58412b0-2955-4fb1-bdda-f3b1eb8c92a1" containerID="738d484cb8a76aa1b122403af67ff418481d2a6750c5892c6b2cf83c6d8e82a6" exitCode=0
Sep 11 16:32:30.691894 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:30.691797    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c9765b6d6-wd7zp" event={"ID":"a58412b0-2955-4fb1-bdda-f3b1eb8c92a1","Type":"ContainerDied","Data":"738d484cb8a76aa1b122403af67ff418481d2a6750c5892c6b2cf83c6d8e82a6"}
Sep 11 16:32:30.823612 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:30.823550    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c9765b6d6-wd7zp"
Sep 11 16:32:30.951810 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:30.951771    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a58412b0-2955-4fb1-bdda-f3b1eb8c92a1-oauth-serving-cert\") pod \"a58412b0-2955-4fb1-bdda-f3b1eb8c92a1\" (UID: \"a58412b0-2955-4fb1-bdda-f3b1eb8c92a1\") "
Sep 11 16:32:30.951810 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:30.951815    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a58412b0-2955-4fb1-bdda-f3b1eb8c92a1-console-serving-cert\") pod \"a58412b0-2955-4fb1-bdda-f3b1eb8c92a1\" (UID: \"a58412b0-2955-4fb1-bdda-f3b1eb8c92a1\") "
Sep 11 16:32:30.952324 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:30.951832    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a58412b0-2955-4fb1-bdda-f3b1eb8c92a1-console-config\") pod \"a58412b0-2955-4fb1-bdda-f3b1eb8c92a1\" (UID: \"a58412b0-2955-4fb1-bdda-f3b1eb8c92a1\") "
Sep 11 16:32:30.952324 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:30.951886    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jrhd\" (UniqueName: \"kubernetes.io/projected/a58412b0-2955-4fb1-bdda-f3b1eb8c92a1-kube-api-access-2jrhd\") pod \"a58412b0-2955-4fb1-bdda-f3b1eb8c92a1\" (UID: \"a58412b0-2955-4fb1-bdda-f3b1eb8c92a1\") "
Sep 11 16:32:30.952324 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:30.951902    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a58412b0-2955-4fb1-bdda-f3b1eb8c92a1-service-ca\") pod \"a58412b0-2955-4fb1-bdda-f3b1eb8c92a1\" (UID: \"a58412b0-2955-4fb1-bdda-f3b1eb8c92a1\") "
Sep 11 16:32:30.952324 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:30.951940    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a58412b0-2955-4fb1-bdda-f3b1eb8c92a1-trusted-ca-bundle\") pod \"a58412b0-2955-4fb1-bdda-f3b1eb8c92a1\" (UID: \"a58412b0-2955-4fb1-bdda-f3b1eb8c92a1\") "
Sep 11 16:32:30.952324 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:30.951973    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a58412b0-2955-4fb1-bdda-f3b1eb8c92a1-console-oauth-config\") pod \"a58412b0-2955-4fb1-bdda-f3b1eb8c92a1\" (UID: \"a58412b0-2955-4fb1-bdda-f3b1eb8c92a1\") "
Sep 11 16:32:30.952579 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:30.952244    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a58412b0-2955-4fb1-bdda-f3b1eb8c92a1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a58412b0-2955-4fb1-bdda-f3b1eb8c92a1" (UID: "a58412b0-2955-4fb1-bdda-f3b1eb8c92a1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:32:30.952579 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:30.952365    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a58412b0-2955-4fb1-bdda-f3b1eb8c92a1-console-config" (OuterVolumeSpecName: "console-config") pod "a58412b0-2955-4fb1-bdda-f3b1eb8c92a1" (UID: "a58412b0-2955-4fb1-bdda-f3b1eb8c92a1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:32:30.952687 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:30.952608    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a58412b0-2955-4fb1-bdda-f3b1eb8c92a1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a58412b0-2955-4fb1-bdda-f3b1eb8c92a1" (UID: "a58412b0-2955-4fb1-bdda-f3b1eb8c92a1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:32:30.952813 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:30.952792    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a58412b0-2955-4fb1-bdda-f3b1eb8c92a1-service-ca" (OuterVolumeSpecName: "service-ca") pod "a58412b0-2955-4fb1-bdda-f3b1eb8c92a1" (UID: "a58412b0-2955-4fb1-bdda-f3b1eb8c92a1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:32:30.954379 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:30.954350    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a58412b0-2955-4fb1-bdda-f3b1eb8c92a1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a58412b0-2955-4fb1-bdda-f3b1eb8c92a1" (UID: "a58412b0-2955-4fb1-bdda-f3b1eb8c92a1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:32:30.954471 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:30.954410    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a58412b0-2955-4fb1-bdda-f3b1eb8c92a1-kube-api-access-2jrhd" (OuterVolumeSpecName: "kube-api-access-2jrhd") pod "a58412b0-2955-4fb1-bdda-f3b1eb8c92a1" (UID: "a58412b0-2955-4fb1-bdda-f3b1eb8c92a1"). InnerVolumeSpecName "kube-api-access-2jrhd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:32:30.954471 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:30.954453    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a58412b0-2955-4fb1-bdda-f3b1eb8c92a1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a58412b0-2955-4fb1-bdda-f3b1eb8c92a1" (UID: "a58412b0-2955-4fb1-bdda-f3b1eb8c92a1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:32:31.052808 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:31.052773    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jrhd\" (UniqueName: \"kubernetes.io/projected/a58412b0-2955-4fb1-bdda-f3b1eb8c92a1-kube-api-access-2jrhd\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:32:31.052808 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:31.052803    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a58412b0-2955-4fb1-bdda-f3b1eb8c92a1-service-ca\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:32:31.052808 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:31.052813    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a58412b0-2955-4fb1-bdda-f3b1eb8c92a1-trusted-ca-bundle\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:32:31.053028 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:31.052823    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a58412b0-2955-4fb1-bdda-f3b1eb8c92a1-console-oauth-config\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:32:31.053028 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:31.052831    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a58412b0-2955-4fb1-bdda-f3b1eb8c92a1-oauth-serving-cert\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:32:31.053028 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:31.052839    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a58412b0-2955-4fb1-bdda-f3b1eb8c92a1-console-serving-cert\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:32:31.053028 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:31.052847    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a58412b0-2955-4fb1-bdda-f3b1eb8c92a1-console-config\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:32:31.696739 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:31.696708    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c9765b6d6-wd7zp"
Sep 11 16:32:31.696739 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:31.696715    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c9765b6d6-wd7zp" event={"ID":"a58412b0-2955-4fb1-bdda-f3b1eb8c92a1","Type":"ContainerDied","Data":"a83ecae3599ebd39717213e07614046d879c24b78bfff789071a6c846f5b7bb9"}
Sep 11 16:32:31.697006 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:31.696782    2581 scope.go:117] "RemoveContainer" containerID="738d484cb8a76aa1b122403af67ff418481d2a6750c5892c6b2cf83c6d8e82a6"
Sep 11 16:32:31.721706 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:31.721676    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c9765b6d6-wd7zp"]
Sep 11 16:32:31.724066 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:31.724044    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c9765b6d6-wd7zp"]
Sep 11 16:32:32.986292 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:32.986260    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a58412b0-2955-4fb1-bdda-f3b1eb8c92a1" path="/var/lib/kubelet/pods/a58412b0-2955-4fb1-bdda-f3b1eb8c92a1/volumes"
Sep 11 16:32:44.693358 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:44.693294    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-9f7478879-nbwmc" podUID="f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d" containerName="console" containerID="cri-o://b1d8f8c4e9fe15036c9a3137954535d0fff8cce95ab1761c549ea682c6d5d7ef" gracePeriod=15
Sep 11 16:32:44.804418 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:44.804379    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:44.901770 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:44.901738    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:44.968362 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:44.968329    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:44.983905 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:44.983874    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9f7478879-nbwmc"
Sep 11 16:32:45.076399 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:45.076364    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d-console-serving-cert\") pod \"f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d\" (UID: \"f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d\") "
Sep 11 16:32:45.076592 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:45.076452    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d-console-config\") pod \"f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d\" (UID: \"f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d\") "
Sep 11 16:32:45.076592 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:45.076484    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d-console-oauth-config\") pod \"f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d\" (UID: \"f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d\") "
Sep 11 16:32:45.076592 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:45.076506    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d-service-ca\") pod \"f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d\" (UID: \"f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d\") "
Sep 11 16:32:45.076592 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:45.076554    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wv5fl\" (UniqueName: \"kubernetes.io/projected/f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d-kube-api-access-wv5fl\") pod \"f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d\" (UID: \"f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d\") "
Sep 11 16:32:45.076592 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:45.076584    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d-oauth-serving-cert\") pod \"f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d\" (UID: \"f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d\") "
Sep 11 16:32:45.076930 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:45.076899    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d-console-config" (OuterVolumeSpecName: "console-config") pod "f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d" (UID: "f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:32:45.077008 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:45.076952    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d-service-ca" (OuterVolumeSpecName: "service-ca") pod "f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d" (UID: "f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:32:45.077078 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:45.077020    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d" (UID: "f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:32:45.083976 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:45.083942    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d" (UID: "f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:32:45.083976 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:45.083961    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d-kube-api-access-wv5fl" (OuterVolumeSpecName: "kube-api-access-wv5fl") pod "f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d" (UID: "f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d"). InnerVolumeSpecName "kube-api-access-wv5fl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:32:45.083976 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:45.083961    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d" (UID: "f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:32:45.177581 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:45.177539    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d-console-config\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:32:45.177581 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:45.177573    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d-console-oauth-config\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:32:45.177581 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:45.177583    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d-service-ca\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:32:45.177959 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:45.177615    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wv5fl\" (UniqueName: \"kubernetes.io/projected/f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d-kube-api-access-wv5fl\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:32:45.177959 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:45.177625    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d-oauth-serving-cert\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:32:45.177959 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:45.177633    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d-console-serving-cert\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:32:45.762715 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:45.762593    2581 generic.go:356] "Generic (PLEG): container finished" podID="f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d" containerID="b1d8f8c4e9fe15036c9a3137954535d0fff8cce95ab1761c549ea682c6d5d7ef" exitCode=0
Sep 11 16:32:45.763171 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:45.762661    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9f7478879-nbwmc"
Sep 11 16:32:45.763171 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:45.762678    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9f7478879-nbwmc" event={"ID":"f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d","Type":"ContainerDied","Data":"b1d8f8c4e9fe15036c9a3137954535d0fff8cce95ab1761c549ea682c6d5d7ef"}
Sep 11 16:32:45.763171 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:45.762909    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9f7478879-nbwmc" event={"ID":"f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d","Type":"ContainerDied","Data":"6010d5e497326ce733b2ba5769978a07d7622ffe4661349cf3ae8bbd40ee5a9e"}
Sep 11 16:32:45.763171 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:45.762931    2581 scope.go:117] "RemoveContainer" containerID="b1d8f8c4e9fe15036c9a3137954535d0fff8cce95ab1761c549ea682c6d5d7ef"
Sep 11 16:32:45.771822 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:45.771803    2581 scope.go:117] "RemoveContainer" containerID="b1d8f8c4e9fe15036c9a3137954535d0fff8cce95ab1761c549ea682c6d5d7ef"
Sep 11 16:32:45.772181 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:32:45.772128    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1d8f8c4e9fe15036c9a3137954535d0fff8cce95ab1761c549ea682c6d5d7ef\": container with ID starting with b1d8f8c4e9fe15036c9a3137954535d0fff8cce95ab1761c549ea682c6d5d7ef not found: ID does not exist" containerID="b1d8f8c4e9fe15036c9a3137954535d0fff8cce95ab1761c549ea682c6d5d7ef"
Sep 11 16:32:45.772181 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:45.772158    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1d8f8c4e9fe15036c9a3137954535d0fff8cce95ab1761c549ea682c6d5d7ef"} err="failed to get container status \"b1d8f8c4e9fe15036c9a3137954535d0fff8cce95ab1761c549ea682c6d5d7ef\": rpc error: code = NotFound desc = could not find container \"b1d8f8c4e9fe15036c9a3137954535d0fff8cce95ab1761c549ea682c6d5d7ef\": container with ID starting with b1d8f8c4e9fe15036c9a3137954535d0fff8cce95ab1761c549ea682c6d5d7ef not found: ID does not exist"
Sep 11 16:32:45.788585 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:45.788541    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9f7478879-nbwmc"]
Sep 11 16:32:45.794756 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:45.794729    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-9f7478879-nbwmc"]
Sep 11 16:32:46.987214 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:46.987180    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d" path="/var/lib/kubelet/pods/f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d/volumes"
Sep 11 16:32:53.800001 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:53.799922    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:53.901063 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:32:53.901028    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:05.758379 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:05.758344    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:05.774856 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:05.774830    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:05.860495 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:05.860466    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:15.014503 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:15.014464    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:15.085449 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:15.085416    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:16.458353 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:16.458318    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:16.521122 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:16.521064    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:23.696672 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:23.696633    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 16:33:23.697254 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:23.696949    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="73e15b09-50ce-4799-87ca-ebe117cf68ea" containerName="prometheus" containerID="cri-o://efb35328c6dd5468e6a56924ca1fe7cbe726b8ecd6d6f6fc7000c025cb54bb8d" gracePeriod=600
Sep 11 16:33:23.697254 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:23.696978    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="73e15b09-50ce-4799-87ca-ebe117cf68ea" containerName="kube-rbac-proxy" containerID="cri-o://d7a31c309a42570d474d77834a43d7471c2373f6968d0dea76ac3b16c31215f7" gracePeriod=600
Sep 11 16:33:23.697254 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:23.697007    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="73e15b09-50ce-4799-87ca-ebe117cf68ea" containerName="kube-rbac-proxy-thanos" containerID="cri-o://f2c389ea3be52089f3a729d605ce9639edfc7ccd6f5247d67a072b45dc322fdc" gracePeriod=600
Sep 11 16:33:23.697254 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:23.697022    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="73e15b09-50ce-4799-87ca-ebe117cf68ea" containerName="thanos-sidecar" containerID="cri-o://70569ff185520ec6660b36f076d8965a2d3c93c5f339624b8a702c04b20cc5e9" gracePeriod=600
Sep 11 16:33:23.697254 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:23.697022    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="73e15b09-50ce-4799-87ca-ebe117cf68ea" containerName="kube-rbac-proxy-web" containerID="cri-o://f1d6e0bb6c6f48a7374008dd4333f190f96b3f9c5066a9dd2fa25a8b13dd2d92" gracePeriod=600
Sep 11 16:33:23.697254 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:23.697069    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="73e15b09-50ce-4799-87ca-ebe117cf68ea" containerName="config-reloader" containerID="cri-o://60d755e3dc3846bb1c54d3239f83a38ef36cf5da12995076f0326a1ef54bd528" gracePeriod=600
Sep 11 16:33:23.919677 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:23.919643    2581 generic.go:356] "Generic (PLEG): container finished" podID="73e15b09-50ce-4799-87ca-ebe117cf68ea" containerID="f2c389ea3be52089f3a729d605ce9639edfc7ccd6f5247d67a072b45dc322fdc" exitCode=0
Sep 11 16:33:23.919677 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:23.919672    2581 generic.go:356] "Generic (PLEG): container finished" podID="73e15b09-50ce-4799-87ca-ebe117cf68ea" containerID="d7a31c309a42570d474d77834a43d7471c2373f6968d0dea76ac3b16c31215f7" exitCode=0
Sep 11 16:33:23.919677 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:23.919681    2581 generic.go:356] "Generic (PLEG): container finished" podID="73e15b09-50ce-4799-87ca-ebe117cf68ea" containerID="f1d6e0bb6c6f48a7374008dd4333f190f96b3f9c5066a9dd2fa25a8b13dd2d92" exitCode=0
Sep 11 16:33:23.919926 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:23.919688    2581 generic.go:356] "Generic (PLEG): container finished" podID="73e15b09-50ce-4799-87ca-ebe117cf68ea" containerID="70569ff185520ec6660b36f076d8965a2d3c93c5f339624b8a702c04b20cc5e9" exitCode=0
Sep 11 16:33:23.919926 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:23.919693    2581 generic.go:356] "Generic (PLEG): container finished" podID="73e15b09-50ce-4799-87ca-ebe117cf68ea" containerID="60d755e3dc3846bb1c54d3239f83a38ef36cf5da12995076f0326a1ef54bd528" exitCode=0
Sep 11 16:33:23.919926 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:23.919701    2581 generic.go:356] "Generic (PLEG): container finished" podID="73e15b09-50ce-4799-87ca-ebe117cf68ea" containerID="efb35328c6dd5468e6a56924ca1fe7cbe726b8ecd6d6f6fc7000c025cb54bb8d" exitCode=0
Sep 11 16:33:23.919926 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:23.919713    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73e15b09-50ce-4799-87ca-ebe117cf68ea","Type":"ContainerDied","Data":"f2c389ea3be52089f3a729d605ce9639edfc7ccd6f5247d67a072b45dc322fdc"}
Sep 11 16:33:23.919926 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:23.919805    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73e15b09-50ce-4799-87ca-ebe117cf68ea","Type":"ContainerDied","Data":"d7a31c309a42570d474d77834a43d7471c2373f6968d0dea76ac3b16c31215f7"}
Sep 11 16:33:23.919926 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:23.919831    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73e15b09-50ce-4799-87ca-ebe117cf68ea","Type":"ContainerDied","Data":"f1d6e0bb6c6f48a7374008dd4333f190f96b3f9c5066a9dd2fa25a8b13dd2d92"}
Sep 11 16:33:23.919926 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:23.919856    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73e15b09-50ce-4799-87ca-ebe117cf68ea","Type":"ContainerDied","Data":"70569ff185520ec6660b36f076d8965a2d3c93c5f339624b8a702c04b20cc5e9"}
Sep 11 16:33:23.919926 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:23.919881    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73e15b09-50ce-4799-87ca-ebe117cf68ea","Type":"ContainerDied","Data":"60d755e3dc3846bb1c54d3239f83a38ef36cf5da12995076f0326a1ef54bd528"}
Sep 11 16:33:23.919926 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:23.919905    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73e15b09-50ce-4799-87ca-ebe117cf68ea","Type":"ContainerDied","Data":"efb35328c6dd5468e6a56924ca1fe7cbe726b8ecd6d6f6fc7000c025cb54bb8d"}
Sep 11 16:33:23.938543 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:23.938523    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:24.020107 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.019997    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73e15b09-50ce-4799-87ca-ebe117cf68ea-prometheus-trusted-ca-bundle\") pod \"73e15b09-50ce-4799-87ca-ebe117cf68ea\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") "
Sep 11 16:33:24.020107 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.020040    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/73e15b09-50ce-4799-87ca-ebe117cf68ea-config-out\") pod \"73e15b09-50ce-4799-87ca-ebe117cf68ea\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") "
Sep 11 16:33:24.020107 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.020079    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-secret-prometheus-k8s-tls\") pod \"73e15b09-50ce-4799-87ca-ebe117cf68ea\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") "
Sep 11 16:33:24.020377 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.020132    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"73e15b09-50ce-4799-87ca-ebe117cf68ea\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") "
Sep 11 16:33:24.020377 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.020156    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-secret-kube-rbac-proxy\") pod \"73e15b09-50ce-4799-87ca-ebe117cf68ea\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") "
Sep 11 16:33:24.020377 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.020191    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/73e15b09-50ce-4799-87ca-ebe117cf68ea-prometheus-k8s-rulefiles-1\") pod \"73e15b09-50ce-4799-87ca-ebe117cf68ea\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") "
Sep 11 16:33:24.020377 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.020216    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73e15b09-50ce-4799-87ca-ebe117cf68ea-configmap-kubelet-serving-ca-bundle\") pod \"73e15b09-50ce-4799-87ca-ebe117cf68ea\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") "
Sep 11 16:33:24.020377 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.020264    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-web-config\") pod \"73e15b09-50ce-4799-87ca-ebe117cf68ea\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") "
Sep 11 16:33:24.020377 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.020309    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/73e15b09-50ce-4799-87ca-ebe117cf68ea-prometheus-k8s-rulefiles-2\") pod \"73e15b09-50ce-4799-87ca-ebe117cf68ea\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") "
Sep 11 16:33:24.020377 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.020339    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-config\") pod \"73e15b09-50ce-4799-87ca-ebe117cf68ea\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") "
Sep 11 16:33:24.020714 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.020379    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/73e15b09-50ce-4799-87ca-ebe117cf68ea-prometheus-k8s-rulefiles-0\") pod \"73e15b09-50ce-4799-87ca-ebe117cf68ea\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") "
Sep 11 16:33:24.020714 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.020418    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"73e15b09-50ce-4799-87ca-ebe117cf68ea\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") "
Sep 11 16:33:24.020714 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.020450    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-secret-metrics-client-certs\") pod \"73e15b09-50ce-4799-87ca-ebe117cf68ea\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") "
Sep 11 16:33:24.020714 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.020463    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73e15b09-50ce-4799-87ca-ebe117cf68ea-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "73e15b09-50ce-4799-87ca-ebe117cf68ea" (UID: "73e15b09-50ce-4799-87ca-ebe117cf68ea"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:33:24.020714 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.020486    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-secret-grpc-tls\") pod \"73e15b09-50ce-4799-87ca-ebe117cf68ea\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") "
Sep 11 16:33:24.020714 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.020542    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/73e15b09-50ce-4799-87ca-ebe117cf68ea-prometheus-k8s-db\") pod \"73e15b09-50ce-4799-87ca-ebe117cf68ea\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") "
Sep 11 16:33:24.020714 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.020579    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73e15b09-50ce-4799-87ca-ebe117cf68ea-configmap-serving-certs-ca-bundle\") pod \"73e15b09-50ce-4799-87ca-ebe117cf68ea\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") "
Sep 11 16:33:24.020714 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.020607    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xshp\" (UniqueName: \"kubernetes.io/projected/73e15b09-50ce-4799-87ca-ebe117cf68ea-kube-api-access-8xshp\") pod \"73e15b09-50ce-4799-87ca-ebe117cf68ea\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") "
Sep 11 16:33:24.021167 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.020644    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-thanos-prometheus-http-client-file\") pod \"73e15b09-50ce-4799-87ca-ebe117cf68ea\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") "
Sep 11 16:33:24.021167 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.020949    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73e15b09-50ce-4799-87ca-ebe117cf68ea-configmap-metrics-client-ca\") pod \"73e15b09-50ce-4799-87ca-ebe117cf68ea\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") "
Sep 11 16:33:24.021167 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.020986    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/73e15b09-50ce-4799-87ca-ebe117cf68ea-tls-assets\") pod \"73e15b09-50ce-4799-87ca-ebe117cf68ea\" (UID: \"73e15b09-50ce-4799-87ca-ebe117cf68ea\") "
Sep 11 16:33:24.021465 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.021400    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73e15b09-50ce-4799-87ca-ebe117cf68ea-prometheus-trusted-ca-bundle\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:33:24.022997 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.020834    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73e15b09-50ce-4799-87ca-ebe117cf68ea-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "73e15b09-50ce-4799-87ca-ebe117cf68ea" (UID: "73e15b09-50ce-4799-87ca-ebe117cf68ea"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:33:24.022997 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.021561    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73e15b09-50ce-4799-87ca-ebe117cf68ea-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "73e15b09-50ce-4799-87ca-ebe117cf68ea" (UID: "73e15b09-50ce-4799-87ca-ebe117cf68ea"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:33:24.022997 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.021935    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73e15b09-50ce-4799-87ca-ebe117cf68ea-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "73e15b09-50ce-4799-87ca-ebe117cf68ea" (UID: "73e15b09-50ce-4799-87ca-ebe117cf68ea"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:33:24.022997 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.022297    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73e15b09-50ce-4799-87ca-ebe117cf68ea-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "73e15b09-50ce-4799-87ca-ebe117cf68ea" (UID: "73e15b09-50ce-4799-87ca-ebe117cf68ea"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:33:24.022997 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.022310    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73e15b09-50ce-4799-87ca-ebe117cf68ea-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "73e15b09-50ce-4799-87ca-ebe117cf68ea" (UID: "73e15b09-50ce-4799-87ca-ebe117cf68ea"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:33:24.022997 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.022407    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73e15b09-50ce-4799-87ca-ebe117cf68ea-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "73e15b09-50ce-4799-87ca-ebe117cf68ea" (UID: "73e15b09-50ce-4799-87ca-ebe117cf68ea"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:33:24.023593 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.023063    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "73e15b09-50ce-4799-87ca-ebe117cf68ea" (UID: "73e15b09-50ce-4799-87ca-ebe117cf68ea"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:33:24.023593 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.023230    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73e15b09-50ce-4799-87ca-ebe117cf68ea-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "73e15b09-50ce-4799-87ca-ebe117cf68ea" (UID: "73e15b09-50ce-4799-87ca-ebe117cf68ea"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:33:24.025677 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.025646    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "73e15b09-50ce-4799-87ca-ebe117cf68ea" (UID: "73e15b09-50ce-4799-87ca-ebe117cf68ea"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:33:24.025898 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.025799    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73e15b09-50ce-4799-87ca-ebe117cf68ea-config-out" (OuterVolumeSpecName: "config-out") pod "73e15b09-50ce-4799-87ca-ebe117cf68ea" (UID: "73e15b09-50ce-4799-87ca-ebe117cf68ea"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:33:24.025898 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.025921    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73e15b09-50ce-4799-87ca-ebe117cf68ea-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "73e15b09-50ce-4799-87ca-ebe117cf68ea" (UID: "73e15b09-50ce-4799-87ca-ebe117cf68ea"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:33:24.026238 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.026201    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-config" (OuterVolumeSpecName: "config") pod "73e15b09-50ce-4799-87ca-ebe117cf68ea" (UID: "73e15b09-50ce-4799-87ca-ebe117cf68ea"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:33:24.026326 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.026239    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "73e15b09-50ce-4799-87ca-ebe117cf68ea" (UID: "73e15b09-50ce-4799-87ca-ebe117cf68ea"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:33:24.026326 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.026253    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "73e15b09-50ce-4799-87ca-ebe117cf68ea" (UID: "73e15b09-50ce-4799-87ca-ebe117cf68ea"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:33:24.026326 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.026302    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "73e15b09-50ce-4799-87ca-ebe117cf68ea" (UID: "73e15b09-50ce-4799-87ca-ebe117cf68ea"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:33:24.026543 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.026324    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "73e15b09-50ce-4799-87ca-ebe117cf68ea" (UID: "73e15b09-50ce-4799-87ca-ebe117cf68ea"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:33:24.026698 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.026681    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "73e15b09-50ce-4799-87ca-ebe117cf68ea" (UID: "73e15b09-50ce-4799-87ca-ebe117cf68ea"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:33:24.026936 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.026921    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73e15b09-50ce-4799-87ca-ebe117cf68ea-kube-api-access-8xshp" (OuterVolumeSpecName: "kube-api-access-8xshp") pod "73e15b09-50ce-4799-87ca-ebe117cf68ea" (UID: "73e15b09-50ce-4799-87ca-ebe117cf68ea"). InnerVolumeSpecName "kube-api-access-8xshp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:33:24.038316 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.038291    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-web-config" (OuterVolumeSpecName: "web-config") pod "73e15b09-50ce-4799-87ca-ebe117cf68ea" (UID: "73e15b09-50ce-4799-87ca-ebe117cf68ea"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:33:24.122631 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.122580    2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:33:24.122631 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.122625    2581 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-secret-metrics-client-certs\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:33:24.122631 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.122636    2581 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-secret-grpc-tls\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:33:24.122631 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.122646    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/73e15b09-50ce-4799-87ca-ebe117cf68ea-prometheus-k8s-db\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:33:24.122883 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.122655    2581 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73e15b09-50ce-4799-87ca-ebe117cf68ea-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:33:24.122883 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.122664    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xshp\" (UniqueName: \"kubernetes.io/projected/73e15b09-50ce-4799-87ca-ebe117cf68ea-kube-api-access-8xshp\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:33:24.122883 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.122673    2581 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-thanos-prometheus-http-client-file\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:33:24.122883 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.122681    2581 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73e15b09-50ce-4799-87ca-ebe117cf68ea-configmap-metrics-client-ca\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:33:24.122883 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.122690    2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/73e15b09-50ce-4799-87ca-ebe117cf68ea-tls-assets\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:33:24.122883 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.122698    2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/73e15b09-50ce-4799-87ca-ebe117cf68ea-config-out\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:33:24.122883 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.122705    2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-secret-prometheus-k8s-tls\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:33:24.122883 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.122713    2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:33:24.122883 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.122721    2581 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-secret-kube-rbac-proxy\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:33:24.122883 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.122729    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/73e15b09-50ce-4799-87ca-ebe117cf68ea-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:33:24.122883 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.122738    2581 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73e15b09-50ce-4799-87ca-ebe117cf68ea-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:33:24.122883 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.122746    2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-web-config\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:33:24.122883 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.122754    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/73e15b09-50ce-4799-87ca-ebe117cf68ea-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:33:24.122883 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.122761    2581 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/73e15b09-50ce-4799-87ca-ebe117cf68ea-config\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:33:24.122883 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.122769    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/73e15b09-50ce-4799-87ca-ebe117cf68ea-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:33:24.926701 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.926664    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73e15b09-50ce-4799-87ca-ebe117cf68ea","Type":"ContainerDied","Data":"f4b0da885b7e5c2dfe3bda69642a4926da35c8386f58a8f5a08bf95706ea6df6"}
Sep 11 16:33:24.927120 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.926741    2581 scope.go:117] "RemoveContainer" containerID="f2c389ea3be52089f3a729d605ce9639edfc7ccd6f5247d67a072b45dc322fdc"
Sep 11 16:33:24.927120 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.926675    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:24.935167 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.935070    2581 scope.go:117] "RemoveContainer" containerID="d7a31c309a42570d474d77834a43d7471c2373f6968d0dea76ac3b16c31215f7"
Sep 11 16:33:24.942399 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.942378    2581 scope.go:117] "RemoveContainer" containerID="f1d6e0bb6c6f48a7374008dd4333f190f96b3f9c5066a9dd2fa25a8b13dd2d92"
Sep 11 16:33:24.949255 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.949235    2581 scope.go:117] "RemoveContainer" containerID="70569ff185520ec6660b36f076d8965a2d3c93c5f339624b8a702c04b20cc5e9"
Sep 11 16:33:24.955959 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.955942    2581 scope.go:117] "RemoveContainer" containerID="60d755e3dc3846bb1c54d3239f83a38ef36cf5da12995076f0326a1ef54bd528"
Sep 11 16:33:24.961012 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.960954    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 16:33:24.963552 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.963530    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 16:33:24.964022 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.964009    2581 scope.go:117] "RemoveContainer" containerID="efb35328c6dd5468e6a56924ca1fe7cbe726b8ecd6d6f6fc7000c025cb54bb8d"
Sep 11 16:33:24.971326 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.971311    2581 scope.go:117] "RemoveContainer" containerID="4f5eac5a30eb689a6afd82bf12d1c6af2341a155b71cc2b195df6af0088a0064"
Sep 11 16:33:24.986546 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:24.986525    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73e15b09-50ce-4799-87ca-ebe117cf68ea" path="/var/lib/kubelet/pods/73e15b09-50ce-4799-87ca-ebe117cf68ea/volumes"
Sep 11 16:33:25.001298 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.001271    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 16:33:25.001568 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.001557    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73e15b09-50ce-4799-87ca-ebe117cf68ea" containerName="init-config-reloader"
Sep 11 16:33:25.001606 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.001570    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="73e15b09-50ce-4799-87ca-ebe117cf68ea" containerName="init-config-reloader"
Sep 11 16:33:25.001606 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.001582    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73e15b09-50ce-4799-87ca-ebe117cf68ea" containerName="thanos-sidecar"
Sep 11 16:33:25.001606 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.001588    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="73e15b09-50ce-4799-87ca-ebe117cf68ea" containerName="thanos-sidecar"
Sep 11 16:33:25.001606 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.001598    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a58412b0-2955-4fb1-bdda-f3b1eb8c92a1" containerName="console"
Sep 11 16:33:25.001606 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.001603    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a58412b0-2955-4fb1-bdda-f3b1eb8c92a1" containerName="console"
Sep 11 16:33:25.001812 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.001609    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73e15b09-50ce-4799-87ca-ebe117cf68ea" containerName="kube-rbac-proxy-web"
Sep 11 16:33:25.001812 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.001614    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="73e15b09-50ce-4799-87ca-ebe117cf68ea" containerName="kube-rbac-proxy-web"
Sep 11 16:33:25.001812 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.001620    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73e15b09-50ce-4799-87ca-ebe117cf68ea" containerName="kube-rbac-proxy"
Sep 11 16:33:25.001812 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.001625    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="73e15b09-50ce-4799-87ca-ebe117cf68ea" containerName="kube-rbac-proxy"
Sep 11 16:33:25.001812 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.001633    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73e15b09-50ce-4799-87ca-ebe117cf68ea" containerName="prometheus"
Sep 11 16:33:25.001812 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.001640    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="73e15b09-50ce-4799-87ca-ebe117cf68ea" containerName="prometheus"
Sep 11 16:33:25.001812 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.001645    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73e15b09-50ce-4799-87ca-ebe117cf68ea" containerName="config-reloader"
Sep 11 16:33:25.001812 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.001650    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="73e15b09-50ce-4799-87ca-ebe117cf68ea" containerName="config-reloader"
Sep 11 16:33:25.001812 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.001657    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06f8ba29-d5d1-4375-8b41-d900e0738e70" containerName="registry"
Sep 11 16:33:25.001812 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.001661    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="06f8ba29-d5d1-4375-8b41-d900e0738e70" containerName="registry"
Sep 11 16:33:25.001812 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.001669    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d" containerName="console"
Sep 11 16:33:25.001812 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.001674    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d" containerName="console"
Sep 11 16:33:25.001812 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.001681    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73e15b09-50ce-4799-87ca-ebe117cf68ea" containerName="kube-rbac-proxy-thanos"
Sep 11 16:33:25.001812 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.001685    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="73e15b09-50ce-4799-87ca-ebe117cf68ea" containerName="kube-rbac-proxy-thanos"
Sep 11 16:33:25.001812 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.001730    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="73e15b09-50ce-4799-87ca-ebe117cf68ea" containerName="kube-rbac-proxy-web"
Sep 11 16:33:25.001812 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.001738    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="73e15b09-50ce-4799-87ca-ebe117cf68ea" containerName="kube-rbac-proxy"
Sep 11 16:33:25.001812 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.001745    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="73e15b09-50ce-4799-87ca-ebe117cf68ea" containerName="thanos-sidecar"
Sep 11 16:33:25.001812 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.001750    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a58412b0-2955-4fb1-bdda-f3b1eb8c92a1" containerName="console"
Sep 11 16:33:25.001812 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.001756    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="73e15b09-50ce-4799-87ca-ebe117cf68ea" containerName="kube-rbac-proxy-thanos"
Sep 11 16:33:25.001812 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.001762    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="73e15b09-50ce-4799-87ca-ebe117cf68ea" containerName="prometheus"
Sep 11 16:33:25.001812 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.001767    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="06f8ba29-d5d1-4375-8b41-d900e0738e70" containerName="registry"
Sep 11 16:33:25.001812 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.001773    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f39b4b9c-a5b7-41ae-8f22-8a8b48de9b2d" containerName="console"
Sep 11 16:33:25.001812 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.001780    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="73e15b09-50ce-4799-87ca-ebe117cf68ea" containerName="config-reloader"
Sep 11 16:33:25.004741 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.004725    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.009732 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.009715    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 11 16:33:25.009936 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.009916    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 11 16:33:25.010102 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.009949    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 11 16:33:25.010102 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.009986    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 11 16:33:25.010384 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.010361    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 11 16:33:25.010486 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.010456    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7nofbaqbboh63\""
Sep 11 16:33:25.011800 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.011778    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 11 16:33:25.012227 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.012212    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 11 16:33:25.012277 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.012233    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 11 16:33:25.013041 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.013024    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-6k2cd\""
Sep 11 16:33:25.013323 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.013306    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 11 16:33:25.013402 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.013306    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 11 16:33:25.013402 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.013352    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 11 16:33:25.013402 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.013379    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 11 16:33:25.013546 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.013306    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 11 16:33:25.014878 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.014861    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 11 16:33:25.019880 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.019863    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 11 16:33:25.030361 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.030340    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/75bc9382-5461-4180-b8fa-a6ae3a336994-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.030424 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.030366    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/75bc9382-5461-4180-b8fa-a6ae3a336994-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.030424 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.030382    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/75bc9382-5461-4180-b8fa-a6ae3a336994-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.030485 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.030446    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75bc9382-5461-4180-b8fa-a6ae3a336994-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.030525 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.030485    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/75bc9382-5461-4180-b8fa-a6ae3a336994-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.030565 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.030536    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/75bc9382-5461-4180-b8fa-a6ae3a336994-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.030565 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.030559    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/75bc9382-5461-4180-b8fa-a6ae3a336994-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.030655 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.030587    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz5w4\" (UniqueName: \"kubernetes.io/projected/75bc9382-5461-4180-b8fa-a6ae3a336994-kube-api-access-cz5w4\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.030655 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.030630    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75bc9382-5461-4180-b8fa-a6ae3a336994-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.030809 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.030792    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75bc9382-5461-4180-b8fa-a6ae3a336994-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.030856 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.030822    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/75bc9382-5461-4180-b8fa-a6ae3a336994-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.030856 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.030836    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/75bc9382-5461-4180-b8fa-a6ae3a336994-config-out\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.030941 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.030868    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/75bc9382-5461-4180-b8fa-a6ae3a336994-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.030941 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.030921    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/75bc9382-5461-4180-b8fa-a6ae3a336994-config\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.030941 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.030936    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75bc9382-5461-4180-b8fa-a6ae3a336994-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.031123 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.031019    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/75bc9382-5461-4180-b8fa-a6ae3a336994-web-config\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.031123 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.031046    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/75bc9382-5461-4180-b8fa-a6ae3a336994-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.031123 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.031066    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/75bc9382-5461-4180-b8fa-a6ae3a336994-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.031123 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.031112    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/75bc9382-5461-4180-b8fa-a6ae3a336994-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.031268 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.031131    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/75bc9382-5461-4180-b8fa-a6ae3a336994-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.044676 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.044643    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 16:33:25.132419 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.132379    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/75bc9382-5461-4180-b8fa-a6ae3a336994-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.132419 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.132421    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/75bc9382-5461-4180-b8fa-a6ae3a336994-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.132647 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.132448    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cz5w4\" (UniqueName: \"kubernetes.io/projected/75bc9382-5461-4180-b8fa-a6ae3a336994-kube-api-access-cz5w4\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.132688 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.132650    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75bc9382-5461-4180-b8fa-a6ae3a336994-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.132688 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.132682    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75bc9382-5461-4180-b8fa-a6ae3a336994-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.132780 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.132715    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/75bc9382-5461-4180-b8fa-a6ae3a336994-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.132780 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.132740    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/75bc9382-5461-4180-b8fa-a6ae3a336994-config-out\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.132888 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.132776    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/75bc9382-5461-4180-b8fa-a6ae3a336994-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.132888 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.132814    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/75bc9382-5461-4180-b8fa-a6ae3a336994-config\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.132888 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.132818    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/75bc9382-5461-4180-b8fa-a6ae3a336994-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.132888 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.132846    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75bc9382-5461-4180-b8fa-a6ae3a336994-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.132888 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.132873    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/75bc9382-5461-4180-b8fa-a6ae3a336994-web-config\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.133170 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.132909    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/75bc9382-5461-4180-b8fa-a6ae3a336994-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.133170 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.132938    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/75bc9382-5461-4180-b8fa-a6ae3a336994-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.133170 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.132962    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/75bc9382-5461-4180-b8fa-a6ae3a336994-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.133170 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.132989    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/75bc9382-5461-4180-b8fa-a6ae3a336994-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.133170 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.133027    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/75bc9382-5461-4180-b8fa-a6ae3a336994-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.133170 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.133051    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/75bc9382-5461-4180-b8fa-a6ae3a336994-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.133170 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.133076    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/75bc9382-5461-4180-b8fa-a6ae3a336994-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.133170 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.133147    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75bc9382-5461-4180-b8fa-a6ae3a336994-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.133551 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.133178    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/75bc9382-5461-4180-b8fa-a6ae3a336994-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.133551 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.133447    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75bc9382-5461-4180-b8fa-a6ae3a336994-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.133551 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.133469    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75bc9382-5461-4180-b8fa-a6ae3a336994-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.135950 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.135132    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/75bc9382-5461-4180-b8fa-a6ae3a336994-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.136149 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.136123    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/75bc9382-5461-4180-b8fa-a6ae3a336994-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.136149 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.136138    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/75bc9382-5461-4180-b8fa-a6ae3a336994-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.136301 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.136251    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75bc9382-5461-4180-b8fa-a6ae3a336994-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.136920 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.136364    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75bc9382-5461-4180-b8fa-a6ae3a336994-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.136920 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.136535    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/75bc9382-5461-4180-b8fa-a6ae3a336994-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.136920 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.136810    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/75bc9382-5461-4180-b8fa-a6ae3a336994-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.136920 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.136873    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/75bc9382-5461-4180-b8fa-a6ae3a336994-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.137830 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.137785    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/75bc9382-5461-4180-b8fa-a6ae3a336994-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.138386 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.137914    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/75bc9382-5461-4180-b8fa-a6ae3a336994-config-out\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.138386 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.138001    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/75bc9382-5461-4180-b8fa-a6ae3a336994-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.138386 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.138346    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/75bc9382-5461-4180-b8fa-a6ae3a336994-web-config\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.138386 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.138378    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/75bc9382-5461-4180-b8fa-a6ae3a336994-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.138723 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.138699    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/75bc9382-5461-4180-b8fa-a6ae3a336994-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.139046 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.139027    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/75bc9382-5461-4180-b8fa-a6ae3a336994-config\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.139427 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.139412    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/75bc9382-5461-4180-b8fa-a6ae3a336994-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.144945 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.144927    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cz5w4\" (UniqueName: \"kubernetes.io/projected/75bc9382-5461-4180-b8fa-a6ae3a336994-kube-api-access-cz5w4\") pod \"prometheus-k8s-0\" (UID: \"75bc9382-5461-4180-b8fa-a6ae3a336994\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.314766 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.314663    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:25.601127 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.601104    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 16:33:25.602445 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:33:25.602417    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75bc9382_5461_4180_b8fa_a6ae3a336994.slice/crio-5c09934b076d353b0f1c34399020451a01bc79229e815082a132c06cc980e60c WatchSource:0}: Error finding container 5c09934b076d353b0f1c34399020451a01bc79229e815082a132c06cc980e60c: Status 404 returned error can't find the container with id 5c09934b076d353b0f1c34399020451a01bc79229e815082a132c06cc980e60c
Sep 11 16:33:25.932151 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.932026    2581 generic.go:356] "Generic (PLEG): container finished" podID="75bc9382-5461-4180-b8fa-a6ae3a336994" containerID="0c7409ac19f9df410089e02e3f788c17e883d1b6faf9e0e841c8ab078f253fb3" exitCode=0
Sep 11 16:33:25.932151 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.932114    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"75bc9382-5461-4180-b8fa-a6ae3a336994","Type":"ContainerDied","Data":"0c7409ac19f9df410089e02e3f788c17e883d1b6faf9e0e841c8ab078f253fb3"}
Sep 11 16:33:25.932646 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:25.932191    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"75bc9382-5461-4180-b8fa-a6ae3a336994","Type":"ContainerStarted","Data":"5c09934b076d353b0f1c34399020451a01bc79229e815082a132c06cc980e60c"}
Sep 11 16:33:26.941722 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:26.941676    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"75bc9382-5461-4180-b8fa-a6ae3a336994","Type":"ContainerStarted","Data":"8426a4336b02b04c6152018c69580911ba27312295e0447146b6826e01e07e2d"}
Sep 11 16:33:26.942123 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:26.941763    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"75bc9382-5461-4180-b8fa-a6ae3a336994","Type":"ContainerStarted","Data":"19b33c160a7d1ced67061cd323b43ed32f8c0eb60ca7fcfa0dc09f211777342c"}
Sep 11 16:33:26.942123 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:26.941804    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"75bc9382-5461-4180-b8fa-a6ae3a336994","Type":"ContainerStarted","Data":"886d28366962c47ce183c996617295f8917888c4c56d29e3590ecef521dc45d2"}
Sep 11 16:33:26.942123 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:26.941841    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"75bc9382-5461-4180-b8fa-a6ae3a336994","Type":"ContainerStarted","Data":"29498435e60e5b849d4eadacb87f1865bd28367a6f8af6bf5a3f952b061c0584"}
Sep 11 16:33:26.942123 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:26.941883    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"75bc9382-5461-4180-b8fa-a6ae3a336994","Type":"ContainerStarted","Data":"3d04ba257960dd2e95e38aa5f627be48df436c32a7016f3589050aa9149fc16e"}
Sep 11 16:33:26.942123 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:26.941919    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"75bc9382-5461-4180-b8fa-a6ae3a336994","Type":"ContainerStarted","Data":"8a7f7e9516affcf1eebaf2146eeea2c2c7955db8e51de73bb07d875228ce357b"}
Sep 11 16:33:26.943673 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:26.943645    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:26.978882 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:26.978819    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.959464686 podStartE2EDuration="2.978794151s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.329465ms" isStatefulPod=false podCreationTimestamp="2026-09-11 16:33:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:33:26.976860051 +0000 UTC m=+206.593617154" watchObservedRunningTime="2026-09-11 16:33:26.978794151 +0000 UTC m=+206.595551217"
Sep 11 16:33:27.044195 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:27.044164    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:27.144226 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:27.144191    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:27.216177 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:27.216038    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:29.909704 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:29.909669    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:30.013079 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:30.013043    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:30.315641 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:30.315606    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:33:36.804303 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:36.804258    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:41.104671 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:41.104638    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:56.588359 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:56.588319    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:56.654230 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:33:56.654200    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:34:12.329369 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:34:12.329333    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:34:12.423770 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:34:12.423742    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:34:24.533999 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:34:24.533924    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:34:25.315345 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:34:25.315306    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:34:25.331550 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:34:25.331521    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:34:26.203245 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:34:26.203217    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:34:34.346652 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:34:34.346613    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:34:35.217996 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:34:35.217960    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:34:38.341186 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:34:38.341155    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:34:38.451892 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:34:38.451859    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:34:41.266279 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:34:41.266250    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:34:41.368605 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:34:41.368576    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:34:41.659581 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:34:41.659497    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:34:41.785838 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:34:41.785810    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:34:43.507494 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:34:43.507463    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:34:43.716718 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:34:43.716688    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:34:43.841474 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:34:43.841394    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2lbsm"]
Sep 11 16:34:43.843875 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:34:43.843861    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-2lbsm"
Sep 11 16:34:43.846626 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:34:43.846604    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 11 16:34:43.846626 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:34:43.846620    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 11 16:34:43.848042 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:34:43.848028    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-l57nv\""
Sep 11 16:34:43.854137 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:34:43.854117    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2lbsm"]
Sep 11 16:34:44.010818 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:34:44.010770    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kx7w\" (UniqueName: \"kubernetes.io/projected/700f3a30-3626-4b5c-8f52-229478019ddf-kube-api-access-7kx7w\") pod \"cert-manager-webhook-6486ffd997-2lbsm\" (UID: \"700f3a30-3626-4b5c-8f52-229478019ddf\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2lbsm"
Sep 11 16:34:44.011000 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:34:44.010875    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/700f3a30-3626-4b5c-8f52-229478019ddf-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2lbsm\" (UID: \"700f3a30-3626-4b5c-8f52-229478019ddf\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2lbsm"
Sep 11 16:34:44.111332 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:34:44.111253    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kx7w\" (UniqueName: \"kubernetes.io/projected/700f3a30-3626-4b5c-8f52-229478019ddf-kube-api-access-7kx7w\") pod \"cert-manager-webhook-6486ffd997-2lbsm\" (UID: \"700f3a30-3626-4b5c-8f52-229478019ddf\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2lbsm"
Sep 11 16:34:44.111473 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:34:44.111354    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/700f3a30-3626-4b5c-8f52-229478019ddf-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2lbsm\" (UID: \"700f3a30-3626-4b5c-8f52-229478019ddf\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2lbsm"
Sep 11 16:34:44.122699 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:34:44.122676    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/700f3a30-3626-4b5c-8f52-229478019ddf-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2lbsm\" (UID: \"700f3a30-3626-4b5c-8f52-229478019ddf\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2lbsm"
Sep 11 16:34:44.122799 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:34:44.122719    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kx7w\" (UniqueName: \"kubernetes.io/projected/700f3a30-3626-4b5c-8f52-229478019ddf-kube-api-access-7kx7w\") pod \"cert-manager-webhook-6486ffd997-2lbsm\" (UID: \"700f3a30-3626-4b5c-8f52-229478019ddf\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2lbsm"
Sep 11 16:34:44.166791 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:34:44.166754    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-2lbsm"
Sep 11 16:34:44.446070 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:34:44.446044    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2lbsm"]
Sep 11 16:34:44.448627 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:34:44.448600    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod700f3a30_3626_4b5c_8f52_229478019ddf.slice/crio-e0e4c14f246874631ad3931ea30ea9eca4fc588a3b1d2c8ac3e66d9927274d53 WatchSource:0}: Error finding container e0e4c14f246874631ad3931ea30ea9eca4fc588a3b1d2c8ac3e66d9927274d53: Status 404 returned error can't find the container with id e0e4c14f246874631ad3931ea30ea9eca4fc588a3b1d2c8ac3e66d9927274d53
Sep 11 16:34:44.546347 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:34:44.546316    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:34:44.626365 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:34:44.626336    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:34:45.264816 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:34:45.264755    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-2lbsm" event={"ID":"700f3a30-3626-4b5c-8f52-229478019ddf","Type":"ContainerStarted","Data":"e0e4c14f246874631ad3931ea30ea9eca4fc588a3b1d2c8ac3e66d9927274d53"}
Sep 11 16:34:47.832257 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:34:47.832227    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:34:47.910729 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:34:47.910693    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:34:48.283457 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:34:48.283423    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-2lbsm" event={"ID":"700f3a30-3626-4b5c-8f52-229478019ddf","Type":"ContainerStarted","Data":"e1b47d58559a19301eadc96530460ce2a165be174ff3f646bb1140d56a8cca1c"}
Sep 11 16:34:48.283658 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:34:48.283615    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-2lbsm"
Sep 11 16:34:51.270632 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:34:51.270590    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:34:51.507849 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:34:51.507810    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:34:52.342333 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:34:52.342300    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:34:52.442517 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:34:52.442484    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:34:54.290888 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:34:54.290840    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-2lbsm"
Sep 11 16:34:54.310562 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:34:54.310487    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-2lbsm" podStartSLOduration=8.410980248 podStartE2EDuration="11.310470551s" totalImagesPullingTime="2.899490303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:34:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:34:48.302471995 +0000 UTC m=+287.919229061" watchObservedRunningTime="2026-09-11 16:34:54.310470551 +0000 UTC m=+293.927227618"
Sep 11 16:34:57.948925 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:34:57.948889    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:34:58.050488 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:34:58.050454    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:34:59.840613 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:34:59.840577    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:35:00.812725 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:00.812700    2581 kubelet.go:1648] "Image garbage collection succeeded"
Sep 11 16:35:10.064382 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:10.064344    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:35:15.071243 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:15.071209    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:35:15.177753 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:15.177723    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:35:15.612664 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:15.612629    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:35:16.347554 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:16.347518    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:35:16.444252 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:16.444219    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:35:16.502404 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:16.502369    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-665d69bffd-cgl5h"]
Sep 11 16:35:16.506073 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:16.506050    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-665d69bffd-cgl5h"
Sep 11 16:35:16.510689 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:16.510665    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 11 16:35:16.510813 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:16.510717    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 11 16:35:16.510813 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:16.510806    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 11 16:35:16.510923 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:16.510891    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-mvggq\""
Sep 11 16:35:16.511028 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:16.511013    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 11 16:35:16.526060 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:16.525989    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-665d69bffd-cgl5h"]
Sep 11 16:35:16.589126 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:16.589078    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/90cc4dbc-457c-4926-ac97-3ff3803f941e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-665d69bffd-cgl5h\" (UID: \"90cc4dbc-457c-4926-ac97-3ff3803f941e\") " pod="opendatahub/opendatahub-operator-controller-manager-665d69bffd-cgl5h"
Sep 11 16:35:16.589287 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:16.589140    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckgd4\" (UniqueName: \"kubernetes.io/projected/90cc4dbc-457c-4926-ac97-3ff3803f941e-kube-api-access-ckgd4\") pod \"opendatahub-operator-controller-manager-665d69bffd-cgl5h\" (UID: \"90cc4dbc-457c-4926-ac97-3ff3803f941e\") " pod="opendatahub/opendatahub-operator-controller-manager-665d69bffd-cgl5h"
Sep 11 16:35:16.589287 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:16.589193    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90cc4dbc-457c-4926-ac97-3ff3803f941e-tmp\") pod \"opendatahub-operator-controller-manager-665d69bffd-cgl5h\" (UID: \"90cc4dbc-457c-4926-ac97-3ff3803f941e\") " pod="opendatahub/opendatahub-operator-controller-manager-665d69bffd-cgl5h"
Sep 11 16:35:16.589287 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:16.589227    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90cc4dbc-457c-4926-ac97-3ff3803f941e-webhook-cert\") pod \"opendatahub-operator-controller-manager-665d69bffd-cgl5h\" (UID: \"90cc4dbc-457c-4926-ac97-3ff3803f941e\") " pod="opendatahub/opendatahub-operator-controller-manager-665d69bffd-cgl5h"
Sep 11 16:35:16.589287 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:16.589265    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/90cc4dbc-457c-4926-ac97-3ff3803f941e-manifests\") pod \"opendatahub-operator-controller-manager-665d69bffd-cgl5h\" (UID: \"90cc4dbc-457c-4926-ac97-3ff3803f941e\") " pod="opendatahub/opendatahub-operator-controller-manager-665d69bffd-cgl5h"
Sep 11 16:35:16.690568 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:16.690540    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/90cc4dbc-457c-4926-ac97-3ff3803f941e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-665d69bffd-cgl5h\" (UID: \"90cc4dbc-457c-4926-ac97-3ff3803f941e\") " pod="opendatahub/opendatahub-operator-controller-manager-665d69bffd-cgl5h"
Sep 11 16:35:16.690744 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:16.690588    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckgd4\" (UniqueName: \"kubernetes.io/projected/90cc4dbc-457c-4926-ac97-3ff3803f941e-kube-api-access-ckgd4\") pod \"opendatahub-operator-controller-manager-665d69bffd-cgl5h\" (UID: \"90cc4dbc-457c-4926-ac97-3ff3803f941e\") " pod="opendatahub/opendatahub-operator-controller-manager-665d69bffd-cgl5h"
Sep 11 16:35:16.690744 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:16.690611    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90cc4dbc-457c-4926-ac97-3ff3803f941e-tmp\") pod \"opendatahub-operator-controller-manager-665d69bffd-cgl5h\" (UID: \"90cc4dbc-457c-4926-ac97-3ff3803f941e\") " pod="opendatahub/opendatahub-operator-controller-manager-665d69bffd-cgl5h"
Sep 11 16:35:16.690744 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:16.690636    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90cc4dbc-457c-4926-ac97-3ff3803f941e-webhook-cert\") pod \"opendatahub-operator-controller-manager-665d69bffd-cgl5h\" (UID: \"90cc4dbc-457c-4926-ac97-3ff3803f941e\") " pod="opendatahub/opendatahub-operator-controller-manager-665d69bffd-cgl5h"
Sep 11 16:35:16.690744 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:16.690678    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/90cc4dbc-457c-4926-ac97-3ff3803f941e-manifests\") pod \"opendatahub-operator-controller-manager-665d69bffd-cgl5h\" (UID: \"90cc4dbc-457c-4926-ac97-3ff3803f941e\") " pod="opendatahub/opendatahub-operator-controller-manager-665d69bffd-cgl5h"
Sep 11 16:35:16.691177 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:16.691144    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/90cc4dbc-457c-4926-ac97-3ff3803f941e-manifests\") pod \"opendatahub-operator-controller-manager-665d69bffd-cgl5h\" (UID: \"90cc4dbc-457c-4926-ac97-3ff3803f941e\") " pod="opendatahub/opendatahub-operator-controller-manager-665d69bffd-cgl5h"
Sep 11 16:35:16.693184 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:16.693156    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90cc4dbc-457c-4926-ac97-3ff3803f941e-tmp\") pod \"opendatahub-operator-controller-manager-665d69bffd-cgl5h\" (UID: \"90cc4dbc-457c-4926-ac97-3ff3803f941e\") " pod="opendatahub/opendatahub-operator-controller-manager-665d69bffd-cgl5h"
Sep 11 16:35:16.693291 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:16.693259    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/90cc4dbc-457c-4926-ac97-3ff3803f941e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-665d69bffd-cgl5h\" (UID: \"90cc4dbc-457c-4926-ac97-3ff3803f941e\") " pod="opendatahub/opendatahub-operator-controller-manager-665d69bffd-cgl5h"
Sep 11 16:35:16.693496 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:16.693474    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90cc4dbc-457c-4926-ac97-3ff3803f941e-webhook-cert\") pod \"opendatahub-operator-controller-manager-665d69bffd-cgl5h\" (UID: \"90cc4dbc-457c-4926-ac97-3ff3803f941e\") " pod="opendatahub/opendatahub-operator-controller-manager-665d69bffd-cgl5h"
Sep 11 16:35:16.705856 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:16.705824    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckgd4\" (UniqueName: \"kubernetes.io/projected/90cc4dbc-457c-4926-ac97-3ff3803f941e-kube-api-access-ckgd4\") pod \"opendatahub-operator-controller-manager-665d69bffd-cgl5h\" (UID: \"90cc4dbc-457c-4926-ac97-3ff3803f941e\") " pod="opendatahub/opendatahub-operator-controller-manager-665d69bffd-cgl5h"
Sep 11 16:35:16.757818 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:16.757774    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:35:16.815992 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:16.815950    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-665d69bffd-cgl5h"
Sep 11 16:35:16.861993 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:16.861956    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:35:16.959035 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:16.958945    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:35:17.093029 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:17.092987    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:35:17.112455 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:17.112428    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-665d69bffd-cgl5h"]
Sep 11 16:35:17.114435 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:35:17.114403    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90cc4dbc_457c_4926_ac97_3ff3803f941e.slice/crio-45235cbd6152e6c515f248cb551b9e8f8f12d50c357a925781ccb78134cae3ca WatchSource:0}: Error finding container 45235cbd6152e6c515f248cb551b9e8f8f12d50c357a925781ccb78134cae3ca: Status 404 returned error can't find the container with id 45235cbd6152e6c515f248cb551b9e8f8f12d50c357a925781ccb78134cae3ca
Sep 11 16:35:17.116555 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:17.116536    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 16:35:17.203427 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:17.203394    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:35:17.329757 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:17.329673    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:35:17.406992 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:17.406956    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-665d69bffd-cgl5h" event={"ID":"90cc4dbc-457c-4926-ac97-3ff3803f941e","Type":"ContainerStarted","Data":"45235cbd6152e6c515f248cb551b9e8f8f12d50c357a925781ccb78134cae3ca"}
Sep 11 16:35:20.425811 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:20.425775    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-665d69bffd-cgl5h" event={"ID":"90cc4dbc-457c-4926-ac97-3ff3803f941e","Type":"ContainerStarted","Data":"7c4f8d37cce9017ee26134aa86d06ca18d4b4d131da1cda5633715c2735a9d1b"}
Sep 11 16:35:21.431798 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:21.431764    2581 generic.go:356] "Generic (PLEG): container finished" podID="90cc4dbc-457c-4926-ac97-3ff3803f941e" containerID="7c4f8d37cce9017ee26134aa86d06ca18d4b4d131da1cda5633715c2735a9d1b" exitCode=0
Sep 11 16:35:21.432257 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:21.431853    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-665d69bffd-cgl5h" event={"ID":"90cc4dbc-457c-4926-ac97-3ff3803f941e","Type":"ContainerDied","Data":"7c4f8d37cce9017ee26134aa86d06ca18d4b4d131da1cda5633715c2735a9d1b"}
Sep 11 16:35:22.438255 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:22.438220    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-665d69bffd-cgl5h" event={"ID":"90cc4dbc-457c-4926-ac97-3ff3803f941e","Type":"ContainerStarted","Data":"7adc8f1794e39f5963b87244902cf05e7bf7541ecab6ed6da016eca0e85add57"}
Sep 11 16:35:22.438657 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:22.438367    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-665d69bffd-cgl5h"
Sep 11 16:35:22.477970 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:22.477915    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-665d69bffd-cgl5h" podStartSLOduration=1.942573816 podStartE2EDuration="6.477899259s" totalImagesPullingTime="3.481206637s" totalInitContainerRuntime="1.054118806s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:35:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:35:22.477531386 +0000 UTC m=+322.094288470" watchObservedRunningTime="2026-09-11 16:35:22.477899259 +0000 UTC m=+322.094656326"
Sep 11 16:35:24.093330 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:24.093288    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:35:24.201673 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:24.201639    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:35:33.445365 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:33.445329    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-665d69bffd-cgl5h"
Sep 11 16:35:35.092240 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:35.092192    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:35:35.251164 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:35.251130    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:35:35.449204 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:35.449167    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:35:35.585766 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:35.585733    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5d87f6b9bb-2jpvk"]
Sep 11 16:35:35.592810 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:35.592781    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:35:35.594207 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:35.594190    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5d87f6b9bb-2jpvk"
Sep 11 16:35:35.597898 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:35.597879    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 11 16:35:35.598003 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:35.597897    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 11 16:35:35.598003 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:35.597943    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-c2gsl\""
Sep 11 16:35:35.609615 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:35.609595    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5d87f6b9bb-2jpvk"]
Sep 11 16:35:35.763904 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:35.763820    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c796fb9f-e246-4980-97b1-da83ad477c1f-tls-certs\") pod \"kube-auth-proxy-5d87f6b9bb-2jpvk\" (UID: \"c796fb9f-e246-4980-97b1-da83ad477c1f\") " pod="openshift-ingress/kube-auth-proxy-5d87f6b9bb-2jpvk"
Sep 11 16:35:35.763904 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:35.763885    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c796fb9f-e246-4980-97b1-da83ad477c1f-tmp\") pod \"kube-auth-proxy-5d87f6b9bb-2jpvk\" (UID: \"c796fb9f-e246-4980-97b1-da83ad477c1f\") " pod="openshift-ingress/kube-auth-proxy-5d87f6b9bb-2jpvk"
Sep 11 16:35:35.764083 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:35.763960    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8q9l\" (UniqueName: \"kubernetes.io/projected/c796fb9f-e246-4980-97b1-da83ad477c1f-kube-api-access-r8q9l\") pod \"kube-auth-proxy-5d87f6b9bb-2jpvk\" (UID: \"c796fb9f-e246-4980-97b1-da83ad477c1f\") " pod="openshift-ingress/kube-auth-proxy-5d87f6b9bb-2jpvk"
Sep 11 16:35:35.864745 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:35.864708    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c796fb9f-e246-4980-97b1-da83ad477c1f-tmp\") pod \"kube-auth-proxy-5d87f6b9bb-2jpvk\" (UID: \"c796fb9f-e246-4980-97b1-da83ad477c1f\") " pod="openshift-ingress/kube-auth-proxy-5d87f6b9bb-2jpvk"
Sep 11 16:35:35.864908 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:35.864764    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8q9l\" (UniqueName: \"kubernetes.io/projected/c796fb9f-e246-4980-97b1-da83ad477c1f-kube-api-access-r8q9l\") pod \"kube-auth-proxy-5d87f6b9bb-2jpvk\" (UID: \"c796fb9f-e246-4980-97b1-da83ad477c1f\") " pod="openshift-ingress/kube-auth-proxy-5d87f6b9bb-2jpvk"
Sep 11 16:35:35.864908 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:35.864791    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c796fb9f-e246-4980-97b1-da83ad477c1f-tls-certs\") pod \"kube-auth-proxy-5d87f6b9bb-2jpvk\" (UID: \"c796fb9f-e246-4980-97b1-da83ad477c1f\") " pod="openshift-ingress/kube-auth-proxy-5d87f6b9bb-2jpvk"
Sep 11 16:35:35.867141 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:35.867110    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c796fb9f-e246-4980-97b1-da83ad477c1f-tmp\") pod \"kube-auth-proxy-5d87f6b9bb-2jpvk\" (UID: \"c796fb9f-e246-4980-97b1-da83ad477c1f\") " pod="openshift-ingress/kube-auth-proxy-5d87f6b9bb-2jpvk"
Sep 11 16:35:35.867265 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:35.867248    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c796fb9f-e246-4980-97b1-da83ad477c1f-tls-certs\") pod \"kube-auth-proxy-5d87f6b9bb-2jpvk\" (UID: \"c796fb9f-e246-4980-97b1-da83ad477c1f\") " pod="openshift-ingress/kube-auth-proxy-5d87f6b9bb-2jpvk"
Sep 11 16:35:35.881859 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:35.881835    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8q9l\" (UniqueName: \"kubernetes.io/projected/c796fb9f-e246-4980-97b1-da83ad477c1f-kube-api-access-r8q9l\") pod \"kube-auth-proxy-5d87f6b9bb-2jpvk\" (UID: \"c796fb9f-e246-4980-97b1-da83ad477c1f\") " pod="openshift-ingress/kube-auth-proxy-5d87f6b9bb-2jpvk"
Sep 11 16:35:35.903301 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:35.903276    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5d87f6b9bb-2jpvk"
Sep 11 16:35:36.178672 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:36.178642    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5d87f6b9bb-2jpvk"]
Sep 11 16:35:36.179745 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:35:36.179720    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc796fb9f_e246_4980_97b1_da83ad477c1f.slice/crio-7bbe586f0b34f2ac8b85f92a7dbc7478458098a2f7082b0d85cbb391355c238d WatchSource:0}: Error finding container 7bbe586f0b34f2ac8b85f92a7dbc7478458098a2f7082b0d85cbb391355c238d: Status 404 returned error can't find the container with id 7bbe586f0b34f2ac8b85f92a7dbc7478458098a2f7082b0d85cbb391355c238d
Sep 11 16:35:36.502284 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:36.502247    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5d87f6b9bb-2jpvk" event={"ID":"c796fb9f-e246-4980-97b1-da83ad477c1f","Type":"ContainerStarted","Data":"7bbe586f0b34f2ac8b85f92a7dbc7478458098a2f7082b0d85cbb391355c238d"}
Sep 11 16:35:37.537707 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:37.537664    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:35:37.661705 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:37.661633    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:35:38.898978 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:38.898939    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:35:39.518552 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:39.518508    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5d87f6b9bb-2jpvk" event={"ID":"c796fb9f-e246-4980-97b1-da83ad477c1f","Type":"ContainerStarted","Data":"d7458f8b1e0755a4cd9db4a55dc0168756e33f2290b7e18df0136121366c466c"}
Sep 11 16:35:39.540898 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:39.540817    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5d87f6b9bb-2jpvk" podStartSLOduration=1.751125052 podStartE2EDuration="4.540797556s" totalImagesPullingTime="2.789672504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:35:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:35:39.540150828 +0000 UTC m=+339.156907906" watchObservedRunningTime="2026-09-11 16:35:39.540797556 +0000 UTC m=+339.157554623"
Sep 11 16:35:42.346773 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:42.346725    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:35:43.661931 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:43.661889    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:35:46.235596 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:46.235564    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:35:46.338283 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:46.338253    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:35:46.438181 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:46.437607    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:35:46.538417 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:46.538331    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:35:46.663296 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:46.663260    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:35:46.967497 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:46.967464    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:35:47.270998 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:47.270905    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:35:49.954109 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:49.954050    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:35:52.243631 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:52.243557    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:35:52.332305 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:52.332259    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:35:53.165039 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:53.164993    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5xm5"]
Sep 11 16:35:53.251074 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:53.251040    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5xm5"]
Sep 11 16:35:53.251544 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:53.251181    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5xm5"
Sep 11 16:35:53.257262 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:53.257232    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 11 16:35:53.259447 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:53.259425    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 16:35:53.260286 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:53.260271    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 11 16:35:53.260365 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:53.260299    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 11 16:35:53.260905 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:53.260888    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-d6p2s\""
Sep 11 16:35:53.314859 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:53.314821    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsrvk\" (UniqueName: \"kubernetes.io/projected/eb0ca823-78c9-4bd5-873d-3ba791e02fdc-kube-api-access-xsrvk\") pod \"istiod-openshift-gateway-5677ccb49b-s5xm5\" (UID: \"eb0ca823-78c9-4bd5-873d-3ba791e02fdc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5xm5"
Sep 11 16:35:53.314990 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:53.314877    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/eb0ca823-78c9-4bd5-873d-3ba791e02fdc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-s5xm5\" (UID: \"eb0ca823-78c9-4bd5-873d-3ba791e02fdc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5xm5"
Sep 11 16:35:53.314990 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:53.314961    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/eb0ca823-78c9-4bd5-873d-3ba791e02fdc-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-s5xm5\" (UID: \"eb0ca823-78c9-4bd5-873d-3ba791e02fdc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5xm5"
Sep 11 16:35:53.315118 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:53.314995    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/eb0ca823-78c9-4bd5-873d-3ba791e02fdc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-s5xm5\" (UID: \"eb0ca823-78c9-4bd5-873d-3ba791e02fdc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5xm5"
Sep 11 16:35:53.315118 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:53.315029    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb0ca823-78c9-4bd5-873d-3ba791e02fdc-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-s5xm5\" (UID: \"eb0ca823-78c9-4bd5-873d-3ba791e02fdc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5xm5"
Sep 11 16:35:53.315229 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:53.315139    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eb0ca823-78c9-4bd5-873d-3ba791e02fdc-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-s5xm5\" (UID: \"eb0ca823-78c9-4bd5-873d-3ba791e02fdc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5xm5"
Sep 11 16:35:53.315229 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:53.315182    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb0ca823-78c9-4bd5-873d-3ba791e02fdc-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-s5xm5\" (UID: \"eb0ca823-78c9-4bd5-873d-3ba791e02fdc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5xm5"
Sep 11 16:35:53.415896 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:53.415834    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb0ca823-78c9-4bd5-873d-3ba791e02fdc-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-s5xm5\" (UID: \"eb0ca823-78c9-4bd5-873d-3ba791e02fdc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5xm5"
Sep 11 16:35:53.415896 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:53.415879    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eb0ca823-78c9-4bd5-873d-3ba791e02fdc-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-s5xm5\" (UID: \"eb0ca823-78c9-4bd5-873d-3ba791e02fdc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5xm5"
Sep 11 16:35:53.416073 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:53.415903    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb0ca823-78c9-4bd5-873d-3ba791e02fdc-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-s5xm5\" (UID: \"eb0ca823-78c9-4bd5-873d-3ba791e02fdc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5xm5"
Sep 11 16:35:53.416073 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:53.416018    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsrvk\" (UniqueName: \"kubernetes.io/projected/eb0ca823-78c9-4bd5-873d-3ba791e02fdc-kube-api-access-xsrvk\") pod \"istiod-openshift-gateway-5677ccb49b-s5xm5\" (UID: \"eb0ca823-78c9-4bd5-873d-3ba791e02fdc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5xm5"
Sep 11 16:35:53.416450 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:53.416110    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/eb0ca823-78c9-4bd5-873d-3ba791e02fdc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-s5xm5\" (UID: \"eb0ca823-78c9-4bd5-873d-3ba791e02fdc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5xm5"
Sep 11 16:35:53.416450 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:53.416147    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/eb0ca823-78c9-4bd5-873d-3ba791e02fdc-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-s5xm5\" (UID: \"eb0ca823-78c9-4bd5-873d-3ba791e02fdc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5xm5"
Sep 11 16:35:53.416450 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:53.416183    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/eb0ca823-78c9-4bd5-873d-3ba791e02fdc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-s5xm5\" (UID: \"eb0ca823-78c9-4bd5-873d-3ba791e02fdc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5xm5"
Sep 11 16:35:53.417072 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:53.417045    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/eb0ca823-78c9-4bd5-873d-3ba791e02fdc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-s5xm5\" (UID: \"eb0ca823-78c9-4bd5-873d-3ba791e02fdc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5xm5"
Sep 11 16:35:53.418461 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:53.418438    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb0ca823-78c9-4bd5-873d-3ba791e02fdc-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-s5xm5\" (UID: \"eb0ca823-78c9-4bd5-873d-3ba791e02fdc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5xm5"
Sep 11 16:35:53.418598 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:53.418579    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/eb0ca823-78c9-4bd5-873d-3ba791e02fdc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-s5xm5\" (UID: \"eb0ca823-78c9-4bd5-873d-3ba791e02fdc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5xm5"
Sep 11 16:35:53.418671 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:53.418599    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eb0ca823-78c9-4bd5-873d-3ba791e02fdc-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-s5xm5\" (UID: \"eb0ca823-78c9-4bd5-873d-3ba791e02fdc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5xm5"
Sep 11 16:35:53.418729 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:53.418686    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/eb0ca823-78c9-4bd5-873d-3ba791e02fdc-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-s5xm5\" (UID: \"eb0ca823-78c9-4bd5-873d-3ba791e02fdc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5xm5"
Sep 11 16:35:53.425667 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:53.425647    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsrvk\" (UniqueName: \"kubernetes.io/projected/eb0ca823-78c9-4bd5-873d-3ba791e02fdc-kube-api-access-xsrvk\") pod \"istiod-openshift-gateway-5677ccb49b-s5xm5\" (UID: \"eb0ca823-78c9-4bd5-873d-3ba791e02fdc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5xm5"
Sep 11 16:35:53.425763 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:53.425672    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb0ca823-78c9-4bd5-873d-3ba791e02fdc-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-s5xm5\" (UID: \"eb0ca823-78c9-4bd5-873d-3ba791e02fdc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5xm5"
Sep 11 16:35:53.560815 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:53.560781    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5xm5"
Sep 11 16:35:53.885689 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:35:53.885659    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb0ca823_78c9_4bd5_873d_3ba791e02fdc.slice/crio-a9f4f44d84ddcbf51c410b8d528a8bc37e42193d5ea8a1232f54be4d0ea1399a WatchSource:0}: Error finding container a9f4f44d84ddcbf51c410b8d528a8bc37e42193d5ea8a1232f54be4d0ea1399a: Status 404 returned error can't find the container with id a9f4f44d84ddcbf51c410b8d528a8bc37e42193d5ea8a1232f54be4d0ea1399a
Sep 11 16:35:53.889153 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:53.889130    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5xm5"]
Sep 11 16:35:54.586835 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:54.586789    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5xm5" event={"ID":"eb0ca823-78c9-4bd5-873d-3ba791e02fdc","Type":"ContainerStarted","Data":"a9f4f44d84ddcbf51c410b8d528a8bc37e42193d5ea8a1232f54be4d0ea1399a"}
Sep 11 16:35:55.206364 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:55.206327    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5bd998d9c-pxjl2"]
Sep 11 16:35:55.208922 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:55.208900    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5bd998d9c-pxjl2"
Sep 11 16:35:55.213506 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:55.213485    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 11 16:35:55.216323 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:55.216305    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 11 16:35:55.216651 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:55.216633    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 11 16:35:55.216651 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:55.216644    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 11 16:35:55.216827 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:55.216803    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 11 16:35:55.217042 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:55.216982    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-gw54b\""
Sep 11 16:35:55.232826 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:55.232787    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5bd998d9c-pxjl2"]
Sep 11 16:35:55.234079 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:55.234054    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krj9m\" (UniqueName: \"kubernetes.io/projected/178b8fe3-4bf4-4532-9141-2267293535af-kube-api-access-krj9m\") pod \"lws-controller-manager-5bd998d9c-pxjl2\" (UID: \"178b8fe3-4bf4-4532-9141-2267293535af\") " pod="openshift-lws-operator/lws-controller-manager-5bd998d9c-pxjl2"
Sep 11 16:35:55.234213 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:55.234186    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/178b8fe3-4bf4-4532-9141-2267293535af-manager-config\") pod \"lws-controller-manager-5bd998d9c-pxjl2\" (UID: \"178b8fe3-4bf4-4532-9141-2267293535af\") " pod="openshift-lws-operator/lws-controller-manager-5bd998d9c-pxjl2"
Sep 11 16:35:55.234278 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:55.234214    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/178b8fe3-4bf4-4532-9141-2267293535af-metrics-cert\") pod \"lws-controller-manager-5bd998d9c-pxjl2\" (UID: \"178b8fe3-4bf4-4532-9141-2267293535af\") " pod="openshift-lws-operator/lws-controller-manager-5bd998d9c-pxjl2"
Sep 11 16:35:55.234335 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:55.234278    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/178b8fe3-4bf4-4532-9141-2267293535af-cert\") pod \"lws-controller-manager-5bd998d9c-pxjl2\" (UID: \"178b8fe3-4bf4-4532-9141-2267293535af\") " pod="openshift-lws-operator/lws-controller-manager-5bd998d9c-pxjl2"
Sep 11 16:35:55.335332 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:55.335301    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/178b8fe3-4bf4-4532-9141-2267293535af-manager-config\") pod \"lws-controller-manager-5bd998d9c-pxjl2\" (UID: \"178b8fe3-4bf4-4532-9141-2267293535af\") " pod="openshift-lws-operator/lws-controller-manager-5bd998d9c-pxjl2"
Sep 11 16:35:55.335526 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:55.335338    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/178b8fe3-4bf4-4532-9141-2267293535af-metrics-cert\") pod \"lws-controller-manager-5bd998d9c-pxjl2\" (UID: \"178b8fe3-4bf4-4532-9141-2267293535af\") " pod="openshift-lws-operator/lws-controller-manager-5bd998d9c-pxjl2"
Sep 11 16:35:55.335526 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:55.335411    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/178b8fe3-4bf4-4532-9141-2267293535af-cert\") pod \"lws-controller-manager-5bd998d9c-pxjl2\" (UID: \"178b8fe3-4bf4-4532-9141-2267293535af\") " pod="openshift-lws-operator/lws-controller-manager-5bd998d9c-pxjl2"
Sep 11 16:35:55.335526 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:55.335459    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krj9m\" (UniqueName: \"kubernetes.io/projected/178b8fe3-4bf4-4532-9141-2267293535af-kube-api-access-krj9m\") pod \"lws-controller-manager-5bd998d9c-pxjl2\" (UID: \"178b8fe3-4bf4-4532-9141-2267293535af\") " pod="openshift-lws-operator/lws-controller-manager-5bd998d9c-pxjl2"
Sep 11 16:35:55.335996 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:55.335972    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/178b8fe3-4bf4-4532-9141-2267293535af-manager-config\") pod \"lws-controller-manager-5bd998d9c-pxjl2\" (UID: \"178b8fe3-4bf4-4532-9141-2267293535af\") " pod="openshift-lws-operator/lws-controller-manager-5bd998d9c-pxjl2"
Sep 11 16:35:55.337914 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:55.337871    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/178b8fe3-4bf4-4532-9141-2267293535af-cert\") pod \"lws-controller-manager-5bd998d9c-pxjl2\" (UID: \"178b8fe3-4bf4-4532-9141-2267293535af\") " pod="openshift-lws-operator/lws-controller-manager-5bd998d9c-pxjl2"
Sep 11 16:35:55.337914 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:55.337885    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/178b8fe3-4bf4-4532-9141-2267293535af-metrics-cert\") pod \"lws-controller-manager-5bd998d9c-pxjl2\" (UID: \"178b8fe3-4bf4-4532-9141-2267293535af\") " pod="openshift-lws-operator/lws-controller-manager-5bd998d9c-pxjl2"
Sep 11 16:35:55.355550 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:55.355524    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krj9m\" (UniqueName: \"kubernetes.io/projected/178b8fe3-4bf4-4532-9141-2267293535af-kube-api-access-krj9m\") pod \"lws-controller-manager-5bd998d9c-pxjl2\" (UID: \"178b8fe3-4bf4-4532-9141-2267293535af\") " pod="openshift-lws-operator/lws-controller-manager-5bd998d9c-pxjl2"
Sep 11 16:35:55.521576 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:55.521488    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5bd998d9c-pxjl2"
Sep 11 16:35:56.237081 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:56.237040    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 16:35:56.237466 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:56.237133    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 16:35:56.465532 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:56.465500    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5bd998d9c-pxjl2"]
Sep 11 16:35:56.466293 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:35:56.466263    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod178b8fe3_4bf4_4532_9141_2267293535af.slice/crio-5ed27fd1b494c33a223e35397b4c43d11124deccc29c22bad3b09ae7d2bf39ef WatchSource:0}: Error finding container 5ed27fd1b494c33a223e35397b4c43d11124deccc29c22bad3b09ae7d2bf39ef: Status 404 returned error can't find the container with id 5ed27fd1b494c33a223e35397b4c43d11124deccc29c22bad3b09ae7d2bf39ef
Sep 11 16:35:56.605320 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:56.605273    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5xm5" event={"ID":"eb0ca823-78c9-4bd5-873d-3ba791e02fdc","Type":"ContainerStarted","Data":"14756bc7c9e7542a0c514a74a8c46bb72e425cea30504e998810a47cd49587e1"}
Sep 11 16:35:56.605479 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:56.605412    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5xm5"
Sep 11 16:35:56.606674 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:56.606645    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5bd998d9c-pxjl2" event={"ID":"178b8fe3-4bf4-4532-9141-2267293535af","Type":"ContainerStarted","Data":"5ed27fd1b494c33a223e35397b4c43d11124deccc29c22bad3b09ae7d2bf39ef"}
Sep 11 16:35:56.659422 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:56.659359    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5xm5" podStartSLOduration=1.310531396 podStartE2EDuration="3.659341868s" totalImagesPullingTime="2.348810472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:35:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:35:56.658308312 +0000 UTC m=+356.275065404" watchObservedRunningTime="2026-09-11 16:35:56.659341868 +0000 UTC m=+356.276098936"
Sep 11 16:35:57.489031 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:57.488979    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:35:57.616658 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:57.616321    2581 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-s5xm5 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 16:35:57.616658 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:57.616392    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5xm5" podUID="eb0ca823-78c9-4bd5-873d-3ba791e02fdc" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 16:35:57.753975 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:57.753895    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:35:57.961955 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:57.961924    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:35:58.141792 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:58.141718    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:35:59.253270 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:59.253232    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:35:59.457784 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:59.457753    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:35:59.625267 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:59.625181    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5bd998d9c-pxjl2" event={"ID":"178b8fe3-4bf4-4532-9141-2267293535af","Type":"ContainerStarted","Data":"6a419d7e3a64549f4db8bc9a974219afbb6763a1bbae6a54192314da303f9073"}
Sep 11 16:35:59.625424 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:59.625315    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5bd998d9c-pxjl2"
Sep 11 16:35:59.694506 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:59.694454    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5bd998d9c-pxjl2" podStartSLOduration=2.235919626 podStartE2EDuration="4.694438988s" totalImagesPullingTime="2.458519362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:35:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:35:59.69115427 +0000 UTC m=+359.307911337" watchObservedRunningTime="2026-09-11 16:35:59.694438988 +0000 UTC m=+359.311196055"
Sep 11 16:35:59.695386 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:35:59.695364    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:36:00.615474 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:36:00.615445    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5xm5"
Sep 11 16:36:10.632369 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:36:10.632339    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5bd998d9c-pxjl2"
Sep 11 16:36:46.109533 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:36:46.109498    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:36:46.174609 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:36:46.174583    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:36:47.199278 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:36:47.199248    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:36:47.307882 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:36:47.307846    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:01.114390 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:37:01.114354    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:01.604659 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:37:01.604628    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:01.700159 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:37:01.700131    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:01.961757 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:37:01.961726    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:04.614309 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:37:04.614275    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:05.147840 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:37:05.147810    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:05.531755 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:37:05.531711    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:05.919711 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:37:05.919633    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:06.864863 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:37:06.864836    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:09.376121 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:37:09.376072    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:09.658850 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:37:09.658754    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:11.579900 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:37:11.579866    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:12.186525 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:37:12.186496    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:13.029354 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:37:13.029281    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:13.227050 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:37:13.226994    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:14.565170 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:37:14.565137    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:14.666371 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:37:14.666308    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:14.956469 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:37:14.956439    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:15.058250 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:37:15.058221    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:19.302066 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:37:19.302034    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:19.402054 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:37:19.402018    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:19.979580 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:37:19.979550    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:20.082568 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:37:20.082540    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:20.967548 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:37:20.967504    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:21.074462 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:37:21.074432    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:26.272585 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:37:26.272434    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:26.392689 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:37:26.392656    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:26.548413 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:37:26.548336    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:26.662896 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:37:26.662862    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:28.775294 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:37:28.775252    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:28.873990 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:37:28.873955    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:33.426380 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:37:33.426337    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:33.526980 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:37:33.526943    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:39.315111 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:37:39.315059    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:39.416012 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:37:39.415955    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:39.732652 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:37:39.732621    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:39.855545 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:37:39.855503    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:40.151686 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:37:40.151581    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:40.258285 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:37:40.258255    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:42.626017 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:37:42.625985    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:42.749286 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:37:42.749249    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:46.176763 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:37:46.176725    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:46.297962 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:37:46.297900    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:48.714822 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:37:48.714788    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:48.844580 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:37:48.844546    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:38:01.286585 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:38:01.286534    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:38:11.694553 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:38:11.694518    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:38:11.949463 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:38:11.949353    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:38:16.250539 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:38:16.250507    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:38:16.354489 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:38:16.354460    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:38:16.453838 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:38:16.453795    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:38:17.267309 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:38:17.267264    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:38:17.359198 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:38:17.359165    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:38:32.404689 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:38:32.404650    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:38:32.533645 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:38:32.533611    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:38:32.869899 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:38:32.869868    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:38:42.689653 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:38:42.689622    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:38:42.985965 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:38:42.985882    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:38:50.512077 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:38:50.512047    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:38:50.635710 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:38:50.635679    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:38:50.745306 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:38:50.745274    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:38:51.061036 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:38:51.060987    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:38:51.160244 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:38:51.160210    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:38:54.575559 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:38:54.575453    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:38:54.677326 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:38:54.677288    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:39:16.743614 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:39:16.743583    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:39:26.533076 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:39:26.533046    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:39:26.917194 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:39:26.917110    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:39:27.071286 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:39:27.071257    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:39:27.688586 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:39:27.688551    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:39:28.521024 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:39:28.520991    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:39:28.645700 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:39:28.645670    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:39:28.785379 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:39:28.785287    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:39:28.938006 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:39:28.937974    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:39:29.427283 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:39:29.427250    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:39:29.524782 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:39:29.524741    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:39:38.599246 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:39:38.599204    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:39:38.708104 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:39:38.708044    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:39:49.102108 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:39:49.102061    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:39:58.476431 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:39:58.476378    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:40:10.895194 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:40:10.895154    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:40:22.443831 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:40:22.443757    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:40:23.968682 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:40:23.968647    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:40:31.243180 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:40:31.243150    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:40:34.518655 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:40:34.518626    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:40:40.729570 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:40:40.729535    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-2sxz7"]
Sep 11 16:40:40.731881 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:40:40.731865    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2sxz7"
Sep 11 16:40:40.735841 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:40:40.735817    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-47mg7\""
Sep 11 16:40:40.735976 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:40:40.735881    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 11 16:40:40.735976 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:40:40.735893    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 11 16:40:40.735976 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:40:40.735903    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 11 16:40:40.746830 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:40:40.746810    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-2sxz7"]
Sep 11 16:40:40.779451 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:40:40.779426    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:40:40.836779 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:40:40.836742    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1febd99-c9df-4c7f-813c-9747b1b7b424-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2sxz7\" (UID: \"c1febd99-c9df-4c7f-813c-9747b1b7b424\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2sxz7"
Sep 11 16:40:40.836975 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:40:40.836805    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1febd99-c9df-4c7f-813c-9747b1b7b424-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2sxz7\" (UID: \"c1febd99-c9df-4c7f-813c-9747b1b7b424\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2sxz7"
Sep 11 16:40:40.836975 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:40:40.836836    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1febd99-c9df-4c7f-813c-9747b1b7b424-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2sxz7\" (UID: \"c1febd99-c9df-4c7f-813c-9747b1b7b424\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2sxz7"
Sep 11 16:40:40.836975 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:40:40.836855    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1febd99-c9df-4c7f-813c-9747b1b7b424-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2sxz7\" (UID: \"c1febd99-c9df-4c7f-813c-9747b1b7b424\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2sxz7"
Sep 11 16:40:40.836975 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:40:40.836875    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jxbq\" (UniqueName: \"kubernetes.io/projected/c1febd99-c9df-4c7f-813c-9747b1b7b424-kube-api-access-9jxbq\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2sxz7\" (UID: \"c1febd99-c9df-4c7f-813c-9747b1b7b424\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2sxz7"
Sep 11 16:40:40.837167 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:40:40.836976    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1febd99-c9df-4c7f-813c-9747b1b7b424-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2sxz7\" (UID: \"c1febd99-c9df-4c7f-813c-9747b1b7b424\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2sxz7"
Sep 11 16:40:40.937506 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:40:40.937468    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1febd99-c9df-4c7f-813c-9747b1b7b424-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2sxz7\" (UID: \"c1febd99-c9df-4c7f-813c-9747b1b7b424\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2sxz7"
Sep 11 16:40:40.937701 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:40:40.937519    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1febd99-c9df-4c7f-813c-9747b1b7b424-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2sxz7\" (UID: \"c1febd99-c9df-4c7f-813c-9747b1b7b424\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2sxz7"
Sep 11 16:40:40.937701 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:40:40.937556    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1febd99-c9df-4c7f-813c-9747b1b7b424-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2sxz7\" (UID: \"c1febd99-c9df-4c7f-813c-9747b1b7b424\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2sxz7"
Sep 11 16:40:40.937701 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:40:40.937573    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1febd99-c9df-4c7f-813c-9747b1b7b424-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2sxz7\" (UID: \"c1febd99-c9df-4c7f-813c-9747b1b7b424\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2sxz7"
Sep 11 16:40:40.937701 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:40:40.937590    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1febd99-c9df-4c7f-813c-9747b1b7b424-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2sxz7\" (UID: \"c1febd99-c9df-4c7f-813c-9747b1b7b424\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2sxz7"
Sep 11 16:40:40.937701 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:40:40.937613    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jxbq\" (UniqueName: \"kubernetes.io/projected/c1febd99-c9df-4c7f-813c-9747b1b7b424-kube-api-access-9jxbq\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2sxz7\" (UID: \"c1febd99-c9df-4c7f-813c-9747b1b7b424\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2sxz7"
Sep 11 16:40:40.938403 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:40:40.938374    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1febd99-c9df-4c7f-813c-9747b1b7b424-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2sxz7\" (UID: \"c1febd99-c9df-4c7f-813c-9747b1b7b424\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2sxz7"
Sep 11 16:40:40.938529 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:40:40.938452    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1febd99-c9df-4c7f-813c-9747b1b7b424-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2sxz7\" (UID: \"c1febd99-c9df-4c7f-813c-9747b1b7b424\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2sxz7"
Sep 11 16:40:40.938529 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:40:40.938382    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1febd99-c9df-4c7f-813c-9747b1b7b424-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2sxz7\" (UID: \"c1febd99-c9df-4c7f-813c-9747b1b7b424\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2sxz7"
Sep 11 16:40:40.941217 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:40:40.941193    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1febd99-c9df-4c7f-813c-9747b1b7b424-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2sxz7\" (UID: \"c1febd99-c9df-4c7f-813c-9747b1b7b424\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2sxz7"
Sep 11 16:40:40.942399 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:40:40.942376    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1febd99-c9df-4c7f-813c-9747b1b7b424-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2sxz7\" (UID: \"c1febd99-c9df-4c7f-813c-9747b1b7b424\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2sxz7"
Sep 11 16:40:40.947721 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:40:40.947698    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jxbq\" (UniqueName: \"kubernetes.io/projected/c1febd99-c9df-4c7f-813c-9747b1b7b424-kube-api-access-9jxbq\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2sxz7\" (UID: \"c1febd99-c9df-4c7f-813c-9747b1b7b424\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2sxz7"
Sep 11 16:40:41.042123 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:40:41.042023    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2sxz7"
Sep 11 16:40:41.320356 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:40:41.320242    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-2sxz7"]
Sep 11 16:40:41.323871 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:40:41.323783    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1febd99_c9df_4c7f_813c_9747b1b7b424.slice/crio-c36ad2377118d0a09e588beaa4144413c5770bbe523ddb41ead469b8510395b4 WatchSource:0}: Error finding container c36ad2377118d0a09e588beaa4144413c5770bbe523ddb41ead469b8510395b4: Status 404 returned error can't find the container with id c36ad2377118d0a09e588beaa4144413c5770bbe523ddb41ead469b8510395b4
Sep 11 16:40:41.325245 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:40:41.325223    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 16:40:41.868250 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:40:41.868216    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2sxz7" event={"ID":"c1febd99-c9df-4c7f-813c-9747b1b7b424","Type":"ContainerStarted","Data":"c36ad2377118d0a09e588beaa4144413c5770bbe523ddb41ead469b8510395b4"}
Sep 11 16:40:42.874389 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:40:42.874350    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2sxz7" event={"ID":"c1febd99-c9df-4c7f-813c-9747b1b7b424","Type":"ContainerStarted","Data":"6aaffe9589d7b5cd176e8d287fa2d5593ddbfb25fed36293158eebdfa43f0227"}
Sep 11 16:40:42.897607 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:40:42.897547    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2sxz7" podStartSLOduration=1.993030422 podStartE2EDuration="2.897528335s" totalImagesPullingTime="904.497913ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:40:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:40:42.895270329 +0000 UTC m=+642.512027421" watchObservedRunningTime="2026-09-11 16:40:42.897528335 +0000 UTC m=+642.514285400"
Sep 11 16:40:47.133783 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:40:47.133742    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:40:48.136685 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:40:48.136651    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:40:51.042314 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:40:51.042279    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2sxz7"
Sep 11 16:40:51.042701 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:40:51.042335    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2sxz7"
Sep 11 16:40:51.054548 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:40:51.054524    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2sxz7"
Sep 11 16:40:51.925488 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:40:51.925453    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2sxz7"
Sep 11 16:40:52.451134 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:40:52.451079    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:42:00.077265 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:00.077192    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:42:21.208250 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:21.208215    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:42:21.307786 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:21.307756    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:42:22.350128 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:22.350073    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:42:22.442035 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:22.441999    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:42:38.151987 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:38.151940    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:42:38.286537 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:38.286450    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:42:38.469573 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:38.469539    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:42:38.978192 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:38.978162    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:42:39.616021 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:39.615982    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:42:39.755304 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:39.755271    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:42:40.091031 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:40.090999    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:42:41.624323 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:41.624286    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:42:41.769040 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:41.769008    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:42:42.878933 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:42.878895    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:42:42.976637 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:42.976600    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:42:43.101824 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:43.101787    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:42:43.432528 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:43.432483    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:42:43.532343 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:43.532309    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:42:45.764773 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:45.764747    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:42:46.102145 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:46.102055    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:42:46.362666 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:46.362593    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:42:46.622555 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:46.622462    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:42:46.723796 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:46.723759    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:42:46.839882 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:46.839852    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:42:47.291578 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:47.291500    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:42:47.393948 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:47.393914    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:42:49.610300 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:49.610269    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:42:49.781524 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:49.781496    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:42:50.155605 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:50.155577    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:42:50.290495 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:50.290465    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:42:50.759236 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:50.759202    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-42752c-6469657cc7-wjsw7"]
Sep 11 16:42:50.762799 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:50.762761    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-42752c-6469657cc7-wjsw7"
Sep 11 16:42:50.767839 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:50.767815    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kfp69\""
Sep 11 16:42:50.767839 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:50.767831    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 11 16:42:50.768071 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:50.767831    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 16:42:50.768071 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:50.767831    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-42752c-serving-cert\""
Sep 11 16:42:50.768071 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:50.767861    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 16:42:50.776356 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:50.776334    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-42752c-6469657cc7-wjsw7"]
Sep 11 16:42:50.781743 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:50.781721    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpzjv\" (UniqueName: \"kubernetes.io/projected/32231c51-4380-43cf-8af8-98b434508be4-kube-api-access-kpzjv\") pod \"maas-api-e2e-autores-42752c-6469657cc7-wjsw7\" (UID: \"32231c51-4380-43cf-8af8-98b434508be4\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-42752c-6469657cc7-wjsw7"
Sep 11 16:42:50.781852 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:50.781755    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32231c51-4380-43cf-8af8-98b434508be4-metrics-certs\") pod \"maas-api-e2e-autores-42752c-6469657cc7-wjsw7\" (UID: \"32231c51-4380-43cf-8af8-98b434508be4\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-42752c-6469657cc7-wjsw7"
Sep 11 16:42:50.781852 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:50.781779    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32231c51-4380-43cf-8af8-98b434508be4-maas-api-tls\") pod \"maas-api-e2e-autores-42752c-6469657cc7-wjsw7\" (UID: \"32231c51-4380-43cf-8af8-98b434508be4\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-42752c-6469657cc7-wjsw7"
Sep 11 16:42:50.781959 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:50.781915    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/32231c51-4380-43cf-8af8-98b434508be4-openshift-service-ca\") pod \"maas-api-e2e-autores-42752c-6469657cc7-wjsw7\" (UID: \"32231c51-4380-43cf-8af8-98b434508be4\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-42752c-6469657cc7-wjsw7"
Sep 11 16:42:50.801678 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:50.801656    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:42:50.882591 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:50.882564    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/32231c51-4380-43cf-8af8-98b434508be4-openshift-service-ca\") pod \"maas-api-e2e-autores-42752c-6469657cc7-wjsw7\" (UID: \"32231c51-4380-43cf-8af8-98b434508be4\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-42752c-6469657cc7-wjsw7"
Sep 11 16:42:50.882719 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:50.882622    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpzjv\" (UniqueName: \"kubernetes.io/projected/32231c51-4380-43cf-8af8-98b434508be4-kube-api-access-kpzjv\") pod \"maas-api-e2e-autores-42752c-6469657cc7-wjsw7\" (UID: \"32231c51-4380-43cf-8af8-98b434508be4\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-42752c-6469657cc7-wjsw7"
Sep 11 16:42:50.882719 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:50.882659    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32231c51-4380-43cf-8af8-98b434508be4-metrics-certs\") pod \"maas-api-e2e-autores-42752c-6469657cc7-wjsw7\" (UID: \"32231c51-4380-43cf-8af8-98b434508be4\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-42752c-6469657cc7-wjsw7"
Sep 11 16:42:50.882719 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:50.882692    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32231c51-4380-43cf-8af8-98b434508be4-maas-api-tls\") pod \"maas-api-e2e-autores-42752c-6469657cc7-wjsw7\" (UID: \"32231c51-4380-43cf-8af8-98b434508be4\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-42752c-6469657cc7-wjsw7"
Sep 11 16:42:50.883292 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:50.883269    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/32231c51-4380-43cf-8af8-98b434508be4-openshift-service-ca\") pod \"maas-api-e2e-autores-42752c-6469657cc7-wjsw7\" (UID: \"32231c51-4380-43cf-8af8-98b434508be4\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-42752c-6469657cc7-wjsw7"
Sep 11 16:42:50.885210 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:50.885187    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32231c51-4380-43cf-8af8-98b434508be4-maas-api-tls\") pod \"maas-api-e2e-autores-42752c-6469657cc7-wjsw7\" (UID: \"32231c51-4380-43cf-8af8-98b434508be4\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-42752c-6469657cc7-wjsw7"
Sep 11 16:42:50.885297 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:50.885217    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32231c51-4380-43cf-8af8-98b434508be4-metrics-certs\") pod \"maas-api-e2e-autores-42752c-6469657cc7-wjsw7\" (UID: \"32231c51-4380-43cf-8af8-98b434508be4\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-42752c-6469657cc7-wjsw7"
Sep 11 16:42:50.895705 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:50.895681    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpzjv\" (UniqueName: \"kubernetes.io/projected/32231c51-4380-43cf-8af8-98b434508be4-kube-api-access-kpzjv\") pod \"maas-api-e2e-autores-42752c-6469657cc7-wjsw7\" (UID: \"32231c51-4380-43cf-8af8-98b434508be4\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-42752c-6469657cc7-wjsw7"
Sep 11 16:42:50.895788 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:50.895720    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:42:50.996531 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:50.996504    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:42:51.072912 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:51.072827    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-42752c-6469657cc7-wjsw7"
Sep 11 16:42:51.350402 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:51.350374    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-42752c-6469657cc7-wjsw7"]
Sep 11 16:42:51.351862 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:42:51.351839    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32231c51_4380_43cf_8af8_98b434508be4.slice/crio-448154498baaea034019b5afb4ad7c3f5f1310101547e88c7eca07cc86daa4a7 WatchSource:0}: Error finding container 448154498baaea034019b5afb4ad7c3f5f1310101547e88c7eca07cc86daa4a7: Status 404 returned error can't find the container with id 448154498baaea034019b5afb4ad7c3f5f1310101547e88c7eca07cc86daa4a7
Sep 11 16:42:51.456231 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:51.456186    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-42752c-6469657cc7-wjsw7" event={"ID":"32231c51-4380-43cf-8af8-98b434508be4","Type":"ContainerStarted","Data":"448154498baaea034019b5afb4ad7c3f5f1310101547e88c7eca07cc86daa4a7"}
Sep 11 16:42:51.503347 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:51.503316    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:42:51.604566 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:51.604487    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:42:52.211609 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:52.211576    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:42:52.283511 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:52.283453    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:42:52.584544 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:52.584467    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:42:52.833828 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:52.833778    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:42:52.941649 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:52.941611    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:42:52.978537 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:52.978502    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-845e25d3-64f7c5f898-mhx89"]
Sep 11 16:42:52.989137 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:52.989102    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-845e25d3-64f7c5f898-mhx89"
Sep 11 16:42:52.992260 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:52.992103    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-845e25d3\""
Sep 11 16:42:52.997817 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:52.997526    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-845e25d3-548cdcf895-z745r"]
Sep 11 16:42:53.003080 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:53.003054    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-845e25d3-64f7c5f898-mhx89"]
Sep 11 16:42:53.003788 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:53.003434    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-845e25d3-548cdcf895-z745r"
Sep 11 16:42:53.012566 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:53.012499    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-845e25d3-548cdcf895-z745r"]
Sep 11 16:42:53.104920 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:53.104886    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de4908f5-f064-4e55-8dcc-988ea740030b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-845e25d3-64f7c5f898-mhx89\" (UID: \"de4908f5-f064-4e55-8dcc-988ea740030b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-845e25d3-64f7c5f898-mhx89"
Sep 11 16:42:53.105133 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:53.104942    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twckm\" (UniqueName: \"kubernetes.io/projected/8277ebb3-223b-40bc-8378-16d997d22b68-kube-api-access-twckm\") pod \"payload-processing-e2e-ait-845e25d3-548cdcf895-z745r\" (UID: \"8277ebb3-223b-40bc-8378-16d997d22b68\") " pod="openshift-ingress/payload-processing-e2e-ait-845e25d3-548cdcf895-z745r"
Sep 11 16:42:53.105210 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:53.105134    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6xx7\" (UniqueName: \"kubernetes.io/projected/de4908f5-f064-4e55-8dcc-988ea740030b-kube-api-access-j6xx7\") pod \"payload-pre-processing-e2e-ait-845e25d3-64f7c5f898-mhx89\" (UID: \"de4908f5-f064-4e55-8dcc-988ea740030b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-845e25d3-64f7c5f898-mhx89"
Sep 11 16:42:53.105272 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:53.105253    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8277ebb3-223b-40bc-8378-16d997d22b68-plugins-config-volume\") pod \"payload-processing-e2e-ait-845e25d3-548cdcf895-z745r\" (UID: \"8277ebb3-223b-40bc-8378-16d997d22b68\") " pod="openshift-ingress/payload-processing-e2e-ait-845e25d3-548cdcf895-z745r"
Sep 11 16:42:53.206279 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:53.206197    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6xx7\" (UniqueName: \"kubernetes.io/projected/de4908f5-f064-4e55-8dcc-988ea740030b-kube-api-access-j6xx7\") pod \"payload-pre-processing-e2e-ait-845e25d3-64f7c5f898-mhx89\" (UID: \"de4908f5-f064-4e55-8dcc-988ea740030b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-845e25d3-64f7c5f898-mhx89"
Sep 11 16:42:53.206279 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:53.206258    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8277ebb3-223b-40bc-8378-16d997d22b68-plugins-config-volume\") pod \"payload-processing-e2e-ait-845e25d3-548cdcf895-z745r\" (UID: \"8277ebb3-223b-40bc-8378-16d997d22b68\") " pod="openshift-ingress/payload-processing-e2e-ait-845e25d3-548cdcf895-z745r"
Sep 11 16:42:53.206500 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:53.206301    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de4908f5-f064-4e55-8dcc-988ea740030b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-845e25d3-64f7c5f898-mhx89\" (UID: \"de4908f5-f064-4e55-8dcc-988ea740030b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-845e25d3-64f7c5f898-mhx89"
Sep 11 16:42:53.206500 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:53.206348    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twckm\" (UniqueName: \"kubernetes.io/projected/8277ebb3-223b-40bc-8378-16d997d22b68-kube-api-access-twckm\") pod \"payload-processing-e2e-ait-845e25d3-548cdcf895-z745r\" (UID: \"8277ebb3-223b-40bc-8378-16d997d22b68\") " pod="openshift-ingress/payload-processing-e2e-ait-845e25d3-548cdcf895-z745r"
Sep 11 16:42:53.206952 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:53.206930    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8277ebb3-223b-40bc-8378-16d997d22b68-plugins-config-volume\") pod \"payload-processing-e2e-ait-845e25d3-548cdcf895-z745r\" (UID: \"8277ebb3-223b-40bc-8378-16d997d22b68\") " pod="openshift-ingress/payload-processing-e2e-ait-845e25d3-548cdcf895-z745r"
Sep 11 16:42:53.207051 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:53.207031    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de4908f5-f064-4e55-8dcc-988ea740030b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-845e25d3-64f7c5f898-mhx89\" (UID: \"de4908f5-f064-4e55-8dcc-988ea740030b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-845e25d3-64f7c5f898-mhx89"
Sep 11 16:42:53.215625 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:53.215592    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twckm\" (UniqueName: \"kubernetes.io/projected/8277ebb3-223b-40bc-8378-16d997d22b68-kube-api-access-twckm\") pod \"payload-processing-e2e-ait-845e25d3-548cdcf895-z745r\" (UID: \"8277ebb3-223b-40bc-8378-16d997d22b68\") " pod="openshift-ingress/payload-processing-e2e-ait-845e25d3-548cdcf895-z745r"
Sep 11 16:42:53.215933 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:53.215837    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6xx7\" (UniqueName: \"kubernetes.io/projected/de4908f5-f064-4e55-8dcc-988ea740030b-kube-api-access-j6xx7\") pod \"payload-pre-processing-e2e-ait-845e25d3-64f7c5f898-mhx89\" (UID: \"de4908f5-f064-4e55-8dcc-988ea740030b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-845e25d3-64f7c5f898-mhx89"
Sep 11 16:42:53.303992 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:53.303952    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-845e25d3-64f7c5f898-mhx89"
Sep 11 16:42:53.319476 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:53.319447    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-845e25d3-548cdcf895-z745r"
Sep 11 16:42:53.375519 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:53.375425    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:42:53.872667 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:53.872447    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-845e25d3-64f7c5f898-mhx89"]
Sep 11 16:42:53.874578 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:53.874554    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-845e25d3-548cdcf895-z745r"]
Sep 11 16:42:53.875048 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:42:53.875021    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde4908f5_f064_4e55_8dcc_988ea740030b.slice/crio-3ed318fb3f07027526a3559d9a1430adc67186c1360306fe09886892b9e6eec2 WatchSource:0}: Error finding container 3ed318fb3f07027526a3559d9a1430adc67186c1360306fe09886892b9e6eec2: Status 404 returned error can't find the container with id 3ed318fb3f07027526a3559d9a1430adc67186c1360306fe09886892b9e6eec2
Sep 11 16:42:53.876541 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:42:53.876520    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8277ebb3_223b_40bc_8378_16d997d22b68.slice/crio-814cb6ef59efe48a78a38e441c3642aae360624ea4db0afa88cc64934504c273 WatchSource:0}: Error finding container 814cb6ef59efe48a78a38e441c3642aae360624ea4db0afa88cc64934504c273: Status 404 returned error can't find the container with id 814cb6ef59efe48a78a38e441c3642aae360624ea4db0afa88cc64934504c273
Sep 11 16:42:54.326718 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:54.326613    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:42:54.477433 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:54.477392    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-845e25d3-548cdcf895-z745r" event={"ID":"8277ebb3-223b-40bc-8378-16d997d22b68","Type":"ContainerStarted","Data":"814cb6ef59efe48a78a38e441c3642aae360624ea4db0afa88cc64934504c273"}
Sep 11 16:42:54.480761 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:54.480728    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-42752c-6469657cc7-wjsw7" event={"ID":"32231c51-4380-43cf-8af8-98b434508be4","Type":"ContainerStarted","Data":"967285cccce6b38b3ec848395e23d287e144dc1a7a7fd38e804b642d1b4ca147"}
Sep 11 16:42:54.481623 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:54.481601    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-42752c-6469657cc7-wjsw7"
Sep 11 16:42:54.483950 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:54.483880    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-845e25d3-64f7c5f898-mhx89" event={"ID":"de4908f5-f064-4e55-8dcc-988ea740030b","Type":"ContainerStarted","Data":"3ed318fb3f07027526a3559d9a1430adc67186c1360306fe09886892b9e6eec2"}
Sep 11 16:42:54.501590 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:54.501541    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-42752c-6469657cc7-wjsw7" podStartSLOduration=2.196505107 podStartE2EDuration="4.50152222s" totalImagesPullingTime="2.305017113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:42:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:42:54.499525417 +0000 UTC m=+774.116282485" watchObservedRunningTime="2026-09-11 16:42:54.50152222 +0000 UTC m=+774.118279297"
Sep 11 16:42:56.005239 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:56.005190    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:42:56.495715 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:56.495661    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-845e25d3-548cdcf895-z745r" event={"ID":"8277ebb3-223b-40bc-8378-16d997d22b68","Type":"ContainerStarted","Data":"3d2730c6e7433f8a9a20d5c41565a9ff65d728635667c8e64a74d461c8e17bd1"}
Sep 11 16:42:56.495897 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:56.495769    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-845e25d3-548cdcf895-z745r"
Sep 11 16:42:56.497347 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:56.497317    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-845e25d3-64f7c5f898-mhx89" event={"ID":"de4908f5-f064-4e55-8dcc-988ea740030b","Type":"ContainerStarted","Data":"098b8e6f74a1e4715e6c278e84b63a936c6700682254e81cac58891c0696b304"}
Sep 11 16:42:56.497465 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:56.497450    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-845e25d3-64f7c5f898-mhx89"
Sep 11 16:42:56.518717 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:56.518670    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-845e25d3-548cdcf895-z745r" podStartSLOduration=2.944926653 podStartE2EDuration="4.518657224s" totalImagesPullingTime="1.573730571s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:42:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:42:56.51732838 +0000 UTC m=+776.134085472" watchObservedRunningTime="2026-09-11 16:42:56.518657224 +0000 UTC m=+776.135414317"
Sep 11 16:42:56.540429 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:56.540390    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-845e25d3-64f7c5f898-mhx89" podStartSLOduration=2.960032611 podStartE2EDuration="4.540376372s" totalImagesPullingTime="1.580343761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:42:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:42:56.539242057 +0000 UTC m=+776.155999143" watchObservedRunningTime="2026-09-11 16:42:56.540376372 +0000 UTC m=+776.157133437"
Sep 11 16:42:57.915240 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:57.915203    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:42:58.091083 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:58.091051    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:42:58.193218 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:58.193191    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:42:58.297292 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:42:58.297251    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:01.039229 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:01.039197    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:01.502942 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:01.502911    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-42752c-6469657cc7-wjsw7"
Sep 11 16:43:03.800247 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:03.800214    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:05.347722 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:05.347685    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:07.503777 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:07.503747    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-845e25d3-64f7c5f898-mhx89"
Sep 11 16:43:07.504167 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:07.503818    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-845e25d3-548cdcf895-z745r"
Sep 11 16:43:11.780051 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:11.780024    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:12.125260 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:12.125163    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:12.253761 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:12.253729    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:12.661451 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:12.661412    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:13.144228 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:13.144197    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:13.823003 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:13.822971    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:14.647196 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:14.647127    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:15.272354 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:15.272327    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:15.940686 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:15.940649    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:16.064632 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:16.064605    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:16.730566 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:16.730517    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:18.081564 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:18.081535    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-587a17-84446b8b6-s45xj"]
Sep 11 16:43:18.087974 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:18.087950    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-587a17-84446b8b6-s45xj"
Sep 11 16:43:18.091079 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:18.091061    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-587a17-serving-cert\""
Sep 11 16:43:18.103848 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:18.103827    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-587a17-84446b8b6-s45xj"]
Sep 11 16:43:18.118969 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:18.118947    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:18.238523 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:18.238494    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/005a026e-fc43-4951-b961-b7735ab386ae-maas-api-tls\") pod \"maas-api-e2e-inf-b-587a17-84446b8b6-s45xj\" (UID: \"005a026e-fc43-4951-b961-b7735ab386ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-587a17-84446b8b6-s45xj"
Sep 11 16:43:18.238523 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:18.238525    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/005a026e-fc43-4951-b961-b7735ab386ae-openshift-service-ca\") pod \"maas-api-e2e-inf-b-587a17-84446b8b6-s45xj\" (UID: \"005a026e-fc43-4951-b961-b7735ab386ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-587a17-84446b8b6-s45xj"
Sep 11 16:43:18.238748 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:18.238585    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/005a026e-fc43-4951-b961-b7735ab386ae-metrics-certs\") pod \"maas-api-e2e-inf-b-587a17-84446b8b6-s45xj\" (UID: \"005a026e-fc43-4951-b961-b7735ab386ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-587a17-84446b8b6-s45xj"
Sep 11 16:43:18.238748 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:18.238613    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjqtn\" (UniqueName: \"kubernetes.io/projected/005a026e-fc43-4951-b961-b7735ab386ae-kube-api-access-rjqtn\") pod \"maas-api-e2e-inf-b-587a17-84446b8b6-s45xj\" (UID: \"005a026e-fc43-4951-b961-b7735ab386ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-587a17-84446b8b6-s45xj"
Sep 11 16:43:18.275228 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:18.275191    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:18.340160 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:18.340048    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/005a026e-fc43-4951-b961-b7735ab386ae-maas-api-tls\") pod \"maas-api-e2e-inf-b-587a17-84446b8b6-s45xj\" (UID: \"005a026e-fc43-4951-b961-b7735ab386ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-587a17-84446b8b6-s45xj"
Sep 11 16:43:18.340160 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:18.340129    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/005a026e-fc43-4951-b961-b7735ab386ae-openshift-service-ca\") pod \"maas-api-e2e-inf-b-587a17-84446b8b6-s45xj\" (UID: \"005a026e-fc43-4951-b961-b7735ab386ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-587a17-84446b8b6-s45xj"
Sep 11 16:43:18.340396 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:18.340195    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/005a026e-fc43-4951-b961-b7735ab386ae-metrics-certs\") pod \"maas-api-e2e-inf-b-587a17-84446b8b6-s45xj\" (UID: \"005a026e-fc43-4951-b961-b7735ab386ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-587a17-84446b8b6-s45xj"
Sep 11 16:43:18.340396 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:43:18.340215    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-587a17-serving-cert: secret "maas-api-e2e-inf-b-587a17-serving-cert" not found
Sep 11 16:43:18.340396 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:18.340242    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjqtn\" (UniqueName: \"kubernetes.io/projected/005a026e-fc43-4951-b961-b7735ab386ae-kube-api-access-rjqtn\") pod \"maas-api-e2e-inf-b-587a17-84446b8b6-s45xj\" (UID: \"005a026e-fc43-4951-b961-b7735ab386ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-587a17-84446b8b6-s45xj"
Sep 11 16:43:18.340396 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:43:18.340287    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/005a026e-fc43-4951-b961-b7735ab386ae-maas-api-tls podName:005a026e-fc43-4951-b961-b7735ab386ae nodeName:}" failed. No retries permitted until 2026-09-11 16:43:18.840271294 +0000 UTC m=+798.457028338 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/005a026e-fc43-4951-b961-b7735ab386ae-maas-api-tls") pod "maas-api-e2e-inf-b-587a17-84446b8b6-s45xj" (UID: "005a026e-fc43-4951-b961-b7735ab386ae") : secret "maas-api-e2e-inf-b-587a17-serving-cert" not found
Sep 11 16:43:18.340923 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:18.340894    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/005a026e-fc43-4951-b961-b7735ab386ae-openshift-service-ca\") pod \"maas-api-e2e-inf-b-587a17-84446b8b6-s45xj\" (UID: \"005a026e-fc43-4951-b961-b7735ab386ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-587a17-84446b8b6-s45xj"
Sep 11 16:43:18.342911 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:18.342896    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/005a026e-fc43-4951-b961-b7735ab386ae-metrics-certs\") pod \"maas-api-e2e-inf-b-587a17-84446b8b6-s45xj\" (UID: \"005a026e-fc43-4951-b961-b7735ab386ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-587a17-84446b8b6-s45xj"
Sep 11 16:43:18.355222 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:18.355199    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjqtn\" (UniqueName: \"kubernetes.io/projected/005a026e-fc43-4951-b961-b7735ab386ae-kube-api-access-rjqtn\") pod \"maas-api-e2e-inf-b-587a17-84446b8b6-s45xj\" (UID: \"005a026e-fc43-4951-b961-b7735ab386ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-587a17-84446b8b6-s45xj"
Sep 11 16:43:18.845624 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:18.845594    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/005a026e-fc43-4951-b961-b7735ab386ae-maas-api-tls\") pod \"maas-api-e2e-inf-b-587a17-84446b8b6-s45xj\" (UID: \"005a026e-fc43-4951-b961-b7735ab386ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-587a17-84446b8b6-s45xj"
Sep 11 16:43:18.848049 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:18.848021    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/005a026e-fc43-4951-b961-b7735ab386ae-maas-api-tls\") pod \"maas-api-e2e-inf-b-587a17-84446b8b6-s45xj\" (UID: \"005a026e-fc43-4951-b961-b7735ab386ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-587a17-84446b8b6-s45xj"
Sep 11 16:43:18.939454 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:18.939430    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:18.997423 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:18.997400    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-587a17-84446b8b6-s45xj"
Sep 11 16:43:19.067809 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:19.067770    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:19.196016 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:19.195988    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:19.196501 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:19.196481    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-587a17-5fd468f66-64r6m"]
Sep 11 16:43:19.199284 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:19.199270    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-587a17-5fd468f66-64r6m"
Sep 11 16:43:19.205018 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:19.204995    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-587a17\""
Sep 11 16:43:19.205148 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:19.205107    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-587a17-dockercfg-cx58t\""
Sep 11 16:43:19.212270 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:19.212251    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-587a17-5fd468f66-64r6m"]
Sep 11 16:43:19.288483 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:19.288455    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-587a17-59bb646f7c-qvntk"]
Sep 11 16:43:19.291129 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:19.291107    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-587a17-59bb646f7c-qvntk"
Sep 11 16:43:19.296914 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:19.296877    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-587a17-84446b8b6-s45xj"]
Sep 11 16:43:19.298393 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:43:19.298364    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod005a026e_fc43_4951_b961_b7735ab386ae.slice/crio-008f8e9bfb506814d2820ca56f047a1abfc818adffec392d0456b1afaabc3a30 WatchSource:0}: Error finding container 008f8e9bfb506814d2820ca56f047a1abfc818adffec392d0456b1afaabc3a30: Status 404 returned error can't find the container with id 008f8e9bfb506814d2820ca56f047a1abfc818adffec392d0456b1afaabc3a30
Sep 11 16:43:19.310407 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:19.310375    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-587a17-59bb646f7c-qvntk"]
Sep 11 16:43:19.350218 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:19.350176    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9mc9\" (UniqueName: \"kubernetes.io/projected/7c2ac70a-2bf5-4400-a581-cae4a6cb2586-kube-api-access-v9mc9\") pod \"payload-pre-processing-e2e-inf-b-587a17-5fd468f66-64r6m\" (UID: \"7c2ac70a-2bf5-4400-a581-cae4a6cb2586\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-587a17-5fd468f66-64r6m"
Sep 11 16:43:19.350381 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:19.350230    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c2ac70a-2bf5-4400-a581-cae4a6cb2586-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-587a17-5fd468f66-64r6m\" (UID: \"7c2ac70a-2bf5-4400-a581-cae4a6cb2586\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-587a17-5fd468f66-64r6m"
Sep 11 16:43:19.451284 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:19.451191    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/edb49788-baad-4212-937b-ab793b157a2f-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-587a17-59bb646f7c-qvntk\" (UID: \"edb49788-baad-4212-937b-ab793b157a2f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-587a17-59bb646f7c-qvntk"
Sep 11 16:43:19.451284 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:19.451276    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc2vv\" (UniqueName: \"kubernetes.io/projected/edb49788-baad-4212-937b-ab793b157a2f-kube-api-access-tc2vv\") pod \"payload-processing-e2e-inf-b-587a17-59bb646f7c-qvntk\" (UID: \"edb49788-baad-4212-937b-ab793b157a2f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-587a17-59bb646f7c-qvntk"
Sep 11 16:43:19.451473 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:19.451338    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9mc9\" (UniqueName: \"kubernetes.io/projected/7c2ac70a-2bf5-4400-a581-cae4a6cb2586-kube-api-access-v9mc9\") pod \"payload-pre-processing-e2e-inf-b-587a17-5fd468f66-64r6m\" (UID: \"7c2ac70a-2bf5-4400-a581-cae4a6cb2586\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-587a17-5fd468f66-64r6m"
Sep 11 16:43:19.451473 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:19.451383    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c2ac70a-2bf5-4400-a581-cae4a6cb2586-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-587a17-5fd468f66-64r6m\" (UID: \"7c2ac70a-2bf5-4400-a581-cae4a6cb2586\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-587a17-5fd468f66-64r6m"
Sep 11 16:43:19.452130 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:19.452073    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c2ac70a-2bf5-4400-a581-cae4a6cb2586-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-587a17-5fd468f66-64r6m\" (UID: \"7c2ac70a-2bf5-4400-a581-cae4a6cb2586\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-587a17-5fd468f66-64r6m"
Sep 11 16:43:19.461211 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:19.461186    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9mc9\" (UniqueName: \"kubernetes.io/projected/7c2ac70a-2bf5-4400-a581-cae4a6cb2586-kube-api-access-v9mc9\") pod \"payload-pre-processing-e2e-inf-b-587a17-5fd468f66-64r6m\" (UID: \"7c2ac70a-2bf5-4400-a581-cae4a6cb2586\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-587a17-5fd468f66-64r6m"
Sep 11 16:43:19.509254 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:19.509215    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-587a17-5fd468f66-64r6m"
Sep 11 16:43:19.552569 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:19.552536    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/edb49788-baad-4212-937b-ab793b157a2f-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-587a17-59bb646f7c-qvntk\" (UID: \"edb49788-baad-4212-937b-ab793b157a2f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-587a17-59bb646f7c-qvntk"
Sep 11 16:43:19.552778 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:19.552597    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc2vv\" (UniqueName: \"kubernetes.io/projected/edb49788-baad-4212-937b-ab793b157a2f-kube-api-access-tc2vv\") pod \"payload-processing-e2e-inf-b-587a17-59bb646f7c-qvntk\" (UID: \"edb49788-baad-4212-937b-ab793b157a2f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-587a17-59bb646f7c-qvntk"
Sep 11 16:43:19.553390 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:19.553362    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/edb49788-baad-4212-937b-ab793b157a2f-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-587a17-59bb646f7c-qvntk\" (UID: \"edb49788-baad-4212-937b-ab793b157a2f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-587a17-59bb646f7c-qvntk"
Sep 11 16:43:19.563252 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:19.563226    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc2vv\" (UniqueName: \"kubernetes.io/projected/edb49788-baad-4212-937b-ab793b157a2f-kube-api-access-tc2vv\") pod \"payload-processing-e2e-inf-b-587a17-59bb646f7c-qvntk\" (UID: \"edb49788-baad-4212-937b-ab793b157a2f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-587a17-59bb646f7c-qvntk"
Sep 11 16:43:19.603108 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:19.603069    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-587a17-59bb646f7c-qvntk"
Sep 11 16:43:19.609565 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:19.609533    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-587a17-84446b8b6-s45xj" event={"ID":"005a026e-fc43-4951-b961-b7735ab386ae","Type":"ContainerStarted","Data":"008f8e9bfb506814d2820ca56f047a1abfc818adffec392d0456b1afaabc3a30"}
Sep 11 16:43:19.780112 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:19.780022    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-587a17-5fd468f66-64r6m"]
Sep 11 16:43:19.782878 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:43:19.782851    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c2ac70a_2bf5_4400_a581_cae4a6cb2586.slice/crio-990ae16aedb4c27c0e6e85f577e97ab0784c578d34c734ffb7fbe7214b5d3200 WatchSource:0}: Error finding container 990ae16aedb4c27c0e6e85f577e97ab0784c578d34c734ffb7fbe7214b5d3200: Status 404 returned error can't find the container with id 990ae16aedb4c27c0e6e85f577e97ab0784c578d34c734ffb7fbe7214b5d3200
Sep 11 16:43:19.876893 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:19.876868    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-587a17-59bb646f7c-qvntk"]
Sep 11 16:43:19.883173 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:43:19.883148    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedb49788_baad_4212_937b_ab793b157a2f.slice/crio-1bed435564c89980e3690b9778fe17b38729caa068a30c75782e7fbb1e8a58f7 WatchSource:0}: Error finding container 1bed435564c89980e3690b9778fe17b38729caa068a30c75782e7fbb1e8a58f7: Status 404 returned error can't find the container with id 1bed435564c89980e3690b9778fe17b38729caa068a30c75782e7fbb1e8a58f7
Sep 11 16:43:20.617672 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:20.617627    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-587a17-84446b8b6-s45xj" event={"ID":"005a026e-fc43-4951-b961-b7735ab386ae","Type":"ContainerStarted","Data":"b8a723a53695b7c0fc981e80039acaca7e899133e3c2e69cd370469fab7a4bf9"}
Sep 11 16:43:20.618076 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:20.617692    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-587a17-84446b8b6-s45xj"
Sep 11 16:43:20.619417 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:20.619384    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-587a17-59bb646f7c-qvntk" event={"ID":"edb49788-baad-4212-937b-ab793b157a2f","Type":"ContainerStarted","Data":"7ec478f9fba2f50e6ba37b5c728717e84da890699957025c36ae7068cec877c5"}
Sep 11 16:43:20.619547 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:20.619440    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-587a17-59bb646f7c-qvntk"
Sep 11 16:43:20.619547 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:20.619459    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-587a17-59bb646f7c-qvntk" event={"ID":"edb49788-baad-4212-937b-ab793b157a2f","Type":"ContainerStarted","Data":"1bed435564c89980e3690b9778fe17b38729caa068a30c75782e7fbb1e8a58f7"}
Sep 11 16:43:20.620936 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:20.620911    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-587a17-5fd468f66-64r6m" event={"ID":"7c2ac70a-2bf5-4400-a581-cae4a6cb2586","Type":"ContainerStarted","Data":"7d1f6a56ff04201de035c8682d72180c8ab9a42e7a31d5b8114fdc1d928c0070"}
Sep 11 16:43:20.621056 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:20.620957    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-587a17-5fd468f66-64r6m" event={"ID":"7c2ac70a-2bf5-4400-a581-cae4a6cb2586","Type":"ContainerStarted","Data":"990ae16aedb4c27c0e6e85f577e97ab0784c578d34c734ffb7fbe7214b5d3200"}
Sep 11 16:43:20.621056 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:20.620987    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-587a17-5fd468f66-64r6m"
Sep 11 16:43:20.638367 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:20.638311    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-587a17-84446b8b6-s45xj" podStartSLOduration=2.086967826 podStartE2EDuration="2.638297401s" totalImagesPullingTime="551.329575ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:43:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:43:20.635602011 +0000 UTC m=+800.252359100" watchObservedRunningTime="2026-09-11 16:43:20.638297401 +0000 UTC m=+800.255054842"
Sep 11 16:43:20.684929 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:20.684875    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-587a17-59bb646f7c-qvntk" podStartSLOduration=1.684860221 podStartE2EDuration="1.684860221s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:43:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:43:20.682691716 +0000 UTC m=+800.299448804" watchObservedRunningTime="2026-09-11 16:43:20.684860221 +0000 UTC m=+800.301617287"
Sep 11 16:43:20.685124 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:20.685103    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-587a17-5fd468f66-64r6m" podStartSLOduration=1.6850850240000002 podStartE2EDuration="1.685085024s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:43:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:43:20.659864992 +0000 UTC m=+800.276622068" watchObservedRunningTime="2026-09-11 16:43:20.685085024 +0000 UTC m=+800.301842090"
Sep 11 16:43:21.171243 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:21.171183    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:21.637083 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:21.637006    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:21.743317 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:21.743290    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:21.867239 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:21.867209    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:26.632047 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:26.632015    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-587a17-84446b8b6-s45xj"
Sep 11 16:43:28.688113 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:28.688067    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:28.792116 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:28.792061    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:28.967055 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:28.966981    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:29.105369 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:29.105339    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:31.628851 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:31.628814    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-587a17-5fd468f66-64r6m"
Sep 11 16:43:31.629281 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:31.629078    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-587a17-59bb646f7c-qvntk"
Sep 11 16:43:32.214835 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:32.214799    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:32.277630 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:32.277595    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-845e25d3-548cdcf895-z745r"]
Sep 11 16:43:32.277883 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:32.277846    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-845e25d3-548cdcf895-z745r" podUID="8277ebb3-223b-40bc-8378-16d997d22b68" containerName="payload-processing" containerID="cri-o://3d2730c6e7433f8a9a20d5c41565a9ff65d728635667c8e64a74d461c8e17bd1" gracePeriod=30
Sep 11 16:43:32.301786 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:32.301761    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-845e25d3-64f7c5f898-mhx89"]
Sep 11 16:43:32.301994 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:32.301971    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-845e25d3-64f7c5f898-mhx89" podUID="de4908f5-f064-4e55-8dcc-988ea740030b" containerName="payload-pre-processing" containerID="cri-o://098b8e6f74a1e4715e6c278e84b63a936c6700682254e81cac58891c0696b304" gracePeriod=30
Sep 11 16:43:32.343671 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:32.343646    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:32.445939 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:32.445907    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:32.544957 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:32.544909    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:32.590047 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:32.590023    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-845e25d3-548cdcf895-z745r"
Sep 11 16:43:32.592882 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:32.592862    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-845e25d3-64f7c5f898-mhx89"
Sep 11 16:43:32.616672 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:32.616639    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:32.673042 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:32.673009    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8277ebb3-223b-40bc-8378-16d997d22b68-plugins-config-volume\") pod \"8277ebb3-223b-40bc-8378-16d997d22b68\" (UID: \"8277ebb3-223b-40bc-8378-16d997d22b68\") "
Sep 11 16:43:32.673512 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:32.673074    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twckm\" (UniqueName: \"kubernetes.io/projected/8277ebb3-223b-40bc-8378-16d997d22b68-kube-api-access-twckm\") pod \"8277ebb3-223b-40bc-8378-16d997d22b68\" (UID: \"8277ebb3-223b-40bc-8378-16d997d22b68\") "
Sep 11 16:43:32.673512 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:32.673116    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6xx7\" (UniqueName: \"kubernetes.io/projected/de4908f5-f064-4e55-8dcc-988ea740030b-kube-api-access-j6xx7\") pod \"de4908f5-f064-4e55-8dcc-988ea740030b\" (UID: \"de4908f5-f064-4e55-8dcc-988ea740030b\") "
Sep 11 16:43:32.673512 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:32.673145    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de4908f5-f064-4e55-8dcc-988ea740030b-plugins-config-volume\") pod \"de4908f5-f064-4e55-8dcc-988ea740030b\" (UID: \"de4908f5-f064-4e55-8dcc-988ea740030b\") "
Sep 11 16:43:32.673512 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:32.673425    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8277ebb3-223b-40bc-8378-16d997d22b68-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8277ebb3-223b-40bc-8378-16d997d22b68" (UID: "8277ebb3-223b-40bc-8378-16d997d22b68"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:43:32.673724 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:32.673571    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de4908f5-f064-4e55-8dcc-988ea740030b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "de4908f5-f064-4e55-8dcc-988ea740030b" (UID: "de4908f5-f064-4e55-8dcc-988ea740030b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:43:32.675619 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:32.675588    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8277ebb3-223b-40bc-8378-16d997d22b68-kube-api-access-twckm" (OuterVolumeSpecName: "kube-api-access-twckm") pod "8277ebb3-223b-40bc-8378-16d997d22b68" (UID: "8277ebb3-223b-40bc-8378-16d997d22b68"). InnerVolumeSpecName "kube-api-access-twckm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:43:32.675732 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:32.675699    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de4908f5-f064-4e55-8dcc-988ea740030b-kube-api-access-j6xx7" (OuterVolumeSpecName: "kube-api-access-j6xx7") pod "de4908f5-f064-4e55-8dcc-988ea740030b" (UID: "de4908f5-f064-4e55-8dcc-988ea740030b"). InnerVolumeSpecName "kube-api-access-j6xx7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:43:32.681992 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:32.681964    2581 generic.go:356] "Generic (PLEG): container finished" podID="de4908f5-f064-4e55-8dcc-988ea740030b" containerID="098b8e6f74a1e4715e6c278e84b63a936c6700682254e81cac58891c0696b304" exitCode=0
Sep 11 16:43:32.682114 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:32.682009    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-845e25d3-64f7c5f898-mhx89"
Sep 11 16:43:32.682114 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:32.682045    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-845e25d3-64f7c5f898-mhx89" event={"ID":"de4908f5-f064-4e55-8dcc-988ea740030b","Type":"ContainerDied","Data":"098b8e6f74a1e4715e6c278e84b63a936c6700682254e81cac58891c0696b304"}
Sep 11 16:43:32.682255 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:32.682118    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-845e25d3-64f7c5f898-mhx89" event={"ID":"de4908f5-f064-4e55-8dcc-988ea740030b","Type":"ContainerDied","Data":"3ed318fb3f07027526a3559d9a1430adc67186c1360306fe09886892b9e6eec2"}
Sep 11 16:43:32.682255 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:32.682148    2581 scope.go:117] "RemoveContainer" containerID="098b8e6f74a1e4715e6c278e84b63a936c6700682254e81cac58891c0696b304"
Sep 11 16:43:32.684604 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:32.684584    2581 generic.go:356] "Generic (PLEG): container finished" podID="8277ebb3-223b-40bc-8378-16d997d22b68" containerID="3d2730c6e7433f8a9a20d5c41565a9ff65d728635667c8e64a74d461c8e17bd1" exitCode=0
Sep 11 16:43:32.684700 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:32.684623    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-845e25d3-548cdcf895-z745r" event={"ID":"8277ebb3-223b-40bc-8378-16d997d22b68","Type":"ContainerDied","Data":"3d2730c6e7433f8a9a20d5c41565a9ff65d728635667c8e64a74d461c8e17bd1"}
Sep 11 16:43:32.684700 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:32.684662    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-845e25d3-548cdcf895-z745r" event={"ID":"8277ebb3-223b-40bc-8378-16d997d22b68","Type":"ContainerDied","Data":"814cb6ef59efe48a78a38e441c3642aae360624ea4db0afa88cc64934504c273"}
Sep 11 16:43:32.684783 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:32.684768    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-845e25d3-548cdcf895-z745r"
Sep 11 16:43:32.694265 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:32.694249    2581 scope.go:117] "RemoveContainer" containerID="098b8e6f74a1e4715e6c278e84b63a936c6700682254e81cac58891c0696b304"
Sep 11 16:43:32.694538 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:43:32.694522    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"098b8e6f74a1e4715e6c278e84b63a936c6700682254e81cac58891c0696b304\": container with ID starting with 098b8e6f74a1e4715e6c278e84b63a936c6700682254e81cac58891c0696b304 not found: ID does not exist" containerID="098b8e6f74a1e4715e6c278e84b63a936c6700682254e81cac58891c0696b304"
Sep 11 16:43:32.694609 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:32.694545    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"098b8e6f74a1e4715e6c278e84b63a936c6700682254e81cac58891c0696b304"} err="failed to get container status \"098b8e6f74a1e4715e6c278e84b63a936c6700682254e81cac58891c0696b304\": rpc error: code = NotFound desc = could not find container \"098b8e6f74a1e4715e6c278e84b63a936c6700682254e81cac58891c0696b304\": container with ID starting with 098b8e6f74a1e4715e6c278e84b63a936c6700682254e81cac58891c0696b304 not found: ID does not exist"
Sep 11 16:43:32.694609 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:32.694561    2581 scope.go:117] "RemoveContainer" containerID="3d2730c6e7433f8a9a20d5c41565a9ff65d728635667c8e64a74d461c8e17bd1"
Sep 11 16:43:32.704080 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:32.704054    2581 scope.go:117] "RemoveContainer" containerID="3d2730c6e7433f8a9a20d5c41565a9ff65d728635667c8e64a74d461c8e17bd1"
Sep 11 16:43:32.704377 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:43:32.704360    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d2730c6e7433f8a9a20d5c41565a9ff65d728635667c8e64a74d461c8e17bd1\": container with ID starting with 3d2730c6e7433f8a9a20d5c41565a9ff65d728635667c8e64a74d461c8e17bd1 not found: ID does not exist" containerID="3d2730c6e7433f8a9a20d5c41565a9ff65d728635667c8e64a74d461c8e17bd1"
Sep 11 16:43:32.704467 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:32.704384    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d2730c6e7433f8a9a20d5c41565a9ff65d728635667c8e64a74d461c8e17bd1"} err="failed to get container status \"3d2730c6e7433f8a9a20d5c41565a9ff65d728635667c8e64a74d461c8e17bd1\": rpc error: code = NotFound desc = could not find container \"3d2730c6e7433f8a9a20d5c41565a9ff65d728635667c8e64a74d461c8e17bd1\": container with ID starting with 3d2730c6e7433f8a9a20d5c41565a9ff65d728635667c8e64a74d461c8e17bd1 not found: ID does not exist"
Sep 11 16:43:32.716085 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:32.716053    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-845e25d3-64f7c5f898-mhx89"]
Sep 11 16:43:32.720919 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:32.720882    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-845e25d3-64f7c5f898-mhx89"]
Sep 11 16:43:32.724591 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:32.724569    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:32.733933 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:32.733909    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-845e25d3-548cdcf895-z745r"]
Sep 11 16:43:32.742317 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:32.742291    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-845e25d3-548cdcf895-z745r"]
Sep 11 16:43:32.774491 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:32.774435    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8277ebb3-223b-40bc-8378-16d997d22b68-plugins-config-volume\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:43:32.774491 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:32.774457    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twckm\" (UniqueName: \"kubernetes.io/projected/8277ebb3-223b-40bc-8378-16d997d22b68-kube-api-access-twckm\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:43:32.774491 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:32.774467    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6xx7\" (UniqueName: \"kubernetes.io/projected/de4908f5-f064-4e55-8dcc-988ea740030b-kube-api-access-j6xx7\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:43:32.774491 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:32.774476    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de4908f5-f064-4e55-8dcc-988ea740030b-plugins-config-volume\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:43:32.992846 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:32.992811    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8277ebb3-223b-40bc-8378-16d997d22b68" path="/var/lib/kubelet/pods/8277ebb3-223b-40bc-8378-16d997d22b68/volumes"
Sep 11 16:43:32.993208 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:32.993194    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de4908f5-f064-4e55-8dcc-988ea740030b" path="/var/lib/kubelet/pods/de4908f5-f064-4e55-8dcc-988ea740030b/volumes"
Sep 11 16:43:33.279530 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:33.279501    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:33.441524 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:33.441496    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:33.564929 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:33.564849    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:33.801219 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:33.801192    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:33.908186 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:33.908112    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:34.791866 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:34.791838    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:36.507698 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:36.507666    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:36.610709 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:36.610678    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:36.712436 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:36.712410    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:36.903143 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:36.903037    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:37.201219 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:37.201197    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:37.302906 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:37.302874    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:37.306478 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:37.306451    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-983a9aee-95895fd46-jdtfk"]
Sep 11 16:43:37.306810 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:37.306799    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de4908f5-f064-4e55-8dcc-988ea740030b" containerName="payload-pre-processing"
Sep 11 16:43:37.306854 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:37.306812    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="de4908f5-f064-4e55-8dcc-988ea740030b" containerName="payload-pre-processing"
Sep 11 16:43:37.306854 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:37.306826    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8277ebb3-223b-40bc-8378-16d997d22b68" containerName="payload-processing"
Sep 11 16:43:37.306854 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:37.306831    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8277ebb3-223b-40bc-8378-16d997d22b68" containerName="payload-processing"
Sep 11 16:43:37.306956 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:37.306895    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8277ebb3-223b-40bc-8378-16d997d22b68" containerName="payload-processing"
Sep 11 16:43:37.306956 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:37.306903    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="de4908f5-f064-4e55-8dcc-988ea740030b" containerName="payload-pre-processing"
Sep 11 16:43:37.311620 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:37.311602    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-983a9aee-95895fd46-jdtfk"
Sep 11 16:43:37.314883 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:37.314868    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-983a9aee\""
Sep 11 16:43:37.325303 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:37.325281    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-983a9aee-95895fd46-jdtfk"]
Sep 11 16:43:37.358486 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:37.358452    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-983a9aee-74646546fd-qg249"]
Sep 11 16:43:37.361855 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:37.361832    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-983a9aee-74646546fd-qg249"
Sep 11 16:43:37.365120 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:37.365103    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-983a9aee-dockercfg-9g8tt\""
Sep 11 16:43:37.417276 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:37.417239    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gv6cx\" (UniqueName: \"kubernetes.io/projected/9318213e-1ed3-473b-b6d4-af671ce64877-kube-api-access-gv6cx\") pod \"payload-pre-processing-e2e-migrate-983a9aee-95895fd46-jdtfk\" (UID: \"9318213e-1ed3-473b-b6d4-af671ce64877\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-983a9aee-95895fd46-jdtfk"
Sep 11 16:43:37.417404 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:37.417292    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdcg7\" (UniqueName: \"kubernetes.io/projected/9b82478e-7871-45bf-8738-1732f41a8adc-kube-api-access-sdcg7\") pod \"payload-processing-e2e-migrate-983a9aee-74646546fd-qg249\" (UID: \"9b82478e-7871-45bf-8738-1732f41a8adc\") " pod="openshift-ingress/payload-processing-e2e-migrate-983a9aee-74646546fd-qg249"
Sep 11 16:43:37.417404 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:37.417358    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b82478e-7871-45bf-8738-1732f41a8adc-plugins-config-volume\") pod \"payload-processing-e2e-migrate-983a9aee-74646546fd-qg249\" (UID: \"9b82478e-7871-45bf-8738-1732f41a8adc\") " pod="openshift-ingress/payload-processing-e2e-migrate-983a9aee-74646546fd-qg249"
Sep 11 16:43:37.417477 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:37.417404    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9318213e-1ed3-473b-b6d4-af671ce64877-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-983a9aee-95895fd46-jdtfk\" (UID: \"9318213e-1ed3-473b-b6d4-af671ce64877\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-983a9aee-95895fd46-jdtfk"
Sep 11 16:43:37.428592 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:37.428564    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-983a9aee-74646546fd-qg249"]
Sep 11 16:43:37.518804 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:37.518723    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b82478e-7871-45bf-8738-1732f41a8adc-plugins-config-volume\") pod \"payload-processing-e2e-migrate-983a9aee-74646546fd-qg249\" (UID: \"9b82478e-7871-45bf-8738-1732f41a8adc\") " pod="openshift-ingress/payload-processing-e2e-migrate-983a9aee-74646546fd-qg249"
Sep 11 16:43:37.518804 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:37.518772    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9318213e-1ed3-473b-b6d4-af671ce64877-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-983a9aee-95895fd46-jdtfk\" (UID: \"9318213e-1ed3-473b-b6d4-af671ce64877\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-983a9aee-95895fd46-jdtfk"
Sep 11 16:43:37.519213 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:37.518833    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gv6cx\" (UniqueName: \"kubernetes.io/projected/9318213e-1ed3-473b-b6d4-af671ce64877-kube-api-access-gv6cx\") pod \"payload-pre-processing-e2e-migrate-983a9aee-95895fd46-jdtfk\" (UID: \"9318213e-1ed3-473b-b6d4-af671ce64877\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-983a9aee-95895fd46-jdtfk"
Sep 11 16:43:37.519213 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:37.518867    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdcg7\" (UniqueName: \"kubernetes.io/projected/9b82478e-7871-45bf-8738-1732f41a8adc-kube-api-access-sdcg7\") pod \"payload-processing-e2e-migrate-983a9aee-74646546fd-qg249\" (UID: \"9b82478e-7871-45bf-8738-1732f41a8adc\") " pod="openshift-ingress/payload-processing-e2e-migrate-983a9aee-74646546fd-qg249"
Sep 11 16:43:37.519545 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:37.519526    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9318213e-1ed3-473b-b6d4-af671ce64877-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-983a9aee-95895fd46-jdtfk\" (UID: \"9318213e-1ed3-473b-b6d4-af671ce64877\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-983a9aee-95895fd46-jdtfk"
Sep 11 16:43:37.519578 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:37.519554    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b82478e-7871-45bf-8738-1732f41a8adc-plugins-config-volume\") pod \"payload-processing-e2e-migrate-983a9aee-74646546fd-qg249\" (UID: \"9b82478e-7871-45bf-8738-1732f41a8adc\") " pod="openshift-ingress/payload-processing-e2e-migrate-983a9aee-74646546fd-qg249"
Sep 11 16:43:37.533561 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:37.533535    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdcg7\" (UniqueName: \"kubernetes.io/projected/9b82478e-7871-45bf-8738-1732f41a8adc-kube-api-access-sdcg7\") pod \"payload-processing-e2e-migrate-983a9aee-74646546fd-qg249\" (UID: \"9b82478e-7871-45bf-8738-1732f41a8adc\") " pod="openshift-ingress/payload-processing-e2e-migrate-983a9aee-74646546fd-qg249"
Sep 11 16:43:37.533736 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:37.533716    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gv6cx\" (UniqueName: \"kubernetes.io/projected/9318213e-1ed3-473b-b6d4-af671ce64877-kube-api-access-gv6cx\") pod \"payload-pre-processing-e2e-migrate-983a9aee-95895fd46-jdtfk\" (UID: \"9318213e-1ed3-473b-b6d4-af671ce64877\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-983a9aee-95895fd46-jdtfk"
Sep 11 16:43:37.620564 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:37.620521    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:37.621391 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:37.621369    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-983a9aee-95895fd46-jdtfk"
Sep 11 16:43:37.671977 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:37.671948    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-983a9aee-74646546fd-qg249"
Sep 11 16:43:37.724477 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:37.724437    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:37.894903 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:37.894876    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-983a9aee-95895fd46-jdtfk"]
Sep 11 16:43:37.895585 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:43:37.895563    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9318213e_1ed3_473b_b6d4_af671ce64877.slice/crio-5ac05eaab934d512b3520bcde00071bb157d57ec2acc48610dd3fda2d1898eb4 WatchSource:0}: Error finding container 5ac05eaab934d512b3520bcde00071bb157d57ec2acc48610dd3fda2d1898eb4: Status 404 returned error can't find the container with id 5ac05eaab934d512b3520bcde00071bb157d57ec2acc48610dd3fda2d1898eb4
Sep 11 16:43:37.952034 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:37.952012    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-983a9aee-74646546fd-qg249"]
Sep 11 16:43:37.954761 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:43:37.954722    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b82478e_7871_45bf_8738_1732f41a8adc.slice/crio-c733f0a7f5fada07a216b1e79a88a8276b87025757b9db0918520ffab4f7d4d7 WatchSource:0}: Error finding container c733f0a7f5fada07a216b1e79a88a8276b87025757b9db0918520ffab4f7d4d7: Status 404 returned error can't find the container with id c733f0a7f5fada07a216b1e79a88a8276b87025757b9db0918520ffab4f7d4d7
Sep 11 16:43:38.716643 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:38.716431    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-983a9aee-74646546fd-qg249" event={"ID":"9b82478e-7871-45bf-8738-1732f41a8adc","Type":"ContainerStarted","Data":"00d8026cd4f7fcc32091019937a9412ea9d2c605d361587c29a99c30388460cd"}
Sep 11 16:43:38.716643 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:38.716555    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-983a9aee-74646546fd-qg249" event={"ID":"9b82478e-7871-45bf-8738-1732f41a8adc","Type":"ContainerStarted","Data":"c733f0a7f5fada07a216b1e79a88a8276b87025757b9db0918520ffab4f7d4d7"}
Sep 11 16:43:38.716643 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:38.716590    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-983a9aee-74646546fd-qg249"
Sep 11 16:43:38.718112 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:38.718068    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-983a9aee-95895fd46-jdtfk" event={"ID":"9318213e-1ed3-473b-b6d4-af671ce64877","Type":"ContainerStarted","Data":"403a24dc376480fe074ac62e00668868a8fd05eaea001fbcb9da9685473e4094"}
Sep 11 16:43:38.718233 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:38.718132    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-983a9aee-95895fd46-jdtfk" event={"ID":"9318213e-1ed3-473b-b6d4-af671ce64877","Type":"ContainerStarted","Data":"5ac05eaab934d512b3520bcde00071bb157d57ec2acc48610dd3fda2d1898eb4"}
Sep 11 16:43:38.718233 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:38.718182    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-983a9aee-95895fd46-jdtfk"
Sep 11 16:43:38.735763 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:38.735711    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-983a9aee-74646546fd-qg249" podStartSLOduration=1.7356980549999999 podStartE2EDuration="1.735698055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:43:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:43:38.733538763 +0000 UTC m=+818.350295841" watchObservedRunningTime="2026-09-11 16:43:38.735698055 +0000 UTC m=+818.352455120"
Sep 11 16:43:38.753997 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:38.753938    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-983a9aee-95895fd46-jdtfk" podStartSLOduration=1.753919154 podStartE2EDuration="1.753919154s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:43:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:43:38.750980537 +0000 UTC m=+818.367737604" watchObservedRunningTime="2026-09-11 16:43:38.753919154 +0000 UTC m=+818.370676219"
Sep 11 16:43:39.746946 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:39.746910    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:45.985203 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:45.985170    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:49.724753 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:49.724722    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-983a9aee-74646546fd-qg249"
Sep 11 16:43:49.725215 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:49.724878    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-983a9aee-95895fd46-jdtfk"
Sep 11 16:43:59.083836 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:43:59.083803    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:44:08.140402 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:08.140367    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:44:08.184142 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:08.184104    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-983a9aee-74646546fd-qg249"]
Sep 11 16:44:08.184411 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:08.184382    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-983a9aee-74646546fd-qg249" podUID="9b82478e-7871-45bf-8738-1732f41a8adc" containerName="payload-processing" containerID="cri-o://00d8026cd4f7fcc32091019937a9412ea9d2c605d361587c29a99c30388460cd" gracePeriod=30
Sep 11 16:44:08.189884 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:08.189858    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-983a9aee-95895fd46-jdtfk"]
Sep 11 16:44:08.190149 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:08.190073    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-983a9aee-95895fd46-jdtfk" podUID="9318213e-1ed3-473b-b6d4-af671ce64877" containerName="payload-pre-processing" containerID="cri-o://403a24dc376480fe074ac62e00668868a8fd05eaea001fbcb9da9685473e4094" gracePeriod=30
Sep 11 16:44:08.227131 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:08.227080    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:44:08.327938 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:08.327904    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:44:08.408992 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:08.408911    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:44:08.443108 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:08.443072    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-983a9aee-74646546fd-qg249"
Sep 11 16:44:08.483070 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:08.483047    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:44:08.487108 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:08.487072    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-983a9aee-95895fd46-jdtfk"
Sep 11 16:44:08.581114 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:08.575840    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:44:08.600191 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:08.600151    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdcg7\" (UniqueName: \"kubernetes.io/projected/9b82478e-7871-45bf-8738-1732f41a8adc-kube-api-access-sdcg7\") pod \"9b82478e-7871-45bf-8738-1732f41a8adc\" (UID: \"9b82478e-7871-45bf-8738-1732f41a8adc\") "
Sep 11 16:44:08.600361 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:08.600207    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9318213e-1ed3-473b-b6d4-af671ce64877-plugins-config-volume\") pod \"9318213e-1ed3-473b-b6d4-af671ce64877\" (UID: \"9318213e-1ed3-473b-b6d4-af671ce64877\") "
Sep 11 16:44:08.600361 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:08.600236    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b82478e-7871-45bf-8738-1732f41a8adc-plugins-config-volume\") pod \"9b82478e-7871-45bf-8738-1732f41a8adc\" (UID: \"9b82478e-7871-45bf-8738-1732f41a8adc\") "
Sep 11 16:44:08.600361 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:08.600301    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gv6cx\" (UniqueName: \"kubernetes.io/projected/9318213e-1ed3-473b-b6d4-af671ce64877-kube-api-access-gv6cx\") pod \"9318213e-1ed3-473b-b6d4-af671ce64877\" (UID: \"9318213e-1ed3-473b-b6d4-af671ce64877\") "
Sep 11 16:44:08.600551 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:08.600529    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9318213e-1ed3-473b-b6d4-af671ce64877-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9318213e-1ed3-473b-b6d4-af671ce64877" (UID: "9318213e-1ed3-473b-b6d4-af671ce64877"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:44:08.600648 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:08.600623    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b82478e-7871-45bf-8738-1732f41a8adc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9b82478e-7871-45bf-8738-1732f41a8adc" (UID: "9b82478e-7871-45bf-8738-1732f41a8adc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:44:08.602356 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:08.602334    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9318213e-1ed3-473b-b6d4-af671ce64877-kube-api-access-gv6cx" (OuterVolumeSpecName: "kube-api-access-gv6cx") pod "9318213e-1ed3-473b-b6d4-af671ce64877" (UID: "9318213e-1ed3-473b-b6d4-af671ce64877"). InnerVolumeSpecName "kube-api-access-gv6cx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:44:08.602451 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:08.602410    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b82478e-7871-45bf-8738-1732f41a8adc-kube-api-access-sdcg7" (OuterVolumeSpecName: "kube-api-access-sdcg7") pod "9b82478e-7871-45bf-8738-1732f41a8adc" (UID: "9b82478e-7871-45bf-8738-1732f41a8adc"). InnerVolumeSpecName "kube-api-access-sdcg7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:44:08.701827 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:08.701787    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b82478e-7871-45bf-8738-1732f41a8adc-plugins-config-volume\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:44:08.701827 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:08.701819    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gv6cx\" (UniqueName: \"kubernetes.io/projected/9318213e-1ed3-473b-b6d4-af671ce64877-kube-api-access-gv6cx\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:44:08.701827 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:08.701828    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdcg7\" (UniqueName: \"kubernetes.io/projected/9b82478e-7871-45bf-8738-1732f41a8adc-kube-api-access-sdcg7\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:44:08.701827 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:08.701838    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9318213e-1ed3-473b-b6d4-af671ce64877-plugins-config-volume\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:44:08.863656 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:08.863616    2581 generic.go:356] "Generic (PLEG): container finished" podID="9b82478e-7871-45bf-8738-1732f41a8adc" containerID="00d8026cd4f7fcc32091019937a9412ea9d2c605d361587c29a99c30388460cd" exitCode=0
Sep 11 16:44:08.863843 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:08.863663    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-983a9aee-74646546fd-qg249"
Sep 11 16:44:08.863843 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:08.863703    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-983a9aee-74646546fd-qg249" event={"ID":"9b82478e-7871-45bf-8738-1732f41a8adc","Type":"ContainerDied","Data":"00d8026cd4f7fcc32091019937a9412ea9d2c605d361587c29a99c30388460cd"}
Sep 11 16:44:08.863843 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:08.863762    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-983a9aee-74646546fd-qg249" event={"ID":"9b82478e-7871-45bf-8738-1732f41a8adc","Type":"ContainerDied","Data":"c733f0a7f5fada07a216b1e79a88a8276b87025757b9db0918520ffab4f7d4d7"}
Sep 11 16:44:08.863843 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:08.863792    2581 scope.go:117] "RemoveContainer" containerID="00d8026cd4f7fcc32091019937a9412ea9d2c605d361587c29a99c30388460cd"
Sep 11 16:44:08.865209 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:08.865183    2581 generic.go:356] "Generic (PLEG): container finished" podID="9318213e-1ed3-473b-b6d4-af671ce64877" containerID="403a24dc376480fe074ac62e00668868a8fd05eaea001fbcb9da9685473e4094" exitCode=0
Sep 11 16:44:08.865374 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:08.865217    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-983a9aee-95895fd46-jdtfk" event={"ID":"9318213e-1ed3-473b-b6d4-af671ce64877","Type":"ContainerDied","Data":"403a24dc376480fe074ac62e00668868a8fd05eaea001fbcb9da9685473e4094"}
Sep 11 16:44:08.865374 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:08.865272    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-983a9aee-95895fd46-jdtfk" event={"ID":"9318213e-1ed3-473b-b6d4-af671ce64877","Type":"ContainerDied","Data":"5ac05eaab934d512b3520bcde00071bb157d57ec2acc48610dd3fda2d1898eb4"}
Sep 11 16:44:08.865374 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:08.865225    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-983a9aee-95895fd46-jdtfk"
Sep 11 16:44:08.881416 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:08.881392    2581 scope.go:117] "RemoveContainer" containerID="00d8026cd4f7fcc32091019937a9412ea9d2c605d361587c29a99c30388460cd"
Sep 11 16:44:08.881751 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:44:08.881726    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00d8026cd4f7fcc32091019937a9412ea9d2c605d361587c29a99c30388460cd\": container with ID starting with 00d8026cd4f7fcc32091019937a9412ea9d2c605d361587c29a99c30388460cd not found: ID does not exist" containerID="00d8026cd4f7fcc32091019937a9412ea9d2c605d361587c29a99c30388460cd"
Sep 11 16:44:08.881840 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:08.881761    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00d8026cd4f7fcc32091019937a9412ea9d2c605d361587c29a99c30388460cd"} err="failed to get container status \"00d8026cd4f7fcc32091019937a9412ea9d2c605d361587c29a99c30388460cd\": rpc error: code = NotFound desc = could not find container \"00d8026cd4f7fcc32091019937a9412ea9d2c605d361587c29a99c30388460cd\": container with ID starting with 00d8026cd4f7fcc32091019937a9412ea9d2c605d361587c29a99c30388460cd not found: ID does not exist"
Sep 11 16:44:08.881840 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:08.881784    2581 scope.go:117] "RemoveContainer" containerID="403a24dc376480fe074ac62e00668868a8fd05eaea001fbcb9da9685473e4094"
Sep 11 16:44:08.889605 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:08.889576    2581 scope.go:117] "RemoveContainer" containerID="403a24dc376480fe074ac62e00668868a8fd05eaea001fbcb9da9685473e4094"
Sep 11 16:44:08.889882 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:44:08.889862    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"403a24dc376480fe074ac62e00668868a8fd05eaea001fbcb9da9685473e4094\": container with ID starting with 403a24dc376480fe074ac62e00668868a8fd05eaea001fbcb9da9685473e4094 not found: ID does not exist" containerID="403a24dc376480fe074ac62e00668868a8fd05eaea001fbcb9da9685473e4094"
Sep 11 16:44:08.889943 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:08.889892    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"403a24dc376480fe074ac62e00668868a8fd05eaea001fbcb9da9685473e4094"} err="failed to get container status \"403a24dc376480fe074ac62e00668868a8fd05eaea001fbcb9da9685473e4094\": rpc error: code = NotFound desc = could not find container \"403a24dc376480fe074ac62e00668868a8fd05eaea001fbcb9da9685473e4094\": container with ID starting with 403a24dc376480fe074ac62e00668868a8fd05eaea001fbcb9da9685473e4094 not found: ID does not exist"
Sep 11 16:44:08.896139 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:08.896119    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-983a9aee-74646546fd-qg249"]
Sep 11 16:44:08.901714 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:08.901696    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-983a9aee-74646546fd-qg249"]
Sep 11 16:44:08.914491 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:08.914468    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-983a9aee-95895fd46-jdtfk"]
Sep 11 16:44:08.920058 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:08.920040    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-983a9aee-95895fd46-jdtfk"]
Sep 11 16:44:08.987355 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:08.987290    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9318213e-1ed3-473b-b6d4-af671ce64877" path="/var/lib/kubelet/pods/9318213e-1ed3-473b-b6d4-af671ce64877/volumes"
Sep 11 16:44:08.987698 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:08.987679    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b82478e-7871-45bf-8738-1732f41a8adc" path="/var/lib/kubelet/pods/9b82478e-7871-45bf-8738-1732f41a8adc/volumes"
Sep 11 16:44:08.993051 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:08.993032    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:44:09.297375 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:09.297287    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:44:09.496856 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:09.496823    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:44:11.604634 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:11.604601    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:44:11.730493 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:11.730463    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:44:12.810042 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:12.810013    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-83625e23-6d79dc7cf5-pph2p"]
Sep 11 16:44:12.810425 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:12.810411    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9318213e-1ed3-473b-b6d4-af671ce64877" containerName="payload-pre-processing"
Sep 11 16:44:12.810468 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:12.810426    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9318213e-1ed3-473b-b6d4-af671ce64877" containerName="payload-pre-processing"
Sep 11 16:44:12.810468 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:12.810438    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b82478e-7871-45bf-8738-1732f41a8adc" containerName="payload-processing"
Sep 11 16:44:12.810468 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:12.810443    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b82478e-7871-45bf-8738-1732f41a8adc" containerName="payload-processing"
Sep 11 16:44:12.810565 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:12.810505    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b82478e-7871-45bf-8738-1732f41a8adc" containerName="payload-processing"
Sep 11 16:44:12.810565 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:12.810515    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9318213e-1ed3-473b-b6d4-af671ce64877" containerName="payload-pre-processing"
Sep 11 16:44:12.815116 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:12.815072    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-83625e23-6d79dc7cf5-pph2p"
Sep 11 16:44:12.817657 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:12.817635    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-83625e23-serving-cert\""
Sep 11 16:44:12.828412 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:12.828389    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-83625e23-6d79dc7cf5-pph2p"]
Sep 11 16:44:12.853439 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:12.853416    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:44:12.942010 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:12.941974    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa6ff606-3ce8-4603-bad3-52c49a8f6594-metrics-certs\") pod \"maas-api-e2e-ait-83625e23-6d79dc7cf5-pph2p\" (UID: \"aa6ff606-3ce8-4603-bad3-52c49a8f6594\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-83625e23-6d79dc7cf5-pph2p"
Sep 11 16:44:12.942010 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:12.942010    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa6ff606-3ce8-4603-bad3-52c49a8f6594-openshift-service-ca\") pod \"maas-api-e2e-ait-83625e23-6d79dc7cf5-pph2p\" (UID: \"aa6ff606-3ce8-4603-bad3-52c49a8f6594\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-83625e23-6d79dc7cf5-pph2p"
Sep 11 16:44:12.942232 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:12.942045    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ch6ft\" (UniqueName: \"kubernetes.io/projected/aa6ff606-3ce8-4603-bad3-52c49a8f6594-kube-api-access-ch6ft\") pod \"maas-api-e2e-ait-83625e23-6d79dc7cf5-pph2p\" (UID: \"aa6ff606-3ce8-4603-bad3-52c49a8f6594\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-83625e23-6d79dc7cf5-pph2p"
Sep 11 16:44:12.942232 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:12.942200    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa6ff606-3ce8-4603-bad3-52c49a8f6594-maas-api-tls\") pod \"maas-api-e2e-ait-83625e23-6d79dc7cf5-pph2p\" (UID: \"aa6ff606-3ce8-4603-bad3-52c49a8f6594\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-83625e23-6d79dc7cf5-pph2p"
Sep 11 16:44:12.987045 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:12.987005    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:44:13.043187 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:13.043161    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa6ff606-3ce8-4603-bad3-52c49a8f6594-maas-api-tls\") pod \"maas-api-e2e-ait-83625e23-6d79dc7cf5-pph2p\" (UID: \"aa6ff606-3ce8-4603-bad3-52c49a8f6594\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-83625e23-6d79dc7cf5-pph2p"
Sep 11 16:44:13.043339 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:13.043212    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa6ff606-3ce8-4603-bad3-52c49a8f6594-metrics-certs\") pod \"maas-api-e2e-ait-83625e23-6d79dc7cf5-pph2p\" (UID: \"aa6ff606-3ce8-4603-bad3-52c49a8f6594\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-83625e23-6d79dc7cf5-pph2p"
Sep 11 16:44:13.043339 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:13.043228    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa6ff606-3ce8-4603-bad3-52c49a8f6594-openshift-service-ca\") pod \"maas-api-e2e-ait-83625e23-6d79dc7cf5-pph2p\" (UID: \"aa6ff606-3ce8-4603-bad3-52c49a8f6594\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-83625e23-6d79dc7cf5-pph2p"
Sep 11 16:44:13.043339 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:13.043258    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch6ft\" (UniqueName: \"kubernetes.io/projected/aa6ff606-3ce8-4603-bad3-52c49a8f6594-kube-api-access-ch6ft\") pod \"maas-api-e2e-ait-83625e23-6d79dc7cf5-pph2p\" (UID: \"aa6ff606-3ce8-4603-bad3-52c49a8f6594\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-83625e23-6d79dc7cf5-pph2p"
Sep 11 16:44:13.043948 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:13.043877    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa6ff606-3ce8-4603-bad3-52c49a8f6594-openshift-service-ca\") pod \"maas-api-e2e-ait-83625e23-6d79dc7cf5-pph2p\" (UID: \"aa6ff606-3ce8-4603-bad3-52c49a8f6594\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-83625e23-6d79dc7cf5-pph2p"
Sep 11 16:44:13.045726 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:13.045702    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa6ff606-3ce8-4603-bad3-52c49a8f6594-metrics-certs\") pod \"maas-api-e2e-ait-83625e23-6d79dc7cf5-pph2p\" (UID: \"aa6ff606-3ce8-4603-bad3-52c49a8f6594\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-83625e23-6d79dc7cf5-pph2p"
Sep 11 16:44:13.045830 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:13.045725    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa6ff606-3ce8-4603-bad3-52c49a8f6594-maas-api-tls\") pod \"maas-api-e2e-ait-83625e23-6d79dc7cf5-pph2p\" (UID: \"aa6ff606-3ce8-4603-bad3-52c49a8f6594\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-83625e23-6d79dc7cf5-pph2p"
Sep 11 16:44:13.061063 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:13.061010    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ch6ft\" (UniqueName: \"kubernetes.io/projected/aa6ff606-3ce8-4603-bad3-52c49a8f6594-kube-api-access-ch6ft\") pod \"maas-api-e2e-ait-83625e23-6d79dc7cf5-pph2p\" (UID: \"aa6ff606-3ce8-4603-bad3-52c49a8f6594\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-83625e23-6d79dc7cf5-pph2p"
Sep 11 16:44:13.127374 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:13.127356    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-83625e23-6d79dc7cf5-pph2p"
Sep 11 16:44:13.398852 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:13.398827    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-83625e23-6d79dc7cf5-pph2p"]
Sep 11 16:44:13.400787 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:44:13.400760    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa6ff606_3ce8_4603_bad3_52c49a8f6594.slice/crio-09f60d1b2a28884f8e85184d37d039bc1ec46bb3dd265be2559290c13cb0b3ad WatchSource:0}: Error finding container 09f60d1b2a28884f8e85184d37d039bc1ec46bb3dd265be2559290c13cb0b3ad: Status 404 returned error can't find the container with id 09f60d1b2a28884f8e85184d37d039bc1ec46bb3dd265be2559290c13cb0b3ad
Sep 11 16:44:13.587778 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:13.587747    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:44:13.692175 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:13.692130    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:44:13.739478 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:13.739446    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-83625e23-5bcbf6f9c4-2pgfc"]
Sep 11 16:44:13.744063 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:13.744044    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-83625e23-5bcbf6f9c4-2pgfc"
Sep 11 16:44:13.746877 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:13.746855    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-83625e23\""
Sep 11 16:44:13.747009 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:13.746922    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-83625e23-dockercfg-jdd24\""
Sep 11 16:44:13.756377 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:13.756346    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-83625e23-5bcbf6f9c4-2pgfc"]
Sep 11 16:44:13.851327 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:13.851295    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5t4c\" (UniqueName: \"kubernetes.io/projected/37e897fe-1d91-4365-8a1c-4792ecb7ff32-kube-api-access-c5t4c\") pod \"payload-pre-processing-e2e-ait-83625e23-5bcbf6f9c4-2pgfc\" (UID: \"37e897fe-1d91-4365-8a1c-4792ecb7ff32\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-83625e23-5bcbf6f9c4-2pgfc"
Sep 11 16:44:13.851619 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:13.851452    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37e897fe-1d91-4365-8a1c-4792ecb7ff32-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-83625e23-5bcbf6f9c4-2pgfc\" (UID: \"37e897fe-1d91-4365-8a1c-4792ecb7ff32\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-83625e23-5bcbf6f9c4-2pgfc"
Sep 11 16:44:13.892833 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:13.892805    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-83625e23-6d79dc7cf5-pph2p" event={"ID":"aa6ff606-3ce8-4603-bad3-52c49a8f6594","Type":"ContainerStarted","Data":"36cd0b6a198232e1d2ba4393cf414bc414c6e76c2a01320c699a8331609e7133"}
Sep 11 16:44:13.892993 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:13.892853    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-83625e23-6d79dc7cf5-pph2p" event={"ID":"aa6ff606-3ce8-4603-bad3-52c49a8f6594","Type":"ContainerStarted","Data":"09f60d1b2a28884f8e85184d37d039bc1ec46bb3dd265be2559290c13cb0b3ad"}
Sep 11 16:44:13.892993 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:13.892901    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-83625e23-6d79dc7cf5-pph2p"
Sep 11 16:44:13.912800 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:13.912752    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-83625e23-6d79dc7cf5-pph2p" podStartSLOduration=1.537974817 podStartE2EDuration="1.912737178s" totalImagesPullingTime="374.762361ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:44:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:44:13.912270189 +0000 UTC m=+853.529027281" watchObservedRunningTime="2026-09-11 16:44:13.912737178 +0000 UTC m=+853.529494244"
Sep 11 16:44:13.952949 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:13.952875    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37e897fe-1d91-4365-8a1c-4792ecb7ff32-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-83625e23-5bcbf6f9c4-2pgfc\" (UID: \"37e897fe-1d91-4365-8a1c-4792ecb7ff32\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-83625e23-5bcbf6f9c4-2pgfc"
Sep 11 16:44:13.953058 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:13.952955    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5t4c\" (UniqueName: \"kubernetes.io/projected/37e897fe-1d91-4365-8a1c-4792ecb7ff32-kube-api-access-c5t4c\") pod \"payload-pre-processing-e2e-ait-83625e23-5bcbf6f9c4-2pgfc\" (UID: \"37e897fe-1d91-4365-8a1c-4792ecb7ff32\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-83625e23-5bcbf6f9c4-2pgfc"
Sep 11 16:44:13.953545 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:13.953528    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37e897fe-1d91-4365-8a1c-4792ecb7ff32-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-83625e23-5bcbf6f9c4-2pgfc\" (UID: \"37e897fe-1d91-4365-8a1c-4792ecb7ff32\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-83625e23-5bcbf6f9c4-2pgfc"
Sep 11 16:44:13.962777 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:13.962759    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5t4c\" (UniqueName: \"kubernetes.io/projected/37e897fe-1d91-4365-8a1c-4792ecb7ff32-kube-api-access-c5t4c\") pod \"payload-pre-processing-e2e-ait-83625e23-5bcbf6f9c4-2pgfc\" (UID: \"37e897fe-1d91-4365-8a1c-4792ecb7ff32\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-83625e23-5bcbf6f9c4-2pgfc"
Sep 11 16:44:14.055928 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:14.055900    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-83625e23-5bcbf6f9c4-2pgfc"
Sep 11 16:44:14.328240 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:14.328186    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-83625e23-5bcbf6f9c4-2pgfc"]
Sep 11 16:44:14.330709 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:44:14.330676    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37e897fe_1d91_4365_8a1c_4792ecb7ff32.slice/crio-f1155e8f9a0b3f93c610c616b2903007f38110a963c08b2c4e9fa3552b3e3100 WatchSource:0}: Error finding container f1155e8f9a0b3f93c610c616b2903007f38110a963c08b2c4e9fa3552b3e3100: Status 404 returned error can't find the container with id f1155e8f9a0b3f93c610c616b2903007f38110a963c08b2c4e9fa3552b3e3100
Sep 11 16:44:14.902670 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:14.902632    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-83625e23-5bcbf6f9c4-2pgfc" event={"ID":"37e897fe-1d91-4365-8a1c-4792ecb7ff32","Type":"ContainerStarted","Data":"53784a86666db4deb84b4766c96df27659180ab66136de78865b2f8f636e4c99"}
Sep 11 16:44:14.903114 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:14.902697    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-83625e23-5bcbf6f9c4-2pgfc" event={"ID":"37e897fe-1d91-4365-8a1c-4792ecb7ff32","Type":"ContainerStarted","Data":"f1155e8f9a0b3f93c610c616b2903007f38110a963c08b2c4e9fa3552b3e3100"}
Sep 11 16:44:14.903114 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:14.902807    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-83625e23-5bcbf6f9c4-2pgfc"
Sep 11 16:44:14.925407 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:14.925356    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-83625e23-5bcbf6f9c4-2pgfc" podStartSLOduration=1.9253369390000001 podStartE2EDuration="1.925336939s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:44:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:44:14.924396018 +0000 UTC m=+854.541153101" watchObservedRunningTime="2026-09-11 16:44:14.925336939 +0000 UTC m=+854.542094007"
Sep 11 16:44:19.908626 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:19.908597    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-83625e23-6d79dc7cf5-pph2p"
Sep 11 16:44:25.909926 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:25.909893    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-83625e23-5bcbf6f9c4-2pgfc"
Sep 11 16:44:40.135920 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:40.135806    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:44:43.340732 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:43.340696    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-83625e23-6d79dc7cf5-pph2p"]
Sep 11 16:44:43.341182 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:43.340962    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-83625e23-6d79dc7cf5-pph2p" podUID="aa6ff606-3ce8-4603-bad3-52c49a8f6594" containerName="maas-api" containerID="cri-o://36cd0b6a198232e1d2ba4393cf414bc414c6e76c2a01320c699a8331609e7133" gracePeriod=30
Sep 11 16:44:43.373653 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:43.373627    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:44:43.411231 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:43.411194    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-83625e23-5bcbf6f9c4-2pgfc"]
Sep 11 16:44:43.411429 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:43.411406    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-83625e23-5bcbf6f9c4-2pgfc" podUID="37e897fe-1d91-4365-8a1c-4792ecb7ff32" containerName="payload-pre-processing" containerID="cri-o://53784a86666db4deb84b4766c96df27659180ab66136de78865b2f8f636e4c99" gracePeriod=30
Sep 11 16:44:43.476425 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:43.476395    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:44:43.581674 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:43.581618    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:44:43.664021 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:43.663998    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-83625e23-6d79dc7cf5-pph2p"
Sep 11 16:44:43.683646 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:43.683617    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:44:43.705428 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:43.705403    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-83625e23-5bcbf6f9c4-2pgfc"
Sep 11 16:44:43.802573 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:43.802544    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa6ff606-3ce8-4603-bad3-52c49a8f6594-metrics-certs\") pod \"aa6ff606-3ce8-4603-bad3-52c49a8f6594\" (UID: \"aa6ff606-3ce8-4603-bad3-52c49a8f6594\") "
Sep 11 16:44:43.802721 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:43.802617    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa6ff606-3ce8-4603-bad3-52c49a8f6594-maas-api-tls\") pod \"aa6ff606-3ce8-4603-bad3-52c49a8f6594\" (UID: \"aa6ff606-3ce8-4603-bad3-52c49a8f6594\") "
Sep 11 16:44:43.802721 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:43.802638    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa6ff606-3ce8-4603-bad3-52c49a8f6594-openshift-service-ca\") pod \"aa6ff606-3ce8-4603-bad3-52c49a8f6594\" (UID: \"aa6ff606-3ce8-4603-bad3-52c49a8f6594\") "
Sep 11 16:44:43.802721 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:43.802677    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ch6ft\" (UniqueName: \"kubernetes.io/projected/aa6ff606-3ce8-4603-bad3-52c49a8f6594-kube-api-access-ch6ft\") pod \"aa6ff606-3ce8-4603-bad3-52c49a8f6594\" (UID: \"aa6ff606-3ce8-4603-bad3-52c49a8f6594\") "
Sep 11 16:44:43.802892 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:43.802730    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5t4c\" (UniqueName: \"kubernetes.io/projected/37e897fe-1d91-4365-8a1c-4792ecb7ff32-kube-api-access-c5t4c\") pod \"37e897fe-1d91-4365-8a1c-4792ecb7ff32\" (UID: \"37e897fe-1d91-4365-8a1c-4792ecb7ff32\") "
Sep 11 16:44:43.802892 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:43.802745    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37e897fe-1d91-4365-8a1c-4792ecb7ff32-plugins-config-volume\") pod \"37e897fe-1d91-4365-8a1c-4792ecb7ff32\" (UID: \"37e897fe-1d91-4365-8a1c-4792ecb7ff32\") "
Sep 11 16:44:43.803067 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:43.803042    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa6ff606-3ce8-4603-bad3-52c49a8f6594-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "aa6ff606-3ce8-4603-bad3-52c49a8f6594" (UID: "aa6ff606-3ce8-4603-bad3-52c49a8f6594"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:44:43.803216 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:43.803187    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37e897fe-1d91-4365-8a1c-4792ecb7ff32-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "37e897fe-1d91-4365-8a1c-4792ecb7ff32" (UID: "37e897fe-1d91-4365-8a1c-4792ecb7ff32"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:44:43.804931 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:43.804911    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa6ff606-3ce8-4603-bad3-52c49a8f6594-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "aa6ff606-3ce8-4603-bad3-52c49a8f6594" (UID: "aa6ff606-3ce8-4603-bad3-52c49a8f6594"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:44:43.805019 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:43.804931    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa6ff606-3ce8-4603-bad3-52c49a8f6594-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "aa6ff606-3ce8-4603-bad3-52c49a8f6594" (UID: "aa6ff606-3ce8-4603-bad3-52c49a8f6594"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:44:43.805402 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:43.805379    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa6ff606-3ce8-4603-bad3-52c49a8f6594-kube-api-access-ch6ft" (OuterVolumeSpecName: "kube-api-access-ch6ft") pod "aa6ff606-3ce8-4603-bad3-52c49a8f6594" (UID: "aa6ff606-3ce8-4603-bad3-52c49a8f6594"). InnerVolumeSpecName "kube-api-access-ch6ft". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:44:43.805454 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:43.805411    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37e897fe-1d91-4365-8a1c-4792ecb7ff32-kube-api-access-c5t4c" (OuterVolumeSpecName: "kube-api-access-c5t4c") pod "37e897fe-1d91-4365-8a1c-4792ecb7ff32" (UID: "37e897fe-1d91-4365-8a1c-4792ecb7ff32"). InnerVolumeSpecName "kube-api-access-c5t4c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:44:43.903435 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:43.903386    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa6ff606-3ce8-4603-bad3-52c49a8f6594-openshift-service-ca\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:44:43.903435 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:43.903412    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ch6ft\" (UniqueName: \"kubernetes.io/projected/aa6ff606-3ce8-4603-bad3-52c49a8f6594-kube-api-access-ch6ft\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:44:43.903435 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:43.903427    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5t4c\" (UniqueName: \"kubernetes.io/projected/37e897fe-1d91-4365-8a1c-4792ecb7ff32-kube-api-access-c5t4c\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:44:43.903570 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:43.903437    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37e897fe-1d91-4365-8a1c-4792ecb7ff32-plugins-config-volume\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:44:43.903570 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:43.903447    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa6ff606-3ce8-4603-bad3-52c49a8f6594-metrics-certs\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:44:43.903570 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:43.903456    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa6ff606-3ce8-4603-bad3-52c49a8f6594-maas-api-tls\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:44:44.036728 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:44.036699    2581 generic.go:356] "Generic (PLEG): container finished" podID="37e897fe-1d91-4365-8a1c-4792ecb7ff32" containerID="53784a86666db4deb84b4766c96df27659180ab66136de78865b2f8f636e4c99" exitCode=0
Sep 11 16:44:44.036855 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:44.036740    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-83625e23-5bcbf6f9c4-2pgfc"
Sep 11 16:44:44.036855 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:44.036784    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-83625e23-5bcbf6f9c4-2pgfc" event={"ID":"37e897fe-1d91-4365-8a1c-4792ecb7ff32","Type":"ContainerDied","Data":"53784a86666db4deb84b4766c96df27659180ab66136de78865b2f8f636e4c99"}
Sep 11 16:44:44.036855 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:44.036832    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-83625e23-5bcbf6f9c4-2pgfc" event={"ID":"37e897fe-1d91-4365-8a1c-4792ecb7ff32","Type":"ContainerDied","Data":"f1155e8f9a0b3f93c610c616b2903007f38110a963c08b2c4e9fa3552b3e3100"}
Sep 11 16:44:44.037022 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:44.036864    2581 scope.go:117] "RemoveContainer" containerID="53784a86666db4deb84b4766c96df27659180ab66136de78865b2f8f636e4c99"
Sep 11 16:44:44.038271 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:44.038246    2581 generic.go:356] "Generic (PLEG): container finished" podID="aa6ff606-3ce8-4603-bad3-52c49a8f6594" containerID="36cd0b6a198232e1d2ba4393cf414bc414c6e76c2a01320c699a8331609e7133" exitCode=0
Sep 11 16:44:44.038378 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:44.038295    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-83625e23-6d79dc7cf5-pph2p"
Sep 11 16:44:44.038378 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:44.038309    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-83625e23-6d79dc7cf5-pph2p" event={"ID":"aa6ff606-3ce8-4603-bad3-52c49a8f6594","Type":"ContainerDied","Data":"36cd0b6a198232e1d2ba4393cf414bc414c6e76c2a01320c699a8331609e7133"}
Sep 11 16:44:44.038460 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:44.038384    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-83625e23-6d79dc7cf5-pph2p" event={"ID":"aa6ff606-3ce8-4603-bad3-52c49a8f6594","Type":"ContainerDied","Data":"09f60d1b2a28884f8e85184d37d039bc1ec46bb3dd265be2559290c13cb0b3ad"}
Sep 11 16:44:44.045912 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:44.045892    2581 scope.go:117] "RemoveContainer" containerID="53784a86666db4deb84b4766c96df27659180ab66136de78865b2f8f636e4c99"
Sep 11 16:44:44.046384 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:44:44.046362    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53784a86666db4deb84b4766c96df27659180ab66136de78865b2f8f636e4c99\": container with ID starting with 53784a86666db4deb84b4766c96df27659180ab66136de78865b2f8f636e4c99 not found: ID does not exist" containerID="53784a86666db4deb84b4766c96df27659180ab66136de78865b2f8f636e4c99"
Sep 11 16:44:44.046467 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:44.046390    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53784a86666db4deb84b4766c96df27659180ab66136de78865b2f8f636e4c99"} err="failed to get container status \"53784a86666db4deb84b4766c96df27659180ab66136de78865b2f8f636e4c99\": rpc error: code = NotFound desc = could not find container \"53784a86666db4deb84b4766c96df27659180ab66136de78865b2f8f636e4c99\": container with ID starting with 53784a86666db4deb84b4766c96df27659180ab66136de78865b2f8f636e4c99 not found: ID does not exist"
Sep 11 16:44:44.046467 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:44.046405    2581 scope.go:117] "RemoveContainer" containerID="36cd0b6a198232e1d2ba4393cf414bc414c6e76c2a01320c699a8331609e7133"
Sep 11 16:44:44.054696 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:44.054682    2581 scope.go:117] "RemoveContainer" containerID="36cd0b6a198232e1d2ba4393cf414bc414c6e76c2a01320c699a8331609e7133"
Sep 11 16:44:44.054942 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:44:44.054926    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36cd0b6a198232e1d2ba4393cf414bc414c6e76c2a01320c699a8331609e7133\": container with ID starting with 36cd0b6a198232e1d2ba4393cf414bc414c6e76c2a01320c699a8331609e7133 not found: ID does not exist" containerID="36cd0b6a198232e1d2ba4393cf414bc414c6e76c2a01320c699a8331609e7133"
Sep 11 16:44:44.054990 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:44.054947    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36cd0b6a198232e1d2ba4393cf414bc414c6e76c2a01320c699a8331609e7133"} err="failed to get container status \"36cd0b6a198232e1d2ba4393cf414bc414c6e76c2a01320c699a8331609e7133\": rpc error: code = NotFound desc = could not find container \"36cd0b6a198232e1d2ba4393cf414bc414c6e76c2a01320c699a8331609e7133\": container with ID starting with 36cd0b6a198232e1d2ba4393cf414bc414c6e76c2a01320c699a8331609e7133 not found: ID does not exist"
Sep 11 16:44:44.064129 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:44.064108    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-83625e23-6d79dc7cf5-pph2p"]
Sep 11 16:44:44.069058 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:44.069034    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-83625e23-6d79dc7cf5-pph2p"]
Sep 11 16:44:44.083825 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:44.083805    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-83625e23-5bcbf6f9c4-2pgfc"]
Sep 11 16:44:44.087431 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:44.087412    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-83625e23-5bcbf6f9c4-2pgfc"]
Sep 11 16:44:44.825239 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:44.825205    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:44:44.987263 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:44.987231    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37e897fe-1d91-4365-8a1c-4792ecb7ff32" path="/var/lib/kubelet/pods/37e897fe-1d91-4365-8a1c-4792ecb7ff32/volumes"
Sep 11 16:44:44.987592 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:44.987580    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa6ff606-3ce8-4603-bad3-52c49a8f6594" path="/var/lib/kubelet/pods/aa6ff606-3ce8-4603-bad3-52c49a8f6594/volumes"
Sep 11 16:44:45.169145 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:45.169057    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:44:45.509821 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:45.509788    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:44:45.760109 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:45.760018    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:44:47.872396 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:47.872369    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:44:47.966764 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:47.966741    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:44:49.028216 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:49.028179    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-4bf042d5-56b74bc46f-tmvqn"]
Sep 11 16:44:49.028572 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:49.028537    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa6ff606-3ce8-4603-bad3-52c49a8f6594" containerName="maas-api"
Sep 11 16:44:49.028572 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:49.028548    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa6ff606-3ce8-4603-bad3-52c49a8f6594" containerName="maas-api"
Sep 11 16:44:49.028572 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:49.028569    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37e897fe-1d91-4365-8a1c-4792ecb7ff32" containerName="payload-pre-processing"
Sep 11 16:44:49.028674 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:49.028574    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="37e897fe-1d91-4365-8a1c-4792ecb7ff32" containerName="payload-pre-processing"
Sep 11 16:44:49.028674 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:49.028632    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="37e897fe-1d91-4365-8a1c-4792ecb7ff32" containerName="payload-pre-processing"
Sep 11 16:44:49.028674 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:49.028641    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa6ff606-3ce8-4603-bad3-52c49a8f6594" containerName="maas-api"
Sep 11 16:44:49.032999 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:49.032975    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-4bf042d5-56b74bc46f-tmvqn"
Sep 11 16:44:49.036949 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:49.036929    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-4bf042d5-serving-cert\""
Sep 11 16:44:49.051455 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:49.051309    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-4bf042d5-56b74bc46f-tmvqn"]
Sep 11 16:44:49.078898 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:49.078864    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:44:49.149516 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:49.149475    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9xlm\" (UniqueName: \"kubernetes.io/projected/a2110f51-4dc3-4c37-bc30-ca99776e908c-kube-api-access-w9xlm\") pod \"maas-api-e2e-derive-4bf042d5-56b74bc46f-tmvqn\" (UID: \"a2110f51-4dc3-4c37-bc30-ca99776e908c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-4bf042d5-56b74bc46f-tmvqn"
Sep 11 16:44:49.149736 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:49.149663    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2110f51-4dc3-4c37-bc30-ca99776e908c-metrics-certs\") pod \"maas-api-e2e-derive-4bf042d5-56b74bc46f-tmvqn\" (UID: \"a2110f51-4dc3-4c37-bc30-ca99776e908c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-4bf042d5-56b74bc46f-tmvqn"
Sep 11 16:44:49.149809 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:49.149795    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2110f51-4dc3-4c37-bc30-ca99776e908c-maas-api-tls\") pod \"maas-api-e2e-derive-4bf042d5-56b74bc46f-tmvqn\" (UID: \"a2110f51-4dc3-4c37-bc30-ca99776e908c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-4bf042d5-56b74bc46f-tmvqn"
Sep 11 16:44:49.149868 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:49.149849    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2110f51-4dc3-4c37-bc30-ca99776e908c-openshift-service-ca\") pod \"maas-api-e2e-derive-4bf042d5-56b74bc46f-tmvqn\" (UID: \"a2110f51-4dc3-4c37-bc30-ca99776e908c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-4bf042d5-56b74bc46f-tmvqn"
Sep 11 16:44:49.198313 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:49.198278    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:44:49.250658 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:49.250617    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9xlm\" (UniqueName: \"kubernetes.io/projected/a2110f51-4dc3-4c37-bc30-ca99776e908c-kube-api-access-w9xlm\") pod \"maas-api-e2e-derive-4bf042d5-56b74bc46f-tmvqn\" (UID: \"a2110f51-4dc3-4c37-bc30-ca99776e908c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-4bf042d5-56b74bc46f-tmvqn"
Sep 11 16:44:49.250862 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:49.250683    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2110f51-4dc3-4c37-bc30-ca99776e908c-metrics-certs\") pod \"maas-api-e2e-derive-4bf042d5-56b74bc46f-tmvqn\" (UID: \"a2110f51-4dc3-4c37-bc30-ca99776e908c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-4bf042d5-56b74bc46f-tmvqn"
Sep 11 16:44:49.250862 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:49.250702    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2110f51-4dc3-4c37-bc30-ca99776e908c-maas-api-tls\") pod \"maas-api-e2e-derive-4bf042d5-56b74bc46f-tmvqn\" (UID: \"a2110f51-4dc3-4c37-bc30-ca99776e908c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-4bf042d5-56b74bc46f-tmvqn"
Sep 11 16:44:49.250862 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:49.250735    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2110f51-4dc3-4c37-bc30-ca99776e908c-openshift-service-ca\") pod \"maas-api-e2e-derive-4bf042d5-56b74bc46f-tmvqn\" (UID: \"a2110f51-4dc3-4c37-bc30-ca99776e908c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-4bf042d5-56b74bc46f-tmvqn"
Sep 11 16:44:49.251416 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:49.251392    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2110f51-4dc3-4c37-bc30-ca99776e908c-openshift-service-ca\") pod \"maas-api-e2e-derive-4bf042d5-56b74bc46f-tmvqn\" (UID: \"a2110f51-4dc3-4c37-bc30-ca99776e908c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-4bf042d5-56b74bc46f-tmvqn"
Sep 11 16:44:49.253425 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:49.253389    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2110f51-4dc3-4c37-bc30-ca99776e908c-metrics-certs\") pod \"maas-api-e2e-derive-4bf042d5-56b74bc46f-tmvqn\" (UID: \"a2110f51-4dc3-4c37-bc30-ca99776e908c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-4bf042d5-56b74bc46f-tmvqn"
Sep 11 16:44:49.253509 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:49.253476    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2110f51-4dc3-4c37-bc30-ca99776e908c-maas-api-tls\") pod \"maas-api-e2e-derive-4bf042d5-56b74bc46f-tmvqn\" (UID: \"a2110f51-4dc3-4c37-bc30-ca99776e908c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-4bf042d5-56b74bc46f-tmvqn"
Sep 11 16:44:49.263276 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:49.263233    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9xlm\" (UniqueName: \"kubernetes.io/projected/a2110f51-4dc3-4c37-bc30-ca99776e908c-kube-api-access-w9xlm\") pod \"maas-api-e2e-derive-4bf042d5-56b74bc46f-tmvqn\" (UID: \"a2110f51-4dc3-4c37-bc30-ca99776e908c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-4bf042d5-56b74bc46f-tmvqn"
Sep 11 16:44:49.300325 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:49.300242    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:44:49.369327 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:49.369283    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-4bf042d5-56b74bc46f-tmvqn"
Sep 11 16:44:49.657295 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:49.657266    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-4bf042d5-56b74bc46f-tmvqn"]
Sep 11 16:44:49.660318 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:44:49.660285    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2110f51_4dc3_4c37_bc30_ca99776e908c.slice/crio-be16d7aa71e3e4d04225b3aac11be1ff07b1b5fba164aee3726b43fa109f07f2 WatchSource:0}: Error finding container be16d7aa71e3e4d04225b3aac11be1ff07b1b5fba164aee3726b43fa109f07f2: Status 404 returned error can't find the container with id be16d7aa71e3e4d04225b3aac11be1ff07b1b5fba164aee3726b43fa109f07f2
Sep 11 16:44:49.719878 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:49.719847    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:44:49.813205 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:49.813167    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:44:49.926551 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:49.926463    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-4bf042d5-6cd59f6774-2g5d8"]
Sep 11 16:44:49.931057 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:49.931033    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-4bf042d5-6cd59f6774-2g5d8"
Sep 11 16:44:49.933934 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:49.933912    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-4bf042d5-dockercfg-rh7nr\""
Sep 11 16:44:49.934037 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:49.934020    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-4bf042d5\""
Sep 11 16:44:49.953459 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:49.953419    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-4bf042d5-6cd59f6774-2g5d8"]
Sep 11 16:44:50.016914 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:50.016871    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-4bf042d5-5dc499bc65-ntk2z"]
Sep 11 16:44:50.020552 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:50.020520    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-4bf042d5-5dc499bc65-ntk2z"
Sep 11 16:44:50.037953 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:50.037919    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-4bf042d5-5dc499bc65-ntk2z"]
Sep 11 16:44:50.059202 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:50.059169    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/759c2c97-e6f8-4f9d-9783-2e7b3f131c05-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-4bf042d5-6cd59f6774-2g5d8\" (UID: \"759c2c97-e6f8-4f9d-9783-2e7b3f131c05\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-4bf042d5-6cd59f6774-2g5d8"
Sep 11 16:44:50.059400 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:50.059353    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zzwh\" (UniqueName: \"kubernetes.io/projected/759c2c97-e6f8-4f9d-9783-2e7b3f131c05-kube-api-access-6zzwh\") pod \"payload-pre-processing-e2e-derive-4bf042d5-6cd59f6774-2g5d8\" (UID: \"759c2c97-e6f8-4f9d-9783-2e7b3f131c05\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-4bf042d5-6cd59f6774-2g5d8"
Sep 11 16:44:50.070344 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:50.070308    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-4bf042d5-56b74bc46f-tmvqn" event={"ID":"a2110f51-4dc3-4c37-bc30-ca99776e908c","Type":"ContainerStarted","Data":"be16d7aa71e3e4d04225b3aac11be1ff07b1b5fba164aee3726b43fa109f07f2"}
Sep 11 16:44:50.160820 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:50.160768    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zzwh\" (UniqueName: \"kubernetes.io/projected/759c2c97-e6f8-4f9d-9783-2e7b3f131c05-kube-api-access-6zzwh\") pod \"payload-pre-processing-e2e-derive-4bf042d5-6cd59f6774-2g5d8\" (UID: \"759c2c97-e6f8-4f9d-9783-2e7b3f131c05\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-4bf042d5-6cd59f6774-2g5d8"
Sep 11 16:44:50.160820 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:50.160819    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4h6n\" (UniqueName: \"kubernetes.io/projected/ffe23d02-d3ec-4eb2-9db8-af82d1af212d-kube-api-access-d4h6n\") pod \"payload-processing-e2e-derive-4bf042d5-5dc499bc65-ntk2z\" (UID: \"ffe23d02-d3ec-4eb2-9db8-af82d1af212d\") " pod="openshift-ingress/payload-processing-e2e-derive-4bf042d5-5dc499bc65-ntk2z"
Sep 11 16:44:50.161128 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:50.160860    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/759c2c97-e6f8-4f9d-9783-2e7b3f131c05-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-4bf042d5-6cd59f6774-2g5d8\" (UID: \"759c2c97-e6f8-4f9d-9783-2e7b3f131c05\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-4bf042d5-6cd59f6774-2g5d8"
Sep 11 16:44:50.161128 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:50.160901    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ffe23d02-d3ec-4eb2-9db8-af82d1af212d-plugins-config-volume\") pod \"payload-processing-e2e-derive-4bf042d5-5dc499bc65-ntk2z\" (UID: \"ffe23d02-d3ec-4eb2-9db8-af82d1af212d\") " pod="openshift-ingress/payload-processing-e2e-derive-4bf042d5-5dc499bc65-ntk2z"
Sep 11 16:44:50.161587 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:50.161565    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/759c2c97-e6f8-4f9d-9783-2e7b3f131c05-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-4bf042d5-6cd59f6774-2g5d8\" (UID: \"759c2c97-e6f8-4f9d-9783-2e7b3f131c05\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-4bf042d5-6cd59f6774-2g5d8"
Sep 11 16:44:50.173393 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:50.173361    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zzwh\" (UniqueName: \"kubernetes.io/projected/759c2c97-e6f8-4f9d-9783-2e7b3f131c05-kube-api-access-6zzwh\") pod \"payload-pre-processing-e2e-derive-4bf042d5-6cd59f6774-2g5d8\" (UID: \"759c2c97-e6f8-4f9d-9783-2e7b3f131c05\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-4bf042d5-6cd59f6774-2g5d8"
Sep 11 16:44:50.242002 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:50.241972    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-4bf042d5-6cd59f6774-2g5d8"
Sep 11 16:44:50.262214 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:50.262184    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4h6n\" (UniqueName: \"kubernetes.io/projected/ffe23d02-d3ec-4eb2-9db8-af82d1af212d-kube-api-access-d4h6n\") pod \"payload-processing-e2e-derive-4bf042d5-5dc499bc65-ntk2z\" (UID: \"ffe23d02-d3ec-4eb2-9db8-af82d1af212d\") " pod="openshift-ingress/payload-processing-e2e-derive-4bf042d5-5dc499bc65-ntk2z"
Sep 11 16:44:50.262346 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:50.262274    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ffe23d02-d3ec-4eb2-9db8-af82d1af212d-plugins-config-volume\") pod \"payload-processing-e2e-derive-4bf042d5-5dc499bc65-ntk2z\" (UID: \"ffe23d02-d3ec-4eb2-9db8-af82d1af212d\") " pod="openshift-ingress/payload-processing-e2e-derive-4bf042d5-5dc499bc65-ntk2z"
Sep 11 16:44:50.262925 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:50.262900    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ffe23d02-d3ec-4eb2-9db8-af82d1af212d-plugins-config-volume\") pod \"payload-processing-e2e-derive-4bf042d5-5dc499bc65-ntk2z\" (UID: \"ffe23d02-d3ec-4eb2-9db8-af82d1af212d\") " pod="openshift-ingress/payload-processing-e2e-derive-4bf042d5-5dc499bc65-ntk2z"
Sep 11 16:44:50.279530 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:50.279503    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4h6n\" (UniqueName: \"kubernetes.io/projected/ffe23d02-d3ec-4eb2-9db8-af82d1af212d-kube-api-access-d4h6n\") pod \"payload-processing-e2e-derive-4bf042d5-5dc499bc65-ntk2z\" (UID: \"ffe23d02-d3ec-4eb2-9db8-af82d1af212d\") " pod="openshift-ingress/payload-processing-e2e-derive-4bf042d5-5dc499bc65-ntk2z"
Sep 11 16:44:50.331339 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:50.331084    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-4bf042d5-5dc499bc65-ntk2z"
Sep 11 16:44:50.527708 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:50.527617    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-4bf042d5-6cd59f6774-2g5d8"]
Sep 11 16:44:50.531206 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:44:50.531163    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod759c2c97_e6f8_4f9d_9783_2e7b3f131c05.slice/crio-cc4ec2b31024438cf99c9e7078c38b79f766ff251cadb8a095e0ce24c33257a8 WatchSource:0}: Error finding container cc4ec2b31024438cf99c9e7078c38b79f766ff251cadb8a095e0ce24c33257a8: Status 404 returned error can't find the container with id cc4ec2b31024438cf99c9e7078c38b79f766ff251cadb8a095e0ce24c33257a8
Sep 11 16:44:50.609124 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:50.609004    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-4bf042d5-5dc499bc65-ntk2z"]
Sep 11 16:44:50.611837 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:44:50.611803    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffe23d02_d3ec_4eb2_9db8_af82d1af212d.slice/crio-bfb888d9d53150b22a9f0c466b3340ec3fd2233af70f58eadcab5a9f8a29183b WatchSource:0}: Error finding container bfb888d9d53150b22a9f0c466b3340ec3fd2233af70f58eadcab5a9f8a29183b: Status 404 returned error can't find the container with id bfb888d9d53150b22a9f0c466b3340ec3fd2233af70f58eadcab5a9f8a29183b
Sep 11 16:44:51.077167 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:51.077135    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-4bf042d5-56b74bc46f-tmvqn" event={"ID":"a2110f51-4dc3-4c37-bc30-ca99776e908c","Type":"ContainerStarted","Data":"2473ccdf41e44cc43cd91a452d096b465e16dd05e601fcf7e59b47359301d141"}
Sep 11 16:44:51.077705 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:51.077245    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-4bf042d5-56b74bc46f-tmvqn"
Sep 11 16:44:51.079018 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:51.078996    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-4bf042d5-5dc499bc65-ntk2z" event={"ID":"ffe23d02-d3ec-4eb2-9db8-af82d1af212d","Type":"ContainerStarted","Data":"820d587185b9d0ef28080f7723dfbcc23ee8055dadddc10014eb8ca9c81126e1"}
Sep 11 16:44:51.079180 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:51.079038    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-4bf042d5-5dc499bc65-ntk2z" event={"ID":"ffe23d02-d3ec-4eb2-9db8-af82d1af212d","Type":"ContainerStarted","Data":"bfb888d9d53150b22a9f0c466b3340ec3fd2233af70f58eadcab5a9f8a29183b"}
Sep 11 16:44:51.079180 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:51.079066    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-4bf042d5-5dc499bc65-ntk2z"
Sep 11 16:44:51.080591 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:51.080566    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-4bf042d5-6cd59f6774-2g5d8" event={"ID":"759c2c97-e6f8-4f9d-9783-2e7b3f131c05","Type":"ContainerStarted","Data":"b9b5e8c80e4c4ee9a8ee65379485b56559899064b32de0bf1eea627574070cdb"}
Sep 11 16:44:51.080708 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:51.080609    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-4bf042d5-6cd59f6774-2g5d8" event={"ID":"759c2c97-e6f8-4f9d-9783-2e7b3f131c05","Type":"ContainerStarted","Data":"cc4ec2b31024438cf99c9e7078c38b79f766ff251cadb8a095e0ce24c33257a8"}
Sep 11 16:44:51.080708 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:51.080637    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-4bf042d5-6cd59f6774-2g5d8"
Sep 11 16:44:51.105675 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:51.105612    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-4bf042d5-56b74bc46f-tmvqn" podStartSLOduration=1.566722741 podStartE2EDuration="2.105595236s" totalImagesPullingTime="538.872495ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:44:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:44:51.104154639 +0000 UTC m=+890.720911723" watchObservedRunningTime="2026-09-11 16:44:51.105595236 +0000 UTC m=+890.722352336"
Sep 11 16:44:51.133908 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:51.133851    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-4bf042d5-6cd59f6774-2g5d8" podStartSLOduration=2.133833518 podStartE2EDuration="2.133833518s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:44:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:44:51.129627229 +0000 UTC m=+890.746384311" watchObservedRunningTime="2026-09-11 16:44:51.133833518 +0000 UTC m=+890.750590583"
Sep 11 16:44:51.189783 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:51.189732    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-4bf042d5-5dc499bc65-ntk2z" podStartSLOduration=2.189714148 podStartE2EDuration="2.189714148s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:44:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:44:51.188169946 +0000 UTC m=+890.804927026" watchObservedRunningTime="2026-09-11 16:44:51.189714148 +0000 UTC m=+890.806471213"
Sep 11 16:44:51.209958 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:51.209926    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:44:57.093917 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:44:57.093844    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-4bf042d5-56b74bc46f-tmvqn"
Sep 11 16:45:02.090772 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:02.090735    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-4bf042d5-5dc499bc65-ntk2z"
Sep 11 16:45:02.091268 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:02.090809    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-4bf042d5-6cd59f6774-2g5d8"
Sep 11 16:45:07.666332 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:07.666293    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:45:10.432971 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:10.432925    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:45:19.789669 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:19.789636    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-4bf042d5-56b74bc46f-tmvqn"]
Sep 11 16:45:19.792168 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:19.789846    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-4bf042d5-56b74bc46f-tmvqn" podUID="a2110f51-4dc3-4c37-bc30-ca99776e908c" containerName="maas-api" containerID="cri-o://2473ccdf41e44cc43cd91a452d096b465e16dd05e601fcf7e59b47359301d141" gracePeriod=30
Sep 11 16:45:19.819536 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:19.819499    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:45:19.891248 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:19.891204    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-4bf042d5-5dc499bc65-ntk2z"]
Sep 11 16:45:19.891485 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:19.891459    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-4bf042d5-5dc499bc65-ntk2z" podUID="ffe23d02-d3ec-4eb2-9db8-af82d1af212d" containerName="payload-processing" containerID="cri-o://820d587185b9d0ef28080f7723dfbcc23ee8055dadddc10014eb8ca9c81126e1" gracePeriod=30
Sep 11 16:45:19.907831 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:19.907797    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-4bf042d5-6cd59f6774-2g5d8"]
Sep 11 16:45:19.908080 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:19.908052    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-4bf042d5-6cd59f6774-2g5d8" podUID="759c2c97-e6f8-4f9d-9783-2e7b3f131c05" containerName="payload-pre-processing" containerID="cri-o://b9b5e8c80e4c4ee9a8ee65379485b56559899064b32de0bf1eea627574070cdb" gracePeriod=30
Sep 11 16:45:19.952892 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:19.952859    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:45:20.049751 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.049718    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:45:20.070472 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.070446    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-4bf042d5-56b74bc46f-tmvqn"
Sep 11 16:45:20.131831 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.131798    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2110f51-4dc3-4c37-bc30-ca99776e908c-maas-api-tls\") pod \"a2110f51-4dc3-4c37-bc30-ca99776e908c\" (UID: \"a2110f51-4dc3-4c37-bc30-ca99776e908c\") "
Sep 11 16:45:20.132041 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.131941    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2110f51-4dc3-4c37-bc30-ca99776e908c-openshift-service-ca\") pod \"a2110f51-4dc3-4c37-bc30-ca99776e908c\" (UID: \"a2110f51-4dc3-4c37-bc30-ca99776e908c\") "
Sep 11 16:45:20.132041 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.131987    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w9xlm\" (UniqueName: \"kubernetes.io/projected/a2110f51-4dc3-4c37-bc30-ca99776e908c-kube-api-access-w9xlm\") pod \"a2110f51-4dc3-4c37-bc30-ca99776e908c\" (UID: \"a2110f51-4dc3-4c37-bc30-ca99776e908c\") "
Sep 11 16:45:20.132041 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.132032    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2110f51-4dc3-4c37-bc30-ca99776e908c-metrics-certs\") pod \"a2110f51-4dc3-4c37-bc30-ca99776e908c\" (UID: \"a2110f51-4dc3-4c37-bc30-ca99776e908c\") "
Sep 11 16:45:20.133156 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.133080    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2110f51-4dc3-4c37-bc30-ca99776e908c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a2110f51-4dc3-4c37-bc30-ca99776e908c" (UID: "a2110f51-4dc3-4c37-bc30-ca99776e908c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:45:20.135222 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.135081    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2110f51-4dc3-4c37-bc30-ca99776e908c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a2110f51-4dc3-4c37-bc30-ca99776e908c" (UID: "a2110f51-4dc3-4c37-bc30-ca99776e908c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:45:20.135336 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.135284    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2110f51-4dc3-4c37-bc30-ca99776e908c-kube-api-access-w9xlm" (OuterVolumeSpecName: "kube-api-access-w9xlm") pod "a2110f51-4dc3-4c37-bc30-ca99776e908c" (UID: "a2110f51-4dc3-4c37-bc30-ca99776e908c"). InnerVolumeSpecName "kube-api-access-w9xlm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:45:20.136084 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.136063    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2110f51-4dc3-4c37-bc30-ca99776e908c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a2110f51-4dc3-4c37-bc30-ca99776e908c" (UID: "a2110f51-4dc3-4c37-bc30-ca99776e908c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:45:20.194469 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.194441    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:45:20.195595 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.195573    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-4bf042d5-5dc499bc65-ntk2z"
Sep 11 16:45:20.198692 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.198672    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-4bf042d5-6cd59f6774-2g5d8"
Sep 11 16:45:20.227161 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.227120    2581 generic.go:356] "Generic (PLEG): container finished" podID="a2110f51-4dc3-4c37-bc30-ca99776e908c" containerID="2473ccdf41e44cc43cd91a452d096b465e16dd05e601fcf7e59b47359301d141" exitCode=0
Sep 11 16:45:20.227354 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.227227    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-4bf042d5-56b74bc46f-tmvqn"
Sep 11 16:45:20.227354 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.227231    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-4bf042d5-56b74bc46f-tmvqn" event={"ID":"a2110f51-4dc3-4c37-bc30-ca99776e908c","Type":"ContainerDied","Data":"2473ccdf41e44cc43cd91a452d096b465e16dd05e601fcf7e59b47359301d141"}
Sep 11 16:45:20.227354 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.227286    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-4bf042d5-56b74bc46f-tmvqn" event={"ID":"a2110f51-4dc3-4c37-bc30-ca99776e908c","Type":"ContainerDied","Data":"be16d7aa71e3e4d04225b3aac11be1ff07b1b5fba164aee3726b43fa109f07f2"}
Sep 11 16:45:20.227354 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.227314    2581 scope.go:117] "RemoveContainer" containerID="2473ccdf41e44cc43cd91a452d096b465e16dd05e601fcf7e59b47359301d141"
Sep 11 16:45:20.229290 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.229263    2581 generic.go:356] "Generic (PLEG): container finished" podID="ffe23d02-d3ec-4eb2-9db8-af82d1af212d" containerID="820d587185b9d0ef28080f7723dfbcc23ee8055dadddc10014eb8ca9c81126e1" exitCode=0
Sep 11 16:45:20.229419 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.229301    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-4bf042d5-5dc499bc65-ntk2z"
Sep 11 16:45:20.229419 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.229371    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-4bf042d5-5dc499bc65-ntk2z" event={"ID":"ffe23d02-d3ec-4eb2-9db8-af82d1af212d","Type":"ContainerDied","Data":"820d587185b9d0ef28080f7723dfbcc23ee8055dadddc10014eb8ca9c81126e1"}
Sep 11 16:45:20.229543 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.229443    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-4bf042d5-5dc499bc65-ntk2z" event={"ID":"ffe23d02-d3ec-4eb2-9db8-af82d1af212d","Type":"ContainerDied","Data":"bfb888d9d53150b22a9f0c466b3340ec3fd2233af70f58eadcab5a9f8a29183b"}
Sep 11 16:45:20.230995 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.230974    2581 generic.go:356] "Generic (PLEG): container finished" podID="759c2c97-e6f8-4f9d-9783-2e7b3f131c05" containerID="b9b5e8c80e4c4ee9a8ee65379485b56559899064b32de0bf1eea627574070cdb" exitCode=0
Sep 11 16:45:20.231142 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.231015    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-4bf042d5-6cd59f6774-2g5d8"
Sep 11 16:45:20.231142 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.231017    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-4bf042d5-6cd59f6774-2g5d8" event={"ID":"759c2c97-e6f8-4f9d-9783-2e7b3f131c05","Type":"ContainerDied","Data":"b9b5e8c80e4c4ee9a8ee65379485b56559899064b32de0bf1eea627574070cdb"}
Sep 11 16:45:20.231142 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.231129    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-4bf042d5-6cd59f6774-2g5d8" event={"ID":"759c2c97-e6f8-4f9d-9783-2e7b3f131c05","Type":"ContainerDied","Data":"cc4ec2b31024438cf99c9e7078c38b79f766ff251cadb8a095e0ce24c33257a8"}
Sep 11 16:45:20.232678 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.232657    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ffe23d02-d3ec-4eb2-9db8-af82d1af212d-plugins-config-volume\") pod \"ffe23d02-d3ec-4eb2-9db8-af82d1af212d\" (UID: \"ffe23d02-d3ec-4eb2-9db8-af82d1af212d\") "
Sep 11 16:45:20.232775 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.232742    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4h6n\" (UniqueName: \"kubernetes.io/projected/ffe23d02-d3ec-4eb2-9db8-af82d1af212d-kube-api-access-d4h6n\") pod \"ffe23d02-d3ec-4eb2-9db8-af82d1af212d\" (UID: \"ffe23d02-d3ec-4eb2-9db8-af82d1af212d\") "
Sep 11 16:45:20.233059 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.233041    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2110f51-4dc3-4c37-bc30-ca99776e908c-openshift-service-ca\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:45:20.233160 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.233047    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffe23d02-d3ec-4eb2-9db8-af82d1af212d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ffe23d02-d3ec-4eb2-9db8-af82d1af212d" (UID: "ffe23d02-d3ec-4eb2-9db8-af82d1af212d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:45:20.233160 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.233066    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w9xlm\" (UniqueName: \"kubernetes.io/projected/a2110f51-4dc3-4c37-bc30-ca99776e908c-kube-api-access-w9xlm\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:45:20.233160 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.233081    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2110f51-4dc3-4c37-bc30-ca99776e908c-metrics-certs\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:45:20.233160 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.233110    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2110f51-4dc3-4c37-bc30-ca99776e908c-maas-api-tls\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:45:20.234959 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.234936    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffe23d02-d3ec-4eb2-9db8-af82d1af212d-kube-api-access-d4h6n" (OuterVolumeSpecName: "kube-api-access-d4h6n") pod "ffe23d02-d3ec-4eb2-9db8-af82d1af212d" (UID: "ffe23d02-d3ec-4eb2-9db8-af82d1af212d"). InnerVolumeSpecName "kube-api-access-d4h6n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:45:20.237196 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.237177    2581 scope.go:117] "RemoveContainer" containerID="2473ccdf41e44cc43cd91a452d096b465e16dd05e601fcf7e59b47359301d141"
Sep 11 16:45:20.237498 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:45:20.237482    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2473ccdf41e44cc43cd91a452d096b465e16dd05e601fcf7e59b47359301d141\": container with ID starting with 2473ccdf41e44cc43cd91a452d096b465e16dd05e601fcf7e59b47359301d141 not found: ID does not exist" containerID="2473ccdf41e44cc43cd91a452d096b465e16dd05e601fcf7e59b47359301d141"
Sep 11 16:45:20.237568 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.237512    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2473ccdf41e44cc43cd91a452d096b465e16dd05e601fcf7e59b47359301d141"} err="failed to get container status \"2473ccdf41e44cc43cd91a452d096b465e16dd05e601fcf7e59b47359301d141\": rpc error: code = NotFound desc = could not find container \"2473ccdf41e44cc43cd91a452d096b465e16dd05e601fcf7e59b47359301d141\": container with ID starting with 2473ccdf41e44cc43cd91a452d096b465e16dd05e601fcf7e59b47359301d141 not found: ID does not exist"
Sep 11 16:45:20.237568 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.237535    2581 scope.go:117] "RemoveContainer" containerID="820d587185b9d0ef28080f7723dfbcc23ee8055dadddc10014eb8ca9c81126e1"
Sep 11 16:45:20.247034 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.246587    2581 scope.go:117] "RemoveContainer" containerID="820d587185b9d0ef28080f7723dfbcc23ee8055dadddc10014eb8ca9c81126e1"
Sep 11 16:45:20.247034 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:45:20.246941    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"820d587185b9d0ef28080f7723dfbcc23ee8055dadddc10014eb8ca9c81126e1\": container with ID starting with 820d587185b9d0ef28080f7723dfbcc23ee8055dadddc10014eb8ca9c81126e1 not found: ID does not exist" containerID="820d587185b9d0ef28080f7723dfbcc23ee8055dadddc10014eb8ca9c81126e1"
Sep 11 16:45:20.247034 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.246974    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"820d587185b9d0ef28080f7723dfbcc23ee8055dadddc10014eb8ca9c81126e1"} err="failed to get container status \"820d587185b9d0ef28080f7723dfbcc23ee8055dadddc10014eb8ca9c81126e1\": rpc error: code = NotFound desc = could not find container \"820d587185b9d0ef28080f7723dfbcc23ee8055dadddc10014eb8ca9c81126e1\": container with ID starting with 820d587185b9d0ef28080f7723dfbcc23ee8055dadddc10014eb8ca9c81126e1 not found: ID does not exist"
Sep 11 16:45:20.247034 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.246998    2581 scope.go:117] "RemoveContainer" containerID="b9b5e8c80e4c4ee9a8ee65379485b56559899064b32de0bf1eea627574070cdb"
Sep 11 16:45:20.256814 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.256790    2581 scope.go:117] "RemoveContainer" containerID="b9b5e8c80e4c4ee9a8ee65379485b56559899064b32de0bf1eea627574070cdb"
Sep 11 16:45:20.257209 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:45:20.257165    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9b5e8c80e4c4ee9a8ee65379485b56559899064b32de0bf1eea627574070cdb\": container with ID starting with b9b5e8c80e4c4ee9a8ee65379485b56559899064b32de0bf1eea627574070cdb not found: ID does not exist" containerID="b9b5e8c80e4c4ee9a8ee65379485b56559899064b32de0bf1eea627574070cdb"
Sep 11 16:45:20.257285 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.257216    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9b5e8c80e4c4ee9a8ee65379485b56559899064b32de0bf1eea627574070cdb"} err="failed to get container status \"b9b5e8c80e4c4ee9a8ee65379485b56559899064b32de0bf1eea627574070cdb\": rpc error: code = NotFound desc = could not find container \"b9b5e8c80e4c4ee9a8ee65379485b56559899064b32de0bf1eea627574070cdb\": container with ID starting with b9b5e8c80e4c4ee9a8ee65379485b56559899064b32de0bf1eea627574070cdb not found: ID does not exist"
Sep 11 16:45:20.270656 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.270618    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-4bf042d5-56b74bc46f-tmvqn"]
Sep 11 16:45:20.273409 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.273383    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-4bf042d5-56b74bc46f-tmvqn"]
Sep 11 16:45:20.307996 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.307905    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:45:20.333602 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.333571    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/759c2c97-e6f8-4f9d-9783-2e7b3f131c05-plugins-config-volume\") pod \"759c2c97-e6f8-4f9d-9783-2e7b3f131c05\" (UID: \"759c2c97-e6f8-4f9d-9783-2e7b3f131c05\") "
Sep 11 16:45:20.333785 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.333616    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6zzwh\" (UniqueName: \"kubernetes.io/projected/759c2c97-e6f8-4f9d-9783-2e7b3f131c05-kube-api-access-6zzwh\") pod \"759c2c97-e6f8-4f9d-9783-2e7b3f131c05\" (UID: \"759c2c97-e6f8-4f9d-9783-2e7b3f131c05\") "
Sep 11 16:45:20.333851 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.333834    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ffe23d02-d3ec-4eb2-9db8-af82d1af212d-plugins-config-volume\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:45:20.333909 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.333851    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4h6n\" (UniqueName: \"kubernetes.io/projected/ffe23d02-d3ec-4eb2-9db8-af82d1af212d-kube-api-access-d4h6n\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:45:20.333957 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.333933    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/759c2c97-e6f8-4f9d-9783-2e7b3f131c05-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "759c2c97-e6f8-4f9d-9783-2e7b3f131c05" (UID: "759c2c97-e6f8-4f9d-9783-2e7b3f131c05"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:45:20.335739 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.335715    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/759c2c97-e6f8-4f9d-9783-2e7b3f131c05-kube-api-access-6zzwh" (OuterVolumeSpecName: "kube-api-access-6zzwh") pod "759c2c97-e6f8-4f9d-9783-2e7b3f131c05" (UID: "759c2c97-e6f8-4f9d-9783-2e7b3f131c05"). InnerVolumeSpecName "kube-api-access-6zzwh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:45:20.425409 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.425371    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:45:20.434553 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.434526    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/759c2c97-e6f8-4f9d-9783-2e7b3f131c05-plugins-config-volume\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:45:20.434553 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.434551    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6zzwh\" (UniqueName: \"kubernetes.io/projected/759c2c97-e6f8-4f9d-9783-2e7b3f131c05-kube-api-access-6zzwh\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:45:20.561723 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.561635    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-4bf042d5-6cd59f6774-2g5d8"]
Sep 11 16:45:20.570963 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.570926    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-4bf042d5-6cd59f6774-2g5d8"]
Sep 11 16:45:20.589530 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.589494    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-4bf042d5-5dc499bc65-ntk2z"]
Sep 11 16:45:20.595746 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.595712    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-4bf042d5-5dc499bc65-ntk2z"]
Sep 11 16:45:20.992764 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.992730    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="759c2c97-e6f8-4f9d-9783-2e7b3f131c05" path="/var/lib/kubelet/pods/759c2c97-e6f8-4f9d-9783-2e7b3f131c05/volumes"
Sep 11 16:45:20.993174 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.993124    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2110f51-4dc3-4c37-bc30-ca99776e908c" path="/var/lib/kubelet/pods/a2110f51-4dc3-4c37-bc30-ca99776e908c/volumes"
Sep 11 16:45:20.993431 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:20.993418    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffe23d02-d3ec-4eb2-9db8-af82d1af212d" path="/var/lib/kubelet/pods/ffe23d02-d3ec-4eb2-9db8-af82d1af212d/volumes"
Sep 11 16:45:21.090983 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:21.090954    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:45:21.199206 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:21.199167    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:45:22.624767 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:22.624735    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:45:27.817519 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:27.817483    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:45:29.430504 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:29.430469    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:45:29.535818 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:29.535788    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:45:29.643117 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:29.643060    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:45:29.742014 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:29.741977    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:45:29.928496 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:29.928459    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:45:30.127486 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:30.127380    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:45:30.453293 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:30.453259    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:45:31.975616 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:31.975584    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:45:32.199794 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:32.199760    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:45:42.848342 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:42.848306    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-42752c-6469657cc7-wjsw7"]
Sep 11 16:45:42.848777 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:42.848561    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-42752c-6469657cc7-wjsw7" podUID="32231c51-4380-43cf-8af8-98b434508be4" containerName="maas-api" containerID="cri-o://967285cccce6b38b3ec848395e23d287e144dc1a7a7fd38e804b642d1b4ca147" gracePeriod=30
Sep 11 16:45:42.917557 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:42.917521    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:45:43.030110 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:43.030043    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:45:43.112104 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:43.112024    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-42752c-6469657cc7-wjsw7"
Sep 11 16:45:43.197377 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:43.197351    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:45:43.236188 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:43.236155    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpzjv\" (UniqueName: \"kubernetes.io/projected/32231c51-4380-43cf-8af8-98b434508be4-kube-api-access-kpzjv\") pod \"32231c51-4380-43cf-8af8-98b434508be4\" (UID: \"32231c51-4380-43cf-8af8-98b434508be4\") "
Sep 11 16:45:43.236367 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:43.236253    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/32231c51-4380-43cf-8af8-98b434508be4-openshift-service-ca\") pod \"32231c51-4380-43cf-8af8-98b434508be4\" (UID: \"32231c51-4380-43cf-8af8-98b434508be4\") "
Sep 11 16:45:43.236367 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:43.236293    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32231c51-4380-43cf-8af8-98b434508be4-metrics-certs\") pod \"32231c51-4380-43cf-8af8-98b434508be4\" (UID: \"32231c51-4380-43cf-8af8-98b434508be4\") "
Sep 11 16:45:43.236367 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:43.236321    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32231c51-4380-43cf-8af8-98b434508be4-maas-api-tls\") pod \"32231c51-4380-43cf-8af8-98b434508be4\" (UID: \"32231c51-4380-43cf-8af8-98b434508be4\") "
Sep 11 16:45:43.236698 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:43.236670    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32231c51-4380-43cf-8af8-98b434508be4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "32231c51-4380-43cf-8af8-98b434508be4" (UID: "32231c51-4380-43cf-8af8-98b434508be4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:45:43.238582 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:43.238553    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32231c51-4380-43cf-8af8-98b434508be4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "32231c51-4380-43cf-8af8-98b434508be4" (UID: "32231c51-4380-43cf-8af8-98b434508be4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:45:43.238582 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:43.238565    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32231c51-4380-43cf-8af8-98b434508be4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "32231c51-4380-43cf-8af8-98b434508be4" (UID: "32231c51-4380-43cf-8af8-98b434508be4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:45:43.238701 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:43.238593    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32231c51-4380-43cf-8af8-98b434508be4-kube-api-access-kpzjv" (OuterVolumeSpecName: "kube-api-access-kpzjv") pod "32231c51-4380-43cf-8af8-98b434508be4" (UID: "32231c51-4380-43cf-8af8-98b434508be4"). InnerVolumeSpecName "kube-api-access-kpzjv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:45:43.312605 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:43.312573    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:45:43.337897 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:43.337853    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32231c51-4380-43cf-8af8-98b434508be4-metrics-certs\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:45:43.337897 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:43.337881    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32231c51-4380-43cf-8af8-98b434508be4-maas-api-tls\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:45:43.337897 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:43.337890    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpzjv\" (UniqueName: \"kubernetes.io/projected/32231c51-4380-43cf-8af8-98b434508be4-kube-api-access-kpzjv\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:45:43.337897 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:43.337907    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/32231c51-4380-43cf-8af8-98b434508be4-openshift-service-ca\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:45:43.344203 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:43.344176    2581 generic.go:356] "Generic (PLEG): container finished" podID="32231c51-4380-43cf-8af8-98b434508be4" containerID="967285cccce6b38b3ec848395e23d287e144dc1a7a7fd38e804b642d1b4ca147" exitCode=0
Sep 11 16:45:43.344345 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:43.344215    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-42752c-6469657cc7-wjsw7" event={"ID":"32231c51-4380-43cf-8af8-98b434508be4","Type":"ContainerDied","Data":"967285cccce6b38b3ec848395e23d287e144dc1a7a7fd38e804b642d1b4ca147"}
Sep 11 16:45:43.344345 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:43.344231    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-42752c-6469657cc7-wjsw7"
Sep 11 16:45:43.344345 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:43.344259    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-42752c-6469657cc7-wjsw7" event={"ID":"32231c51-4380-43cf-8af8-98b434508be4","Type":"ContainerDied","Data":"448154498baaea034019b5afb4ad7c3f5f1310101547e88c7eca07cc86daa4a7"}
Sep 11 16:45:43.344345 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:43.344281    2581 scope.go:117] "RemoveContainer" containerID="967285cccce6b38b3ec848395e23d287e144dc1a7a7fd38e804b642d1b4ca147"
Sep 11 16:45:43.353678 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:43.353660    2581 scope.go:117] "RemoveContainer" containerID="967285cccce6b38b3ec848395e23d287e144dc1a7a7fd38e804b642d1b4ca147"
Sep 11 16:45:43.353956 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:45:43.353936    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"967285cccce6b38b3ec848395e23d287e144dc1a7a7fd38e804b642d1b4ca147\": container with ID starting with 967285cccce6b38b3ec848395e23d287e144dc1a7a7fd38e804b642d1b4ca147 not found: ID does not exist" containerID="967285cccce6b38b3ec848395e23d287e144dc1a7a7fd38e804b642d1b4ca147"
Sep 11 16:45:43.354026 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:43.353964    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"967285cccce6b38b3ec848395e23d287e144dc1a7a7fd38e804b642d1b4ca147"} err="failed to get container status \"967285cccce6b38b3ec848395e23d287e144dc1a7a7fd38e804b642d1b4ca147\": rpc error: code = NotFound desc = could not find container \"967285cccce6b38b3ec848395e23d287e144dc1a7a7fd38e804b642d1b4ca147\": container with ID starting with 967285cccce6b38b3ec848395e23d287e144dc1a7a7fd38e804b642d1b4ca147 not found: ID does not exist"
Sep 11 16:45:43.375357 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:43.375285    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-42752c-6469657cc7-wjsw7"]
Sep 11 16:45:43.380280 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:43.380252    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-42752c-6469657cc7-wjsw7"]
Sep 11 16:45:43.688768 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:43.688728    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:45:44.987163 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:44.987128    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32231c51-4380-43cf-8af8-98b434508be4" path="/var/lib/kubelet/pods/32231c51-4380-43cf-8af8-98b434508be4/volumes"
Sep 11 16:45:50.815385 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:50.815347    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:45:52.352788 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:52.352755    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:45:54.919897 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:54.919859    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:45:55.015613 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:55.015581    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:45:56.052594 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:56.052563    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-a864cd-8f8d7fdc7-j575v"]
Sep 11 16:45:56.053162 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:56.053143    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2110f51-4dc3-4c37-bc30-ca99776e908c" containerName="maas-api"
Sep 11 16:45:56.053226 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:56.053167    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2110f51-4dc3-4c37-bc30-ca99776e908c" containerName="maas-api"
Sep 11 16:45:56.053226 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:56.053205    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32231c51-4380-43cf-8af8-98b434508be4" containerName="maas-api"
Sep 11 16:45:56.053226 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:56.053214    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="32231c51-4380-43cf-8af8-98b434508be4" containerName="maas-api"
Sep 11 16:45:56.053325 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:56.053227    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="759c2c97-e6f8-4f9d-9783-2e7b3f131c05" containerName="payload-pre-processing"
Sep 11 16:45:56.053325 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:56.053236    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="759c2c97-e6f8-4f9d-9783-2e7b3f131c05" containerName="payload-pre-processing"
Sep 11 16:45:56.053325 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:56.053253    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffe23d02-d3ec-4eb2-9db8-af82d1af212d" containerName="payload-processing"
Sep 11 16:45:56.053325 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:56.053261    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffe23d02-d3ec-4eb2-9db8-af82d1af212d" containerName="payload-processing"
Sep 11 16:45:56.053486 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:56.053345    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffe23d02-d3ec-4eb2-9db8-af82d1af212d" containerName="payload-processing"
Sep 11 16:45:56.053486 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:56.053359    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2110f51-4dc3-4c37-bc30-ca99776e908c" containerName="maas-api"
Sep 11 16:45:56.053486 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:56.053372    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="759c2c97-e6f8-4f9d-9783-2e7b3f131c05" containerName="payload-pre-processing"
Sep 11 16:45:56.053486 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:56.053380    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="32231c51-4380-43cf-8af8-98b434508be4" containerName="maas-api"
Sep 11 16:45:56.056740 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:56.056722    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a864cd-8f8d7fdc7-j575v"
Sep 11 16:45:56.061842 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:56.061818    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-a864cd-serving-cert\""
Sep 11 16:45:56.070111 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:56.070062    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-a864cd-8f8d7fdc7-j575v"]
Sep 11 16:45:56.111841 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:56.111807    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:45:56.154952 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:56.154912    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jspt\" (UniqueName: \"kubernetes.io/projected/54f8f9b9-8a61-4838-abce-32cd571331a2-kube-api-access-5jspt\") pod \"maas-api-e2e-explicit-a864cd-8f8d7fdc7-j575v\" (UID: \"54f8f9b9-8a61-4838-abce-32cd571331a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a864cd-8f8d7fdc7-j575v"
Sep 11 16:45:56.155146 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:56.154963    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54f8f9b9-8a61-4838-abce-32cd571331a2-maas-api-tls\") pod \"maas-api-e2e-explicit-a864cd-8f8d7fdc7-j575v\" (UID: \"54f8f9b9-8a61-4838-abce-32cd571331a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a864cd-8f8d7fdc7-j575v"
Sep 11 16:45:56.155146 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:56.155004    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54f8f9b9-8a61-4838-abce-32cd571331a2-openshift-service-ca\") pod \"maas-api-e2e-explicit-a864cd-8f8d7fdc7-j575v\" (UID: \"54f8f9b9-8a61-4838-abce-32cd571331a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a864cd-8f8d7fdc7-j575v"
Sep 11 16:45:56.155146 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:56.155022    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54f8f9b9-8a61-4838-abce-32cd571331a2-metrics-certs\") pod \"maas-api-e2e-explicit-a864cd-8f8d7fdc7-j575v\" (UID: \"54f8f9b9-8a61-4838-abce-32cd571331a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a864cd-8f8d7fdc7-j575v"
Sep 11 16:45:56.210190 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:56.210149    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:45:56.256467 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:56.256427    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54f8f9b9-8a61-4838-abce-32cd571331a2-openshift-service-ca\") pod \"maas-api-e2e-explicit-a864cd-8f8d7fdc7-j575v\" (UID: \"54f8f9b9-8a61-4838-abce-32cd571331a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a864cd-8f8d7fdc7-j575v"
Sep 11 16:45:56.256654 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:56.256479    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54f8f9b9-8a61-4838-abce-32cd571331a2-metrics-certs\") pod \"maas-api-e2e-explicit-a864cd-8f8d7fdc7-j575v\" (UID: \"54f8f9b9-8a61-4838-abce-32cd571331a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a864cd-8f8d7fdc7-j575v"
Sep 11 16:45:56.256654 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:56.256544    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jspt\" (UniqueName: \"kubernetes.io/projected/54f8f9b9-8a61-4838-abce-32cd571331a2-kube-api-access-5jspt\") pod \"maas-api-e2e-explicit-a864cd-8f8d7fdc7-j575v\" (UID: \"54f8f9b9-8a61-4838-abce-32cd571331a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a864cd-8f8d7fdc7-j575v"
Sep 11 16:45:56.256654 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:56.256601    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54f8f9b9-8a61-4838-abce-32cd571331a2-maas-api-tls\") pod \"maas-api-e2e-explicit-a864cd-8f8d7fdc7-j575v\" (UID: \"54f8f9b9-8a61-4838-abce-32cd571331a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a864cd-8f8d7fdc7-j575v"
Sep 11 16:45:56.256840 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:45:56.256703    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-explicit-a864cd-serving-cert: secret "maas-api-e2e-explicit-a864cd-serving-cert" not found
Sep 11 16:45:56.256840 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:45:56.256784    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54f8f9b9-8a61-4838-abce-32cd571331a2-maas-api-tls podName:54f8f9b9-8a61-4838-abce-32cd571331a2 nodeName:}" failed. No retries permitted until 2026-09-11 16:45:56.756763425 +0000 UTC m=+956.373520493 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/54f8f9b9-8a61-4838-abce-32cd571331a2-maas-api-tls") pod "maas-api-e2e-explicit-a864cd-8f8d7fdc7-j575v" (UID: "54f8f9b9-8a61-4838-abce-32cd571331a2") : secret "maas-api-e2e-explicit-a864cd-serving-cert" not found
Sep 11 16:45:56.257124 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:56.257081    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54f8f9b9-8a61-4838-abce-32cd571331a2-openshift-service-ca\") pod \"maas-api-e2e-explicit-a864cd-8f8d7fdc7-j575v\" (UID: \"54f8f9b9-8a61-4838-abce-32cd571331a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a864cd-8f8d7fdc7-j575v"
Sep 11 16:45:56.259084 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:56.259058    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54f8f9b9-8a61-4838-abce-32cd571331a2-metrics-certs\") pod \"maas-api-e2e-explicit-a864cd-8f8d7fdc7-j575v\" (UID: \"54f8f9b9-8a61-4838-abce-32cd571331a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a864cd-8f8d7fdc7-j575v"
Sep 11 16:45:56.270293 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:56.270271    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jspt\" (UniqueName: \"kubernetes.io/projected/54f8f9b9-8a61-4838-abce-32cd571331a2-kube-api-access-5jspt\") pod \"maas-api-e2e-explicit-a864cd-8f8d7fdc7-j575v\" (UID: \"54f8f9b9-8a61-4838-abce-32cd571331a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a864cd-8f8d7fdc7-j575v"
Sep 11 16:45:56.384409 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:56.384291    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:45:56.760988 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:56.760954    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54f8f9b9-8a61-4838-abce-32cd571331a2-maas-api-tls\") pod \"maas-api-e2e-explicit-a864cd-8f8d7fdc7-j575v\" (UID: \"54f8f9b9-8a61-4838-abce-32cd571331a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a864cd-8f8d7fdc7-j575v"
Sep 11 16:45:56.763676 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:56.763642    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54f8f9b9-8a61-4838-abce-32cd571331a2-maas-api-tls\") pod \"maas-api-e2e-explicit-a864cd-8f8d7fdc7-j575v\" (UID: \"54f8f9b9-8a61-4838-abce-32cd571331a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a864cd-8f8d7fdc7-j575v"
Sep 11 16:45:56.890085 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:56.890054    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:45:56.966402 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:56.966364    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a864cd-8f8d7fdc7-j575v"
Sep 11 16:45:56.995541 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:56.995507    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:45:57.170697 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:57.170654    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-a864cd-58d9c4cddf-sssmr"]
Sep 11 16:45:57.175546 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:57.175510    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-a864cd-58d9c4cddf-sssmr"
Sep 11 16:45:57.184768 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:57.184745    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-a864cd\""
Sep 11 16:45:57.185946 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:57.185927    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-a864cd-dockercfg-5krsr\""
Sep 11 16:45:57.235815 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:57.235777    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-a864cd-58d9c4cddf-sssmr"]
Sep 11 16:45:57.243946 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:57.243919    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-a864cd-8f8d7fdc7-j575v"]
Sep 11 16:45:57.245363 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:45:57.245338    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54f8f9b9_8a61_4838_abce_32cd571331a2.slice/crio-bb0adbac55e41eca8463b7e2a061efdd0bd4579b97c1270a7aa686d2cca683d0 WatchSource:0}: Error finding container bb0adbac55e41eca8463b7e2a061efdd0bd4579b97c1270a7aa686d2cca683d0: Status 404 returned error can't find the container with id bb0adbac55e41eca8463b7e2a061efdd0bd4579b97c1270a7aa686d2cca683d0
Sep 11 16:45:57.247082 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:57.247066    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 16:45:57.265475 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:57.265388    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsz78\" (UniqueName: \"kubernetes.io/projected/3941d321-5494-4e95-888b-2ed1f98e6a4c-kube-api-access-tsz78\") pod \"payload-processing-e2e-explicit-a864cd-58d9c4cddf-sssmr\" (UID: \"3941d321-5494-4e95-888b-2ed1f98e6a4c\") " pod="openshift-ingress/payload-processing-e2e-explicit-a864cd-58d9c4cddf-sssmr"
Sep 11 16:45:57.265624 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:57.265507    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3941d321-5494-4e95-888b-2ed1f98e6a4c-plugins-config-volume\") pod \"payload-processing-e2e-explicit-a864cd-58d9c4cddf-sssmr\" (UID: \"3941d321-5494-4e95-888b-2ed1f98e6a4c\") " pod="openshift-ingress/payload-processing-e2e-explicit-a864cd-58d9c4cddf-sssmr"
Sep 11 16:45:57.366288 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:57.366251    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsz78\" (UniqueName: \"kubernetes.io/projected/3941d321-5494-4e95-888b-2ed1f98e6a4c-kube-api-access-tsz78\") pod \"payload-processing-e2e-explicit-a864cd-58d9c4cddf-sssmr\" (UID: \"3941d321-5494-4e95-888b-2ed1f98e6a4c\") " pod="openshift-ingress/payload-processing-e2e-explicit-a864cd-58d9c4cddf-sssmr"
Sep 11 16:45:57.366439 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:57.366338    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3941d321-5494-4e95-888b-2ed1f98e6a4c-plugins-config-volume\") pod \"payload-processing-e2e-explicit-a864cd-58d9c4cddf-sssmr\" (UID: \"3941d321-5494-4e95-888b-2ed1f98e6a4c\") " pod="openshift-ingress/payload-processing-e2e-explicit-a864cd-58d9c4cddf-sssmr"
Sep 11 16:45:57.366980 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:57.366961    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3941d321-5494-4e95-888b-2ed1f98e6a4c-plugins-config-volume\") pod \"payload-processing-e2e-explicit-a864cd-58d9c4cddf-sssmr\" (UID: \"3941d321-5494-4e95-888b-2ed1f98e6a4c\") " pod="openshift-ingress/payload-processing-e2e-explicit-a864cd-58d9c4cddf-sssmr"
Sep 11 16:45:57.393997 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:57.393963    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsz78\" (UniqueName: \"kubernetes.io/projected/3941d321-5494-4e95-888b-2ed1f98e6a4c-kube-api-access-tsz78\") pod \"payload-processing-e2e-explicit-a864cd-58d9c4cddf-sssmr\" (UID: \"3941d321-5494-4e95-888b-2ed1f98e6a4c\") " pod="openshift-ingress/payload-processing-e2e-explicit-a864cd-58d9c4cddf-sssmr"
Sep 11 16:45:57.409440 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:57.409411    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a864cd-8f8d7fdc7-j575v" event={"ID":"54f8f9b9-8a61-4838-abce-32cd571331a2","Type":"ContainerStarted","Data":"bb0adbac55e41eca8463b7e2a061efdd0bd4579b97c1270a7aa686d2cca683d0"}
Sep 11 16:45:57.485847 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:57.485800    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-a864cd-58d9c4cddf-sssmr"
Sep 11 16:45:57.760504 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:57.760476    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-a864cd-58d9c4cddf-sssmr"]
Sep 11 16:45:57.763853 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:45:57.763827    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3941d321_5494_4e95_888b_2ed1f98e6a4c.slice/crio-a54e7cd192e77ce490946eb7c8d44b61df854fc304f5e41174e68bb72c97abb3 WatchSource:0}: Error finding container a54e7cd192e77ce490946eb7c8d44b61df854fc304f5e41174e68bb72c97abb3: Status 404 returned error can't find the container with id a54e7cd192e77ce490946eb7c8d44b61df854fc304f5e41174e68bb72c97abb3
Sep 11 16:45:58.416724 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:58.416658    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-a864cd-58d9c4cddf-sssmr" event={"ID":"3941d321-5494-4e95-888b-2ed1f98e6a4c","Type":"ContainerStarted","Data":"90c9fd9099cf8aa4fed9764ec5df548a88fb88fdb7f8f649e7bedd2c2dc4084a"}
Sep 11 16:45:58.417240 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:58.416773    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-a864cd-58d9c4cddf-sssmr" event={"ID":"3941d321-5494-4e95-888b-2ed1f98e6a4c","Type":"ContainerStarted","Data":"a54e7cd192e77ce490946eb7c8d44b61df854fc304f5e41174e68bb72c97abb3"}
Sep 11 16:45:58.417240 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:58.416803    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-a864cd-58d9c4cddf-sssmr"
Sep 11 16:45:58.418426 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:58.418398    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a864cd-8f8d7fdc7-j575v" event={"ID":"54f8f9b9-8a61-4838-abce-32cd571331a2","Type":"ContainerStarted","Data":"2b913ea23dcbff531af53bb09de2fecc6ebdd05f0a63450d9a670b423db979e9"}
Sep 11 16:45:58.418538 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:58.418453    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a864cd-8f8d7fdc7-j575v"
Sep 11 16:45:58.443343 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:58.443285    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-a864cd-58d9c4cddf-sssmr" podStartSLOduration=1.443269543 podStartE2EDuration="1.443269543s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:45:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:45:58.440204763 +0000 UTC m=+958.056961840" watchObservedRunningTime="2026-09-11 16:45:58.443269543 +0000 UTC m=+958.060026609"
Sep 11 16:45:58.479938 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:45:58.479868    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a864cd-8f8d7fdc7-j575v" podStartSLOduration=2.015883795 podStartE2EDuration="2.479848539s" totalImagesPullingTime="463.964744ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:45:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:45:58.472059575 +0000 UTC m=+958.088816660" watchObservedRunningTime="2026-09-11 16:45:58.479848539 +0000 UTC m=+958.096605605"
Sep 11 16:46:04.241966 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:46:04.241910    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:46:04.364161 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:46:04.364120    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:46:04.429601 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:46:04.429572    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a864cd-8f8d7fdc7-j575v"
Sep 11 16:46:04.519953 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:46:04.519860    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:46:09.426283 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:46:09.426245    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-a864cd-58d9c4cddf-sssmr"
Sep 11 16:46:13.242503 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:46:13.242467    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:46:19.730321 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:46:19.730288    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:46:20.389375 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:46:20.389339    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:46:26.987771 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:46:26.987698    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:46:27.090715 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:46:27.090676    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:46:27.188568 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:46:27.188528    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:46:37.272015 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:46:37.271965    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:46:37.353492 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:46:37.353456    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:46:37.670369 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:46:37.670229    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:46:38.469778 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:46:38.469736    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:46:41.474927 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:46:41.474875    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:46:46.030976 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:46:46.030944    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:46:46.132962 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:46:46.132922    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:46:46.234887 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:46:46.234854    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:46:46.305500 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:46:46.305420    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:46:47.089631 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:46:47.089605    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:46:47.307008 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:46:47.306971    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:46:48.840594 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:46:48.840565    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:46:55.965978 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:46:55.965920    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:46:56.060396 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:46:56.060365    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:46:56.688679 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:46:56.688610    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:46:58.840875 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:46:58.840836    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:04.193622 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:04.193583    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:04.291887 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:04.291858    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:04.439661 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:04.439629    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:05.189207 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:05.189162    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:05.615923 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:05.615843    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:08.330657 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:08.330623    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:08.441306 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:08.441273    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:10.043013 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:10.042978    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:10.138045 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:10.138014    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:10.313370 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:10.313256    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:10.676776 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:10.676657    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:10.797744 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:10.797707    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:10.909658 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:10.909629    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-424dd7d1-68b9bf9478-sp7lj"]
Sep 11 16:47:10.913312 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:10.913293    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-424dd7d1-68b9bf9478-sp7lj"
Sep 11 16:47:10.917635 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:10.917594    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-424dd7d1\""
Sep 11 16:47:10.917938 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:10.917920    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-424dd7d1-dockercfg-trdbq\""
Sep 11 16:47:10.926707 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:10.926683    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-424dd7d1-68b9bf9478-sp7lj"]
Sep 11 16:47:10.989012 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:10.988974    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-424dd7d1-6ffc5d479c-ldnq4"]
Sep 11 16:47:10.992710 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:10.992692    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-424dd7d1-6ffc5d479c-ldnq4"
Sep 11 16:47:11.003299 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.003271    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-424dd7d1-6ffc5d479c-ldnq4"]
Sep 11 16:47:11.051910 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.051864    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d564a1f-f834-428d-8cdb-02c585c3d270-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-424dd7d1-68b9bf9478-sp7lj\" (UID: \"7d564a1f-f834-428d-8cdb-02c585c3d270\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-424dd7d1-68b9bf9478-sp7lj"
Sep 11 16:47:11.052327 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.051934    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpn49\" (UniqueName: \"kubernetes.io/projected/7d564a1f-f834-428d-8cdb-02c585c3d270-kube-api-access-xpn49\") pod \"payload-pre-processing-e2e-mt-424dd7d1-68b9bf9478-sp7lj\" (UID: \"7d564a1f-f834-428d-8cdb-02c585c3d270\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-424dd7d1-68b9bf9478-sp7lj"
Sep 11 16:47:11.152733 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.152696    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d564a1f-f834-428d-8cdb-02c585c3d270-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-424dd7d1-68b9bf9478-sp7lj\" (UID: \"7d564a1f-f834-428d-8cdb-02c585c3d270\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-424dd7d1-68b9bf9478-sp7lj"
Sep 11 16:47:11.152927 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.152762    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e167c9d-739b-4339-9b5f-23918c08a822-plugins-config-volume\") pod \"payload-processing-e2e-mt-424dd7d1-6ffc5d479c-ldnq4\" (UID: \"4e167c9d-739b-4339-9b5f-23918c08a822\") " pod="openshift-ingress/payload-processing-e2e-mt-424dd7d1-6ffc5d479c-ldnq4"
Sep 11 16:47:11.152927 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.152793    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpn49\" (UniqueName: \"kubernetes.io/projected/7d564a1f-f834-428d-8cdb-02c585c3d270-kube-api-access-xpn49\") pod \"payload-pre-processing-e2e-mt-424dd7d1-68b9bf9478-sp7lj\" (UID: \"7d564a1f-f834-428d-8cdb-02c585c3d270\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-424dd7d1-68b9bf9478-sp7lj"
Sep 11 16:47:11.152927 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.152826    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhkm4\" (UniqueName: \"kubernetes.io/projected/4e167c9d-739b-4339-9b5f-23918c08a822-kube-api-access-hhkm4\") pod \"payload-processing-e2e-mt-424dd7d1-6ffc5d479c-ldnq4\" (UID: \"4e167c9d-739b-4339-9b5f-23918c08a822\") " pod="openshift-ingress/payload-processing-e2e-mt-424dd7d1-6ffc5d479c-ldnq4"
Sep 11 16:47:11.153578 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.153554    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d564a1f-f834-428d-8cdb-02c585c3d270-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-424dd7d1-68b9bf9478-sp7lj\" (UID: \"7d564a1f-f834-428d-8cdb-02c585c3d270\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-424dd7d1-68b9bf9478-sp7lj"
Sep 11 16:47:11.166411 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.166378    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpn49\" (UniqueName: \"kubernetes.io/projected/7d564a1f-f834-428d-8cdb-02c585c3d270-kube-api-access-xpn49\") pod \"payload-pre-processing-e2e-mt-424dd7d1-68b9bf9478-sp7lj\" (UID: \"7d564a1f-f834-428d-8cdb-02c585c3d270\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-424dd7d1-68b9bf9478-sp7lj"
Sep 11 16:47:11.179147 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.179115    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-a864cd-8f8d7fdc7-j575v"]
Sep 11 16:47:11.179375 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.179331    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a864cd-8f8d7fdc7-j575v" podUID="54f8f9b9-8a61-4838-abce-32cd571331a2" containerName="maas-api" containerID="cri-o://2b913ea23dcbff531af53bb09de2fecc6ebdd05f0a63450d9a670b423db979e9" gracePeriod=30
Sep 11 16:47:11.224247 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.224212    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-424dd7d1-68b9bf9478-sp7lj"
Sep 11 16:47:11.247341 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.247310    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:11.253365 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.253337    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e167c9d-739b-4339-9b5f-23918c08a822-plugins-config-volume\") pod \"payload-processing-e2e-mt-424dd7d1-6ffc5d479c-ldnq4\" (UID: \"4e167c9d-739b-4339-9b5f-23918c08a822\") " pod="openshift-ingress/payload-processing-e2e-mt-424dd7d1-6ffc5d479c-ldnq4"
Sep 11 16:47:11.253533 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.253376    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhkm4\" (UniqueName: \"kubernetes.io/projected/4e167c9d-739b-4339-9b5f-23918c08a822-kube-api-access-hhkm4\") pod \"payload-processing-e2e-mt-424dd7d1-6ffc5d479c-ldnq4\" (UID: \"4e167c9d-739b-4339-9b5f-23918c08a822\") " pod="openshift-ingress/payload-processing-e2e-mt-424dd7d1-6ffc5d479c-ldnq4"
Sep 11 16:47:11.254212 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.254189    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e167c9d-739b-4339-9b5f-23918c08a822-plugins-config-volume\") pod \"payload-processing-e2e-mt-424dd7d1-6ffc5d479c-ldnq4\" (UID: \"4e167c9d-739b-4339-9b5f-23918c08a822\") " pod="openshift-ingress/payload-processing-e2e-mt-424dd7d1-6ffc5d479c-ldnq4"
Sep 11 16:47:11.305324 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.305257    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhkm4\" (UniqueName: \"kubernetes.io/projected/4e167c9d-739b-4339-9b5f-23918c08a822-kube-api-access-hhkm4\") pod \"payload-processing-e2e-mt-424dd7d1-6ffc5d479c-ldnq4\" (UID: \"4e167c9d-739b-4339-9b5f-23918c08a822\") " pod="openshift-ingress/payload-processing-e2e-mt-424dd7d1-6ffc5d479c-ldnq4"
Sep 11 16:47:11.388251 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.388220    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-a864cd-58d9c4cddf-sssmr"]
Sep 11 16:47:11.388619 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.388449    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-a864cd-58d9c4cddf-sssmr" podUID="3941d321-5494-4e95-888b-2ed1f98e6a4c" containerName="payload-processing" containerID="cri-o://90c9fd9099cf8aa4fed9764ec5df548a88fb88fdb7f8f649e7bedd2c2dc4084a" gracePeriod=30
Sep 11 16:47:11.501850 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.501821    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a864cd-8f8d7fdc7-j575v"
Sep 11 16:47:11.528685 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.528653    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:11.542270 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:47:11.542240    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d564a1f_f834_428d_8cdb_02c585c3d270.slice/crio-61a11156110b2539e09f254d39170cbc8e7c4c1f81430f6b64e7804e42e125e1 WatchSource:0}: Error finding container 61a11156110b2539e09f254d39170cbc8e7c4c1f81430f6b64e7804e42e125e1: Status 404 returned error can't find the container with id 61a11156110b2539e09f254d39170cbc8e7c4c1f81430f6b64e7804e42e125e1
Sep 11 16:47:11.550965 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.550938    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-424dd7d1-68b9bf9478-sp7lj"]
Sep 11 16:47:11.604237 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.604063    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-424dd7d1-6ffc5d479c-ldnq4"
Sep 11 16:47:11.656715 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.656678    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-a864cd-58d9c4cddf-sssmr"
Sep 11 16:47:11.658932 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.658759    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jspt\" (UniqueName: \"kubernetes.io/projected/54f8f9b9-8a61-4838-abce-32cd571331a2-kube-api-access-5jspt\") pod \"54f8f9b9-8a61-4838-abce-32cd571331a2\" (UID: \"54f8f9b9-8a61-4838-abce-32cd571331a2\") "
Sep 11 16:47:11.658932 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.658869    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54f8f9b9-8a61-4838-abce-32cd571331a2-maas-api-tls\") pod \"54f8f9b9-8a61-4838-abce-32cd571331a2\" (UID: \"54f8f9b9-8a61-4838-abce-32cd571331a2\") "
Sep 11 16:47:11.658932 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.658905    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54f8f9b9-8a61-4838-abce-32cd571331a2-openshift-service-ca\") pod \"54f8f9b9-8a61-4838-abce-32cd571331a2\" (UID: \"54f8f9b9-8a61-4838-abce-32cd571331a2\") "
Sep 11 16:47:11.659197 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.658954    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54f8f9b9-8a61-4838-abce-32cd571331a2-metrics-certs\") pod \"54f8f9b9-8a61-4838-abce-32cd571331a2\" (UID: \"54f8f9b9-8a61-4838-abce-32cd571331a2\") "
Sep 11 16:47:11.660042 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.660002    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54f8f9b9-8a61-4838-abce-32cd571331a2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "54f8f9b9-8a61-4838-abce-32cd571331a2" (UID: "54f8f9b9-8a61-4838-abce-32cd571331a2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:47:11.662727 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.662699    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54f8f9b9-8a61-4838-abce-32cd571331a2-kube-api-access-5jspt" (OuterVolumeSpecName: "kube-api-access-5jspt") pod "54f8f9b9-8a61-4838-abce-32cd571331a2" (UID: "54f8f9b9-8a61-4838-abce-32cd571331a2"). InnerVolumeSpecName "kube-api-access-5jspt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:47:11.662987 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.662955    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54f8f9b9-8a61-4838-abce-32cd571331a2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "54f8f9b9-8a61-4838-abce-32cd571331a2" (UID: "54f8f9b9-8a61-4838-abce-32cd571331a2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:47:11.664530 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.664500    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54f8f9b9-8a61-4838-abce-32cd571331a2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "54f8f9b9-8a61-4838-abce-32cd571331a2" (UID: "54f8f9b9-8a61-4838-abce-32cd571331a2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:47:11.724109 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.724052    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:11.759901 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.759798    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3941d321-5494-4e95-888b-2ed1f98e6a4c-plugins-config-volume\") pod \"3941d321-5494-4e95-888b-2ed1f98e6a4c\" (UID: \"3941d321-5494-4e95-888b-2ed1f98e6a4c\") "
Sep 11 16:47:11.760141 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.759907    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tsz78\" (UniqueName: \"kubernetes.io/projected/3941d321-5494-4e95-888b-2ed1f98e6a4c-kube-api-access-tsz78\") pod \"3941d321-5494-4e95-888b-2ed1f98e6a4c\" (UID: \"3941d321-5494-4e95-888b-2ed1f98e6a4c\") "
Sep 11 16:47:11.760273 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.760247    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3941d321-5494-4e95-888b-2ed1f98e6a4c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3941d321-5494-4e95-888b-2ed1f98e6a4c" (UID: "3941d321-5494-4e95-888b-2ed1f98e6a4c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:47:11.760273 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.760264    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54f8f9b9-8a61-4838-abce-32cd571331a2-maas-api-tls\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:47:11.760397 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.760304    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54f8f9b9-8a61-4838-abce-32cd571331a2-openshift-service-ca\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:47:11.760397 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.760320    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54f8f9b9-8a61-4838-abce-32cd571331a2-metrics-certs\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:47:11.760397 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.760335    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jspt\" (UniqueName: \"kubernetes.io/projected/54f8f9b9-8a61-4838-abce-32cd571331a2-kube-api-access-5jspt\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:47:11.763000 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.762974    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3941d321-5494-4e95-888b-2ed1f98e6a4c-kube-api-access-tsz78" (OuterVolumeSpecName: "kube-api-access-tsz78") pod "3941d321-5494-4e95-888b-2ed1f98e6a4c" (UID: "3941d321-5494-4e95-888b-2ed1f98e6a4c"). InnerVolumeSpecName "kube-api-access-tsz78". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:47:11.764768 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.764747    2581 generic.go:356] "Generic (PLEG): container finished" podID="3941d321-5494-4e95-888b-2ed1f98e6a4c" containerID="90c9fd9099cf8aa4fed9764ec5df548a88fb88fdb7f8f649e7bedd2c2dc4084a" exitCode=0
Sep 11 16:47:11.764829 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.764798    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-a864cd-58d9c4cddf-sssmr"
Sep 11 16:47:11.764956 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.764787    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-a864cd-58d9c4cddf-sssmr" event={"ID":"3941d321-5494-4e95-888b-2ed1f98e6a4c","Type":"ContainerDied","Data":"90c9fd9099cf8aa4fed9764ec5df548a88fb88fdb7f8f649e7bedd2c2dc4084a"}
Sep 11 16:47:11.765014 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.764994    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-a864cd-58d9c4cddf-sssmr" event={"ID":"3941d321-5494-4e95-888b-2ed1f98e6a4c","Type":"ContainerDied","Data":"a54e7cd192e77ce490946eb7c8d44b61df854fc304f5e41174e68bb72c97abb3"}
Sep 11 16:47:11.765057 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.765033    2581 scope.go:117] "RemoveContainer" containerID="90c9fd9099cf8aa4fed9764ec5df548a88fb88fdb7f8f649e7bedd2c2dc4084a"
Sep 11 16:47:11.766545 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.766523    2581 generic.go:356] "Generic (PLEG): container finished" podID="54f8f9b9-8a61-4838-abce-32cd571331a2" containerID="2b913ea23dcbff531af53bb09de2fecc6ebdd05f0a63450d9a670b423db979e9" exitCode=0
Sep 11 16:47:11.766656 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.766579    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a864cd-8f8d7fdc7-j575v"
Sep 11 16:47:11.766656 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.766601    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a864cd-8f8d7fdc7-j575v" event={"ID":"54f8f9b9-8a61-4838-abce-32cd571331a2","Type":"ContainerDied","Data":"2b913ea23dcbff531af53bb09de2fecc6ebdd05f0a63450d9a670b423db979e9"}
Sep 11 16:47:11.766656 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.766649    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a864cd-8f8d7fdc7-j575v" event={"ID":"54f8f9b9-8a61-4838-abce-32cd571331a2","Type":"ContainerDied","Data":"bb0adbac55e41eca8463b7e2a061efdd0bd4579b97c1270a7aa686d2cca683d0"}
Sep 11 16:47:11.768354 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.768329    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-424dd7d1-68b9bf9478-sp7lj" event={"ID":"7d564a1f-f834-428d-8cdb-02c585c3d270","Type":"ContainerStarted","Data":"253fb07a55000184507d4619d2037404726fb25052c7c09e5eff2b12b2fc0001"}
Sep 11 16:47:11.768465 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.768376    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-424dd7d1-68b9bf9478-sp7lj" event={"ID":"7d564a1f-f834-428d-8cdb-02c585c3d270","Type":"ContainerStarted","Data":"61a11156110b2539e09f254d39170cbc8e7c4c1f81430f6b64e7804e42e125e1"}
Sep 11 16:47:11.768534 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.768470    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-424dd7d1-68b9bf9478-sp7lj"
Sep 11 16:47:11.775313 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.775289    2581 scope.go:117] "RemoveContainer" containerID="90c9fd9099cf8aa4fed9764ec5df548a88fb88fdb7f8f649e7bedd2c2dc4084a"
Sep 11 16:47:11.775618 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:47:11.775599    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90c9fd9099cf8aa4fed9764ec5df548a88fb88fdb7f8f649e7bedd2c2dc4084a\": container with ID starting with 90c9fd9099cf8aa4fed9764ec5df548a88fb88fdb7f8f649e7bedd2c2dc4084a not found: ID does not exist" containerID="90c9fd9099cf8aa4fed9764ec5df548a88fb88fdb7f8f649e7bedd2c2dc4084a"
Sep 11 16:47:11.775682 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.775626    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90c9fd9099cf8aa4fed9764ec5df548a88fb88fdb7f8f649e7bedd2c2dc4084a"} err="failed to get container status \"90c9fd9099cf8aa4fed9764ec5df548a88fb88fdb7f8f649e7bedd2c2dc4084a\": rpc error: code = NotFound desc = could not find container \"90c9fd9099cf8aa4fed9764ec5df548a88fb88fdb7f8f649e7bedd2c2dc4084a\": container with ID starting with 90c9fd9099cf8aa4fed9764ec5df548a88fb88fdb7f8f649e7bedd2c2dc4084a not found: ID does not exist"
Sep 11 16:47:11.775682 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.775647    2581 scope.go:117] "RemoveContainer" containerID="2b913ea23dcbff531af53bb09de2fecc6ebdd05f0a63450d9a670b423db979e9"
Sep 11 16:47:11.786021 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.785990    2581 scope.go:117] "RemoveContainer" containerID="2b913ea23dcbff531af53bb09de2fecc6ebdd05f0a63450d9a670b423db979e9"
Sep 11 16:47:11.786381 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:47:11.786357    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b913ea23dcbff531af53bb09de2fecc6ebdd05f0a63450d9a670b423db979e9\": container with ID starting with 2b913ea23dcbff531af53bb09de2fecc6ebdd05f0a63450d9a670b423db979e9 not found: ID does not exist" containerID="2b913ea23dcbff531af53bb09de2fecc6ebdd05f0a63450d9a670b423db979e9"
Sep 11 16:47:11.786448 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.786390    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b913ea23dcbff531af53bb09de2fecc6ebdd05f0a63450d9a670b423db979e9"} err="failed to get container status \"2b913ea23dcbff531af53bb09de2fecc6ebdd05f0a63450d9a670b423db979e9\": rpc error: code = NotFound desc = could not find container \"2b913ea23dcbff531af53bb09de2fecc6ebdd05f0a63450d9a670b423db979e9\": container with ID starting with 2b913ea23dcbff531af53bb09de2fecc6ebdd05f0a63450d9a670b423db979e9 not found: ID does not exist"
Sep 11 16:47:11.841047 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.840989    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-424dd7d1-68b9bf9478-sp7lj" podStartSLOduration=1.840961814 podStartE2EDuration="1.840961814s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:47:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:47:11.816535434 +0000 UTC m=+1031.433292525" watchObservedRunningTime="2026-09-11 16:47:11.840961814 +0000 UTC m=+1031.457718878"
Sep 11 16:47:11.842398 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.842370    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-a864cd-58d9c4cddf-sssmr"]
Sep 11 16:47:11.847563 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.847539    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-a864cd-58d9c4cddf-sssmr"]
Sep 11 16:47:11.856867 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.856844    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:11.861111 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.861066    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tsz78\" (UniqueName: \"kubernetes.io/projected/3941d321-5494-4e95-888b-2ed1f98e6a4c-kube-api-access-tsz78\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:47:11.861260 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.861120    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3941d321-5494-4e95-888b-2ed1f98e6a4c-plugins-config-volume\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:47:11.867933 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.864419    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-a864cd-8f8d7fdc7-j575v"]
Sep 11 16:47:11.874071 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.874045    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-a864cd-8f8d7fdc7-j575v"]
Sep 11 16:47:11.907782 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:11.907755    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-424dd7d1-6ffc5d479c-ldnq4"]
Sep 11 16:47:11.910025 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:47:11.909981    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e167c9d_739b_4339_9b5f_23918c08a822.slice/crio-56d9e39804dce15daa965859beae4a6c7d58d60ce0fe84088440757607b0bae0 WatchSource:0}: Error finding container 56d9e39804dce15daa965859beae4a6c7d58d60ce0fe84088440757607b0bae0: Status 404 returned error can't find the container with id 56d9e39804dce15daa965859beae4a6c7d58d60ce0fe84088440757607b0bae0
Sep 11 16:47:12.048462 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:12.048372    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:12.297622 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:12.297588    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:12.777002 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:12.776962    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-424dd7d1-6ffc5d479c-ldnq4" event={"ID":"4e167c9d-739b-4339-9b5f-23918c08a822","Type":"ContainerStarted","Data":"62c33513cd68b11adde21e1dbb68e962db0d71b2524df4a9b0a9ff3603a5a345"}
Sep 11 16:47:12.777227 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:12.777018    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-424dd7d1-6ffc5d479c-ldnq4" event={"ID":"4e167c9d-739b-4339-9b5f-23918c08a822","Type":"ContainerStarted","Data":"56d9e39804dce15daa965859beae4a6c7d58d60ce0fe84088440757607b0bae0"}
Sep 11 16:47:12.805909 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:12.805852    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-424dd7d1-6ffc5d479c-ldnq4" podStartSLOduration=2.805835141 podStartE2EDuration="2.805835141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:47:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:47:12.804499065 +0000 UTC m=+1032.421256152" watchObservedRunningTime="2026-09-11 16:47:12.805835141 +0000 UTC m=+1032.422592208"
Sep 11 16:47:12.987990 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:12.987952    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3941d321-5494-4e95-888b-2ed1f98e6a4c" path="/var/lib/kubelet/pods/3941d321-5494-4e95-888b-2ed1f98e6a4c/volumes"
Sep 11 16:47:12.988462 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:12.988443    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54f8f9b9-8a61-4838-abce-32cd571331a2" path="/var/lib/kubelet/pods/54f8f9b9-8a61-4838-abce-32cd571331a2/volumes"
Sep 11 16:47:13.781888 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:13.781857    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-424dd7d1-6ffc5d479c-ldnq4"
Sep 11 16:47:20.473762 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:20.473718    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:20.574726 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:20.574683    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:20.829703 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:20.829618    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:21.225520 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:21.225484    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:21.573064 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:21.572961    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:21.701403 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:21.701369    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:22.728188 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:22.728157    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:22.780032 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:22.780000    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-424dd7d1-68b9bf9478-sp7lj"
Sep 11 16:47:22.848081 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:22.848032    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:22.949136 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:22.949043    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:24.790188 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:24.790153    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-424dd7d1-6ffc5d479c-ldnq4"
Sep 11 16:47:30.664477 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:30.664441    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:33.307645 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:33.307610    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:34.006518 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:34.006485    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:34.145069 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:34.145036    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:34.464584 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:34.464554    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:34.640786 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:34.640758    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:34.775709 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:34.775630    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:34.980275 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:34.980238    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:35.114587 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:35.114500    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:38.645084 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:38.645047    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:39.967907 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:39.967865    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:40.173316 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:40.173229    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:40.320487 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:40.320459    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:42.318763 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:42.318731    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:42.420337 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:42.420303    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:42.955634 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:42.955600    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:50.203253 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:50.203216    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:51.089397 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:51.089356    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:51.184673 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:51.184640    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:51.273298 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:51.273263    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:51.370821 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:51.370735    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:51.468151 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:51.468119    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:51.830733 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:51.830701    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:52.877419 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:52.877383    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:53.788603 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:53.788570    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:53.842243 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:53.842210    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-424dd7d1-6ffc5d479c-ldnq4"]
Sep 11 16:47:53.842476 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:53.842449    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-424dd7d1-6ffc5d479c-ldnq4" podUID="4e167c9d-739b-4339-9b5f-23918c08a822" containerName="payload-processing" containerID="cri-o://62c33513cd68b11adde21e1dbb68e962db0d71b2524df4a9b0a9ff3603a5a345" gracePeriod=30
Sep 11 16:47:53.850903 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:53.850878    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-424dd7d1-68b9bf9478-sp7lj"]
Sep 11 16:47:53.851133 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:53.851078    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-424dd7d1-68b9bf9478-sp7lj" podUID="7d564a1f-f834-428d-8cdb-02c585c3d270" containerName="payload-pre-processing" containerID="cri-o://253fb07a55000184507d4619d2037404726fb25052c7c09e5eff2b12b2fc0001" gracePeriod=30
Sep 11 16:47:53.885788 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:53.885757    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:53.980963 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:53.980919    2581 generic.go:356] "Generic (PLEG): container finished" podID="7d564a1f-f834-428d-8cdb-02c585c3d270" containerID="253fb07a55000184507d4619d2037404726fb25052c7c09e5eff2b12b2fc0001" exitCode=0
Sep 11 16:47:53.981191 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:53.980990    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-424dd7d1-68b9bf9478-sp7lj" event={"ID":"7d564a1f-f834-428d-8cdb-02c585c3d270","Type":"ContainerDied","Data":"253fb07a55000184507d4619d2037404726fb25052c7c09e5eff2b12b2fc0001"}
Sep 11 16:47:53.982964 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:53.982933    2581 generic.go:356] "Generic (PLEG): container finished" podID="4e167c9d-739b-4339-9b5f-23918c08a822" containerID="62c33513cd68b11adde21e1dbb68e962db0d71b2524df4a9b0a9ff3603a5a345" exitCode=0
Sep 11 16:47:53.983126 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:53.982995    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-424dd7d1-6ffc5d479c-ldnq4" event={"ID":"4e167c9d-739b-4339-9b5f-23918c08a822","Type":"ContainerDied","Data":"62c33513cd68b11adde21e1dbb68e962db0d71b2524df4a9b0a9ff3603a5a345"}
Sep 11 16:47:53.983258 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:53.983240    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:54.114911 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:54.114886    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-424dd7d1-6ffc5d479c-ldnq4"
Sep 11 16:47:54.116232 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:54.116213    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:54.144936 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:54.144895    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-424dd7d1-68b9bf9478-sp7lj"
Sep 11 16:47:54.220496 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:54.220463    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:54.261550 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:54.261515    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhkm4\" (UniqueName: \"kubernetes.io/projected/4e167c9d-739b-4339-9b5f-23918c08a822-kube-api-access-hhkm4\") pod \"4e167c9d-739b-4339-9b5f-23918c08a822\" (UID: \"4e167c9d-739b-4339-9b5f-23918c08a822\") "
Sep 11 16:47:54.261740 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:54.261581    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d564a1f-f834-428d-8cdb-02c585c3d270-plugins-config-volume\") pod \"7d564a1f-f834-428d-8cdb-02c585c3d270\" (UID: \"7d564a1f-f834-428d-8cdb-02c585c3d270\") "
Sep 11 16:47:54.261740 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:54.261628    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xpn49\" (UniqueName: \"kubernetes.io/projected/7d564a1f-f834-428d-8cdb-02c585c3d270-kube-api-access-xpn49\") pod \"7d564a1f-f834-428d-8cdb-02c585c3d270\" (UID: \"7d564a1f-f834-428d-8cdb-02c585c3d270\") "
Sep 11 16:47:54.261740 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:54.261676    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e167c9d-739b-4339-9b5f-23918c08a822-plugins-config-volume\") pod \"4e167c9d-739b-4339-9b5f-23918c08a822\" (UID: \"4e167c9d-739b-4339-9b5f-23918c08a822\") "
Sep 11 16:47:54.262057 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:54.262034    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d564a1f-f834-428d-8cdb-02c585c3d270-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7d564a1f-f834-428d-8cdb-02c585c3d270" (UID: "7d564a1f-f834-428d-8cdb-02c585c3d270"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:47:54.262178 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:54.262080    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e167c9d-739b-4339-9b5f-23918c08a822-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4e167c9d-739b-4339-9b5f-23918c08a822" (UID: "4e167c9d-739b-4339-9b5f-23918c08a822"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:47:54.264034 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:54.264008    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d564a1f-f834-428d-8cdb-02c585c3d270-kube-api-access-xpn49" (OuterVolumeSpecName: "kube-api-access-xpn49") pod "7d564a1f-f834-428d-8cdb-02c585c3d270" (UID: "7d564a1f-f834-428d-8cdb-02c585c3d270"). InnerVolumeSpecName "kube-api-access-xpn49". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:47:54.264174 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:54.264155    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e167c9d-739b-4339-9b5f-23918c08a822-kube-api-access-hhkm4" (OuterVolumeSpecName: "kube-api-access-hhkm4") pod "4e167c9d-739b-4339-9b5f-23918c08a822" (UID: "4e167c9d-739b-4339-9b5f-23918c08a822"). InnerVolumeSpecName "kube-api-access-hhkm4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:47:54.363002 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:54.362911    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e167c9d-739b-4339-9b5f-23918c08a822-plugins-config-volume\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:47:54.363002 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:54.362945    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhkm4\" (UniqueName: \"kubernetes.io/projected/4e167c9d-739b-4339-9b5f-23918c08a822-kube-api-access-hhkm4\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:47:54.363002 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:54.362954    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d564a1f-f834-428d-8cdb-02c585c3d270-plugins-config-volume\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:47:54.363002 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:54.362964    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpn49\" (UniqueName: \"kubernetes.io/projected/7d564a1f-f834-428d-8cdb-02c585c3d270-kube-api-access-xpn49\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:47:54.568688 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:54.568651    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:54.989785 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:54.989750    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-424dd7d1-68b9bf9478-sp7lj"
Sep 11 16:47:54.989785 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:54.989775    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-424dd7d1-68b9bf9478-sp7lj" event={"ID":"7d564a1f-f834-428d-8cdb-02c585c3d270","Type":"ContainerDied","Data":"61a11156110b2539e09f254d39170cbc8e7c4c1f81430f6b64e7804e42e125e1"}
Sep 11 16:47:54.990309 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:54.989838    2581 scope.go:117] "RemoveContainer" containerID="253fb07a55000184507d4619d2037404726fb25052c7c09e5eff2b12b2fc0001"
Sep 11 16:47:54.992130 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:54.992083    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-424dd7d1-6ffc5d479c-ldnq4"
Sep 11 16:47:54.992266 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:54.992078    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-424dd7d1-6ffc5d479c-ldnq4" event={"ID":"4e167c9d-739b-4339-9b5f-23918c08a822","Type":"ContainerDied","Data":"56d9e39804dce15daa965859beae4a6c7d58d60ce0fe84088440757607b0bae0"}
Sep 11 16:47:55.009702 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:55.002202    2581 scope.go:117] "RemoveContainer" containerID="62c33513cd68b11adde21e1dbb68e962db0d71b2524df4a9b0a9ff3603a5a345"
Sep 11 16:47:55.033572 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:55.033481    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-424dd7d1-68b9bf9478-sp7lj"]
Sep 11 16:47:55.035368 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:55.035342    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-424dd7d1-68b9bf9478-sp7lj"]
Sep 11 16:47:55.053716 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:55.053680    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-424dd7d1-6ffc5d479c-ldnq4"]
Sep 11 16:47:55.065929 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:55.065896    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-424dd7d1-6ffc5d479c-ldnq4"]
Sep 11 16:47:56.987030 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:56.986995    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e167c9d-739b-4339-9b5f-23918c08a822" path="/var/lib/kubelet/pods/4e167c9d-739b-4339-9b5f-23918c08a822/volumes"
Sep 11 16:47:56.987429 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:56.987356    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d564a1f-f834-428d-8cdb-02c585c3d270" path="/var/lib/kubelet/pods/7d564a1f-f834-428d-8cdb-02c585c3d270/volumes"
Sep 11 16:47:58.991676 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:58.991643    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:59.106072 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:59.106042    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:59.330473 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:59.330371    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:47:59.925341 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:47:59.925295    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:03.433912 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:03.433864    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:03.578073 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:03.578034    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:03.724387 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:03.724361    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:04.074333 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:04.074254    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:04.198676 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:04.198646    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:04.302622 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:04.302594    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:10.587151 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:10.587111    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-587a17-84446b8b6-s45xj"]
Sep 11 16:48:10.587570 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:10.587337    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-587a17-84446b8b6-s45xj" podUID="005a026e-fc43-4951-b961-b7735ab386ae" containerName="maas-api" containerID="cri-o://b8a723a53695b7c0fc981e80039acaca7e899133e3c2e69cd370469fab7a4bf9" gracePeriod=30
Sep 11 16:48:10.648584 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:10.648552    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:10.678678 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:10.678637    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-587a17-59bb646f7c-qvntk"]
Sep 11 16:48:10.678938 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:10.678899    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-587a17-59bb646f7c-qvntk" podUID="edb49788-baad-4212-937b-ab793b157a2f" containerName="payload-processing" containerID="cri-o://7ec478f9fba2f50e6ba37b5c728717e84da890699957025c36ae7068cec877c5" gracePeriod=30
Sep 11 16:48:10.692538 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:10.692493    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-587a17-5fd468f66-64r6m"]
Sep 11 16:48:10.693001 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:10.692968    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-587a17-5fd468f66-64r6m" podUID="7c2ac70a-2bf5-4400-a581-cae4a6cb2586" containerName="payload-pre-processing" containerID="cri-o://7d1f6a56ff04201de035c8682d72180c8ab9a42e7a31d5b8114fdc1d928c0070" gracePeriod=30
Sep 11 16:48:10.776761 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:10.776735    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:10.951807 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:10.951782    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-587a17-84446b8b6-s45xj"
Sep 11 16:48:10.977121 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:10.977079    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-587a17-59bb646f7c-qvntk"
Sep 11 16:48:10.980164 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:10.980140    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-587a17-5fd468f66-64r6m"
Sep 11 16:48:10.999702 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:10.999676    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:11.011049 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.011016    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/005a026e-fc43-4951-b961-b7735ab386ae-maas-api-tls\") pod \"005a026e-fc43-4951-b961-b7735ab386ae\" (UID: \"005a026e-fc43-4951-b961-b7735ab386ae\") "
Sep 11 16:48:11.011203 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.011064    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/edb49788-baad-4212-937b-ab793b157a2f-plugins-config-volume\") pod \"edb49788-baad-4212-937b-ab793b157a2f\" (UID: \"edb49788-baad-4212-937b-ab793b157a2f\") "
Sep 11 16:48:11.011203 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.011146    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/005a026e-fc43-4951-b961-b7735ab386ae-metrics-certs\") pod \"005a026e-fc43-4951-b961-b7735ab386ae\" (UID: \"005a026e-fc43-4951-b961-b7735ab386ae\") "
Sep 11 16:48:11.011203 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.011175    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c2ac70a-2bf5-4400-a581-cae4a6cb2586-plugins-config-volume\") pod \"7c2ac70a-2bf5-4400-a581-cae4a6cb2586\" (UID: \"7c2ac70a-2bf5-4400-a581-cae4a6cb2586\") "
Sep 11 16:48:11.011378 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.011222    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v9mc9\" (UniqueName: \"kubernetes.io/projected/7c2ac70a-2bf5-4400-a581-cae4a6cb2586-kube-api-access-v9mc9\") pod \"7c2ac70a-2bf5-4400-a581-cae4a6cb2586\" (UID: \"7c2ac70a-2bf5-4400-a581-cae4a6cb2586\") "
Sep 11 16:48:11.011378 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.011279    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjqtn\" (UniqueName: \"kubernetes.io/projected/005a026e-fc43-4951-b961-b7735ab386ae-kube-api-access-rjqtn\") pod \"005a026e-fc43-4951-b961-b7735ab386ae\" (UID: \"005a026e-fc43-4951-b961-b7735ab386ae\") "
Sep 11 16:48:11.011378 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.011304    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tc2vv\" (UniqueName: \"kubernetes.io/projected/edb49788-baad-4212-937b-ab793b157a2f-kube-api-access-tc2vv\") pod \"edb49788-baad-4212-937b-ab793b157a2f\" (UID: \"edb49788-baad-4212-937b-ab793b157a2f\") "
Sep 11 16:48:11.011378 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.011348    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/005a026e-fc43-4951-b961-b7735ab386ae-openshift-service-ca\") pod \"005a026e-fc43-4951-b961-b7735ab386ae\" (UID: \"005a026e-fc43-4951-b961-b7735ab386ae\") "
Sep 11 16:48:11.011587 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.011475    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edb49788-baad-4212-937b-ab793b157a2f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "edb49788-baad-4212-937b-ab793b157a2f" (UID: "edb49788-baad-4212-937b-ab793b157a2f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:48:11.011641 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.011584    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c2ac70a-2bf5-4400-a581-cae4a6cb2586-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7c2ac70a-2bf5-4400-a581-cae4a6cb2586" (UID: "7c2ac70a-2bf5-4400-a581-cae4a6cb2586"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:48:11.011875 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.011823    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/005a026e-fc43-4951-b961-b7735ab386ae-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "005a026e-fc43-4951-b961-b7735ab386ae" (UID: "005a026e-fc43-4951-b961-b7735ab386ae"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:48:11.011875 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.011838    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/edb49788-baad-4212-937b-ab793b157a2f-plugins-config-volume\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:48:11.013640 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.013618    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/005a026e-fc43-4951-b961-b7735ab386ae-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "005a026e-fc43-4951-b961-b7735ab386ae" (UID: "005a026e-fc43-4951-b961-b7735ab386ae"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:48:11.014015 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.014000    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/005a026e-fc43-4951-b961-b7735ab386ae-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "005a026e-fc43-4951-b961-b7735ab386ae" (UID: "005a026e-fc43-4951-b961-b7735ab386ae"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:48:11.014212 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.014186    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c2ac70a-2bf5-4400-a581-cae4a6cb2586-kube-api-access-v9mc9" (OuterVolumeSpecName: "kube-api-access-v9mc9") pod "7c2ac70a-2bf5-4400-a581-cae4a6cb2586" (UID: "7c2ac70a-2bf5-4400-a581-cae4a6cb2586"). InnerVolumeSpecName "kube-api-access-v9mc9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:48:11.014295 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.014223    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edb49788-baad-4212-937b-ab793b157a2f-kube-api-access-tc2vv" (OuterVolumeSpecName: "kube-api-access-tc2vv") pod "edb49788-baad-4212-937b-ab793b157a2f" (UID: "edb49788-baad-4212-937b-ab793b157a2f"). InnerVolumeSpecName "kube-api-access-tc2vv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:48:11.014295 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.014247    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/005a026e-fc43-4951-b961-b7735ab386ae-kube-api-access-rjqtn" (OuterVolumeSpecName: "kube-api-access-rjqtn") pod "005a026e-fc43-4951-b961-b7735ab386ae" (UID: "005a026e-fc43-4951-b961-b7735ab386ae"). InnerVolumeSpecName "kube-api-access-rjqtn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:48:11.077908 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.077871    2581 generic.go:356] "Generic (PLEG): container finished" podID="7c2ac70a-2bf5-4400-a581-cae4a6cb2586" containerID="7d1f6a56ff04201de035c8682d72180c8ab9a42e7a31d5b8114fdc1d928c0070" exitCode=0
Sep 11 16:48:11.078118 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.077925    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-587a17-5fd468f66-64r6m"
Sep 11 16:48:11.078118 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.077964    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-587a17-5fd468f66-64r6m" event={"ID":"7c2ac70a-2bf5-4400-a581-cae4a6cb2586","Type":"ContainerDied","Data":"7d1f6a56ff04201de035c8682d72180c8ab9a42e7a31d5b8114fdc1d928c0070"}
Sep 11 16:48:11.078118 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.078026    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-587a17-5fd468f66-64r6m" event={"ID":"7c2ac70a-2bf5-4400-a581-cae4a6cb2586","Type":"ContainerDied","Data":"990ae16aedb4c27c0e6e85f577e97ab0784c578d34c734ffb7fbe7214b5d3200"}
Sep 11 16:48:11.078118 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.078050    2581 scope.go:117] "RemoveContainer" containerID="7d1f6a56ff04201de035c8682d72180c8ab9a42e7a31d5b8114fdc1d928c0070"
Sep 11 16:48:11.079438 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.079418    2581 generic.go:356] "Generic (PLEG): container finished" podID="005a026e-fc43-4951-b961-b7735ab386ae" containerID="b8a723a53695b7c0fc981e80039acaca7e899133e3c2e69cd370469fab7a4bf9" exitCode=0
Sep 11 16:48:11.079547 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.079471    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-587a17-84446b8b6-s45xj"
Sep 11 16:48:11.079547 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.079505    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-587a17-84446b8b6-s45xj" event={"ID":"005a026e-fc43-4951-b961-b7735ab386ae","Type":"ContainerDied","Data":"b8a723a53695b7c0fc981e80039acaca7e899133e3c2e69cd370469fab7a4bf9"}
Sep 11 16:48:11.079660 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.079556    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-587a17-84446b8b6-s45xj" event={"ID":"005a026e-fc43-4951-b961-b7735ab386ae","Type":"ContainerDied","Data":"008f8e9bfb506814d2820ca56f047a1abfc818adffec392d0456b1afaabc3a30"}
Sep 11 16:48:11.081241 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.081221    2581 generic.go:356] "Generic (PLEG): container finished" podID="edb49788-baad-4212-937b-ab793b157a2f" containerID="7ec478f9fba2f50e6ba37b5c728717e84da890699957025c36ae7068cec877c5" exitCode=0
Sep 11 16:48:11.081340 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.081251    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-587a17-59bb646f7c-qvntk" event={"ID":"edb49788-baad-4212-937b-ab793b157a2f","Type":"ContainerDied","Data":"7ec478f9fba2f50e6ba37b5c728717e84da890699957025c36ae7068cec877c5"}
Sep 11 16:48:11.081340 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.081266    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-587a17-59bb646f7c-qvntk"
Sep 11 16:48:11.081340 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.081289    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-587a17-59bb646f7c-qvntk" event={"ID":"edb49788-baad-4212-937b-ab793b157a2f","Type":"ContainerDied","Data":"1bed435564c89980e3690b9778fe17b38729caa068a30c75782e7fbb1e8a58f7"}
Sep 11 16:48:11.087707 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.087677    2581 scope.go:117] "RemoveContainer" containerID="7d1f6a56ff04201de035c8682d72180c8ab9a42e7a31d5b8114fdc1d928c0070"
Sep 11 16:48:11.088035 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:48:11.088010    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d1f6a56ff04201de035c8682d72180c8ab9a42e7a31d5b8114fdc1d928c0070\": container with ID starting with 7d1f6a56ff04201de035c8682d72180c8ab9a42e7a31d5b8114fdc1d928c0070 not found: ID does not exist" containerID="7d1f6a56ff04201de035c8682d72180c8ab9a42e7a31d5b8114fdc1d928c0070"
Sep 11 16:48:11.088150 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.088051    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d1f6a56ff04201de035c8682d72180c8ab9a42e7a31d5b8114fdc1d928c0070"} err="failed to get container status \"7d1f6a56ff04201de035c8682d72180c8ab9a42e7a31d5b8114fdc1d928c0070\": rpc error: code = NotFound desc = could not find container \"7d1f6a56ff04201de035c8682d72180c8ab9a42e7a31d5b8114fdc1d928c0070\": container with ID starting with 7d1f6a56ff04201de035c8682d72180c8ab9a42e7a31d5b8114fdc1d928c0070 not found: ID does not exist"
Sep 11 16:48:11.088150 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.088080    2581 scope.go:117] "RemoveContainer" containerID="b8a723a53695b7c0fc981e80039acaca7e899133e3c2e69cd370469fab7a4bf9"
Sep 11 16:48:11.099948 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.099928    2581 scope.go:117] "RemoveContainer" containerID="b8a723a53695b7c0fc981e80039acaca7e899133e3c2e69cd370469fab7a4bf9"
Sep 11 16:48:11.100291 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:48:11.100272    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8a723a53695b7c0fc981e80039acaca7e899133e3c2e69cd370469fab7a4bf9\": container with ID starting with b8a723a53695b7c0fc981e80039acaca7e899133e3c2e69cd370469fab7a4bf9 not found: ID does not exist" containerID="b8a723a53695b7c0fc981e80039acaca7e899133e3c2e69cd370469fab7a4bf9"
Sep 11 16:48:11.100380 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.100300    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8a723a53695b7c0fc981e80039acaca7e899133e3c2e69cd370469fab7a4bf9"} err="failed to get container status \"b8a723a53695b7c0fc981e80039acaca7e899133e3c2e69cd370469fab7a4bf9\": rpc error: code = NotFound desc = could not find container \"b8a723a53695b7c0fc981e80039acaca7e899133e3c2e69cd370469fab7a4bf9\": container with ID starting with b8a723a53695b7c0fc981e80039acaca7e899133e3c2e69cd370469fab7a4bf9 not found: ID does not exist"
Sep 11 16:48:11.100380 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.100318    2581 scope.go:117] "RemoveContainer" containerID="7ec478f9fba2f50e6ba37b5c728717e84da890699957025c36ae7068cec877c5"
Sep 11 16:48:11.109524 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.109504    2581 scope.go:117] "RemoveContainer" containerID="7ec478f9fba2f50e6ba37b5c728717e84da890699957025c36ae7068cec877c5"
Sep 11 16:48:11.109862 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:48:11.109844    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ec478f9fba2f50e6ba37b5c728717e84da890699957025c36ae7068cec877c5\": container with ID starting with 7ec478f9fba2f50e6ba37b5c728717e84da890699957025c36ae7068cec877c5 not found: ID does not exist" containerID="7ec478f9fba2f50e6ba37b5c728717e84da890699957025c36ae7068cec877c5"
Sep 11 16:48:11.109928 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.109869    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ec478f9fba2f50e6ba37b5c728717e84da890699957025c36ae7068cec877c5"} err="failed to get container status \"7ec478f9fba2f50e6ba37b5c728717e84da890699957025c36ae7068cec877c5\": rpc error: code = NotFound desc = could not find container \"7ec478f9fba2f50e6ba37b5c728717e84da890699957025c36ae7068cec877c5\": container with ID starting with 7ec478f9fba2f50e6ba37b5c728717e84da890699957025c36ae7068cec877c5 not found: ID does not exist"
Sep 11 16:48:11.112604 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.112578    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/005a026e-fc43-4951-b961-b7735ab386ae-metrics-certs\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:48:11.112701 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.112610    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c2ac70a-2bf5-4400-a581-cae4a6cb2586-plugins-config-volume\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:48:11.112701 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.112626    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v9mc9\" (UniqueName: \"kubernetes.io/projected/7c2ac70a-2bf5-4400-a581-cae4a6cb2586-kube-api-access-v9mc9\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:48:11.112701 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.112641    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjqtn\" (UniqueName: \"kubernetes.io/projected/005a026e-fc43-4951-b961-b7735ab386ae-kube-api-access-rjqtn\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:48:11.112701 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.112655    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tc2vv\" (UniqueName: \"kubernetes.io/projected/edb49788-baad-4212-937b-ab793b157a2f-kube-api-access-tc2vv\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:48:11.112701 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.112669    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/005a026e-fc43-4951-b961-b7735ab386ae-openshift-service-ca\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:48:11.112701 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.112682    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/005a026e-fc43-4951-b961-b7735ab386ae-maas-api-tls\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:48:11.199711 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.199655    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:11.200420 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.200399    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-587a17-59bb646f7c-qvntk"]
Sep 11 16:48:11.204287 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.204259    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-587a17-59bb646f7c-qvntk"]
Sep 11 16:48:11.229657 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.229622    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-587a17-84446b8b6-s45xj"]
Sep 11 16:48:11.236256 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.236230    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-587a17-84446b8b6-s45xj"]
Sep 11 16:48:11.276636 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.276602    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-587a17-5fd468f66-64r6m"]
Sep 11 16:48:11.289950 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.289912    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-587a17-5fd468f66-64r6m"]
Sep 11 16:48:11.500968 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:11.500922    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:12.602018 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:12.601986    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:12.746817 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:12.746788    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:12.866152 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:12.866072    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:12.979414 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:12.979385    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:12.986821 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:12.986794    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="005a026e-fc43-4951-b961-b7735ab386ae" path="/var/lib/kubelet/pods/005a026e-fc43-4951-b961-b7735ab386ae/volumes"
Sep 11 16:48:12.987176 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:12.987162    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c2ac70a-2bf5-4400-a581-cae4a6cb2586" path="/var/lib/kubelet/pods/7c2ac70a-2bf5-4400-a581-cae4a6cb2586/volumes"
Sep 11 16:48:12.987483 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:12.987471    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edb49788-baad-4212-937b-ab793b157a2f" path="/var/lib/kubelet/pods/edb49788-baad-4212-937b-ab793b157a2f/volumes"
Sep 11 16:48:20.592415 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:20.592380    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:21.325885 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:21.325847    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:21.542894 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:21.542855    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:21.737916 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:21.737882    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:21.882512 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:21.882477    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:22.355044 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:22.355017    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:22.787897 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:22.787867    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:22.983614 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:22.983580    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:23.634579 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:23.634550    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:23.896818 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:23.896724    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:24.584498 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:24.584464    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:25.038451 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:25.038421    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:25.294603 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:25.294513    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:26.237208 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:26.237174    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:26.388398 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:26.388363    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:27.388970 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:27.388922    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ff7416-6bcdb89b7c-s6fs9"]
Sep 11 16:48:27.389414 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:27.389396    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d564a1f-f834-428d-8cdb-02c585c3d270" containerName="payload-pre-processing"
Sep 11 16:48:27.389464 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:27.389417    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d564a1f-f834-428d-8cdb-02c585c3d270" containerName="payload-pre-processing"
Sep 11 16:48:27.389464 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:27.389428    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c2ac70a-2bf5-4400-a581-cae4a6cb2586" containerName="payload-pre-processing"
Sep 11 16:48:27.389464 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:27.389434    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c2ac70a-2bf5-4400-a581-cae4a6cb2586" containerName="payload-pre-processing"
Sep 11 16:48:27.389464 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:27.389441    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="005a026e-fc43-4951-b961-b7735ab386ae" containerName="maas-api"
Sep 11 16:48:27.389464 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:27.389448    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="005a026e-fc43-4951-b961-b7735ab386ae" containerName="maas-api"
Sep 11 16:48:27.389464 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:27.389456    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3941d321-5494-4e95-888b-2ed1f98e6a4c" containerName="payload-processing"
Sep 11 16:48:27.389464 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:27.389461    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3941d321-5494-4e95-888b-2ed1f98e6a4c" containerName="payload-processing"
Sep 11 16:48:27.389674 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:27.389484    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54f8f9b9-8a61-4838-abce-32cd571331a2" containerName="maas-api"
Sep 11 16:48:27.389674 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:27.389492    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="54f8f9b9-8a61-4838-abce-32cd571331a2" containerName="maas-api"
Sep 11 16:48:27.389674 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:27.389503    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e167c9d-739b-4339-9b5f-23918c08a822" containerName="payload-processing"
Sep 11 16:48:27.389674 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:27.389508    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e167c9d-739b-4339-9b5f-23918c08a822" containerName="payload-processing"
Sep 11 16:48:27.389674 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:27.389517    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edb49788-baad-4212-937b-ab793b157a2f" containerName="payload-processing"
Sep 11 16:48:27.389674 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:27.389522    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="edb49788-baad-4212-937b-ab793b157a2f" containerName="payload-processing"
Sep 11 16:48:27.389674 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:27.389573    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c2ac70a-2bf5-4400-a581-cae4a6cb2586" containerName="payload-pre-processing"
Sep 11 16:48:27.389674 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:27.389581    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="005a026e-fc43-4951-b961-b7735ab386ae" containerName="maas-api"
Sep 11 16:48:27.389674 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:27.389588    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d564a1f-f834-428d-8cdb-02c585c3d270" containerName="payload-pre-processing"
Sep 11 16:48:27.389674 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:27.389594    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="edb49788-baad-4212-937b-ab793b157a2f" containerName="payload-processing"
Sep 11 16:48:27.389674 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:27.389599    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3941d321-5494-4e95-888b-2ed1f98e6a4c" containerName="payload-processing"
Sep 11 16:48:27.389674 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:27.389606    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="54f8f9b9-8a61-4838-abce-32cd571331a2" containerName="maas-api"
Sep 11 16:48:27.389674 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:27.389611    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e167c9d-739b-4339-9b5f-23918c08a822" containerName="payload-processing"
Sep 11 16:48:27.392383 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:27.392368    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ff7416-6bcdb89b7c-s6fs9"
Sep 11 16:48:27.401263 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:27.401242    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-ff7416-serving-cert\""
Sep 11 16:48:27.401399 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:27.401332    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 16:48:27.402434 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:27.402419    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 11 16:48:27.405284 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:27.405268    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kfp69\""
Sep 11 16:48:27.406387 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:27.406371    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 16:48:27.435803 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:27.435762    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ff7416-6bcdb89b7c-s6fs9"]
Sep 11 16:48:27.463779 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:27.463742    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9619fa9c-b818-4634-9d4f-6591dc6a328f-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-ff7416-6bcdb89b7c-s6fs9\" (UID: \"9619fa9c-b818-4634-9d4f-6591dc6a328f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ff7416-6bcdb89b7c-s6fs9"
Sep 11 16:48:27.463956 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:27.463807    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9619fa9c-b818-4634-9d4f-6591dc6a328f-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-ff7416-6bcdb89b7c-s6fs9\" (UID: \"9619fa9c-b818-4634-9d4f-6591dc6a328f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ff7416-6bcdb89b7c-s6fs9"
Sep 11 16:48:27.463956 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:27.463867    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lz7kz\" (UniqueName: \"kubernetes.io/projected/9619fa9c-b818-4634-9d4f-6591dc6a328f-kube-api-access-lz7kz\") pod \"maas-api-e2e-shared-a-w3-ff7416-6bcdb89b7c-s6fs9\" (UID: \"9619fa9c-b818-4634-9d4f-6591dc6a328f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ff7416-6bcdb89b7c-s6fs9"
Sep 11 16:48:27.463956 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:27.463883    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9619fa9c-b818-4634-9d4f-6591dc6a328f-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-ff7416-6bcdb89b7c-s6fs9\" (UID: \"9619fa9c-b818-4634-9d4f-6591dc6a328f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ff7416-6bcdb89b7c-s6fs9"
Sep 11 16:48:27.496516 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:27.496477    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:27.565083 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:27.565044    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9619fa9c-b818-4634-9d4f-6591dc6a328f-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-ff7416-6bcdb89b7c-s6fs9\" (UID: \"9619fa9c-b818-4634-9d4f-6591dc6a328f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ff7416-6bcdb89b7c-s6fs9"
Sep 11 16:48:27.565313 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:27.565173    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9619fa9c-b818-4634-9d4f-6591dc6a328f-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-ff7416-6bcdb89b7c-s6fs9\" (UID: \"9619fa9c-b818-4634-9d4f-6591dc6a328f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ff7416-6bcdb89b7c-s6fs9"
Sep 11 16:48:27.565313 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:27.565235    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz7kz\" (UniqueName: \"kubernetes.io/projected/9619fa9c-b818-4634-9d4f-6591dc6a328f-kube-api-access-lz7kz\") pod \"maas-api-e2e-shared-a-w3-ff7416-6bcdb89b7c-s6fs9\" (UID: \"9619fa9c-b818-4634-9d4f-6591dc6a328f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ff7416-6bcdb89b7c-s6fs9"
Sep 11 16:48:27.565313 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:27.565263    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9619fa9c-b818-4634-9d4f-6591dc6a328f-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-ff7416-6bcdb89b7c-s6fs9\" (UID: \"9619fa9c-b818-4634-9d4f-6591dc6a328f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ff7416-6bcdb89b7c-s6fs9"
Sep 11 16:48:27.565846 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:27.565821    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9619fa9c-b818-4634-9d4f-6591dc6a328f-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-ff7416-6bcdb89b7c-s6fs9\" (UID: \"9619fa9c-b818-4634-9d4f-6591dc6a328f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ff7416-6bcdb89b7c-s6fs9"
Sep 11 16:48:27.567699 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:27.567676    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9619fa9c-b818-4634-9d4f-6591dc6a328f-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-ff7416-6bcdb89b7c-s6fs9\" (UID: \"9619fa9c-b818-4634-9d4f-6591dc6a328f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ff7416-6bcdb89b7c-s6fs9"
Sep 11 16:48:27.567789 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:27.567742    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9619fa9c-b818-4634-9d4f-6591dc6a328f-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-ff7416-6bcdb89b7c-s6fs9\" (UID: \"9619fa9c-b818-4634-9d4f-6591dc6a328f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ff7416-6bcdb89b7c-s6fs9"
Sep 11 16:48:27.582026 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:27.581999    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz7kz\" (UniqueName: \"kubernetes.io/projected/9619fa9c-b818-4634-9d4f-6591dc6a328f-kube-api-access-lz7kz\") pod \"maas-api-e2e-shared-a-w3-ff7416-6bcdb89b7c-s6fs9\" (UID: \"9619fa9c-b818-4634-9d4f-6591dc6a328f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ff7416-6bcdb89b7c-s6fs9"
Sep 11 16:48:27.618248 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:27.618218    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:27.701904 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:27.701866    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ff7416-6bcdb89b7c-s6fs9"
Sep 11 16:48:27.738372 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:27.738333    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:27.891945 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:27.891912    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:27.996713 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:27.996470    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ff7416-6bcdb89b7c-s6fs9"]
Sep 11 16:48:27.999654 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:48:27.999627    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9619fa9c_b818_4634_9d4f_6591dc6a328f.slice/crio-f6c3f52f9318ddd81c6609856f72e1188f297fe5699b76717e7e440ff47bd751 WatchSource:0}: Error finding container f6c3f52f9318ddd81c6609856f72e1188f297fe5699b76717e7e440ff47bd751: Status 404 returned error can't find the container with id f6c3f52f9318ddd81c6609856f72e1188f297fe5699b76717e7e440ff47bd751
Sep 11 16:48:28.068710 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:28.068680    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:28.162376 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:28.162341    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ff7416-6bcdb89b7c-s6fs9" event={"ID":"9619fa9c-b818-4634-9d4f-6591dc6a328f","Type":"ContainerStarted","Data":"f6c3f52f9318ddd81c6609856f72e1188f297fe5699b76717e7e440ff47bd751"}
Sep 11 16:48:28.364903 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:28.364824    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:28.483936 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:28.483903    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:29.168647 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:29.168610    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ff7416-6bcdb89b7c-s6fs9" event={"ID":"9619fa9c-b818-4634-9d4f-6591dc6a328f","Type":"ContainerStarted","Data":"beec2db948cda1b74aef624f8f8d250d452fb7db7024a3dc05d3be4c4628388a"}
Sep 11 16:48:29.168805 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:29.168743    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ff7416-6bcdb89b7c-s6fs9"
Sep 11 16:48:29.221001 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:29.220948    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ff7416-6bcdb89b7c-s6fs9" podStartSLOduration=1.843983219 podStartE2EDuration="2.220923443s" totalImagesPullingTime="376.940224ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:48:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:48:29.219885952 +0000 UTC m=+1108.836643020" watchObservedRunningTime="2026-09-11 16:48:29.220923443 +0000 UTC m=+1108.837680489"
Sep 11 16:48:30.466346 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:30.466305    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-347815-79c55764fb-7c6g7"]
Sep 11 16:48:30.469671 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:30.469648    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-347815-79c55764fb-7c6g7"
Sep 11 16:48:30.474761 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:30.474726    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-347815-serving-cert\""
Sep 11 16:48:30.493258 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:30.493228    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-347815-79c55764fb-7c6g7"]
Sep 11 16:48:30.575814 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:30.575776    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:30.592509 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:30.592471    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1e8248a-7e14-4407-a8a0-c5b3cc55b53a-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-347815-79c55764fb-7c6g7\" (UID: \"c1e8248a-7e14-4407-a8a0-c5b3cc55b53a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-347815-79c55764fb-7c6g7"
Sep 11 16:48:30.592682 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:30.592574    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1e8248a-7e14-4407-a8a0-c5b3cc55b53a-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-347815-79c55764fb-7c6g7\" (UID: \"c1e8248a-7e14-4407-a8a0-c5b3cc55b53a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-347815-79c55764fb-7c6g7"
Sep 11 16:48:30.592784 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:30.592709    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1e8248a-7e14-4407-a8a0-c5b3cc55b53a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-347815-79c55764fb-7c6g7\" (UID: \"c1e8248a-7e14-4407-a8a0-c5b3cc55b53a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-347815-79c55764fb-7c6g7"
Sep 11 16:48:30.592784 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:30.592766    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dskd\" (UniqueName: \"kubernetes.io/projected/c1e8248a-7e14-4407-a8a0-c5b3cc55b53a-kube-api-access-6dskd\") pod \"maas-api-e2e-shared-a-w2-347815-79c55764fb-7c6g7\" (UID: \"c1e8248a-7e14-4407-a8a0-c5b3cc55b53a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-347815-79c55764fb-7c6g7"
Sep 11 16:48:30.694141 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:30.694072    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1e8248a-7e14-4407-a8a0-c5b3cc55b53a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-347815-79c55764fb-7c6g7\" (UID: \"c1e8248a-7e14-4407-a8a0-c5b3cc55b53a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-347815-79c55764fb-7c6g7"
Sep 11 16:48:30.694316 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:30.694179    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dskd\" (UniqueName: \"kubernetes.io/projected/c1e8248a-7e14-4407-a8a0-c5b3cc55b53a-kube-api-access-6dskd\") pod \"maas-api-e2e-shared-a-w2-347815-79c55764fb-7c6g7\" (UID: \"c1e8248a-7e14-4407-a8a0-c5b3cc55b53a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-347815-79c55764fb-7c6g7"
Sep 11 16:48:30.694316 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:30.694208    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1e8248a-7e14-4407-a8a0-c5b3cc55b53a-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-347815-79c55764fb-7c6g7\" (UID: \"c1e8248a-7e14-4407-a8a0-c5b3cc55b53a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-347815-79c55764fb-7c6g7"
Sep 11 16:48:30.694316 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:30.694239    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1e8248a-7e14-4407-a8a0-c5b3cc55b53a-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-347815-79c55764fb-7c6g7\" (UID: \"c1e8248a-7e14-4407-a8a0-c5b3cc55b53a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-347815-79c55764fb-7c6g7"
Sep 11 16:48:30.694426 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:48:30.694387    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-347815-serving-cert: secret "maas-api-e2e-shared-a-w2-347815-serving-cert" not found
Sep 11 16:48:30.694460 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:48:30.694454    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1e8248a-7e14-4407-a8a0-c5b3cc55b53a-maas-api-tls podName:c1e8248a-7e14-4407-a8a0-c5b3cc55b53a nodeName:}" failed. No retries permitted until 2026-09-11 16:48:31.194434949 +0000 UTC m=+1110.811191993 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c1e8248a-7e14-4407-a8a0-c5b3cc55b53a-maas-api-tls") pod "maas-api-e2e-shared-a-w2-347815-79c55764fb-7c6g7" (UID: "c1e8248a-7e14-4407-a8a0-c5b3cc55b53a") : secret "maas-api-e2e-shared-a-w2-347815-serving-cert" not found
Sep 11 16:48:30.694828 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:30.694803    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1e8248a-7e14-4407-a8a0-c5b3cc55b53a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-347815-79c55764fb-7c6g7\" (UID: \"c1e8248a-7e14-4407-a8a0-c5b3cc55b53a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-347815-79c55764fb-7c6g7"
Sep 11 16:48:30.696830 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:30.696804    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1e8248a-7e14-4407-a8a0-c5b3cc55b53a-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-347815-79c55764fb-7c6g7\" (UID: \"c1e8248a-7e14-4407-a8a0-c5b3cc55b53a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-347815-79c55764fb-7c6g7"
Sep 11 16:48:30.713299 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:30.713269    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dskd\" (UniqueName: \"kubernetes.io/projected/c1e8248a-7e14-4407-a8a0-c5b3cc55b53a-kube-api-access-6dskd\") pod \"maas-api-e2e-shared-a-w2-347815-79c55764fb-7c6g7\" (UID: \"c1e8248a-7e14-4407-a8a0-c5b3cc55b53a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-347815-79c55764fb-7c6g7"
Sep 11 16:48:30.749932 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:30.749818    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:31.199179 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:31.199136    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1e8248a-7e14-4407-a8a0-c5b3cc55b53a-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-347815-79c55764fb-7c6g7\" (UID: \"c1e8248a-7e14-4407-a8a0-c5b3cc55b53a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-347815-79c55764fb-7c6g7"
Sep 11 16:48:31.199366 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:48:31.199308    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-347815-serving-cert: secret "maas-api-e2e-shared-a-w2-347815-serving-cert" not found
Sep 11 16:48:31.199430 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:48:31.199400    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1e8248a-7e14-4407-a8a0-c5b3cc55b53a-maas-api-tls podName:c1e8248a-7e14-4407-a8a0-c5b3cc55b53a nodeName:}" failed. No retries permitted until 2026-09-11 16:48:32.199372446 +0000 UTC m=+1111.816129548 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c1e8248a-7e14-4407-a8a0-c5b3cc55b53a-maas-api-tls") pod "maas-api-e2e-shared-a-w2-347815-79c55764fb-7c6g7" (UID: "c1e8248a-7e14-4407-a8a0-c5b3cc55b53a") : secret "maas-api-e2e-shared-a-w2-347815-serving-cert" not found
Sep 11 16:48:31.395360 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:31.395324    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:31.525063 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:31.524983    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:31.708542 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:31.708510    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-347815-6487cdc597-jc4cd"]
Sep 11 16:48:31.712188 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:31.712168    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-347815-6487cdc597-jc4cd"
Sep 11 16:48:31.714931 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:31.714904    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-347815\""
Sep 11 16:48:31.714931 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:31.714904    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-347815-dockercfg-nchq8\""
Sep 11 16:48:31.724888 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:31.724861    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-347815-6487cdc597-jc4cd"]
Sep 11 16:48:31.805491 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:31.805383    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gkl4\" (UniqueName: \"kubernetes.io/projected/0099813f-1264-419f-885c-4a6d954b8dd9-kube-api-access-9gkl4\") pod \"payload-processing-e2e-shared-a-w2-347815-6487cdc597-jc4cd\" (UID: \"0099813f-1264-419f-885c-4a6d954b8dd9\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-347815-6487cdc597-jc4cd"
Sep 11 16:48:31.805661 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:31.805525    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0099813f-1264-419f-885c-4a6d954b8dd9-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-347815-6487cdc597-jc4cd\" (UID: \"0099813f-1264-419f-885c-4a6d954b8dd9\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-347815-6487cdc597-jc4cd"
Sep 11 16:48:31.906839 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:31.906801    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gkl4\" (UniqueName: \"kubernetes.io/projected/0099813f-1264-419f-885c-4a6d954b8dd9-kube-api-access-9gkl4\") pod \"payload-processing-e2e-shared-a-w2-347815-6487cdc597-jc4cd\" (UID: \"0099813f-1264-419f-885c-4a6d954b8dd9\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-347815-6487cdc597-jc4cd"
Sep 11 16:48:31.907064 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:31.906877    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0099813f-1264-419f-885c-4a6d954b8dd9-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-347815-6487cdc597-jc4cd\" (UID: \"0099813f-1264-419f-885c-4a6d954b8dd9\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-347815-6487cdc597-jc4cd"
Sep 11 16:48:31.907539 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:31.907518    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0099813f-1264-419f-885c-4a6d954b8dd9-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-347815-6487cdc597-jc4cd\" (UID: \"0099813f-1264-419f-885c-4a6d954b8dd9\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-347815-6487cdc597-jc4cd"
Sep 11 16:48:31.932007 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:31.931971    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gkl4\" (UniqueName: \"kubernetes.io/projected/0099813f-1264-419f-885c-4a6d954b8dd9-kube-api-access-9gkl4\") pod \"payload-processing-e2e-shared-a-w2-347815-6487cdc597-jc4cd\" (UID: \"0099813f-1264-419f-885c-4a6d954b8dd9\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-347815-6487cdc597-jc4cd"
Sep 11 16:48:32.024573 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:32.024531    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-347815-6487cdc597-jc4cd"
Sep 11 16:48:32.142391 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:32.142357    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:32.209426 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:32.209382    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1e8248a-7e14-4407-a8a0-c5b3cc55b53a-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-347815-79c55764fb-7c6g7\" (UID: \"c1e8248a-7e14-4407-a8a0-c5b3cc55b53a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-347815-79c55764fb-7c6g7"
Sep 11 16:48:32.212080 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:32.212056    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1e8248a-7e14-4407-a8a0-c5b3cc55b53a-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-347815-79c55764fb-7c6g7\" (UID: \"c1e8248a-7e14-4407-a8a0-c5b3cc55b53a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-347815-79c55764fb-7c6g7"
Sep 11 16:48:32.286000 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:32.285965    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-347815-79c55764fb-7c6g7"
Sep 11 16:48:32.309748 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:32.309710    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-347815-6487cdc597-jc4cd"]
Sep 11 16:48:32.310921 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:48:32.310895    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0099813f_1264_419f_885c_4a6d954b8dd9.slice/crio-1c263103c1920b5afc47fdedd209f6ea4ff0b532d35e6b6f138949d601f899e7 WatchSource:0}: Error finding container 1c263103c1920b5afc47fdedd209f6ea4ff0b532d35e6b6f138949d601f899e7: Status 404 returned error can't find the container with id 1c263103c1920b5afc47fdedd209f6ea4ff0b532d35e6b6f138949d601f899e7
Sep 11 16:48:32.570437 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:32.570411    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-347815-79c55764fb-7c6g7"]
Sep 11 16:48:32.571702 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:48:32.571674    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1e8248a_7e14_4407_a8a0_c5b3cc55b53a.slice/crio-66184409578a5e6d9556256f31b13c803e2fc910ff15a2597dcd6ab6fdbbbb0c WatchSource:0}: Error finding container 66184409578a5e6d9556256f31b13c803e2fc910ff15a2597dcd6ab6fdbbbb0c: Status 404 returned error can't find the container with id 66184409578a5e6d9556256f31b13c803e2fc910ff15a2597dcd6ab6fdbbbb0c
Sep 11 16:48:33.188853 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:33.188816    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-347815-79c55764fb-7c6g7" event={"ID":"c1e8248a-7e14-4407-a8a0-c5b3cc55b53a","Type":"ContainerStarted","Data":"239efd51cdc3f8c36c7ec646a309b1a196bf23e02836aed7792d7944fbbbc53a"}
Sep 11 16:48:33.189049 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:33.188869    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-347815-79c55764fb-7c6g7" event={"ID":"c1e8248a-7e14-4407-a8a0-c5b3cc55b53a","Type":"ContainerStarted","Data":"66184409578a5e6d9556256f31b13c803e2fc910ff15a2597dcd6ab6fdbbbb0c"}
Sep 11 16:48:33.189049 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:33.189007    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-347815-79c55764fb-7c6g7"
Sep 11 16:48:33.190624 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:33.190585    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-347815-6487cdc597-jc4cd" event={"ID":"0099813f-1264-419f-885c-4a6d954b8dd9","Type":"ContainerStarted","Data":"3a17cb770403701c825b7d55288ec323d2e4819bf7418a1575b83aba62e85337"}
Sep 11 16:48:33.190728 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:33.190628    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-347815-6487cdc597-jc4cd" event={"ID":"0099813f-1264-419f-885c-4a6d954b8dd9","Type":"ContainerStarted","Data":"1c263103c1920b5afc47fdedd209f6ea4ff0b532d35e6b6f138949d601f899e7"}
Sep 11 16:48:33.190728 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:33.190662    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-347815-6487cdc597-jc4cd"
Sep 11 16:48:33.218812 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:33.218753    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-347815-79c55764fb-7c6g7" podStartSLOduration=2.898531618 podStartE2EDuration="3.218737054s" totalImagesPullingTime="320.205436ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:48:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:48:33.215797057 +0000 UTC m=+1112.832554123" watchObservedRunningTime="2026-09-11 16:48:33.218737054 +0000 UTC m=+1112.835494120"
Sep 11 16:48:33.248952 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:33.248884    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-347815-6487cdc597-jc4cd" podStartSLOduration=2.248867986 podStartE2EDuration="2.248867986s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:48:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:48:33.248443873 +0000 UTC m=+1112.865200958" watchObservedRunningTime="2026-09-11 16:48:33.248867986 +0000 UTC m=+1112.865625052"
Sep 11 16:48:33.392340 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:33.392294    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:35.178740 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:35.178710    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ff7416-6bcdb89b7c-s6fs9"
Sep 11 16:48:39.200534 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:39.200504    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-347815-79c55764fb-7c6g7"
Sep 11 16:48:44.198281 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:44.198244    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-347815-6487cdc597-jc4cd"
Sep 11 16:48:53.436062 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:53.436029    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:54.087247 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:54.087195    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:54.619303 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:54.619268    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:55.638324 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:55.638292    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:56.117689 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:56.117655    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:56.454848 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:56.454822    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:56.787864 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:56.787759    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:56.986684 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:56.986651    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:58.000841 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:58.000806    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:58.327941 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:58.327861    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:58.691080 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:58.691049    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:48:59.158694 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:48:59.158613    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:49:00.029456 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:00.029422    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:49:00.140546 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:00.140512    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:49:00.238355 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:00.238323    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:49:01.286708 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:01.286613    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:49:01.416977 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:01.416945    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:49:01.561462 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:01.561371    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:49:01.974527 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:01.974497    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:49:02.150617 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:02.150589    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:49:02.220548 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:02.220514    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-ce902a-677d9c78bb-2zw6g"]
Sep 11 16:49:02.225478 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:02.225430    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-ce902a-677d9c78bb-2zw6g"
Sep 11 16:49:02.229183 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:02.229153    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-ce902a-dockercfg-bgx8v\""
Sep 11 16:49:02.229713 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:02.229697    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-ce902a\""
Sep 11 16:49:02.246291 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:02.246260    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-ce902a-677d9c78bb-2zw6g"]
Sep 11 16:49:02.281333 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:02.281294    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9aad7de-775e-4b4d-b2d9-bf04e909f5f5-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-ce902a-677d9c78bb-2zw6g\" (UID: \"a9aad7de-775e-4b4d-b2d9-bf04e909f5f5\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-ce902a-677d9c78bb-2zw6g"
Sep 11 16:49:02.281501 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:02.281397    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttgkt\" (UniqueName: \"kubernetes.io/projected/a9aad7de-775e-4b4d-b2d9-bf04e909f5f5-kube-api-access-ttgkt\") pod \"payload-pre-processing-e2e-shared-b-w3-ce902a-677d9c78bb-2zw6g\" (UID: \"a9aad7de-775e-4b4d-b2d9-bf04e909f5f5\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-ce902a-677d9c78bb-2zw6g"
Sep 11 16:49:02.289006 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:02.288969    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:49:02.305524 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:02.305493    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-ce902a-5c84787ff7-wh8rr"]
Sep 11 16:49:02.308940 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:02.308916    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ce902a-5c84787ff7-wh8rr"
Sep 11 16:49:02.325124 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:02.325077    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-ce902a-5c84787ff7-wh8rr"]
Sep 11 16:49:02.382144 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:02.382107    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53b02782-f4d4-4751-af2d-61bf1144d2e3-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-ce902a-5c84787ff7-wh8rr\" (UID: \"53b02782-f4d4-4751-af2d-61bf1144d2e3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ce902a-5c84787ff7-wh8rr"
Sep 11 16:49:02.382293 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:02.382197    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttgkt\" (UniqueName: \"kubernetes.io/projected/a9aad7de-775e-4b4d-b2d9-bf04e909f5f5-kube-api-access-ttgkt\") pod \"payload-pre-processing-e2e-shared-b-w3-ce902a-677d9c78bb-2zw6g\" (UID: \"a9aad7de-775e-4b4d-b2d9-bf04e909f5f5\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-ce902a-677d9c78bb-2zw6g"
Sep 11 16:49:02.382293 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:02.382230    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qcvj\" (UniqueName: \"kubernetes.io/projected/53b02782-f4d4-4751-af2d-61bf1144d2e3-kube-api-access-5qcvj\") pod \"payload-processing-e2e-shared-b-w3-ce902a-5c84787ff7-wh8rr\" (UID: \"53b02782-f4d4-4751-af2d-61bf1144d2e3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ce902a-5c84787ff7-wh8rr"
Sep 11 16:49:02.382402 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:02.382315    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9aad7de-775e-4b4d-b2d9-bf04e909f5f5-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-ce902a-677d9c78bb-2zw6g\" (UID: \"a9aad7de-775e-4b4d-b2d9-bf04e909f5f5\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-ce902a-677d9c78bb-2zw6g"
Sep 11 16:49:02.382999 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:02.382982    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9aad7de-775e-4b4d-b2d9-bf04e909f5f5-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-ce902a-677d9c78bb-2zw6g\" (UID: \"a9aad7de-775e-4b4d-b2d9-bf04e909f5f5\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-ce902a-677d9c78bb-2zw6g"
Sep 11 16:49:02.393227 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:02.393204    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttgkt\" (UniqueName: \"kubernetes.io/projected/a9aad7de-775e-4b4d-b2d9-bf04e909f5f5-kube-api-access-ttgkt\") pod \"payload-pre-processing-e2e-shared-b-w3-ce902a-677d9c78bb-2zw6g\" (UID: \"a9aad7de-775e-4b4d-b2d9-bf04e909f5f5\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-ce902a-677d9c78bb-2zw6g"
Sep 11 16:49:02.483723 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:02.483631    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53b02782-f4d4-4751-af2d-61bf1144d2e3-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-ce902a-5c84787ff7-wh8rr\" (UID: \"53b02782-f4d4-4751-af2d-61bf1144d2e3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ce902a-5c84787ff7-wh8rr"
Sep 11 16:49:02.483723 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:02.483685    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qcvj\" (UniqueName: \"kubernetes.io/projected/53b02782-f4d4-4751-af2d-61bf1144d2e3-kube-api-access-5qcvj\") pod \"payload-processing-e2e-shared-b-w3-ce902a-5c84787ff7-wh8rr\" (UID: \"53b02782-f4d4-4751-af2d-61bf1144d2e3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ce902a-5c84787ff7-wh8rr"
Sep 11 16:49:02.484357 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:02.484337    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53b02782-f4d4-4751-af2d-61bf1144d2e3-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-ce902a-5c84787ff7-wh8rr\" (UID: \"53b02782-f4d4-4751-af2d-61bf1144d2e3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ce902a-5c84787ff7-wh8rr"
Sep 11 16:49:02.495125 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:02.495075    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qcvj\" (UniqueName: \"kubernetes.io/projected/53b02782-f4d4-4751-af2d-61bf1144d2e3-kube-api-access-5qcvj\") pod \"payload-processing-e2e-shared-b-w3-ce902a-5c84787ff7-wh8rr\" (UID: \"53b02782-f4d4-4751-af2d-61bf1144d2e3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ce902a-5c84787ff7-wh8rr"
Sep 11 16:49:02.535785 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:02.535748    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-ce902a-677d9c78bb-2zw6g"
Sep 11 16:49:02.619950 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:02.619915    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ce902a-5c84787ff7-wh8rr"
Sep 11 16:49:02.819224 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:02.819195    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-ce902a-677d9c78bb-2zw6g"]
Sep 11 16:49:02.820008 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:49:02.819984    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9aad7de_775e_4b4d_b2d9_bf04e909f5f5.slice/crio-d795d5f4fa1a4b70b84feb4d8b976738fd386f4ef980bd3ef11401c46821f7ac WatchSource:0}: Error finding container d795d5f4fa1a4b70b84feb4d8b976738fd386f4ef980bd3ef11401c46821f7ac: Status 404 returned error can't find the container with id d795d5f4fa1a4b70b84feb4d8b976738fd386f4ef980bd3ef11401c46821f7ac
Sep 11 16:49:02.906122 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:02.906069    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-ce902a-5c84787ff7-wh8rr"]
Sep 11 16:49:02.907446 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:49:02.907414    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53b02782_f4d4_4751_af2d_61bf1144d2e3.slice/crio-7af96028093cc8a6af40766489c9e9cb1e8ccfb22e0de8695c07c2f56242b501 WatchSource:0}: Error finding container 7af96028093cc8a6af40766489c9e9cb1e8ccfb22e0de8695c07c2f56242b501: Status 404 returned error can't find the container with id 7af96028093cc8a6af40766489c9e9cb1e8ccfb22e0de8695c07c2f56242b501
Sep 11 16:49:03.340489 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:03.340447    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ce902a-5c84787ff7-wh8rr" event={"ID":"53b02782-f4d4-4751-af2d-61bf1144d2e3","Type":"ContainerStarted","Data":"395c61baf5168c0b1fcb098893953fff129279965a7e50ca7d579d7fc3568720"}
Sep 11 16:49:03.340982 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:03.340512    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ce902a-5c84787ff7-wh8rr" event={"ID":"53b02782-f4d4-4751-af2d-61bf1144d2e3","Type":"ContainerStarted","Data":"7af96028093cc8a6af40766489c9e9cb1e8ccfb22e0de8695c07c2f56242b501"}
Sep 11 16:49:03.340982 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:03.340615    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ce902a-5c84787ff7-wh8rr"
Sep 11 16:49:03.342210 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:03.342167    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-ce902a-677d9c78bb-2zw6g" event={"ID":"a9aad7de-775e-4b4d-b2d9-bf04e909f5f5","Type":"ContainerStarted","Data":"d95a2326bceca7b87f2b41acde4dae864d2584c58e15ed65a4fd8f2900dfe36c"}
Sep 11 16:49:03.342358 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:03.342229    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-ce902a-677d9c78bb-2zw6g" event={"ID":"a9aad7de-775e-4b4d-b2d9-bf04e909f5f5","Type":"ContainerStarted","Data":"d795d5f4fa1a4b70b84feb4d8b976738fd386f4ef980bd3ef11401c46821f7ac"}
Sep 11 16:49:03.342358 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:03.342256    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-ce902a-677d9c78bb-2zw6g"
Sep 11 16:49:03.375582 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:03.375522    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ce902a-5c84787ff7-wh8rr" podStartSLOduration=1.3754999030000001 podStartE2EDuration="1.375499903s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:49:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:49:03.374301485 +0000 UTC m=+1142.991058573" watchObservedRunningTime="2026-09-11 16:49:03.375499903 +0000 UTC m=+1142.992256966"
Sep 11 16:49:03.428308 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:03.428247    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-ce902a-677d9c78bb-2zw6g" podStartSLOduration=1.428230301 podStartE2EDuration="1.428230301s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:49:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:49:03.422344655 +0000 UTC m=+1143.039101721" watchObservedRunningTime="2026-09-11 16:49:03.428230301 +0000 UTC m=+1143.044987428"
Sep 11 16:49:03.866525 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:03.866494    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:49:03.956651 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:03.956621    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:49:04.079140 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:04.079071    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:49:04.765865 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:04.765815    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:49:04.875452 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:04.875396    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:49:05.020718 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:05.020636    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-3e9c29-668fc4747c-j224l"]
Sep 11 16:49:05.024111 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:05.024077    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-3e9c29-668fc4747c-j224l"
Sep 11 16:49:05.027407 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:05.027373    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-3e9c29-dockercfg-6qkdf\""
Sep 11 16:49:05.027556 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:05.027481    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-3e9c29\""
Sep 11 16:49:05.037662 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:05.037635    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-3e9c29-668fc4747c-j224l"]
Sep 11 16:49:05.105711 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:05.105675    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hsqg\" (UniqueName: \"kubernetes.io/projected/69fa7924-e83e-4120-b998-1d2b67faaf01-kube-api-access-7hsqg\") pod \"payload-processing-e2e-shared-b-w2-3e9c29-668fc4747c-j224l\" (UID: \"69fa7924-e83e-4120-b998-1d2b67faaf01\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-3e9c29-668fc4747c-j224l"
Sep 11 16:49:05.105876 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:05.105802    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/69fa7924-e83e-4120-b998-1d2b67faaf01-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-3e9c29-668fc4747c-j224l\" (UID: \"69fa7924-e83e-4120-b998-1d2b67faaf01\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-3e9c29-668fc4747c-j224l"
Sep 11 16:49:05.206856 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:05.206820    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/69fa7924-e83e-4120-b998-1d2b67faaf01-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-3e9c29-668fc4747c-j224l\" (UID: \"69fa7924-e83e-4120-b998-1d2b67faaf01\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-3e9c29-668fc4747c-j224l"
Sep 11 16:49:05.207023 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:05.206920    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hsqg\" (UniqueName: \"kubernetes.io/projected/69fa7924-e83e-4120-b998-1d2b67faaf01-kube-api-access-7hsqg\") pod \"payload-processing-e2e-shared-b-w2-3e9c29-668fc4747c-j224l\" (UID: \"69fa7924-e83e-4120-b998-1d2b67faaf01\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-3e9c29-668fc4747c-j224l"
Sep 11 16:49:05.207633 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:05.207614    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/69fa7924-e83e-4120-b998-1d2b67faaf01-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-3e9c29-668fc4747c-j224l\" (UID: \"69fa7924-e83e-4120-b998-1d2b67faaf01\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-3e9c29-668fc4747c-j224l"
Sep 11 16:49:05.217903 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:05.217873    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hsqg\" (UniqueName: \"kubernetes.io/projected/69fa7924-e83e-4120-b998-1d2b67faaf01-kube-api-access-7hsqg\") pod \"payload-processing-e2e-shared-b-w2-3e9c29-668fc4747c-j224l\" (UID: \"69fa7924-e83e-4120-b998-1d2b67faaf01\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-3e9c29-668fc4747c-j224l"
Sep 11 16:49:05.336044 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:05.335956    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-3e9c29-668fc4747c-j224l"
Sep 11 16:49:05.611756 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:05.611723    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-3e9c29-668fc4747c-j224l"]
Sep 11 16:49:05.613443 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:49:05.613401    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69fa7924_e83e_4120_b998_1d2b67faaf01.slice/crio-ab585ac32a5d8bdedc8409aef1c0e27745239cefbc7bfb6ca8cd6a9321df5f2d WatchSource:0}: Error finding container ab585ac32a5d8bdedc8409aef1c0e27745239cefbc7bfb6ca8cd6a9321df5f2d: Status 404 returned error can't find the container with id ab585ac32a5d8bdedc8409aef1c0e27745239cefbc7bfb6ca8cd6a9321df5f2d
Sep 11 16:49:06.362997 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:06.362953    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-3e9c29-668fc4747c-j224l" event={"ID":"69fa7924-e83e-4120-b998-1d2b67faaf01","Type":"ContainerStarted","Data":"22dcf46fd9f99175c8618954c846eb69bb4bfe077643d6d32237dac533c2b28f"}
Sep 11 16:49:06.363479 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:06.363005    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-3e9c29-668fc4747c-j224l" event={"ID":"69fa7924-e83e-4120-b998-1d2b67faaf01","Type":"ContainerStarted","Data":"ab585ac32a5d8bdedc8409aef1c0e27745239cefbc7bfb6ca8cd6a9321df5f2d"}
Sep 11 16:49:06.363479 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:06.363036    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-3e9c29-668fc4747c-j224l"
Sep 11 16:49:06.384192 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:06.384147    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-3e9c29-668fc4747c-j224l" podStartSLOduration=2.384113363 podStartE2EDuration="2.384113363s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:49:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:49:06.382936953 +0000 UTC m=+1145.999694040" watchObservedRunningTime="2026-09-11 16:49:06.384113363 +0000 UTC m=+1146.000870422"
Sep 11 16:49:07.007765 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:07.007735    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:49:14.352607 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:14.352570    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ce902a-5c84787ff7-wh8rr"
Sep 11 16:49:14.353034 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:14.352655    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-ce902a-677d9c78bb-2zw6g"
Sep 11 16:49:17.370465 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:17.370432    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-3e9c29-668fc4747c-j224l"
Sep 11 16:49:22.697297 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:22.697220    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:49:25.068426 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:25.068389    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:49:25.401459 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:25.401362    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:49:27.142842 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:27.142808    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:49:34.366487 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:34.366443    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:49:36.656592 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:36.656558    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:49:37.015946 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:37.015914    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:49:37.372388 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:37.372310    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:49:40.682901 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:40.682871    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:49:40.901165 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:40.901130    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:49:41.985300 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:41.985264    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:49:42.086138 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:42.086081    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:49:42.265112 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:42.265009    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:49:42.783992 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:42.783955    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:49:42.899319 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:42.899293    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:49:43.000842 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:43.000812    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-3bf678c7-bbfb686fd-s5rh7"]
Sep 11 16:49:43.005800 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:43.005780    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-3bf678c7-bbfb686fd-s5rh7"
Sep 11 16:49:43.010334 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:43.010308    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-3bf678c7-dockercfg-vfgqt\""
Sep 11 16:49:43.010467 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:43.010396    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-3bf678c7\""
Sep 11 16:49:43.037694 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:43.037620    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-3bf678c7-bbfb686fd-s5rh7"]
Sep 11 16:49:43.077280 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:43.077232    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4661880e-8aaa-4b5e-aac2-c14fa98574e3-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-3bf678c7-bbfb686fd-s5rh7\" (UID: \"4661880e-8aaa-4b5e-aac2-c14fa98574e3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-3bf678c7-bbfb686fd-s5rh7"
Sep 11 16:49:43.077468 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:43.077307    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpzt4\" (UniqueName: \"kubernetes.io/projected/4661880e-8aaa-4b5e-aac2-c14fa98574e3-kube-api-access-mpzt4\") pod \"payload-pre-processing-e2e-mt-3bf678c7-bbfb686fd-s5rh7\" (UID: \"4661880e-8aaa-4b5e-aac2-c14fa98574e3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-3bf678c7-bbfb686fd-s5rh7"
Sep 11 16:49:43.178727 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:43.178680    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4661880e-8aaa-4b5e-aac2-c14fa98574e3-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-3bf678c7-bbfb686fd-s5rh7\" (UID: \"4661880e-8aaa-4b5e-aac2-c14fa98574e3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-3bf678c7-bbfb686fd-s5rh7"
Sep 11 16:49:43.178941 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:43.178773    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpzt4\" (UniqueName: \"kubernetes.io/projected/4661880e-8aaa-4b5e-aac2-c14fa98574e3-kube-api-access-mpzt4\") pod \"payload-pre-processing-e2e-mt-3bf678c7-bbfb686fd-s5rh7\" (UID: \"4661880e-8aaa-4b5e-aac2-c14fa98574e3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-3bf678c7-bbfb686fd-s5rh7"
Sep 11 16:49:43.179471 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:43.179446    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4661880e-8aaa-4b5e-aac2-c14fa98574e3-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-3bf678c7-bbfb686fd-s5rh7\" (UID: \"4661880e-8aaa-4b5e-aac2-c14fa98574e3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-3bf678c7-bbfb686fd-s5rh7"
Sep 11 16:49:43.199035 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:43.199005    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpzt4\" (UniqueName: \"kubernetes.io/projected/4661880e-8aaa-4b5e-aac2-c14fa98574e3-kube-api-access-mpzt4\") pod \"payload-pre-processing-e2e-mt-3bf678c7-bbfb686fd-s5rh7\" (UID: \"4661880e-8aaa-4b5e-aac2-c14fa98574e3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-3bf678c7-bbfb686fd-s5rh7"
Sep 11 16:49:43.318233 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:43.318120    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-3bf678c7-bbfb686fd-s5rh7"
Sep 11 16:49:43.614455 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:43.614430    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-3bf678c7-bbfb686fd-s5rh7"]
Sep 11 16:49:43.617157 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:49:43.617128    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4661880e_8aaa_4b5e_aac2_c14fa98574e3.slice/crio-bc7d1782e4f02ec335a04924a4c52cfcdfb8c91641aa8b1b02bb17b24c6fd5eb WatchSource:0}: Error finding container bc7d1782e4f02ec335a04924a4c52cfcdfb8c91641aa8b1b02bb17b24c6fd5eb: Status 404 returned error can't find the container with id bc7d1782e4f02ec335a04924a4c52cfcdfb8c91641aa8b1b02bb17b24c6fd5eb
Sep 11 16:49:44.554667 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:44.554630    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-3bf678c7-bbfb686fd-s5rh7" event={"ID":"4661880e-8aaa-4b5e-aac2-c14fa98574e3","Type":"ContainerStarted","Data":"3b6887cae07d2ce4f63055d72a450a2d7628cd712c16687bc5473b449ccd52df"}
Sep 11 16:49:44.555044 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:44.554689    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-3bf678c7-bbfb686fd-s5rh7" event={"ID":"4661880e-8aaa-4b5e-aac2-c14fa98574e3","Type":"ContainerStarted","Data":"bc7d1782e4f02ec335a04924a4c52cfcdfb8c91641aa8b1b02bb17b24c6fd5eb"}
Sep 11 16:49:44.555044 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:44.554745    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-3bf678c7-bbfb686fd-s5rh7"
Sep 11 16:49:44.577296 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:44.577247    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-3bf678c7-bbfb686fd-s5rh7" podStartSLOduration=2.577227996 podStartE2EDuration="2.577227996s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:49:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:49:44.575045105 +0000 UTC m=+1184.191802193" watchObservedRunningTime="2026-09-11 16:49:44.577227996 +0000 UTC m=+1184.193985061"
Sep 11 16:49:52.421749 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:52.421709    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:49:55.562191 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:49:55.562157    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-3bf678c7-bbfb686fd-s5rh7"
Sep 11 16:50:00.560231 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:50:00.560191    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:50:03.504057 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:50:03.504026    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:50:05.504655 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:50:05.504625    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:50:14.826819 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:50:14.826785    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:50:55.569641 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:50:55.569561    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:50:55.601853 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:50:55.601817    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-3bf678c7-bbfb686fd-s5rh7"]
Sep 11 16:50:55.602162 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:50:55.602116    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-3bf678c7-bbfb686fd-s5rh7" podUID="4661880e-8aaa-4b5e-aac2-c14fa98574e3" containerName="payload-pre-processing" containerID="cri-o://3b6887cae07d2ce4f63055d72a450a2d7628cd712c16687bc5473b449ccd52df" gracePeriod=30
Sep 11 16:50:55.851653 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:50:55.851628    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-3bf678c7-bbfb686fd-s5rh7"
Sep 11 16:50:55.904031 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:50:55.903992    2581 generic.go:356] "Generic (PLEG): container finished" podID="4661880e-8aaa-4b5e-aac2-c14fa98574e3" containerID="3b6887cae07d2ce4f63055d72a450a2d7628cd712c16687bc5473b449ccd52df" exitCode=0
Sep 11 16:50:55.904227 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:50:55.904054    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-3bf678c7-bbfb686fd-s5rh7"
Sep 11 16:50:55.904227 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:50:55.904054    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-3bf678c7-bbfb686fd-s5rh7" event={"ID":"4661880e-8aaa-4b5e-aac2-c14fa98574e3","Type":"ContainerDied","Data":"3b6887cae07d2ce4f63055d72a450a2d7628cd712c16687bc5473b449ccd52df"}
Sep 11 16:50:55.904227 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:50:55.904188    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-3bf678c7-bbfb686fd-s5rh7" event={"ID":"4661880e-8aaa-4b5e-aac2-c14fa98574e3","Type":"ContainerDied","Data":"bc7d1782e4f02ec335a04924a4c52cfcdfb8c91641aa8b1b02bb17b24c6fd5eb"}
Sep 11 16:50:55.904227 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:50:55.904217    2581 scope.go:117] "RemoveContainer" containerID="3b6887cae07d2ce4f63055d72a450a2d7628cd712c16687bc5473b449ccd52df"
Sep 11 16:50:55.913265 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:50:55.913245    2581 scope.go:117] "RemoveContainer" containerID="3b6887cae07d2ce4f63055d72a450a2d7628cd712c16687bc5473b449ccd52df"
Sep 11 16:50:55.913583 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:50:55.913564    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b6887cae07d2ce4f63055d72a450a2d7628cd712c16687bc5473b449ccd52df\": container with ID starting with 3b6887cae07d2ce4f63055d72a450a2d7628cd712c16687bc5473b449ccd52df not found: ID does not exist" containerID="3b6887cae07d2ce4f63055d72a450a2d7628cd712c16687bc5473b449ccd52df"
Sep 11 16:50:55.913637 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:50:55.913593    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b6887cae07d2ce4f63055d72a450a2d7628cd712c16687bc5473b449ccd52df"} err="failed to get container status \"3b6887cae07d2ce4f63055d72a450a2d7628cd712c16687bc5473b449ccd52df\": rpc error: code = NotFound desc = could not find container \"3b6887cae07d2ce4f63055d72a450a2d7628cd712c16687bc5473b449ccd52df\": container with ID starting with 3b6887cae07d2ce4f63055d72a450a2d7628cd712c16687bc5473b449ccd52df not found: ID does not exist"
Sep 11 16:50:55.951984 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:50:55.951948    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mpzt4\" (UniqueName: \"kubernetes.io/projected/4661880e-8aaa-4b5e-aac2-c14fa98574e3-kube-api-access-mpzt4\") pod \"4661880e-8aaa-4b5e-aac2-c14fa98574e3\" (UID: \"4661880e-8aaa-4b5e-aac2-c14fa98574e3\") "
Sep 11 16:50:55.952213 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:50:55.952008    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4661880e-8aaa-4b5e-aac2-c14fa98574e3-plugins-config-volume\") pod \"4661880e-8aaa-4b5e-aac2-c14fa98574e3\" (UID: \"4661880e-8aaa-4b5e-aac2-c14fa98574e3\") "
Sep 11 16:50:55.952424 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:50:55.952399    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4661880e-8aaa-4b5e-aac2-c14fa98574e3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4661880e-8aaa-4b5e-aac2-c14fa98574e3" (UID: "4661880e-8aaa-4b5e-aac2-c14fa98574e3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:50:55.954246 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:50:55.954221    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4661880e-8aaa-4b5e-aac2-c14fa98574e3-kube-api-access-mpzt4" (OuterVolumeSpecName: "kube-api-access-mpzt4") pod "4661880e-8aaa-4b5e-aac2-c14fa98574e3" (UID: "4661880e-8aaa-4b5e-aac2-c14fa98574e3"). InnerVolumeSpecName "kube-api-access-mpzt4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:50:56.053420 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:50:56.053385    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mpzt4\" (UniqueName: \"kubernetes.io/projected/4661880e-8aaa-4b5e-aac2-c14fa98574e3-kube-api-access-mpzt4\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:50:56.053420 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:50:56.053412    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4661880e-8aaa-4b5e-aac2-c14fa98574e3-plugins-config-volume\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:50:56.229133 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:50:56.229085    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-3bf678c7-bbfb686fd-s5rh7"]
Sep 11 16:50:56.234083 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:50:56.234060    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-3bf678c7-bbfb686fd-s5rh7"]
Sep 11 16:50:56.827869 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:50:56.827840    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:50:56.987608 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:50:56.987576    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4661880e-8aaa-4b5e-aac2-c14fa98574e3" path="/var/lib/kubelet/pods/4661880e-8aaa-4b5e-aac2-c14fa98574e3/volumes"
Sep 11 16:50:59.049064 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:50:59.049030    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:51:04.135951 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:51:04.135911    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:51:40.518332 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:51:40.518298    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:51:42.717810 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:51:42.717778    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:51:48.853544 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:51:48.853510    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:51:48.956589 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:51:48.956551    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:51:49.238454 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:51:49.238421    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:51:50.466346 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:51:50.466306    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:51:50.565829 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:51:50.565795    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:51:50.666022 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:51:50.665968    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:51:51.350637 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:51:51.350598    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:51:51.446129 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:51:51.446082    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:51:51.545889 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:51:51.545846    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:51:52.837438 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:51:52.837392    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:51:52.931632 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:51:52.931588    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:52:00.212449 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:52:00.212384    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:52:00.336687 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:52:00.336655    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:52:00.862413 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:52:00.862369    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:52:03.459490 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:52:03.459433    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:52:04.430780 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:52:04.430754    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:52:07.542825 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:52:07.542795    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:52:07.649182 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:52:07.649150    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:52:07.750008 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:52:07.749976    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:52:18.300441 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:52:18.300404    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:52:18.535847 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:52:18.535813    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:52:25.943907 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:52:25.943782    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:52:39.509513 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:52:39.509452    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:52:45.978926 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:52:45.978897    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:52:46.074308 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:52:46.074274    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:52:46.339946 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:52:46.339855    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:52:46.704465 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:52:46.704413    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:52:47.163045 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:52:47.162959    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:52:49.684130 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:52:49.684071    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:52:49.794594 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:52:49.794550    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:52:50.815167 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:52:50.815082    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:52:50.906818 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:52:50.906782    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:52:51.049468 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:52:51.049438    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:52:51.459426 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:52:51.459396    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:52:51.568676 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:52:51.568643    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:52:51.755514 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:52:51.755427    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-01987b-7486bd69b9-jmzd6"]
Sep 11 16:52:51.755931 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:52:51.755912    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4661880e-8aaa-4b5e-aac2-c14fa98574e3" containerName="payload-pre-processing"
Sep 11 16:52:51.756025 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:52:51.755933    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4661880e-8aaa-4b5e-aac2-c14fa98574e3" containerName="payload-pre-processing"
Sep 11 16:52:51.756082 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:52:51.756053    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4661880e-8aaa-4b5e-aac2-c14fa98574e3" containerName="payload-pre-processing"
Sep 11 16:52:51.759483 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:52:51.759460    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-01987b-7486bd69b9-jmzd6"
Sep 11 16:52:51.762397 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:52:51.762370    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-01987b\""
Sep 11 16:52:51.762397 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:52:51.762386    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-01987b-dockercfg-g56dd\""
Sep 11 16:52:51.769355 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:52:51.769319    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-01987b-7486bd69b9-jmzd6"]
Sep 11 16:52:51.812121 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:52:51.812058    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-249gn\" (UniqueName: \"kubernetes.io/projected/6848dc3c-4824-4b54-804f-42c13830ab33-kube-api-access-249gn\") pod \"payload-processing-e2e-api-a-01987b-7486bd69b9-jmzd6\" (UID: \"6848dc3c-4824-4b54-804f-42c13830ab33\") " pod="openshift-ingress/payload-processing-e2e-api-a-01987b-7486bd69b9-jmzd6"
Sep 11 16:52:51.812300 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:52:51.812144    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6848dc3c-4824-4b54-804f-42c13830ab33-plugins-config-volume\") pod \"payload-processing-e2e-api-a-01987b-7486bd69b9-jmzd6\" (UID: \"6848dc3c-4824-4b54-804f-42c13830ab33\") " pod="openshift-ingress/payload-processing-e2e-api-a-01987b-7486bd69b9-jmzd6"
Sep 11 16:52:51.913382 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:52:51.913339    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6848dc3c-4824-4b54-804f-42c13830ab33-plugins-config-volume\") pod \"payload-processing-e2e-api-a-01987b-7486bd69b9-jmzd6\" (UID: \"6848dc3c-4824-4b54-804f-42c13830ab33\") " pod="openshift-ingress/payload-processing-e2e-api-a-01987b-7486bd69b9-jmzd6"
Sep 11 16:52:51.913781 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:52:51.913457    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-249gn\" (UniqueName: \"kubernetes.io/projected/6848dc3c-4824-4b54-804f-42c13830ab33-kube-api-access-249gn\") pod \"payload-processing-e2e-api-a-01987b-7486bd69b9-jmzd6\" (UID: \"6848dc3c-4824-4b54-804f-42c13830ab33\") " pod="openshift-ingress/payload-processing-e2e-api-a-01987b-7486bd69b9-jmzd6"
Sep 11 16:52:51.914048 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:52:51.914027    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6848dc3c-4824-4b54-804f-42c13830ab33-plugins-config-volume\") pod \"payload-processing-e2e-api-a-01987b-7486bd69b9-jmzd6\" (UID: \"6848dc3c-4824-4b54-804f-42c13830ab33\") " pod="openshift-ingress/payload-processing-e2e-api-a-01987b-7486bd69b9-jmzd6"
Sep 11 16:52:51.928988 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:52:51.928951    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-249gn\" (UniqueName: \"kubernetes.io/projected/6848dc3c-4824-4b54-804f-42c13830ab33-kube-api-access-249gn\") pod \"payload-processing-e2e-api-a-01987b-7486bd69b9-jmzd6\" (UID: \"6848dc3c-4824-4b54-804f-42c13830ab33\") " pod="openshift-ingress/payload-processing-e2e-api-a-01987b-7486bd69b9-jmzd6"
Sep 11 16:52:52.071066 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:52:52.070973    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-01987b-7486bd69b9-jmzd6"
Sep 11 16:52:52.350429 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:52:52.350403    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-01987b-7486bd69b9-jmzd6"]
Sep 11 16:52:52.352843 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:52:52.352816    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6848dc3c_4824_4b54_804f_42c13830ab33.slice/crio-95b9e17d3b3acb5bdfa7f7b82d40e61271a9f0064cf6052c7411ee0b6f566269 WatchSource:0}: Error finding container 95b9e17d3b3acb5bdfa7f7b82d40e61271a9f0064cf6052c7411ee0b6f566269: Status 404 returned error can't find the container with id 95b9e17d3b3acb5bdfa7f7b82d40e61271a9f0064cf6052c7411ee0b6f566269
Sep 11 16:52:52.477398 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:52:52.477356    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-01987b-7486bd69b9-jmzd6" event={"ID":"6848dc3c-4824-4b54-804f-42c13830ab33","Type":"ContainerStarted","Data":"f69dee79082996efdd6eb8f395e39485b8a47fae0d7cd9ffc55b3b98decb712c"}
Sep 11 16:52:52.477584 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:52:52.477417    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-01987b-7486bd69b9-jmzd6" event={"ID":"6848dc3c-4824-4b54-804f-42c13830ab33","Type":"ContainerStarted","Data":"95b9e17d3b3acb5bdfa7f7b82d40e61271a9f0064cf6052c7411ee0b6f566269"}
Sep 11 16:52:52.477584 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:52:52.477558    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-01987b-7486bd69b9-jmzd6"
Sep 11 16:52:52.501150 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:52:52.501083    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-01987b-7486bd69b9-jmzd6" podStartSLOduration=1.501066635 podStartE2EDuration="1.501066635s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:52:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:52:52.498853053 +0000 UTC m=+1372.115610121" watchObservedRunningTime="2026-09-11 16:52:52.501066635 +0000 UTC m=+1372.117823701"
Sep 11 16:53:01.743673 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:01.743640    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:53:03.484025 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:03.483993    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-01987b-7486bd69b9-jmzd6"
Sep 11 16:53:14.621588 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:14.621557    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:53:15.116523 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:15.116491    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:53:15.474514 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:15.474472    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:53:15.962836 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:15.962809    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:53:18.832007 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:18.831970    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:53:18.930609 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:18.930575    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:53:20.075303 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:20.075273    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:53:20.172478 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:20.172448    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:53:20.596266 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:20.596240    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:53:20.782469 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:20.782415    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:53:20.880838 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:20.880755    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:53:20.956530 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:20.956497    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-16265e-6d55b95f54-j9bss"]
Sep 11 16:53:20.960348 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:20.960332    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-16265e-6d55b95f54-j9bss"
Sep 11 16:53:20.963343 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:20.963322    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-16265e-dockercfg-vs8vd\""
Sep 11 16:53:20.963343 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:20.963333    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-16265e\""
Sep 11 16:53:20.971840 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:20.971814    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-16265e-6d55b95f54-j9bss"]
Sep 11 16:53:21.002491 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:21.002453    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa766f9e-01d6-4913-8a82-78ea16d41b60-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-16265e-6d55b95f54-j9bss\" (UID: \"fa766f9e-01d6-4913-8a82-78ea16d41b60\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-16265e-6d55b95f54-j9bss"
Sep 11 16:53:21.002690 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:21.002502    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hztjj\" (UniqueName: \"kubernetes.io/projected/fa766f9e-01d6-4913-8a82-78ea16d41b60-kube-api-access-hztjj\") pod \"payload-pre-processing-e2e-api-b-16265e-6d55b95f54-j9bss\" (UID: \"fa766f9e-01d6-4913-8a82-78ea16d41b60\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-16265e-6d55b95f54-j9bss"
Sep 11 16:53:21.073133 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:21.073085    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-16265e-85f547ddf9-5w59c"]
Sep 11 16:53:21.076736 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:21.076720    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-16265e-85f547ddf9-5w59c"
Sep 11 16:53:21.089779 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:21.089754    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-16265e-85f547ddf9-5w59c"]
Sep 11 16:53:21.103287 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:21.103260    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23b235bb-dc0b-45c8-8ac5-2ebed6324346-plugins-config-volume\") pod \"payload-processing-e2e-api-b-16265e-85f547ddf9-5w59c\" (UID: \"23b235bb-dc0b-45c8-8ac5-2ebed6324346\") " pod="openshift-ingress/payload-processing-e2e-api-b-16265e-85f547ddf9-5w59c"
Sep 11 16:53:21.103416 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:21.103311    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmm8m\" (UniqueName: \"kubernetes.io/projected/23b235bb-dc0b-45c8-8ac5-2ebed6324346-kube-api-access-zmm8m\") pod \"payload-processing-e2e-api-b-16265e-85f547ddf9-5w59c\" (UID: \"23b235bb-dc0b-45c8-8ac5-2ebed6324346\") " pod="openshift-ingress/payload-processing-e2e-api-b-16265e-85f547ddf9-5w59c"
Sep 11 16:53:21.103459 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:21.103403    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa766f9e-01d6-4913-8a82-78ea16d41b60-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-16265e-6d55b95f54-j9bss\" (UID: \"fa766f9e-01d6-4913-8a82-78ea16d41b60\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-16265e-6d55b95f54-j9bss"
Sep 11 16:53:21.103496 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:21.103460    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hztjj\" (UniqueName: \"kubernetes.io/projected/fa766f9e-01d6-4913-8a82-78ea16d41b60-kube-api-access-hztjj\") pod \"payload-pre-processing-e2e-api-b-16265e-6d55b95f54-j9bss\" (UID: \"fa766f9e-01d6-4913-8a82-78ea16d41b60\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-16265e-6d55b95f54-j9bss"
Sep 11 16:53:21.104411 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:21.104389    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa766f9e-01d6-4913-8a82-78ea16d41b60-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-16265e-6d55b95f54-j9bss\" (UID: \"fa766f9e-01d6-4913-8a82-78ea16d41b60\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-16265e-6d55b95f54-j9bss"
Sep 11 16:53:21.114447 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:21.114415    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hztjj\" (UniqueName: \"kubernetes.io/projected/fa766f9e-01d6-4913-8a82-78ea16d41b60-kube-api-access-hztjj\") pod \"payload-pre-processing-e2e-api-b-16265e-6d55b95f54-j9bss\" (UID: \"fa766f9e-01d6-4913-8a82-78ea16d41b60\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-16265e-6d55b95f54-j9bss"
Sep 11 16:53:21.204112 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:21.204067    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23b235bb-dc0b-45c8-8ac5-2ebed6324346-plugins-config-volume\") pod \"payload-processing-e2e-api-b-16265e-85f547ddf9-5w59c\" (UID: \"23b235bb-dc0b-45c8-8ac5-2ebed6324346\") " pod="openshift-ingress/payload-processing-e2e-api-b-16265e-85f547ddf9-5w59c"
Sep 11 16:53:21.204298 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:21.204177    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmm8m\" (UniqueName: \"kubernetes.io/projected/23b235bb-dc0b-45c8-8ac5-2ebed6324346-kube-api-access-zmm8m\") pod \"payload-processing-e2e-api-b-16265e-85f547ddf9-5w59c\" (UID: \"23b235bb-dc0b-45c8-8ac5-2ebed6324346\") " pod="openshift-ingress/payload-processing-e2e-api-b-16265e-85f547ddf9-5w59c"
Sep 11 16:53:21.204729 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:21.204707    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23b235bb-dc0b-45c8-8ac5-2ebed6324346-plugins-config-volume\") pod \"payload-processing-e2e-api-b-16265e-85f547ddf9-5w59c\" (UID: \"23b235bb-dc0b-45c8-8ac5-2ebed6324346\") " pod="openshift-ingress/payload-processing-e2e-api-b-16265e-85f547ddf9-5w59c"
Sep 11 16:53:21.218520 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:21.218494    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmm8m\" (UniqueName: \"kubernetes.io/projected/23b235bb-dc0b-45c8-8ac5-2ebed6324346-kube-api-access-zmm8m\") pod \"payload-processing-e2e-api-b-16265e-85f547ddf9-5w59c\" (UID: \"23b235bb-dc0b-45c8-8ac5-2ebed6324346\") " pod="openshift-ingress/payload-processing-e2e-api-b-16265e-85f547ddf9-5w59c"
Sep 11 16:53:21.270962 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:21.270920    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-16265e-6d55b95f54-j9bss"
Sep 11 16:53:21.386660 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:21.386613    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-16265e-85f547ddf9-5w59c"
Sep 11 16:53:21.552269 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:21.552242    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-16265e-6d55b95f54-j9bss"]
Sep 11 16:53:21.554002 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:53:21.553978    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa766f9e_01d6_4913_8a82_78ea16d41b60.slice/crio-c377f1a61dbf47a961afbf4d131fd0fe874813910fdd4804c14651c01ed3886a WatchSource:0}: Error finding container c377f1a61dbf47a961afbf4d131fd0fe874813910fdd4804c14651c01ed3886a: Status 404 returned error can't find the container with id c377f1a61dbf47a961afbf4d131fd0fe874813910fdd4804c14651c01ed3886a
Sep 11 16:53:21.627344 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:21.627312    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-16265e-6d55b95f54-j9bss" event={"ID":"fa766f9e-01d6-4913-8a82-78ea16d41b60","Type":"ContainerStarted","Data":"77961293a434bdf534051cb9beb61c0f09b1c93371d877db9ae457d0833686fe"}
Sep 11 16:53:21.627513 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:21.627368    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-16265e-6d55b95f54-j9bss" event={"ID":"fa766f9e-01d6-4913-8a82-78ea16d41b60","Type":"ContainerStarted","Data":"c377f1a61dbf47a961afbf4d131fd0fe874813910fdd4804c14651c01ed3886a"}
Sep 11 16:53:21.627513 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:21.627470    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-16265e-6d55b95f54-j9bss"
Sep 11 16:53:21.675597 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:21.675542    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-16265e-6d55b95f54-j9bss" podStartSLOduration=1.6755269419999999 podStartE2EDuration="1.675526942s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:53:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:53:21.673487393 +0000 UTC m=+1401.290244482" watchObservedRunningTime="2026-09-11 16:53:21.675526942 +0000 UTC m=+1401.292284008"
Sep 11 16:53:21.682288 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:21.682261    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-16265e-85f547ddf9-5w59c"]
Sep 11 16:53:21.684185 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:53:21.684159    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23b235bb_dc0b_45c8_8ac5_2ebed6324346.slice/crio-f60af7b47abe4df9962c2ac19ffb454f40d563f3434e435a42e0ab4e43b5db29 WatchSource:0}: Error finding container f60af7b47abe4df9962c2ac19ffb454f40d563f3434e435a42e0ab4e43b5db29: Status 404 returned error can't find the container with id f60af7b47abe4df9962c2ac19ffb454f40d563f3434e435a42e0ab4e43b5db29
Sep 11 16:53:22.634009 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:22.633970    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-16265e-85f547ddf9-5w59c" event={"ID":"23b235bb-dc0b-45c8-8ac5-2ebed6324346","Type":"ContainerStarted","Data":"43af2375f20c52b4addc8c1ff24a62c047b085ae4fdbc10921aa00f34cb9ef30"}
Sep 11 16:53:22.634551 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:22.634033    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-16265e-85f547ddf9-5w59c" event={"ID":"23b235bb-dc0b-45c8-8ac5-2ebed6324346","Type":"ContainerStarted","Data":"f60af7b47abe4df9962c2ac19ffb454f40d563f3434e435a42e0ab4e43b5db29"}
Sep 11 16:53:22.634551 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:22.634076    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-16265e-85f547ddf9-5w59c"
Sep 11 16:53:22.666371 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:22.666313    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-16265e-85f547ddf9-5w59c" podStartSLOduration=1.6662956759999998 podStartE2EDuration="1.666295676s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:53:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:53:22.664314778 +0000 UTC m=+1402.281071846" watchObservedRunningTime="2026-09-11 16:53:22.666295676 +0000 UTC m=+1402.283052744"
Sep 11 16:53:28.061531 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:28.061484    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:53:32.636794 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:32.636763    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-16265e-6d55b95f54-j9bss"
Sep 11 16:53:33.641162 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:33.641129    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-16265e-85f547ddf9-5w59c"
Sep 11 16:53:43.783323 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:43.783269    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:53:46.846348 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:46.846288    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:53:52.766156 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:52.766044    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:53:54.643909 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:54.643870    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:53:56.884326 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:53:56.884278    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:54:02.623387 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:02.623329    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:54:02.654547 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:02.654510    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-01987b-7486bd69b9-jmzd6"]
Sep 11 16:54:02.654809 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:02.654767    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-01987b-7486bd69b9-jmzd6" podUID="6848dc3c-4824-4b54-804f-42c13830ab33" containerName="payload-processing" containerID="cri-o://f69dee79082996efdd6eb8f395e39485b8a47fae0d7cd9ffc55b3b98decb712c" gracePeriod=30
Sep 11 16:54:02.735518 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:02.735478    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:54:02.834379 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:02.834349    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:54:02.838401 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:02.838287    2581 generic.go:356] "Generic (PLEG): container finished" podID="6848dc3c-4824-4b54-804f-42c13830ab33" containerID="f69dee79082996efdd6eb8f395e39485b8a47fae0d7cd9ffc55b3b98decb712c" exitCode=0
Sep 11 16:54:02.838401 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:02.838347    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-01987b-7486bd69b9-jmzd6" event={"ID":"6848dc3c-4824-4b54-804f-42c13830ab33","Type":"ContainerDied","Data":"f69dee79082996efdd6eb8f395e39485b8a47fae0d7cd9ffc55b3b98decb712c"}
Sep 11 16:54:02.920411 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:02.920387    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-01987b-7486bd69b9-jmzd6"
Sep 11 16:54:02.936998 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:02.936968    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:54:03.002966 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:03.002932    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6848dc3c-4824-4b54-804f-42c13830ab33-plugins-config-volume\") pod \"6848dc3c-4824-4b54-804f-42c13830ab33\" (UID: \"6848dc3c-4824-4b54-804f-42c13830ab33\") "
Sep 11 16:54:03.003215 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:03.003017    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-249gn\" (UniqueName: \"kubernetes.io/projected/6848dc3c-4824-4b54-804f-42c13830ab33-kube-api-access-249gn\") pod \"6848dc3c-4824-4b54-804f-42c13830ab33\" (UID: \"6848dc3c-4824-4b54-804f-42c13830ab33\") "
Sep 11 16:54:03.003404 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:03.003381    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6848dc3c-4824-4b54-804f-42c13830ab33-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6848dc3c-4824-4b54-804f-42c13830ab33" (UID: "6848dc3c-4824-4b54-804f-42c13830ab33"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:54:03.005219 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:03.005186    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6848dc3c-4824-4b54-804f-42c13830ab33-kube-api-access-249gn" (OuterVolumeSpecName: "kube-api-access-249gn") pod "6848dc3c-4824-4b54-804f-42c13830ab33" (UID: "6848dc3c-4824-4b54-804f-42c13830ab33"). InnerVolumeSpecName "kube-api-access-249gn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:54:03.103862 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:03.103821    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6848dc3c-4824-4b54-804f-42c13830ab33-plugins-config-volume\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:54:03.103862 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:03.103851    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-249gn\" (UniqueName: \"kubernetes.io/projected/6848dc3c-4824-4b54-804f-42c13830ab33-kube-api-access-249gn\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:54:03.305384 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:03.305354    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:54:03.844749 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:03.844720    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-01987b-7486bd69b9-jmzd6"
Sep 11 16:54:03.844749 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:03.844736    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-01987b-7486bd69b9-jmzd6" event={"ID":"6848dc3c-4824-4b54-804f-42c13830ab33","Type":"ContainerDied","Data":"95b9e17d3b3acb5bdfa7f7b82d40e61271a9f0064cf6052c7411ee0b6f566269"}
Sep 11 16:54:03.845343 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:03.844791    2581 scope.go:117] "RemoveContainer" containerID="f69dee79082996efdd6eb8f395e39485b8a47fae0d7cd9ffc55b3b98decb712c"
Sep 11 16:54:03.878913 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:03.878795    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-01987b-7486bd69b9-jmzd6"]
Sep 11 16:54:03.887079 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:03.887043    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-01987b-7486bd69b9-jmzd6"]
Sep 11 16:54:04.987845 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:04.987809    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6848dc3c-4824-4b54-804f-42c13830ab33" path="/var/lib/kubelet/pods/6848dc3c-4824-4b54-804f-42c13830ab33/volumes"
Sep 11 16:54:10.778143 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:10.778107    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:54:10.880215 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:10.880181    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:54:11.071912 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:11.071821    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:54:11.622406 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:11.622373    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:54:12.384255 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:12.384224    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:54:16.839345 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:16.839297    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:54:20.012380 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:20.012343    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:54:20.899149 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:20.899081    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:54:23.765496 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:23.765457    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:54:24.554681 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:24.554652    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:54:26.385337 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:26.385309    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:54:27.152293 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:27.152263    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:54:27.187419 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:27.187376    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-16265e-85f547ddf9-5w59c"]
Sep 11 16:54:27.187612 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:27.187587    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-16265e-85f547ddf9-5w59c" podUID="23b235bb-dc0b-45c8-8ac5-2ebed6324346" containerName="payload-processing" containerID="cri-o://43af2375f20c52b4addc8c1ff24a62c047b085ae4fdbc10921aa00f34cb9ef30" gracePeriod=30
Sep 11 16:54:27.197067 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:27.197042    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-16265e-6d55b95f54-j9bss"]
Sep 11 16:54:27.197286 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:27.197262    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-16265e-6d55b95f54-j9bss" podUID="fa766f9e-01d6-4913-8a82-78ea16d41b60" containerName="payload-pre-processing" containerID="cri-o://77961293a434bdf534051cb9beb61c0f09b1c93371d877db9ae457d0833686fe" gracePeriod=30
Sep 11 16:54:27.278412 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:27.278346    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:54:27.374029 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:27.373985    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:54:27.450031 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:27.450002    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-16265e-85f547ddf9-5w59c"
Sep 11 16:54:27.474348 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:27.474307    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:54:27.476816 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:27.476789    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-16265e-6d55b95f54-j9bss"
Sep 11 16:54:27.529751 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:27.529722    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23b235bb-dc0b-45c8-8ac5-2ebed6324346-plugins-config-volume\") pod \"23b235bb-dc0b-45c8-8ac5-2ebed6324346\" (UID: \"23b235bb-dc0b-45c8-8ac5-2ebed6324346\") "
Sep 11 16:54:27.529943 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:27.529781    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zmm8m\" (UniqueName: \"kubernetes.io/projected/23b235bb-dc0b-45c8-8ac5-2ebed6324346-kube-api-access-zmm8m\") pod \"23b235bb-dc0b-45c8-8ac5-2ebed6324346\" (UID: \"23b235bb-dc0b-45c8-8ac5-2ebed6324346\") "
Sep 11 16:54:27.530109 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:27.530070    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23b235bb-dc0b-45c8-8ac5-2ebed6324346-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "23b235bb-dc0b-45c8-8ac5-2ebed6324346" (UID: "23b235bb-dc0b-45c8-8ac5-2ebed6324346"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:54:27.532115 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:27.532070    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23b235bb-dc0b-45c8-8ac5-2ebed6324346-kube-api-access-zmm8m" (OuterVolumeSpecName: "kube-api-access-zmm8m") pod "23b235bb-dc0b-45c8-8ac5-2ebed6324346" (UID: "23b235bb-dc0b-45c8-8ac5-2ebed6324346"). InnerVolumeSpecName "kube-api-access-zmm8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:54:27.573818 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:27.573781    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:54:27.631218 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:27.631188    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hztjj\" (UniqueName: \"kubernetes.io/projected/fa766f9e-01d6-4913-8a82-78ea16d41b60-kube-api-access-hztjj\") pod \"fa766f9e-01d6-4913-8a82-78ea16d41b60\" (UID: \"fa766f9e-01d6-4913-8a82-78ea16d41b60\") "
Sep 11 16:54:27.631398 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:27.631320    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa766f9e-01d6-4913-8a82-78ea16d41b60-plugins-config-volume\") pod \"fa766f9e-01d6-4913-8a82-78ea16d41b60\" (UID: \"fa766f9e-01d6-4913-8a82-78ea16d41b60\") "
Sep 11 16:54:27.631535 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:27.631521    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23b235bb-dc0b-45c8-8ac5-2ebed6324346-plugins-config-volume\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:54:27.631598 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:27.631538    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zmm8m\" (UniqueName: \"kubernetes.io/projected/23b235bb-dc0b-45c8-8ac5-2ebed6324346-kube-api-access-zmm8m\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:54:27.631702 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:27.631679    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa766f9e-01d6-4913-8a82-78ea16d41b60-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fa766f9e-01d6-4913-8a82-78ea16d41b60" (UID: "fa766f9e-01d6-4913-8a82-78ea16d41b60"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:54:27.633498 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:27.633476    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa766f9e-01d6-4913-8a82-78ea16d41b60-kube-api-access-hztjj" (OuterVolumeSpecName: "kube-api-access-hztjj") pod "fa766f9e-01d6-4913-8a82-78ea16d41b60" (UID: "fa766f9e-01d6-4913-8a82-78ea16d41b60"). InnerVolumeSpecName "kube-api-access-hztjj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:54:27.732419 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:27.732384    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa766f9e-01d6-4913-8a82-78ea16d41b60-plugins-config-volume\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:54:27.732419 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:27.732412    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hztjj\" (UniqueName: \"kubernetes.io/projected/fa766f9e-01d6-4913-8a82-78ea16d41b60-kube-api-access-hztjj\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:54:27.849455 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:27.849403    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:54:27.964442 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:27.964403    2581 generic.go:356] "Generic (PLEG): container finished" podID="23b235bb-dc0b-45c8-8ac5-2ebed6324346" containerID="43af2375f20c52b4addc8c1ff24a62c047b085ae4fdbc10921aa00f34cb9ef30" exitCode=0
Sep 11 16:54:27.964636 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:27.964449    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-16265e-85f547ddf9-5w59c"
Sep 11 16:54:27.964636 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:27.964485    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-16265e-85f547ddf9-5w59c" event={"ID":"23b235bb-dc0b-45c8-8ac5-2ebed6324346","Type":"ContainerDied","Data":"43af2375f20c52b4addc8c1ff24a62c047b085ae4fdbc10921aa00f34cb9ef30"}
Sep 11 16:54:27.964636 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:27.964536    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-16265e-85f547ddf9-5w59c" event={"ID":"23b235bb-dc0b-45c8-8ac5-2ebed6324346","Type":"ContainerDied","Data":"f60af7b47abe4df9962c2ac19ffb454f40d563f3434e435a42e0ab4e43b5db29"}
Sep 11 16:54:27.964636 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:27.964561    2581 scope.go:117] "RemoveContainer" containerID="43af2375f20c52b4addc8c1ff24a62c047b085ae4fdbc10921aa00f34cb9ef30"
Sep 11 16:54:27.966241 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:27.966220    2581 generic.go:356] "Generic (PLEG): container finished" podID="fa766f9e-01d6-4913-8a82-78ea16d41b60" containerID="77961293a434bdf534051cb9beb61c0f09b1c93371d877db9ae457d0833686fe" exitCode=0
Sep 11 16:54:27.966347 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:27.966259    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-16265e-6d55b95f54-j9bss" event={"ID":"fa766f9e-01d6-4913-8a82-78ea16d41b60","Type":"ContainerDied","Data":"77961293a434bdf534051cb9beb61c0f09b1c93371d877db9ae457d0833686fe"}
Sep 11 16:54:27.966347 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:27.966267    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-16265e-6d55b95f54-j9bss"
Sep 11 16:54:27.966347 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:27.966297    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-16265e-6d55b95f54-j9bss" event={"ID":"fa766f9e-01d6-4913-8a82-78ea16d41b60","Type":"ContainerDied","Data":"c377f1a61dbf47a961afbf4d131fd0fe874813910fdd4804c14651c01ed3886a"}
Sep 11 16:54:27.973541 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:27.973519    2581 scope.go:117] "RemoveContainer" containerID="43af2375f20c52b4addc8c1ff24a62c047b085ae4fdbc10921aa00f34cb9ef30"
Sep 11 16:54:27.973855 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:54:27.973830    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43af2375f20c52b4addc8c1ff24a62c047b085ae4fdbc10921aa00f34cb9ef30\": container with ID starting with 43af2375f20c52b4addc8c1ff24a62c047b085ae4fdbc10921aa00f34cb9ef30 not found: ID does not exist" containerID="43af2375f20c52b4addc8c1ff24a62c047b085ae4fdbc10921aa00f34cb9ef30"
Sep 11 16:54:27.973921 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:27.973868    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43af2375f20c52b4addc8c1ff24a62c047b085ae4fdbc10921aa00f34cb9ef30"} err="failed to get container status \"43af2375f20c52b4addc8c1ff24a62c047b085ae4fdbc10921aa00f34cb9ef30\": rpc error: code = NotFound desc = could not find container \"43af2375f20c52b4addc8c1ff24a62c047b085ae4fdbc10921aa00f34cb9ef30\": container with ID starting with 43af2375f20c52b4addc8c1ff24a62c047b085ae4fdbc10921aa00f34cb9ef30 not found: ID does not exist"
Sep 11 16:54:27.973921 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:27.973891    2581 scope.go:117] "RemoveContainer" containerID="77961293a434bdf534051cb9beb61c0f09b1c93371d877db9ae457d0833686fe"
Sep 11 16:54:27.982580 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:27.982533    2581 scope.go:117] "RemoveContainer" containerID="77961293a434bdf534051cb9beb61c0f09b1c93371d877db9ae457d0833686fe"
Sep 11 16:54:27.982894 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:54:27.982875    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77961293a434bdf534051cb9beb61c0f09b1c93371d877db9ae457d0833686fe\": container with ID starting with 77961293a434bdf534051cb9beb61c0f09b1c93371d877db9ae457d0833686fe not found: ID does not exist" containerID="77961293a434bdf534051cb9beb61c0f09b1c93371d877db9ae457d0833686fe"
Sep 11 16:54:27.982947 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:27.982904    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77961293a434bdf534051cb9beb61c0f09b1c93371d877db9ae457d0833686fe"} err="failed to get container status \"77961293a434bdf534051cb9beb61c0f09b1c93371d877db9ae457d0833686fe\": rpc error: code = NotFound desc = could not find container \"77961293a434bdf534051cb9beb61c0f09b1c93371d877db9ae457d0833686fe\": container with ID starting with 77961293a434bdf534051cb9beb61c0f09b1c93371d877db9ae457d0833686fe not found: ID does not exist"
Sep 11 16:54:27.998032 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:27.997993    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-16265e-6d55b95f54-j9bss"]
Sep 11 16:54:28.002224 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:28.002193    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-16265e-6d55b95f54-j9bss"]
Sep 11 16:54:28.018084 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:28.018044    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-16265e-85f547ddf9-5w59c"]
Sep 11 16:54:28.026167 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:28.026134    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-16265e-85f547ddf9-5w59c"]
Sep 11 16:54:28.987601 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:28.987557    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23b235bb-dc0b-45c8-8ac5-2ebed6324346" path="/var/lib/kubelet/pods/23b235bb-dc0b-45c8-8ac5-2ebed6324346/volumes"
Sep 11 16:54:28.988157 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:28.988137    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa766f9e-01d6-4913-8a82-78ea16d41b60" path="/var/lib/kubelet/pods/fa766f9e-01d6-4913-8a82-78ea16d41b60/volumes"
Sep 11 16:54:34.490601 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:34.490547    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:54:34.597238 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:34.597207    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:54:34.764814 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:34.764737    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:54:35.251686 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:35.251659    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:54:43.161359 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:43.161319    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:54:43.235239 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:43.235204    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:54:45.767183 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:45.767150    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-347815-79c55764fb-7c6g7"]
Sep 11 16:54:45.767586 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:45.767363    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-347815-79c55764fb-7c6g7" podUID="c1e8248a-7e14-4407-a8a0-c5b3cc55b53a" containerName="maas-api" containerID="cri-o://239efd51cdc3f8c36c7ec646a309b1a196bf23e02836aed7792d7944fbbbc53a" gracePeriod=30
Sep 11 16:54:45.802963 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:45.802909    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:54:45.835832 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:45.835783    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-347815-6487cdc597-jc4cd"]
Sep 11 16:54:45.836944 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:45.836901    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-347815-6487cdc597-jc4cd" podUID="0099813f-1264-419f-885c-4a6d954b8dd9" containerName="payload-processing" containerID="cri-o://3a17cb770403701c825b7d55288ec323d2e4819bf7418a1575b83aba62e85337" gracePeriod=30
Sep 11 16:54:45.882917 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:45.882884    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:54:45.984804 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:45.984753    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:54:46.062698 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:46.062667    2581 generic.go:356] "Generic (PLEG): container finished" podID="c1e8248a-7e14-4407-a8a0-c5b3cc55b53a" containerID="239efd51cdc3f8c36c7ec646a309b1a196bf23e02836aed7792d7944fbbbc53a" exitCode=0
Sep 11 16:54:46.062946 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:46.062742    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-347815-79c55764fb-7c6g7" event={"ID":"c1e8248a-7e14-4407-a8a0-c5b3cc55b53a","Type":"ContainerDied","Data":"239efd51cdc3f8c36c7ec646a309b1a196bf23e02836aed7792d7944fbbbc53a"}
Sep 11 16:54:46.065111 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:46.065064    2581 generic.go:356] "Generic (PLEG): container finished" podID="0099813f-1264-419f-885c-4a6d954b8dd9" containerID="3a17cb770403701c825b7d55288ec323d2e4819bf7418a1575b83aba62e85337" exitCode=0
Sep 11 16:54:46.065233 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:46.065127    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-347815-6487cdc597-jc4cd" event={"ID":"0099813f-1264-419f-885c-4a6d954b8dd9","Type":"ContainerDied","Data":"3a17cb770403701c825b7d55288ec323d2e4819bf7418a1575b83aba62e85337"}
Sep 11 16:54:46.071494 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:46.071472    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:54:46.122010 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:46.121979    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-347815-79c55764fb-7c6g7"
Sep 11 16:54:46.125293 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:46.125266    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-347815-6487cdc597-jc4cd"
Sep 11 16:54:46.198552 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:46.198514    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0099813f-1264-419f-885c-4a6d954b8dd9-plugins-config-volume\") pod \"0099813f-1264-419f-885c-4a6d954b8dd9\" (UID: \"0099813f-1264-419f-885c-4a6d954b8dd9\") "
Sep 11 16:54:46.198721 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:46.198583    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9gkl4\" (UniqueName: \"kubernetes.io/projected/0099813f-1264-419f-885c-4a6d954b8dd9-kube-api-access-9gkl4\") pod \"0099813f-1264-419f-885c-4a6d954b8dd9\" (UID: \"0099813f-1264-419f-885c-4a6d954b8dd9\") "
Sep 11 16:54:46.198721 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:46.198661    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1e8248a-7e14-4407-a8a0-c5b3cc55b53a-openshift-service-ca\") pod \"c1e8248a-7e14-4407-a8a0-c5b3cc55b53a\" (UID: \"c1e8248a-7e14-4407-a8a0-c5b3cc55b53a\") "
Sep 11 16:54:46.198721 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:46.198695    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1e8248a-7e14-4407-a8a0-c5b3cc55b53a-metrics-certs\") pod \"c1e8248a-7e14-4407-a8a0-c5b3cc55b53a\" (UID: \"c1e8248a-7e14-4407-a8a0-c5b3cc55b53a\") "
Sep 11 16:54:46.198863 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:46.198749    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1e8248a-7e14-4407-a8a0-c5b3cc55b53a-maas-api-tls\") pod \"c1e8248a-7e14-4407-a8a0-c5b3cc55b53a\" (UID: \"c1e8248a-7e14-4407-a8a0-c5b3cc55b53a\") "
Sep 11 16:54:46.198863 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:46.198811    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dskd\" (UniqueName: \"kubernetes.io/projected/c1e8248a-7e14-4407-a8a0-c5b3cc55b53a-kube-api-access-6dskd\") pod \"c1e8248a-7e14-4407-a8a0-c5b3cc55b53a\" (UID: \"c1e8248a-7e14-4407-a8a0-c5b3cc55b53a\") "
Sep 11 16:54:46.198974 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:46.198894    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0099813f-1264-419f-885c-4a6d954b8dd9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0099813f-1264-419f-885c-4a6d954b8dd9" (UID: "0099813f-1264-419f-885c-4a6d954b8dd9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:54:46.199085 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:46.199054    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1e8248a-7e14-4407-a8a0-c5b3cc55b53a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c1e8248a-7e14-4407-a8a0-c5b3cc55b53a" (UID: "c1e8248a-7e14-4407-a8a0-c5b3cc55b53a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:54:46.199197 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:46.199171    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1e8248a-7e14-4407-a8a0-c5b3cc55b53a-openshift-service-ca\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:54:46.199197 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:46.199192    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0099813f-1264-419f-885c-4a6d954b8dd9-plugins-config-volume\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:54:46.200818 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:46.200791    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0099813f-1264-419f-885c-4a6d954b8dd9-kube-api-access-9gkl4" (OuterVolumeSpecName: "kube-api-access-9gkl4") pod "0099813f-1264-419f-885c-4a6d954b8dd9" (UID: "0099813f-1264-419f-885c-4a6d954b8dd9"). InnerVolumeSpecName "kube-api-access-9gkl4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:54:46.200948 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:46.200854    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1e8248a-7e14-4407-a8a0-c5b3cc55b53a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c1e8248a-7e14-4407-a8a0-c5b3cc55b53a" (UID: "c1e8248a-7e14-4407-a8a0-c5b3cc55b53a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:54:46.200948 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:46.200935    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1e8248a-7e14-4407-a8a0-c5b3cc55b53a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c1e8248a-7e14-4407-a8a0-c5b3cc55b53a" (UID: "c1e8248a-7e14-4407-a8a0-c5b3cc55b53a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:54:46.201352 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:46.201329    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1e8248a-7e14-4407-a8a0-c5b3cc55b53a-kube-api-access-6dskd" (OuterVolumeSpecName: "kube-api-access-6dskd") pod "c1e8248a-7e14-4407-a8a0-c5b3cc55b53a" (UID: "c1e8248a-7e14-4407-a8a0-c5b3cc55b53a"). InnerVolumeSpecName "kube-api-access-6dskd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:54:46.300123 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:46.300016    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1e8248a-7e14-4407-a8a0-c5b3cc55b53a-metrics-certs\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:54:46.300123 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:46.300047    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1e8248a-7e14-4407-a8a0-c5b3cc55b53a-maas-api-tls\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:54:46.300123 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:46.300058    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dskd\" (UniqueName: \"kubernetes.io/projected/c1e8248a-7e14-4407-a8a0-c5b3cc55b53a-kube-api-access-6dskd\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:54:46.300123 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:46.300067    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9gkl4\" (UniqueName: \"kubernetes.io/projected/0099813f-1264-419f-885c-4a6d954b8dd9-kube-api-access-9gkl4\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:54:46.416801 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:46.416771    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:54:47.071539 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:47.071475    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-347815-79c55764fb-7c6g7"
Sep 11 16:54:47.071539 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:47.071483    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-347815-79c55764fb-7c6g7" event={"ID":"c1e8248a-7e14-4407-a8a0-c5b3cc55b53a","Type":"ContainerDied","Data":"66184409578a5e6d9556256f31b13c803e2fc910ff15a2597dcd6ab6fdbbbb0c"}
Sep 11 16:54:47.072000 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:47.071546    2581 scope.go:117] "RemoveContainer" containerID="239efd51cdc3f8c36c7ec646a309b1a196bf23e02836aed7792d7944fbbbc53a"
Sep 11 16:54:47.073119 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:47.073075    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-347815-6487cdc597-jc4cd" event={"ID":"0099813f-1264-419f-885c-4a6d954b8dd9","Type":"ContainerDied","Data":"1c263103c1920b5afc47fdedd209f6ea4ff0b532d35e6b6f138949d601f899e7"}
Sep 11 16:54:47.073308 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:47.073128    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-347815-6487cdc597-jc4cd"
Sep 11 16:54:47.080546 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:47.080528    2581 scope.go:117] "RemoveContainer" containerID="3a17cb770403701c825b7d55288ec323d2e4819bf7418a1575b83aba62e85337"
Sep 11 16:54:47.095018 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:47.094996    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-347815-79c55764fb-7c6g7"]
Sep 11 16:54:47.116078 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:47.116051    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-347815-79c55764fb-7c6g7"]
Sep 11 16:54:47.131995 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:47.131959    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-347815-6487cdc597-jc4cd"]
Sep 11 16:54:47.137973 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:47.137940    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-347815-6487cdc597-jc4cd"]
Sep 11 16:54:48.987307 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:48.987278    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0099813f-1264-419f-885c-4a6d954b8dd9" path="/var/lib/kubelet/pods/0099813f-1264-419f-885c-4a6d954b8dd9/volumes"
Sep 11 16:54:48.987678 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:48.987642    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1e8248a-7e14-4407-a8a0-c5b3cc55b53a" path="/var/lib/kubelet/pods/c1e8248a-7e14-4407-a8a0-c5b3cc55b53a/volumes"
Sep 11 16:54:53.446345 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:53.446313    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:54:53.565412 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:53.565374    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:54:53.775755 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:53.775644    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:54:54.358237 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:54:54.358202    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:55:04.689029 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:55:04.688998    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:55:04.774578 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:55:04.774541    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-3e9c29-668fc4747c-j224l"]
Sep 11 16:55:04.774796 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:55:04.774775    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-3e9c29-668fc4747c-j224l" podUID="69fa7924-e83e-4120-b998-1d2b67faaf01" containerName="payload-processing" containerID="cri-o://22dcf46fd9f99175c8618954c846eb69bb4bfe077643d6d32237dac533c2b28f" gracePeriod=30
Sep 11 16:55:04.912179 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:55:04.912151    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:55:05.025769 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:55:05.025743    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-3e9c29-668fc4747c-j224l"
Sep 11 16:55:05.139218 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:55:05.139185    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:55:05.163959 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:55:05.163916    2581 generic.go:356] "Generic (PLEG): container finished" podID="69fa7924-e83e-4120-b998-1d2b67faaf01" containerID="22dcf46fd9f99175c8618954c846eb69bb4bfe077643d6d32237dac533c2b28f" exitCode=0
Sep 11 16:55:05.163959 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:55:05.163960    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-3e9c29-668fc4747c-j224l"
Sep 11 16:55:05.164193 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:55:05.164000    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-3e9c29-668fc4747c-j224l" event={"ID":"69fa7924-e83e-4120-b998-1d2b67faaf01","Type":"ContainerDied","Data":"22dcf46fd9f99175c8618954c846eb69bb4bfe077643d6d32237dac533c2b28f"}
Sep 11 16:55:05.164193 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:55:05.164056    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-3e9c29-668fc4747c-j224l" event={"ID":"69fa7924-e83e-4120-b998-1d2b67faaf01","Type":"ContainerDied","Data":"ab585ac32a5d8bdedc8409aef1c0e27745239cefbc7bfb6ca8cd6a9321df5f2d"}
Sep 11 16:55:05.164193 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:55:05.164083    2581 scope.go:117] "RemoveContainer" containerID="22dcf46fd9f99175c8618954c846eb69bb4bfe077643d6d32237dac533c2b28f"
Sep 11 16:55:05.172477 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:55:05.172448    2581 scope.go:117] "RemoveContainer" containerID="22dcf46fd9f99175c8618954c846eb69bb4bfe077643d6d32237dac533c2b28f"
Sep 11 16:55:05.172760 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:55:05.172745    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22dcf46fd9f99175c8618954c846eb69bb4bfe077643d6d32237dac533c2b28f\": container with ID starting with 22dcf46fd9f99175c8618954c846eb69bb4bfe077643d6d32237dac533c2b28f not found: ID does not exist" containerID="22dcf46fd9f99175c8618954c846eb69bb4bfe077643d6d32237dac533c2b28f"
Sep 11 16:55:05.172800 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:55:05.172775    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22dcf46fd9f99175c8618954c846eb69bb4bfe077643d6d32237dac533c2b28f"} err="failed to get container status \"22dcf46fd9f99175c8618954c846eb69bb4bfe077643d6d32237dac533c2b28f\": rpc error: code = NotFound desc = could not find container \"22dcf46fd9f99175c8618954c846eb69bb4bfe077643d6d32237dac533c2b28f\": container with ID starting with 22dcf46fd9f99175c8618954c846eb69bb4bfe077643d6d32237dac533c2b28f not found: ID does not exist"
Sep 11 16:55:05.176329 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:55:05.176309    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/69fa7924-e83e-4120-b998-1d2b67faaf01-plugins-config-volume\") pod \"69fa7924-e83e-4120-b998-1d2b67faaf01\" (UID: \"69fa7924-e83e-4120-b998-1d2b67faaf01\") "
Sep 11 16:55:05.176438 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:55:05.176359    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hsqg\" (UniqueName: \"kubernetes.io/projected/69fa7924-e83e-4120-b998-1d2b67faaf01-kube-api-access-7hsqg\") pod \"69fa7924-e83e-4120-b998-1d2b67faaf01\" (UID: \"69fa7924-e83e-4120-b998-1d2b67faaf01\") "
Sep 11 16:55:05.176714 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:55:05.176688    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69fa7924-e83e-4120-b998-1d2b67faaf01-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "69fa7924-e83e-4120-b998-1d2b67faaf01" (UID: "69fa7924-e83e-4120-b998-1d2b67faaf01"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:55:05.178627 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:55:05.178606    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69fa7924-e83e-4120-b998-1d2b67faaf01-kube-api-access-7hsqg" (OuterVolumeSpecName: "kube-api-access-7hsqg") pod "69fa7924-e83e-4120-b998-1d2b67faaf01" (UID: "69fa7924-e83e-4120-b998-1d2b67faaf01"). InnerVolumeSpecName "kube-api-access-7hsqg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:55:05.227834 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:55:05.227743    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:55:05.277205 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:55:05.277164    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hsqg\" (UniqueName: \"kubernetes.io/projected/69fa7924-e83e-4120-b998-1d2b67faaf01-kube-api-access-7hsqg\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:55:05.277205 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:55:05.277197    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/69fa7924-e83e-4120-b998-1d2b67faaf01-plugins-config-volume\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:55:05.490336 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:55:05.490245    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-3e9c29-668fc4747c-j224l"]
Sep 11 16:55:05.497395 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:55:05.497364    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-3e9c29-668fc4747c-j224l"]
Sep 11 16:55:05.662365 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:55:05.662331    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:55:06.988138 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:55:06.988073    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69fa7924-e83e-4120-b998-1d2b67faaf01" path="/var/lib/kubelet/pods/69fa7924-e83e-4120-b998-1d2b67faaf01/volumes"
Sep 11 16:55:10.711366 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:55:10.711331    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:55:13.462717 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:55:13.462688    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:55:13.622111 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:55:13.622056    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:55:13.807452 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:55:13.807366    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:56:02.462249 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:02.462209    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:56:04.461623 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:04.461583    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:56:06.743323 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:06.743292    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:56:06.834414 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:06.834381    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:56:07.904125 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:07.904077    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-519b89-5975d8c99d-gkc5l"]
Sep 11 16:56:07.904674 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:07.904651    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1e8248a-7e14-4407-a8a0-c5b3cc55b53a" containerName="maas-api"
Sep 11 16:56:07.904811 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:07.904799    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1e8248a-7e14-4407-a8a0-c5b3cc55b53a" containerName="maas-api"
Sep 11 16:56:07.904925 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:07.904907    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0099813f-1264-419f-885c-4a6d954b8dd9" containerName="payload-processing"
Sep 11 16:56:07.905012 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:07.904927    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0099813f-1264-419f-885c-4a6d954b8dd9" containerName="payload-processing"
Sep 11 16:56:07.905012 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:07.904958    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69fa7924-e83e-4120-b998-1d2b67faaf01" containerName="payload-processing"
Sep 11 16:56:07.905012 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:07.904967    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="69fa7924-e83e-4120-b998-1d2b67faaf01" containerName="payload-processing"
Sep 11 16:56:07.905012 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:07.904979    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa766f9e-01d6-4913-8a82-78ea16d41b60" containerName="payload-pre-processing"
Sep 11 16:56:07.905012 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:07.904987    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa766f9e-01d6-4913-8a82-78ea16d41b60" containerName="payload-pre-processing"
Sep 11 16:56:07.905012 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:07.904998    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23b235bb-dc0b-45c8-8ac5-2ebed6324346" containerName="payload-processing"
Sep 11 16:56:07.905012 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:07.905006    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="23b235bb-dc0b-45c8-8ac5-2ebed6324346" containerName="payload-processing"
Sep 11 16:56:07.905397 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:07.905016    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6848dc3c-4824-4b54-804f-42c13830ab33" containerName="payload-processing"
Sep 11 16:56:07.905397 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:07.905024    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6848dc3c-4824-4b54-804f-42c13830ab33" containerName="payload-processing"
Sep 11 16:56:07.905397 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:07.905152    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1e8248a-7e14-4407-a8a0-c5b3cc55b53a" containerName="maas-api"
Sep 11 16:56:07.905397 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:07.905169    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6848dc3c-4824-4b54-804f-42c13830ab33" containerName="payload-processing"
Sep 11 16:56:07.905397 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:07.905182    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0099813f-1264-419f-885c-4a6d954b8dd9" containerName="payload-processing"
Sep 11 16:56:07.905397 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:07.905195    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="69fa7924-e83e-4120-b998-1d2b67faaf01" containerName="payload-processing"
Sep 11 16:56:07.905397 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:07.905204    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="23b235bb-dc0b-45c8-8ac5-2ebed6324346" containerName="payload-processing"
Sep 11 16:56:07.905397 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:07.905215    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa766f9e-01d6-4913-8a82-78ea16d41b60" containerName="payload-pre-processing"
Sep 11 16:56:07.909807 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:07.909784    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-519b89-5975d8c99d-gkc5l"
Sep 11 16:56:07.912220 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:07.912198    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-519b89-serving-cert\""
Sep 11 16:56:07.920877 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:07.920852    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-519b89-5975d8c99d-gkc5l"]
Sep 11 16:56:07.942209 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:07.942168    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:56:07.942454 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:07.942433    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2bc4ae85-c58b-4502-ba2a-42d7770ea7a2-metrics-certs\") pod \"maas-api-e2e-ipp-a-519b89-5975d8c99d-gkc5l\" (UID: \"2bc4ae85-c58b-4502-ba2a-42d7770ea7a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-519b89-5975d8c99d-gkc5l"
Sep 11 16:56:07.942536 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:07.942467    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2bc4ae85-c58b-4502-ba2a-42d7770ea7a2-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-519b89-5975d8c99d-gkc5l\" (UID: \"2bc4ae85-c58b-4502-ba2a-42d7770ea7a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-519b89-5975d8c99d-gkc5l"
Sep 11 16:56:07.942536 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:07.942523    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zjpn\" (UniqueName: \"kubernetes.io/projected/2bc4ae85-c58b-4502-ba2a-42d7770ea7a2-kube-api-access-9zjpn\") pod \"maas-api-e2e-ipp-a-519b89-5975d8c99d-gkc5l\" (UID: \"2bc4ae85-c58b-4502-ba2a-42d7770ea7a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-519b89-5975d8c99d-gkc5l"
Sep 11 16:56:07.942634 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:07.942614    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2bc4ae85-c58b-4502-ba2a-42d7770ea7a2-maas-api-tls\") pod \"maas-api-e2e-ipp-a-519b89-5975d8c99d-gkc5l\" (UID: \"2bc4ae85-c58b-4502-ba2a-42d7770ea7a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-519b89-5975d8c99d-gkc5l"
Sep 11 16:56:08.012998 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:08.012967    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:56:08.043230 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:08.043203    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zjpn\" (UniqueName: \"kubernetes.io/projected/2bc4ae85-c58b-4502-ba2a-42d7770ea7a2-kube-api-access-9zjpn\") pod \"maas-api-e2e-ipp-a-519b89-5975d8c99d-gkc5l\" (UID: \"2bc4ae85-c58b-4502-ba2a-42d7770ea7a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-519b89-5975d8c99d-gkc5l"
Sep 11 16:56:08.043363 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:08.043239    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2bc4ae85-c58b-4502-ba2a-42d7770ea7a2-maas-api-tls\") pod \"maas-api-e2e-ipp-a-519b89-5975d8c99d-gkc5l\" (UID: \"2bc4ae85-c58b-4502-ba2a-42d7770ea7a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-519b89-5975d8c99d-gkc5l"
Sep 11 16:56:08.043363 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:08.043302    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2bc4ae85-c58b-4502-ba2a-42d7770ea7a2-metrics-certs\") pod \"maas-api-e2e-ipp-a-519b89-5975d8c99d-gkc5l\" (UID: \"2bc4ae85-c58b-4502-ba2a-42d7770ea7a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-519b89-5975d8c99d-gkc5l"
Sep 11 16:56:08.043363 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:08.043318    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2bc4ae85-c58b-4502-ba2a-42d7770ea7a2-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-519b89-5975d8c99d-gkc5l\" (UID: \"2bc4ae85-c58b-4502-ba2a-42d7770ea7a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-519b89-5975d8c99d-gkc5l"
Sep 11 16:56:08.043529 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:56:08.043407    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-519b89-serving-cert: secret "maas-api-e2e-ipp-a-519b89-serving-cert" not found
Sep 11 16:56:08.043529 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:56:08.043488    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bc4ae85-c58b-4502-ba2a-42d7770ea7a2-maas-api-tls podName:2bc4ae85-c58b-4502-ba2a-42d7770ea7a2 nodeName:}" failed. No retries permitted until 2026-09-11 16:56:08.543466643 +0000 UTC m=+1568.160223699 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2bc4ae85-c58b-4502-ba2a-42d7770ea7a2-maas-api-tls") pod "maas-api-e2e-ipp-a-519b89-5975d8c99d-gkc5l" (UID: "2bc4ae85-c58b-4502-ba2a-42d7770ea7a2") : secret "maas-api-e2e-ipp-a-519b89-serving-cert" not found
Sep 11 16:56:08.043866 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:08.043848    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2bc4ae85-c58b-4502-ba2a-42d7770ea7a2-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-519b89-5975d8c99d-gkc5l\" (UID: \"2bc4ae85-c58b-4502-ba2a-42d7770ea7a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-519b89-5975d8c99d-gkc5l"
Sep 11 16:56:08.046040 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:08.046016    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2bc4ae85-c58b-4502-ba2a-42d7770ea7a2-metrics-certs\") pod \"maas-api-e2e-ipp-a-519b89-5975d8c99d-gkc5l\" (UID: \"2bc4ae85-c58b-4502-ba2a-42d7770ea7a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-519b89-5975d8c99d-gkc5l"
Sep 11 16:56:08.058125 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:08.058083    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zjpn\" (UniqueName: \"kubernetes.io/projected/2bc4ae85-c58b-4502-ba2a-42d7770ea7a2-kube-api-access-9zjpn\") pod \"maas-api-e2e-ipp-a-519b89-5975d8c99d-gkc5l\" (UID: \"2bc4ae85-c58b-4502-ba2a-42d7770ea7a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-519b89-5975d8c99d-gkc5l"
Sep 11 16:56:08.547684 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:08.547653    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2bc4ae85-c58b-4502-ba2a-42d7770ea7a2-maas-api-tls\") pod \"maas-api-e2e-ipp-a-519b89-5975d8c99d-gkc5l\" (UID: \"2bc4ae85-c58b-4502-ba2a-42d7770ea7a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-519b89-5975d8c99d-gkc5l"
Sep 11 16:56:08.550137 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:08.550117    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2bc4ae85-c58b-4502-ba2a-42d7770ea7a2-maas-api-tls\") pod \"maas-api-e2e-ipp-a-519b89-5975d8c99d-gkc5l\" (UID: \"2bc4ae85-c58b-4502-ba2a-42d7770ea7a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-519b89-5975d8c99d-gkc5l"
Sep 11 16:56:08.569568 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:08.569542    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:56:08.668954 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:08.668918    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:56:08.822663 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:08.822565    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-519b89-5975d8c99d-gkc5l"
Sep 11 16:56:08.845592 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:08.845559    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-519b89-6bcccd5f7-hg97h"]
Sep 11 16:56:08.850185 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:08.850162    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-519b89-6bcccd5f7-hg97h"
Sep 11 16:56:08.850614 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:08.850592    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64caa8d0-d612-4876-ab10-fcc02e5de58b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-519b89-6bcccd5f7-hg97h\" (UID: \"64caa8d0-d612-4876-ab10-fcc02e5de58b\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-519b89-6bcccd5f7-hg97h"
Sep 11 16:56:08.850710 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:08.850628    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9b5j\" (UniqueName: \"kubernetes.io/projected/64caa8d0-d612-4876-ab10-fcc02e5de58b-kube-api-access-p9b5j\") pod \"payload-processing-e2e-ipp-a-519b89-6bcccd5f7-hg97h\" (UID: \"64caa8d0-d612-4876-ab10-fcc02e5de58b\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-519b89-6bcccd5f7-hg97h"
Sep 11 16:56:08.853077 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:08.853055    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-519b89-dockercfg-r2kgl\""
Sep 11 16:56:08.853214 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:08.853062    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-519b89\""
Sep 11 16:56:08.864449 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:08.864424    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-519b89-6bcccd5f7-hg97h"]
Sep 11 16:56:08.951850 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:08.951803    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64caa8d0-d612-4876-ab10-fcc02e5de58b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-519b89-6bcccd5f7-hg97h\" (UID: \"64caa8d0-d612-4876-ab10-fcc02e5de58b\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-519b89-6bcccd5f7-hg97h"
Sep 11 16:56:08.951850 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:08.951853    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9b5j\" (UniqueName: \"kubernetes.io/projected/64caa8d0-d612-4876-ab10-fcc02e5de58b-kube-api-access-p9b5j\") pod \"payload-processing-e2e-ipp-a-519b89-6bcccd5f7-hg97h\" (UID: \"64caa8d0-d612-4876-ab10-fcc02e5de58b\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-519b89-6bcccd5f7-hg97h"
Sep 11 16:56:08.952531 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:08.952511    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64caa8d0-d612-4876-ab10-fcc02e5de58b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-519b89-6bcccd5f7-hg97h\" (UID: \"64caa8d0-d612-4876-ab10-fcc02e5de58b\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-519b89-6bcccd5f7-hg97h"
Sep 11 16:56:08.961855 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:08.961832    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9b5j\" (UniqueName: \"kubernetes.io/projected/64caa8d0-d612-4876-ab10-fcc02e5de58b-kube-api-access-p9b5j\") pod \"payload-processing-e2e-ipp-a-519b89-6bcccd5f7-hg97h\" (UID: \"64caa8d0-d612-4876-ab10-fcc02e5de58b\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-519b89-6bcccd5f7-hg97h"
Sep 11 16:56:09.108708 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:09.108686    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-519b89-5975d8c99d-gkc5l"]
Sep 11 16:56:09.110564 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:56:09.110535    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bc4ae85_c58b_4502_ba2a_42d7770ea7a2.slice/crio-65577cfda8e256d270885023a6e07a6c3dc5b8addfa936db0a74bf7625ad4674 WatchSource:0}: Error finding container 65577cfda8e256d270885023a6e07a6c3dc5b8addfa936db0a74bf7625ad4674: Status 404 returned error can't find the container with id 65577cfda8e256d270885023a6e07a6c3dc5b8addfa936db0a74bf7625ad4674
Sep 11 16:56:09.111865 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:09.111848    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 16:56:09.163695 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:09.163674    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-519b89-6bcccd5f7-hg97h"
Sep 11 16:56:09.436925 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:09.436902    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-519b89-6bcccd5f7-hg97h"]
Sep 11 16:56:09.439043 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:56:09.439005    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64caa8d0_d612_4876_ab10_fcc02e5de58b.slice/crio-0575e4ffdc4b28987986be2374a36e9b4354ee5dd9c967ee00f67dba54405835 WatchSource:0}: Error finding container 0575e4ffdc4b28987986be2374a36e9b4354ee5dd9c967ee00f67dba54405835: Status 404 returned error can't find the container with id 0575e4ffdc4b28987986be2374a36e9b4354ee5dd9c967ee00f67dba54405835
Sep 11 16:56:09.468691 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:09.468662    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-519b89-5975d8c99d-gkc5l" event={"ID":"2bc4ae85-c58b-4502-ba2a-42d7770ea7a2","Type":"ContainerStarted","Data":"65577cfda8e256d270885023a6e07a6c3dc5b8addfa936db0a74bf7625ad4674"}
Sep 11 16:56:09.469686 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:09.469663    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-519b89-6bcccd5f7-hg97h" event={"ID":"64caa8d0-d612-4876-ab10-fcc02e5de58b","Type":"ContainerStarted","Data":"0575e4ffdc4b28987986be2374a36e9b4354ee5dd9c967ee00f67dba54405835"}
Sep 11 16:56:10.476233 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:10.476204    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-519b89-5975d8c99d-gkc5l" event={"ID":"2bc4ae85-c58b-4502-ba2a-42d7770ea7a2","Type":"ContainerStarted","Data":"d5dade54703e34e5aeeeb5e294ca3cb684ec24b160f5d9e2c10dc153fa39633f"}
Sep 11 16:56:10.476663 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:10.476294    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-519b89-5975d8c99d-gkc5l"
Sep 11 16:56:10.477838 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:10.477812    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-519b89-6bcccd5f7-hg97h" event={"ID":"64caa8d0-d612-4876-ab10-fcc02e5de58b","Type":"ContainerStarted","Data":"d22a01caee0a852891852796ebdddfd93622a89f74dee0987b5e42ef336a9f3a"}
Sep 11 16:56:10.477952 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:10.477854    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-519b89-6bcccd5f7-hg97h"
Sep 11 16:56:10.498781 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:10.498731    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-519b89-5975d8c99d-gkc5l" podStartSLOduration=3.026779915 podStartE2EDuration="3.498718066s" totalImagesPullingTime="471.938151ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:56:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:56:10.496923612 +0000 UTC m=+1570.113680724" watchObservedRunningTime="2026-09-11 16:56:10.498718066 +0000 UTC m=+1570.115475152"
Sep 11 16:56:10.515834 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:10.515788    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-519b89-6bcccd5f7-hg97h" podStartSLOduration=2.515772334 podStartE2EDuration="2.515772334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:56:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:56:10.515764218 +0000 UTC m=+1570.132521314" watchObservedRunningTime="2026-09-11 16:56:10.515772334 +0000 UTC m=+1570.132529401"
Sep 11 16:56:16.488817 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:16.488780    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-519b89-5975d8c99d-gkc5l"
Sep 11 16:56:21.485276 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:21.485245    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-519b89-6bcccd5f7-hg97h"
Sep 11 16:56:27.293316 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:27.293286    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:56:27.365744 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:27.365708    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:56:31.764608 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:31.764567    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:56:32.512874 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:32.512839    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:56:32.884555 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:32.884474    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:56:32.982899 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:32.982857    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:56:35.907797 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:35.907756    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:56:36.003966 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:36.003929    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:56:37.106306 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:37.106277    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:56:37.209807 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:37.209771    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:56:37.392524 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:37.392442    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:56:37.624168 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:37.624122    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:56:37.727274 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:37.727241    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:56:37.753714 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:37.753691    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-eb677c-765cf67f99-fws52"]
Sep 11 16:56:37.763107 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:37.763067    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-eb677c-765cf67f99-fws52"
Sep 11 16:56:37.767432 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:37.767411    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-eb677c-dockercfg-9jdqp\""
Sep 11 16:56:37.767571 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:37.767435    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-eb677c\""
Sep 11 16:56:37.768402 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:37.768378    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-eb677c-765cf67f99-fws52"]
Sep 11 16:56:37.910897 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:37.910862    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40a81310-979c-4277-b5a8-be1735f689a4-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-eb677c-765cf67f99-fws52\" (UID: \"40a81310-979c-4277-b5a8-be1735f689a4\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-eb677c-765cf67f99-fws52"
Sep 11 16:56:37.911134 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:37.910927    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7g6g\" (UniqueName: \"kubernetes.io/projected/40a81310-979c-4277-b5a8-be1735f689a4-kube-api-access-p7g6g\") pod \"payload-processing-e2e-ipp-b-eb677c-765cf67f99-fws52\" (UID: \"40a81310-979c-4277-b5a8-be1735f689a4\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-eb677c-765cf67f99-fws52"
Sep 11 16:56:38.012132 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:38.012033    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40a81310-979c-4277-b5a8-be1735f689a4-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-eb677c-765cf67f99-fws52\" (UID: \"40a81310-979c-4277-b5a8-be1735f689a4\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-eb677c-765cf67f99-fws52"
Sep 11 16:56:38.012132 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:38.012121    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7g6g\" (UniqueName: \"kubernetes.io/projected/40a81310-979c-4277-b5a8-be1735f689a4-kube-api-access-p7g6g\") pod \"payload-processing-e2e-ipp-b-eb677c-765cf67f99-fws52\" (UID: \"40a81310-979c-4277-b5a8-be1735f689a4\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-eb677c-765cf67f99-fws52"
Sep 11 16:56:38.012770 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:38.012751    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40a81310-979c-4277-b5a8-be1735f689a4-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-eb677c-765cf67f99-fws52\" (UID: \"40a81310-979c-4277-b5a8-be1735f689a4\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-eb677c-765cf67f99-fws52"
Sep 11 16:56:38.036929 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:38.036897    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7g6g\" (UniqueName: \"kubernetes.io/projected/40a81310-979c-4277-b5a8-be1735f689a4-kube-api-access-p7g6g\") pod \"payload-processing-e2e-ipp-b-eb677c-765cf67f99-fws52\" (UID: \"40a81310-979c-4277-b5a8-be1735f689a4\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-eb677c-765cf67f99-fws52"
Sep 11 16:56:38.076907 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:38.076883    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-eb677c-765cf67f99-fws52"
Sep 11 16:56:38.352553 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:38.352529    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-eb677c-765cf67f99-fws52"]
Sep 11 16:56:38.354344 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:56:38.354317    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40a81310_979c_4277_b5a8_be1735f689a4.slice/crio-9456efa7fcaa9182289f9f8f1b453036e9c59035fee85e898c0bc82adfbb8b54 WatchSource:0}: Error finding container 9456efa7fcaa9182289f9f8f1b453036e9c59035fee85e898c0bc82adfbb8b54: Status 404 returned error can't find the container with id 9456efa7fcaa9182289f9f8f1b453036e9c59035fee85e898c0bc82adfbb8b54
Sep 11 16:56:38.614340 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:38.614246    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-eb677c-765cf67f99-fws52" event={"ID":"40a81310-979c-4277-b5a8-be1735f689a4","Type":"ContainerStarted","Data":"e5b1634c2d05481fc82df7028c9594480dc56ece5e5423bf7a68b949d954fba6"}
Sep 11 16:56:38.614340 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:38.614310    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-eb677c-765cf67f99-fws52" event={"ID":"40a81310-979c-4277-b5a8-be1735f689a4","Type":"ContainerStarted","Data":"9456efa7fcaa9182289f9f8f1b453036e9c59035fee85e898c0bc82adfbb8b54"}
Sep 11 16:56:38.614565 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:38.614415    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-eb677c-765cf67f99-fws52"
Sep 11 16:56:38.634040 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:38.633990    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-eb677c-765cf67f99-fws52" podStartSLOduration=1.633976428 podStartE2EDuration="1.633976428s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:56:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:56:38.632308107 +0000 UTC m=+1598.249065185" watchObservedRunningTime="2026-09-11 16:56:38.633976428 +0000 UTC m=+1598.250733522"
Sep 11 16:56:49.620604 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:56:49.620570    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-eb677c-765cf67f99-fws52"
Sep 11 16:57:00.925408 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:57:00.925327    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:57:06.213539 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:57:06.213512    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-eb677c-765cf67f99-fws52_40a81310-979c-4277-b5a8-be1735f689a4/payload-processing/0.log"
Sep 11 16:57:15.235020 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:57:15.234984    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:57:57.232207 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:57:57.232175    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-519b89-6bcccd5f7-hg97h_64caa8d0-d612-4876-ab10-fcc02e5de58b/payload-processing/0.log"
Sep 11 16:57:57.514994 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:57:57.514907    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-eb677c-765cf67f99-fws52_40a81310-979c-4277-b5a8-be1735f689a4/payload-processing/0.log"
Sep 11 16:57:57.797757 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:57:57.797674    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:57:58.110438 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:57:58.110362    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:57:58.397959 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:57:58.397874    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:58:01.411967 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:01.411933    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:58:01.582634 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:01.582601    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:58:02.642977 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:02.642941    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:58:02.743417 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:02.743384    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:58:02.843074 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:02.843044    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:58:03.235285 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:03.235242    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:58:03.336779 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:03.336744    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:58:03.444546 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:03.444510    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8a65bd-75574fbd78-7s2sr"]
Sep 11 16:58:03.448032 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:03.448009    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8a65bd-75574fbd78-7s2sr"
Sep 11 16:58:03.450988 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:03.450967    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-8a65bd-dockercfg-wxvnz\""
Sep 11 16:58:03.451273 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:03.451252    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-8a65bd\""
Sep 11 16:58:03.459732 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:03.459708    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8a65bd-75574fbd78-7s2sr"]
Sep 11 16:58:03.503043 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:03.502965    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c134dff2-b0e4-474b-b86c-551b00cd6ba6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-8a65bd-75574fbd78-7s2sr\" (UID: \"c134dff2-b0e4-474b-b86c-551b00cd6ba6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8a65bd-75574fbd78-7s2sr"
Sep 11 16:58:03.503043 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:03.503041    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr2sp\" (UniqueName: \"kubernetes.io/projected/c134dff2-b0e4-474b-b86c-551b00cd6ba6-kube-api-access-jr2sp\") pod \"payload-pre-processing-e2e-ipp-cleanup-8a65bd-75574fbd78-7s2sr\" (UID: \"c134dff2-b0e4-474b-b86c-551b00cd6ba6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8a65bd-75574fbd78-7s2sr"
Sep 11 16:58:03.531033 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:03.530992    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-8a65bd-6d899f747f-545wc"]
Sep 11 16:58:03.534968 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:03.534947    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8a65bd-6d899f747f-545wc"
Sep 11 16:58:03.548634 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:03.548606    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-8a65bd-6d899f747f-545wc"]
Sep 11 16:58:03.603821 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:03.603787    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62bb6f57-e59b-4176-830b-e8680c3abdee-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-8a65bd-6d899f747f-545wc\" (UID: \"62bb6f57-e59b-4176-830b-e8680c3abdee\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8a65bd-6d899f747f-545wc"
Sep 11 16:58:03.603821 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:03.603820    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsmc8\" (UniqueName: \"kubernetes.io/projected/62bb6f57-e59b-4176-830b-e8680c3abdee-kube-api-access-tsmc8\") pod \"payload-processing-e2e-ipp-cleanup-8a65bd-6d899f747f-545wc\" (UID: \"62bb6f57-e59b-4176-830b-e8680c3abdee\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8a65bd-6d899f747f-545wc"
Sep 11 16:58:03.604026 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:03.603867    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr2sp\" (UniqueName: \"kubernetes.io/projected/c134dff2-b0e4-474b-b86c-551b00cd6ba6-kube-api-access-jr2sp\") pod \"payload-pre-processing-e2e-ipp-cleanup-8a65bd-75574fbd78-7s2sr\" (UID: \"c134dff2-b0e4-474b-b86c-551b00cd6ba6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8a65bd-75574fbd78-7s2sr"
Sep 11 16:58:03.604026 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:03.603972    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c134dff2-b0e4-474b-b86c-551b00cd6ba6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-8a65bd-75574fbd78-7s2sr\" (UID: \"c134dff2-b0e4-474b-b86c-551b00cd6ba6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8a65bd-75574fbd78-7s2sr"
Sep 11 16:58:03.604634 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:03.604616    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c134dff2-b0e4-474b-b86c-551b00cd6ba6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-8a65bd-75574fbd78-7s2sr\" (UID: \"c134dff2-b0e4-474b-b86c-551b00cd6ba6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8a65bd-75574fbd78-7s2sr"
Sep 11 16:58:03.613659 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:03.613630    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr2sp\" (UniqueName: \"kubernetes.io/projected/c134dff2-b0e4-474b-b86c-551b00cd6ba6-kube-api-access-jr2sp\") pod \"payload-pre-processing-e2e-ipp-cleanup-8a65bd-75574fbd78-7s2sr\" (UID: \"c134dff2-b0e4-474b-b86c-551b00cd6ba6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8a65bd-75574fbd78-7s2sr"
Sep 11 16:58:03.705254 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:03.705211    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62bb6f57-e59b-4176-830b-e8680c3abdee-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-8a65bd-6d899f747f-545wc\" (UID: \"62bb6f57-e59b-4176-830b-e8680c3abdee\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8a65bd-6d899f747f-545wc"
Sep 11 16:58:03.705254 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:03.705251    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsmc8\" (UniqueName: \"kubernetes.io/projected/62bb6f57-e59b-4176-830b-e8680c3abdee-kube-api-access-tsmc8\") pod \"payload-processing-e2e-ipp-cleanup-8a65bd-6d899f747f-545wc\" (UID: \"62bb6f57-e59b-4176-830b-e8680c3abdee\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8a65bd-6d899f747f-545wc"
Sep 11 16:58:03.705999 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:03.705976    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62bb6f57-e59b-4176-830b-e8680c3abdee-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-8a65bd-6d899f747f-545wc\" (UID: \"62bb6f57-e59b-4176-830b-e8680c3abdee\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8a65bd-6d899f747f-545wc"
Sep 11 16:58:03.715959 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:03.715923    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsmc8\" (UniqueName: \"kubernetes.io/projected/62bb6f57-e59b-4176-830b-e8680c3abdee-kube-api-access-tsmc8\") pod \"payload-processing-e2e-ipp-cleanup-8a65bd-6d899f747f-545wc\" (UID: \"62bb6f57-e59b-4176-830b-e8680c3abdee\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8a65bd-6d899f747f-545wc"
Sep 11 16:58:03.759764 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:03.759683    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8a65bd-75574fbd78-7s2sr"
Sep 11 16:58:03.845442 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:03.845404    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8a65bd-6d899f747f-545wc"
Sep 11 16:58:04.042085 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:04.042056    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8a65bd-75574fbd78-7s2sr"]
Sep 11 16:58:04.043136 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:58:04.043104    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc134dff2_b0e4_474b_b86c_551b00cd6ba6.slice/crio-d645528a3087ae61f5dd4f72c86878d11bf46ab7b034b9d6dcb666d54797e0b9 WatchSource:0}: Error finding container d645528a3087ae61f5dd4f72c86878d11bf46ab7b034b9d6dcb666d54797e0b9: Status 404 returned error can't find the container with id d645528a3087ae61f5dd4f72c86878d11bf46ab7b034b9d6dcb666d54797e0b9
Sep 11 16:58:04.125885 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:04.125858    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-8a65bd-6d899f747f-545wc"]
Sep 11 16:58:04.128358 ip-10-0-140-192 kubenswrapper[2581]: W0911 16:58:04.128329    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62bb6f57_e59b_4176_830b_e8680c3abdee.slice/crio-c6e4d7fdba905688d51426ac4f6bdfc312e2a33ddeeb6333f05a119c4a4bc293 WatchSource:0}: Error finding container c6e4d7fdba905688d51426ac4f6bdfc312e2a33ddeeb6333f05a119c4a4bc293: Status 404 returned error can't find the container with id c6e4d7fdba905688d51426ac4f6bdfc312e2a33ddeeb6333f05a119c4a4bc293
Sep 11 16:58:05.026170 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:05.026128    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8a65bd-75574fbd78-7s2sr" event={"ID":"c134dff2-b0e4-474b-b86c-551b00cd6ba6","Type":"ContainerStarted","Data":"f409ea9da5d0260a0a99f657d8914a237ad87cbe9f4c5ff9132bdf4e7bc57e8c"}
Sep 11 16:58:05.026589 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:05.026193    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8a65bd-75574fbd78-7s2sr" event={"ID":"c134dff2-b0e4-474b-b86c-551b00cd6ba6","Type":"ContainerStarted","Data":"d645528a3087ae61f5dd4f72c86878d11bf46ab7b034b9d6dcb666d54797e0b9"}
Sep 11 16:58:05.026589 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:05.026223    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8a65bd-75574fbd78-7s2sr"
Sep 11 16:58:05.028161 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:05.028132    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8a65bd-6d899f747f-545wc" event={"ID":"62bb6f57-e59b-4176-830b-e8680c3abdee","Type":"ContainerStarted","Data":"1e6088ef6a2177e7de2e62f6a0103b8cda710f8c784fda843a33404c3d1d5ac5"}
Sep 11 16:58:05.028303 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:05.028176    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8a65bd-6d899f747f-545wc" event={"ID":"62bb6f57-e59b-4176-830b-e8680c3abdee","Type":"ContainerStarted","Data":"c6e4d7fdba905688d51426ac4f6bdfc312e2a33ddeeb6333f05a119c4a4bc293"}
Sep 11 16:58:05.028303 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:05.028217    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8a65bd-6d899f747f-545wc"
Sep 11 16:58:05.046320 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:05.046278    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8a65bd-75574fbd78-7s2sr" podStartSLOduration=2.046264429 podStartE2EDuration="2.046264429s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:58:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:58:05.044555691 +0000 UTC m=+1684.661312784" watchObservedRunningTime="2026-09-11 16:58:05.046264429 +0000 UTC m=+1684.663021492"
Sep 11 16:58:05.064848 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:05.064803    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8a65bd-6d899f747f-545wc" podStartSLOduration=2.064788728 podStartE2EDuration="2.064788728s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:58:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:58:05.063049606 +0000 UTC m=+1684.679806682" watchObservedRunningTime="2026-09-11 16:58:05.064788728 +0000 UTC m=+1684.681545809"
Sep 11 16:58:16.034902 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:16.034865    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8a65bd-6d899f747f-545wc"
Sep 11 16:58:16.035433 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:16.035021    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8a65bd-75574fbd78-7s2sr"
Sep 11 16:58:26.423312 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:26.423238    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:58:33.448581 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:33.448546    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:58:33.504718 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:33.504678    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-8a65bd-6d899f747f-545wc"]
Sep 11 16:58:33.504979 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:33.504941    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8a65bd-6d899f747f-545wc" podUID="62bb6f57-e59b-4176-830b-e8680c3abdee" containerName="payload-processing" containerID="cri-o://1e6088ef6a2177e7de2e62f6a0103b8cda710f8c784fda843a33404c3d1d5ac5" gracePeriod=30
Sep 11 16:58:33.513943 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:33.513915    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8a65bd-75574fbd78-7s2sr"]
Sep 11 16:58:33.514597 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:33.514372    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8a65bd-75574fbd78-7s2sr" podUID="c134dff2-b0e4-474b-b86c-551b00cd6ba6" containerName="payload-pre-processing" containerID="cri-o://f409ea9da5d0260a0a99f657d8914a237ad87cbe9f4c5ff9132bdf4e7bc57e8c" gracePeriod=30
Sep 11 16:58:33.638533 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:33.638502    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:58:33.783427 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:33.783399    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8a65bd-6d899f747f-545wc"
Sep 11 16:58:33.809689 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:33.809518    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8a65bd-75574fbd78-7s2sr"
Sep 11 16:58:33.844427 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:33.844387    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:58:33.890812 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:33.890782    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jr2sp\" (UniqueName: \"kubernetes.io/projected/c134dff2-b0e4-474b-b86c-551b00cd6ba6-kube-api-access-jr2sp\") pod \"c134dff2-b0e4-474b-b86c-551b00cd6ba6\" (UID: \"c134dff2-b0e4-474b-b86c-551b00cd6ba6\") "
Sep 11 16:58:33.890961 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:33.890892    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c134dff2-b0e4-474b-b86c-551b00cd6ba6-plugins-config-volume\") pod \"c134dff2-b0e4-474b-b86c-551b00cd6ba6\" (UID: \"c134dff2-b0e4-474b-b86c-551b00cd6ba6\") "
Sep 11 16:58:33.890961 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:33.890910    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tsmc8\" (UniqueName: \"kubernetes.io/projected/62bb6f57-e59b-4176-830b-e8680c3abdee-kube-api-access-tsmc8\") pod \"62bb6f57-e59b-4176-830b-e8680c3abdee\" (UID: \"62bb6f57-e59b-4176-830b-e8680c3abdee\") "
Sep 11 16:58:33.890961 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:33.890947    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62bb6f57-e59b-4176-830b-e8680c3abdee-plugins-config-volume\") pod \"62bb6f57-e59b-4176-830b-e8680c3abdee\" (UID: \"62bb6f57-e59b-4176-830b-e8680c3abdee\") "
Sep 11 16:58:33.891366 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:33.891344    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c134dff2-b0e4-474b-b86c-551b00cd6ba6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c134dff2-b0e4-474b-b86c-551b00cd6ba6" (UID: "c134dff2-b0e4-474b-b86c-551b00cd6ba6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:58:33.891453 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:33.891358    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62bb6f57-e59b-4176-830b-e8680c3abdee-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "62bb6f57-e59b-4176-830b-e8680c3abdee" (UID: "62bb6f57-e59b-4176-830b-e8680c3abdee"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:58:33.892982 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:33.892953    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c134dff2-b0e4-474b-b86c-551b00cd6ba6-kube-api-access-jr2sp" (OuterVolumeSpecName: "kube-api-access-jr2sp") pod "c134dff2-b0e4-474b-b86c-551b00cd6ba6" (UID: "c134dff2-b0e4-474b-b86c-551b00cd6ba6"). InnerVolumeSpecName "kube-api-access-jr2sp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:58:33.893108 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:33.893074    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62bb6f57-e59b-4176-830b-e8680c3abdee-kube-api-access-tsmc8" (OuterVolumeSpecName: "kube-api-access-tsmc8") pod "62bb6f57-e59b-4176-830b-e8680c3abdee" (UID: "62bb6f57-e59b-4176-830b-e8680c3abdee"). InnerVolumeSpecName "kube-api-access-tsmc8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:58:33.964287 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:33.964253    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:58:33.992161 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:33.992073    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c134dff2-b0e4-474b-b86c-551b00cd6ba6-plugins-config-volume\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:58:33.992161 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:33.992126    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tsmc8\" (UniqueName: \"kubernetes.io/projected/62bb6f57-e59b-4176-830b-e8680c3abdee-kube-api-access-tsmc8\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:58:33.992161 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:33.992136    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62bb6f57-e59b-4176-830b-e8680c3abdee-plugins-config-volume\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:58:33.992161 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:33.992144    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jr2sp\" (UniqueName: \"kubernetes.io/projected/c134dff2-b0e4-474b-b86c-551b00cd6ba6-kube-api-access-jr2sp\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:58:34.182574 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:34.182538    2581 generic.go:356] "Generic (PLEG): container finished" podID="62bb6f57-e59b-4176-830b-e8680c3abdee" containerID="1e6088ef6a2177e7de2e62f6a0103b8cda710f8c784fda843a33404c3d1d5ac5" exitCode=0
Sep 11 16:58:34.182742 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:34.182583    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8a65bd-6d899f747f-545wc"
Sep 11 16:58:34.182742 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:34.182620    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8a65bd-6d899f747f-545wc" event={"ID":"62bb6f57-e59b-4176-830b-e8680c3abdee","Type":"ContainerDied","Data":"1e6088ef6a2177e7de2e62f6a0103b8cda710f8c784fda843a33404c3d1d5ac5"}
Sep 11 16:58:34.182742 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:34.182678    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8a65bd-6d899f747f-545wc" event={"ID":"62bb6f57-e59b-4176-830b-e8680c3abdee","Type":"ContainerDied","Data":"c6e4d7fdba905688d51426ac4f6bdfc312e2a33ddeeb6333f05a119c4a4bc293"}
Sep 11 16:58:34.182742 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:34.182719    2581 scope.go:117] "RemoveContainer" containerID="1e6088ef6a2177e7de2e62f6a0103b8cda710f8c784fda843a33404c3d1d5ac5"
Sep 11 16:58:34.183904 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:34.183880    2581 generic.go:356] "Generic (PLEG): container finished" podID="c134dff2-b0e4-474b-b86c-551b00cd6ba6" containerID="f409ea9da5d0260a0a99f657d8914a237ad87cbe9f4c5ff9132bdf4e7bc57e8c" exitCode=0
Sep 11 16:58:34.184007 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:34.183904    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8a65bd-75574fbd78-7s2sr" event={"ID":"c134dff2-b0e4-474b-b86c-551b00cd6ba6","Type":"ContainerDied","Data":"f409ea9da5d0260a0a99f657d8914a237ad87cbe9f4c5ff9132bdf4e7bc57e8c"}
Sep 11 16:58:34.184007 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:34.183926    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8a65bd-75574fbd78-7s2sr"
Sep 11 16:58:34.184007 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:34.183949    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8a65bd-75574fbd78-7s2sr" event={"ID":"c134dff2-b0e4-474b-b86c-551b00cd6ba6","Type":"ContainerDied","Data":"d645528a3087ae61f5dd4f72c86878d11bf46ab7b034b9d6dcb666d54797e0b9"}
Sep 11 16:58:34.192762 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:34.192741    2581 scope.go:117] "RemoveContainer" containerID="1e6088ef6a2177e7de2e62f6a0103b8cda710f8c784fda843a33404c3d1d5ac5"
Sep 11 16:58:34.193056 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:58:34.193032    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e6088ef6a2177e7de2e62f6a0103b8cda710f8c784fda843a33404c3d1d5ac5\": container with ID starting with 1e6088ef6a2177e7de2e62f6a0103b8cda710f8c784fda843a33404c3d1d5ac5 not found: ID does not exist" containerID="1e6088ef6a2177e7de2e62f6a0103b8cda710f8c784fda843a33404c3d1d5ac5"
Sep 11 16:58:34.193198 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:34.193062    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e6088ef6a2177e7de2e62f6a0103b8cda710f8c784fda843a33404c3d1d5ac5"} err="failed to get container status \"1e6088ef6a2177e7de2e62f6a0103b8cda710f8c784fda843a33404c3d1d5ac5\": rpc error: code = NotFound desc = could not find container \"1e6088ef6a2177e7de2e62f6a0103b8cda710f8c784fda843a33404c3d1d5ac5\": container with ID starting with 1e6088ef6a2177e7de2e62f6a0103b8cda710f8c784fda843a33404c3d1d5ac5 not found: ID does not exist"
Sep 11 16:58:34.193198 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:34.193103    2581 scope.go:117] "RemoveContainer" containerID="f409ea9da5d0260a0a99f657d8914a237ad87cbe9f4c5ff9132bdf4e7bc57e8c"
Sep 11 16:58:34.201338 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:34.201322    2581 scope.go:117] "RemoveContainer" containerID="f409ea9da5d0260a0a99f657d8914a237ad87cbe9f4c5ff9132bdf4e7bc57e8c"
Sep 11 16:58:34.201628 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:58:34.201605    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f409ea9da5d0260a0a99f657d8914a237ad87cbe9f4c5ff9132bdf4e7bc57e8c\": container with ID starting with f409ea9da5d0260a0a99f657d8914a237ad87cbe9f4c5ff9132bdf4e7bc57e8c not found: ID does not exist" containerID="f409ea9da5d0260a0a99f657d8914a237ad87cbe9f4c5ff9132bdf4e7bc57e8c"
Sep 11 16:58:34.201704 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:34.201639    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f409ea9da5d0260a0a99f657d8914a237ad87cbe9f4c5ff9132bdf4e7bc57e8c"} err="failed to get container status \"f409ea9da5d0260a0a99f657d8914a237ad87cbe9f4c5ff9132bdf4e7bc57e8c\": rpc error: code = NotFound desc = could not find container \"f409ea9da5d0260a0a99f657d8914a237ad87cbe9f4c5ff9132bdf4e7bc57e8c\": container with ID starting with f409ea9da5d0260a0a99f657d8914a237ad87cbe9f4c5ff9132bdf4e7bc57e8c not found: ID does not exist"
Sep 11 16:58:34.202439 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:34.202412    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:58:34.208433 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:34.208413    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-8a65bd-6d899f747f-545wc"]
Sep 11 16:58:34.210129 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:34.210110    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-8a65bd-6d899f747f-545wc"]
Sep 11 16:58:34.227872 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:34.227848    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8a65bd-75574fbd78-7s2sr"]
Sep 11 16:58:34.235355 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:34.235333    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8a65bd-75574fbd78-7s2sr"]
Sep 11 16:58:34.987334 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:34.987297    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62bb6f57-e59b-4176-830b-e8680c3abdee" path="/var/lib/kubelet/pods/62bb6f57-e59b-4176-830b-e8680c3abdee/volumes"
Sep 11 16:58:34.987687 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:34.987677    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c134dff2-b0e4-474b-b86c-551b00cd6ba6" path="/var/lib/kubelet/pods/c134dff2-b0e4-474b-b86c-551b00cd6ba6/volumes"
Sep 11 16:58:40.610714 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:40.610684    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:58:40.741445 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:40.741393    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:58:40.938674 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:40.938638    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:58:44.743417 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:44.743384    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:58:55.506945 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:58:55.506917    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:59:00.179395 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:00.179358    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-519b89-5975d8c99d-gkc5l"]
Sep 11 16:59:00.179828 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:00.179551    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-519b89-5975d8c99d-gkc5l" podUID="2bc4ae85-c58b-4502-ba2a-42d7770ea7a2" containerName="maas-api" containerID="cri-o://d5dade54703e34e5aeeeb5e294ca3cb684ec24b160f5d9e2c10dc153fa39633f" gracePeriod=30
Sep 11 16:59:00.222303 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:00.222277    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:59:00.261853 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:00.261820    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-519b89-6bcccd5f7-hg97h"]
Sep 11 16:59:00.262122 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:00.262073    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-519b89-6bcccd5f7-hg97h" podUID="64caa8d0-d612-4876-ab10-fcc02e5de58b" containerName="payload-processing" containerID="cri-o://d22a01caee0a852891852796ebdddfd93622a89f74dee0987b5e42ef336a9f3a" gracePeriod=30
Sep 11 16:59:00.298853 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:00.298827    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:59:00.313792 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:00.313765    2581 generic.go:356] "Generic (PLEG): container finished" podID="2bc4ae85-c58b-4502-ba2a-42d7770ea7a2" containerID="d5dade54703e34e5aeeeb5e294ca3cb684ec24b160f5d9e2c10dc153fa39633f" exitCode=0
Sep 11 16:59:00.313919 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:00.313796    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-519b89-5975d8c99d-gkc5l" event={"ID":"2bc4ae85-c58b-4502-ba2a-42d7770ea7a2","Type":"ContainerDied","Data":"d5dade54703e34e5aeeeb5e294ca3cb684ec24b160f5d9e2c10dc153fa39633f"}
Sep 11 16:59:00.404928 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:00.404890    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:59:00.510264 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:00.510237    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-519b89-5975d8c99d-gkc5l"
Sep 11 16:59:00.520404 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:00.520383    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:59:00.540315 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:00.540294    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-519b89-6bcccd5f7-hg97h"
Sep 11 16:59:00.540458 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:00.540442    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2bc4ae85-c58b-4502-ba2a-42d7770ea7a2-openshift-service-ca\") pod \"2bc4ae85-c58b-4502-ba2a-42d7770ea7a2\" (UID: \"2bc4ae85-c58b-4502-ba2a-42d7770ea7a2\") "
Sep 11 16:59:00.540498 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:00.540480    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9zjpn\" (UniqueName: \"kubernetes.io/projected/2bc4ae85-c58b-4502-ba2a-42d7770ea7a2-kube-api-access-9zjpn\") pod \"2bc4ae85-c58b-4502-ba2a-42d7770ea7a2\" (UID: \"2bc4ae85-c58b-4502-ba2a-42d7770ea7a2\") "
Sep 11 16:59:00.540587 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:00.540568    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2bc4ae85-c58b-4502-ba2a-42d7770ea7a2-metrics-certs\") pod \"2bc4ae85-c58b-4502-ba2a-42d7770ea7a2\" (UID: \"2bc4ae85-c58b-4502-ba2a-42d7770ea7a2\") "
Sep 11 16:59:00.540717 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:00.540622    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2bc4ae85-c58b-4502-ba2a-42d7770ea7a2-maas-api-tls\") pod \"2bc4ae85-c58b-4502-ba2a-42d7770ea7a2\" (UID: \"2bc4ae85-c58b-4502-ba2a-42d7770ea7a2\") "
Sep 11 16:59:00.540822 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:00.540791    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bc4ae85-c58b-4502-ba2a-42d7770ea7a2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2bc4ae85-c58b-4502-ba2a-42d7770ea7a2" (UID: "2bc4ae85-c58b-4502-ba2a-42d7770ea7a2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:59:00.541024 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:00.541003    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2bc4ae85-c58b-4502-ba2a-42d7770ea7a2-openshift-service-ca\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:59:00.542663 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:00.542641    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bc4ae85-c58b-4502-ba2a-42d7770ea7a2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2bc4ae85-c58b-4502-ba2a-42d7770ea7a2" (UID: "2bc4ae85-c58b-4502-ba2a-42d7770ea7a2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:59:00.542663 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:00.542644    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bc4ae85-c58b-4502-ba2a-42d7770ea7a2-kube-api-access-9zjpn" (OuterVolumeSpecName: "kube-api-access-9zjpn") pod "2bc4ae85-c58b-4502-ba2a-42d7770ea7a2" (UID: "2bc4ae85-c58b-4502-ba2a-42d7770ea7a2"). InnerVolumeSpecName "kube-api-access-9zjpn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:59:00.542794 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:00.542706    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bc4ae85-c58b-4502-ba2a-42d7770ea7a2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2bc4ae85-c58b-4502-ba2a-42d7770ea7a2" (UID: "2bc4ae85-c58b-4502-ba2a-42d7770ea7a2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:59:00.641736 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:00.641710    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9b5j\" (UniqueName: \"kubernetes.io/projected/64caa8d0-d612-4876-ab10-fcc02e5de58b-kube-api-access-p9b5j\") pod \"64caa8d0-d612-4876-ab10-fcc02e5de58b\" (UID: \"64caa8d0-d612-4876-ab10-fcc02e5de58b\") "
Sep 11 16:59:00.641890 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:00.641803    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64caa8d0-d612-4876-ab10-fcc02e5de58b-plugins-config-volume\") pod \"64caa8d0-d612-4876-ab10-fcc02e5de58b\" (UID: \"64caa8d0-d612-4876-ab10-fcc02e5de58b\") "
Sep 11 16:59:00.642019 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:00.642006    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2bc4ae85-c58b-4502-ba2a-42d7770ea7a2-metrics-certs\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:59:00.642066 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:00.642020    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2bc4ae85-c58b-4502-ba2a-42d7770ea7a2-maas-api-tls\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:59:00.642066 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:00.642029    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zjpn\" (UniqueName: \"kubernetes.io/projected/2bc4ae85-c58b-4502-ba2a-42d7770ea7a2-kube-api-access-9zjpn\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:59:00.642210 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:00.642149    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64caa8d0-d612-4876-ab10-fcc02e5de58b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "64caa8d0-d612-4876-ab10-fcc02e5de58b" (UID: "64caa8d0-d612-4876-ab10-fcc02e5de58b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:59:00.643861 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:00.643842    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64caa8d0-d612-4876-ab10-fcc02e5de58b-kube-api-access-p9b5j" (OuterVolumeSpecName: "kube-api-access-p9b5j") pod "64caa8d0-d612-4876-ab10-fcc02e5de58b" (UID: "64caa8d0-d612-4876-ab10-fcc02e5de58b"). InnerVolumeSpecName "kube-api-access-p9b5j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:59:00.685277 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:00.685247    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:59:00.743488 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:00.743418    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9b5j\" (UniqueName: \"kubernetes.io/projected/64caa8d0-d612-4876-ab10-fcc02e5de58b-kube-api-access-p9b5j\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:59:00.743488 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:00.743445    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64caa8d0-d612-4876-ab10-fcc02e5de58b-plugins-config-volume\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 16:59:00.931652 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:00.931616    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:59:01.319953 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:01.319868    2581 generic.go:356] "Generic (PLEG): container finished" podID="64caa8d0-d612-4876-ab10-fcc02e5de58b" containerID="d22a01caee0a852891852796ebdddfd93622a89f74dee0987b5e42ef336a9f3a" exitCode=0
Sep 11 16:59:01.319953 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:01.319917    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-519b89-6bcccd5f7-hg97h"
Sep 11 16:59:01.320442 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:01.319944    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-519b89-6bcccd5f7-hg97h" event={"ID":"64caa8d0-d612-4876-ab10-fcc02e5de58b","Type":"ContainerDied","Data":"d22a01caee0a852891852796ebdddfd93622a89f74dee0987b5e42ef336a9f3a"}
Sep 11 16:59:01.320442 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:01.319999    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-519b89-6bcccd5f7-hg97h" event={"ID":"64caa8d0-d612-4876-ab10-fcc02e5de58b","Type":"ContainerDied","Data":"0575e4ffdc4b28987986be2374a36e9b4354ee5dd9c967ee00f67dba54405835"}
Sep 11 16:59:01.320442 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:01.320024    2581 scope.go:117] "RemoveContainer" containerID="d22a01caee0a852891852796ebdddfd93622a89f74dee0987b5e42ef336a9f3a"
Sep 11 16:59:01.324773 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:01.324670    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-519b89-5975d8c99d-gkc5l" event={"ID":"2bc4ae85-c58b-4502-ba2a-42d7770ea7a2","Type":"ContainerDied","Data":"65577cfda8e256d270885023a6e07a6c3dc5b8addfa936db0a74bf7625ad4674"}
Sep 11 16:59:01.324773 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:01.324722    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-519b89-5975d8c99d-gkc5l"
Sep 11 16:59:01.330906 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:01.330878    2581 scope.go:117] "RemoveContainer" containerID="d22a01caee0a852891852796ebdddfd93622a89f74dee0987b5e42ef336a9f3a"
Sep 11 16:59:01.331225 ip-10-0-140-192 kubenswrapper[2581]: E0911 16:59:01.331174    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d22a01caee0a852891852796ebdddfd93622a89f74dee0987b5e42ef336a9f3a\": container with ID starting with d22a01caee0a852891852796ebdddfd93622a89f74dee0987b5e42ef336a9f3a not found: ID does not exist" containerID="d22a01caee0a852891852796ebdddfd93622a89f74dee0987b5e42ef336a9f3a"
Sep 11 16:59:01.331225 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:01.331211    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d22a01caee0a852891852796ebdddfd93622a89f74dee0987b5e42ef336a9f3a"} err="failed to get container status \"d22a01caee0a852891852796ebdddfd93622a89f74dee0987b5e42ef336a9f3a\": rpc error: code = NotFound desc = could not find container \"d22a01caee0a852891852796ebdddfd93622a89f74dee0987b5e42ef336a9f3a\": container with ID starting with d22a01caee0a852891852796ebdddfd93622a89f74dee0987b5e42ef336a9f3a not found: ID does not exist"
Sep 11 16:59:01.331360 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:01.331235    2581 scope.go:117] "RemoveContainer" containerID="d5dade54703e34e5aeeeb5e294ca3cb684ec24b160f5d9e2c10dc153fa39633f"
Sep 11 16:59:01.344537 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:01.344511    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-519b89-5975d8c99d-gkc5l"]
Sep 11 16:59:01.349228 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:01.349204    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-519b89-5975d8c99d-gkc5l"]
Sep 11 16:59:01.362031 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:01.361996    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-519b89-6bcccd5f7-hg97h"]
Sep 11 16:59:01.369046 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:01.369023    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-519b89-6bcccd5f7-hg97h"]
Sep 11 16:59:02.987482 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:02.987440    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bc4ae85-c58b-4502-ba2a-42d7770ea7a2" path="/var/lib/kubelet/pods/2bc4ae85-c58b-4502-ba2a-42d7770ea7a2/volumes"
Sep 11 16:59:02.987967 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:02.987946    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64caa8d0-d612-4876-ab10-fcc02e5de58b" path="/var/lib/kubelet/pods/64caa8d0-d612-4876-ab10-fcc02e5de58b/volumes"
Sep 11 16:59:05.977289 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:05.977256    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:59:24.820792 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:24.820755    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:59:42.851067 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:42.851034    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:59:43.957011 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:43.956977    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:59:48.817058 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:48.817029    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:59:50.301706 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:50.301674    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:59:54.340349 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:54.340257    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:59:56.494537 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:56.494501    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:59:56.568495 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:56.568461    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:59:56.806024 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:56.805921    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 16:59:57.283228 ip-10-0-140-192 kubenswrapper[2581]: I0911 16:59:57.283193    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 17:00:00.138014 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:00.137983    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ff7416-29819100-ft2k6"]
Sep 11 17:00:00.138383 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:00.138355    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62bb6f57-e59b-4176-830b-e8680c3abdee" containerName="payload-processing"
Sep 11 17:00:00.138383 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:00.138367    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="62bb6f57-e59b-4176-830b-e8680c3abdee" containerName="payload-processing"
Sep 11 17:00:00.138467 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:00.138383    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c134dff2-b0e4-474b-b86c-551b00cd6ba6" containerName="payload-pre-processing"
Sep 11 17:00:00.138467 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:00.138403    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c134dff2-b0e4-474b-b86c-551b00cd6ba6" containerName="payload-pre-processing"
Sep 11 17:00:00.138467 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:00.138412    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64caa8d0-d612-4876-ab10-fcc02e5de58b" containerName="payload-processing"
Sep 11 17:00:00.138467 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:00.138420    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="64caa8d0-d612-4876-ab10-fcc02e5de58b" containerName="payload-processing"
Sep 11 17:00:00.138467 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:00.138450    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bc4ae85-c58b-4502-ba2a-42d7770ea7a2" containerName="maas-api"
Sep 11 17:00:00.138467 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:00.138458    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bc4ae85-c58b-4502-ba2a-42d7770ea7a2" containerName="maas-api"
Sep 11 17:00:00.138752 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:00.138544    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="62bb6f57-e59b-4176-830b-e8680c3abdee" containerName="payload-processing"
Sep 11 17:00:00.138752 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:00.138558    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="64caa8d0-d612-4876-ab10-fcc02e5de58b" containerName="payload-processing"
Sep 11 17:00:00.138752 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:00.138568    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c134dff2-b0e4-474b-b86c-551b00cd6ba6" containerName="payload-pre-processing"
Sep 11 17:00:00.138752 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:00.138577    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bc4ae85-c58b-4502-ba2a-42d7770ea7a2" containerName="maas-api"
Sep 11 17:00:00.141810 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:00.141788    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-eb677c-29819100-lplp5"]
Sep 11 17:00:00.141922 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:00.141908    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ff7416-29819100-ft2k6"
Sep 11 17:00:00.144864 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:00.144838    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7xqmx\""
Sep 11 17:00:00.144995 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:00.144946    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-eb677c-29819100-lplp5"
Sep 11 17:00:00.152559 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:00.152536    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ff7416-29819100-ft2k6"]
Sep 11 17:00:00.154301 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:00.154153    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ff7416-29819100-ft2k6"
Sep 11 17:00:00.154902 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:00.154884    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-eb677c-29819100-lplp5"]
Sep 11 17:00:00.161377 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:00.161353    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-eb677c-29819100-lplp5"
Sep 11 17:00:00.434768 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:00.434741    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ff7416-29819100-ft2k6"]
Sep 11 17:00:00.436497 ip-10-0-140-192 kubenswrapper[2581]: W0911 17:00:00.436469    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9125af3_0d09_4c45_851e_6c922e97f28a.slice/crio-5a7b5e666d1cbf2e78fb6345992c3e4da3cecab07f8f3957f8d77c627414c7fd WatchSource:0}: Error finding container 5a7b5e666d1cbf2e78fb6345992c3e4da3cecab07f8f3957f8d77c627414c7fd: Status 404 returned error can't find the container with id 5a7b5e666d1cbf2e78fb6345992c3e4da3cecab07f8f3957f8d77c627414c7fd
Sep 11 17:00:00.448795 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:00.448774    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-eb677c-29819100-lplp5"]
Sep 11 17:00:00.450436 ip-10-0-140-192 kubenswrapper[2581]: W0911 17:00:00.450412    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc934fde_e662_4163_92af_df6e5b0125de.slice/crio-c32bcbf6025c45e276f9c9a2b8d39964617ddc322f1b2d91334b03f4d5a41c93 WatchSource:0}: Error finding container c32bcbf6025c45e276f9c9a2b8d39964617ddc322f1b2d91334b03f4d5a41c93: Status 404 returned error can't find the container with id c32bcbf6025c45e276f9c9a2b8d39964617ddc322f1b2d91334b03f4d5a41c93
Sep 11 17:00:00.616735 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:00.616699    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ff7416-29819100-ft2k6" event={"ID":"d9125af3-0d09-4c45-851e-6c922e97f28a","Type":"ContainerStarted","Data":"5a7b5e666d1cbf2e78fb6345992c3e4da3cecab07f8f3957f8d77c627414c7fd"}
Sep 11 17:00:00.617994 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:00.617965    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-eb677c-29819100-lplp5" event={"ID":"fc934fde-e662-4163-92af-df6e5b0125de","Type":"ContainerStarted","Data":"c32bcbf6025c45e276f9c9a2b8d39964617ddc322f1b2d91334b03f4d5a41c93"}
Sep 11 17:00:03.634562 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:03.634474    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ff7416-29819100-ft2k6" event={"ID":"d9125af3-0d09-4c45-851e-6c922e97f28a","Type":"ContainerStarted","Data":"7188ac42fefc76b18cffe0037d5138b5aafdbc04ef2972d3e05374af171727e8"}
Sep 11 17:00:03.636044 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:03.636021    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-eb677c-29819100-lplp5" event={"ID":"fc934fde-e662-4163-92af-df6e5b0125de","Type":"ContainerStarted","Data":"a1b504405896a4b6cc6be677eb7b9f81d0026468ad6ec5dcd021ed4531389098"}
Sep 11 17:00:03.654350 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:03.654298    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ff7416-29819100-ft2k6" podStartSLOduration=1.030184044 podStartE2EDuration="3.654285963s" totalImagesPullingTime="2.624101919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:00:03.653042155 +0000 UTC m=+1803.269799221" watchObservedRunningTime="2026-09-11 17:00:03.654285963 +0000 UTC m=+1803.271043028"
Sep 11 17:00:03.672075 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:03.672035    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-eb677c-29819100-lplp5" podStartSLOduration=1.058341519 podStartE2EDuration="3.672022832s" totalImagesPullingTime="2.613681313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:00:03.670541547 +0000 UTC m=+1803.287298631" watchObservedRunningTime="2026-09-11 17:00:03.672022832 +0000 UTC m=+1803.288779897"
Sep 11 17:00:04.642562 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:04.642529    2581 generic.go:356] "Generic (PLEG): container finished" podID="d9125af3-0d09-4c45-851e-6c922e97f28a" containerID="7188ac42fefc76b18cffe0037d5138b5aafdbc04ef2972d3e05374af171727e8" exitCode=0
Sep 11 17:00:04.642948 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:04.642607    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ff7416-29819100-ft2k6" event={"ID":"d9125af3-0d09-4c45-851e-6c922e97f28a","Type":"ContainerDied","Data":"7188ac42fefc76b18cffe0037d5138b5aafdbc04ef2972d3e05374af171727e8"}
Sep 11 17:00:04.644237 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:04.644214    2581 generic.go:356] "Generic (PLEG): container finished" podID="fc934fde-e662-4163-92af-df6e5b0125de" containerID="a1b504405896a4b6cc6be677eb7b9f81d0026468ad6ec5dcd021ed4531389098" exitCode=0
Sep 11 17:00:04.644342 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:04.644266    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-eb677c-29819100-lplp5" event={"ID":"fc934fde-e662-4163-92af-df6e5b0125de","Type":"ContainerDied","Data":"a1b504405896a4b6cc6be677eb7b9f81d0026468ad6ec5dcd021ed4531389098"}
Sep 11 17:00:05.787490 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:05.787464    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ff7416-29819100-ft2k6"
Sep 11 17:00:05.809345 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:05.809322    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-eb677c-29819100-lplp5"
Sep 11 17:00:06.655626 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:06.655588    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ff7416-29819100-ft2k6"
Sep 11 17:00:06.655802 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:06.655593    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ff7416-29819100-ft2k6" event={"ID":"d9125af3-0d09-4c45-851e-6c922e97f28a","Type":"ContainerDied","Data":"5a7b5e666d1cbf2e78fb6345992c3e4da3cecab07f8f3957f8d77c627414c7fd"}
Sep 11 17:00:06.655802 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:06.655763    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5a7b5e666d1cbf2e78fb6345992c3e4da3cecab07f8f3957f8d77c627414c7fd"
Sep 11 17:00:06.657026 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:06.657006    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-eb677c-29819100-lplp5"
Sep 11 17:00:06.657026 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:06.657011    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-eb677c-29819100-lplp5" event={"ID":"fc934fde-e662-4163-92af-df6e5b0125de","Type":"ContainerDied","Data":"c32bcbf6025c45e276f9c9a2b8d39964617ddc322f1b2d91334b03f4d5a41c93"}
Sep 11 17:00:06.657163 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:06.657052    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c32bcbf6025c45e276f9c9a2b8d39964617ddc322f1b2d91334b03f4d5a41c93"
Sep 11 17:00:07.828029 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:07.827993    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-eb677c-29819100-lplp5"]
Sep 11 17:00:07.828585 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:07.828345    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 17:00:07.830131 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:07.830081    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-eb677c-29819100-lplp5"]
Sep 11 17:00:07.857275 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:07.857235    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-eb677c-765cf67f99-fws52"]
Sep 11 17:00:07.857533 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:07.857490    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-eb677c-765cf67f99-fws52" podUID="40a81310-979c-4277-b5a8-be1735f689a4" containerName="payload-processing" containerID="cri-o://e5b1634c2d05481fc82df7028c9594480dc56ece5e5423bf7a68b949d954fba6" gracePeriod=30
Sep 11 17:00:07.928031 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:07.927995    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 17:00:08.027939 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:08.027911    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 17:00:08.106521 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:08.106498    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-eb677c-765cf67f99-fws52"
Sep 11 17:00:08.119490 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:08.119458    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 17:00:08.204350 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:08.204317    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 17:00:08.258453 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:08.258428    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7g6g\" (UniqueName: \"kubernetes.io/projected/40a81310-979c-4277-b5a8-be1735f689a4-kube-api-access-p7g6g\") pod \"40a81310-979c-4277-b5a8-be1735f689a4\" (UID: \"40a81310-979c-4277-b5a8-be1735f689a4\") "
Sep 11 17:00:08.258599 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:08.258485    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40a81310-979c-4277-b5a8-be1735f689a4-plugins-config-volume\") pod \"40a81310-979c-4277-b5a8-be1735f689a4\" (UID: \"40a81310-979c-4277-b5a8-be1735f689a4\") "
Sep 11 17:00:08.258889 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:08.258866    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40a81310-979c-4277-b5a8-be1735f689a4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "40a81310-979c-4277-b5a8-be1735f689a4" (UID: "40a81310-979c-4277-b5a8-be1735f689a4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:00:08.261379 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:08.261344    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40a81310-979c-4277-b5a8-be1735f689a4-kube-api-access-p7g6g" (OuterVolumeSpecName: "kube-api-access-p7g6g") pod "40a81310-979c-4277-b5a8-be1735f689a4" (UID: "40a81310-979c-4277-b5a8-be1735f689a4"). InnerVolumeSpecName "kube-api-access-p7g6g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:00:08.359839 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:08.359767    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7g6g\" (UniqueName: \"kubernetes.io/projected/40a81310-979c-4277-b5a8-be1735f689a4-kube-api-access-p7g6g\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 17:00:08.359839 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:08.359794    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40a81310-979c-4277-b5a8-be1735f689a4-plugins-config-volume\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 17:00:08.501389 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:08.501357    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 17:00:08.667847 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:08.667758    2581 generic.go:356] "Generic (PLEG): container finished" podID="40a81310-979c-4277-b5a8-be1735f689a4" containerID="e5b1634c2d05481fc82df7028c9594480dc56ece5e5423bf7a68b949d954fba6" exitCode=0
Sep 11 17:00:08.667847 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:08.667803    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-eb677c-765cf67f99-fws52"
Sep 11 17:00:08.668032 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:08.667805    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-eb677c-765cf67f99-fws52" event={"ID":"40a81310-979c-4277-b5a8-be1735f689a4","Type":"ContainerDied","Data":"e5b1634c2d05481fc82df7028c9594480dc56ece5e5423bf7a68b949d954fba6"}
Sep 11 17:00:08.668032 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:08.667929    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-eb677c-765cf67f99-fws52" event={"ID":"40a81310-979c-4277-b5a8-be1735f689a4","Type":"ContainerDied","Data":"9456efa7fcaa9182289f9f8f1b453036e9c59035fee85e898c0bc82adfbb8b54"}
Sep 11 17:00:08.668032 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:08.667956    2581 scope.go:117] "RemoveContainer" containerID="e5b1634c2d05481fc82df7028c9594480dc56ece5e5423bf7a68b949d954fba6"
Sep 11 17:00:08.677478 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:08.677462    2581 scope.go:117] "RemoveContainer" containerID="e5b1634c2d05481fc82df7028c9594480dc56ece5e5423bf7a68b949d954fba6"
Sep 11 17:00:08.677778 ip-10-0-140-192 kubenswrapper[2581]: E0911 17:00:08.677756    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5b1634c2d05481fc82df7028c9594480dc56ece5e5423bf7a68b949d954fba6\": container with ID starting with e5b1634c2d05481fc82df7028c9594480dc56ece5e5423bf7a68b949d954fba6 not found: ID does not exist" containerID="e5b1634c2d05481fc82df7028c9594480dc56ece5e5423bf7a68b949d954fba6"
Sep 11 17:00:08.677849 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:08.677786    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5b1634c2d05481fc82df7028c9594480dc56ece5e5423bf7a68b949d954fba6"} err="failed to get container status \"e5b1634c2d05481fc82df7028c9594480dc56ece5e5423bf7a68b949d954fba6\": rpc error: code = NotFound desc = could not find container \"e5b1634c2d05481fc82df7028c9594480dc56ece5e5423bf7a68b949d954fba6\": container with ID starting with e5b1634c2d05481fc82df7028c9594480dc56ece5e5423bf7a68b949d954fba6 not found: ID does not exist"
Sep 11 17:00:08.691265 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:08.691235    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-eb677c-765cf67f99-fws52"]
Sep 11 17:00:08.698501 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:08.698473    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-eb677c-765cf67f99-fws52"]
Sep 11 17:00:08.987297 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:08.987261    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40a81310-979c-4277-b5a8-be1735f689a4" path="/var/lib/kubelet/pods/40a81310-979c-4277-b5a8-be1735f689a4/volumes"
Sep 11 17:00:08.987676 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:08.987553    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc934fde-e662-4163-92af-df6e5b0125de" path="/var/lib/kubelet/pods/fc934fde-e662-4163-92af-df6e5b0125de/volumes"
Sep 11 17:00:14.927318 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:14.927284    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 17:00:15.002434 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:15.002393    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 17:00:15.260620 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:15.260589    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 17:00:15.716026 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:15.715997    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 17:00:26.263469 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:26.263435    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ff7416-6bcdb89b7c-s6fs9"]
Sep 11 17:00:26.263959 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:26.263714    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ff7416-6bcdb89b7c-s6fs9" podUID="9619fa9c-b818-4634-9d4f-6591dc6a328f" containerName="maas-api" containerID="cri-o://beec2db948cda1b74aef624f8f8d250d452fb7db7024a3dc05d3be4c4628388a" gracePeriod=30
Sep 11 17:00:26.293175 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:26.293145    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ff7416-29819100-ft2k6"]
Sep 11 17:00:26.294437 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:26.294393    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 17:00:26.296585 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:26.296559    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ff7416-29819100-ft2k6"]
Sep 11 17:00:26.375414 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:26.375382    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 17:00:26.446490 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:26.446463    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 17:00:26.510937 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:26.510906    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ff7416-6bcdb89b7c-s6fs9"
Sep 11 17:00:26.520910 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:26.520856    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lz7kz\" (UniqueName: \"kubernetes.io/projected/9619fa9c-b818-4634-9d4f-6591dc6a328f-kube-api-access-lz7kz\") pod \"9619fa9c-b818-4634-9d4f-6591dc6a328f\" (UID: \"9619fa9c-b818-4634-9d4f-6591dc6a328f\") "
Sep 11 17:00:26.520910 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:26.520903    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9619fa9c-b818-4634-9d4f-6591dc6a328f-metrics-certs\") pod \"9619fa9c-b818-4634-9d4f-6591dc6a328f\" (UID: \"9619fa9c-b818-4634-9d4f-6591dc6a328f\") "
Sep 11 17:00:26.521124 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:26.520920    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9619fa9c-b818-4634-9d4f-6591dc6a328f-openshift-service-ca\") pod \"9619fa9c-b818-4634-9d4f-6591dc6a328f\" (UID: \"9619fa9c-b818-4634-9d4f-6591dc6a328f\") "
Sep 11 17:00:26.521124 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:26.520936    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9619fa9c-b818-4634-9d4f-6591dc6a328f-maas-api-tls\") pod \"9619fa9c-b818-4634-9d4f-6591dc6a328f\" (UID: \"9619fa9c-b818-4634-9d4f-6591dc6a328f\") "
Sep 11 17:00:26.521275 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:26.521237    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9619fa9c-b818-4634-9d4f-6591dc6a328f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9619fa9c-b818-4634-9d4f-6591dc6a328f" (UID: "9619fa9c-b818-4634-9d4f-6591dc6a328f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:00:26.523167 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:26.523143    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9619fa9c-b818-4634-9d4f-6591dc6a328f-kube-api-access-lz7kz" (OuterVolumeSpecName: "kube-api-access-lz7kz") pod "9619fa9c-b818-4634-9d4f-6591dc6a328f" (UID: "9619fa9c-b818-4634-9d4f-6591dc6a328f"). InnerVolumeSpecName "kube-api-access-lz7kz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:00:26.523266 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:26.523241    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9619fa9c-b818-4634-9d4f-6591dc6a328f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9619fa9c-b818-4634-9d4f-6591dc6a328f" (UID: "9619fa9c-b818-4634-9d4f-6591dc6a328f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:00:26.523444 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:26.523424    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9619fa9c-b818-4634-9d4f-6591dc6a328f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9619fa9c-b818-4634-9d4f-6591dc6a328f" (UID: "9619fa9c-b818-4634-9d4f-6591dc6a328f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:00:26.540657 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:26.540595    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 17:00:26.610392 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:26.610359    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 17:00:26.621665 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:26.621640    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lz7kz\" (UniqueName: \"kubernetes.io/projected/9619fa9c-b818-4634-9d4f-6591dc6a328f-kube-api-access-lz7kz\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 17:00:26.621734 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:26.621665    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9619fa9c-b818-4634-9d4f-6591dc6a328f-metrics-certs\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 17:00:26.621734 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:26.621680    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9619fa9c-b818-4634-9d4f-6591dc6a328f-openshift-service-ca\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 17:00:26.621734 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:26.621690    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9619fa9c-b818-4634-9d4f-6591dc6a328f-maas-api-tls\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 17:00:26.756649 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:26.756611    2581 generic.go:356] "Generic (PLEG): container finished" podID="9619fa9c-b818-4634-9d4f-6591dc6a328f" containerID="beec2db948cda1b74aef624f8f8d250d452fb7db7024a3dc05d3be4c4628388a" exitCode=0
Sep 11 17:00:26.756649 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:26.756655    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ff7416-6bcdb89b7c-s6fs9"
Sep 11 17:00:26.756921 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:26.756698    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ff7416-6bcdb89b7c-s6fs9" event={"ID":"9619fa9c-b818-4634-9d4f-6591dc6a328f","Type":"ContainerDied","Data":"beec2db948cda1b74aef624f8f8d250d452fb7db7024a3dc05d3be4c4628388a"}
Sep 11 17:00:26.756921 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:26.756764    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ff7416-6bcdb89b7c-s6fs9" event={"ID":"9619fa9c-b818-4634-9d4f-6591dc6a328f","Type":"ContainerDied","Data":"f6c3f52f9318ddd81c6609856f72e1188f297fe5699b76717e7e440ff47bd751"}
Sep 11 17:00:26.756921 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:26.756797    2581 scope.go:117] "RemoveContainer" containerID="beec2db948cda1b74aef624f8f8d250d452fb7db7024a3dc05d3be4c4628388a"
Sep 11 17:00:26.766603 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:26.766580    2581 scope.go:117] "RemoveContainer" containerID="beec2db948cda1b74aef624f8f8d250d452fb7db7024a3dc05d3be4c4628388a"
Sep 11 17:00:26.766960 ip-10-0-140-192 kubenswrapper[2581]: E0911 17:00:26.766938    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"beec2db948cda1b74aef624f8f8d250d452fb7db7024a3dc05d3be4c4628388a\": container with ID starting with beec2db948cda1b74aef624f8f8d250d452fb7db7024a3dc05d3be4c4628388a not found: ID does not exist" containerID="beec2db948cda1b74aef624f8f8d250d452fb7db7024a3dc05d3be4c4628388a"
Sep 11 17:00:26.767031 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:26.766971    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"beec2db948cda1b74aef624f8f8d250d452fb7db7024a3dc05d3be4c4628388a"} err="failed to get container status \"beec2db948cda1b74aef624f8f8d250d452fb7db7024a3dc05d3be4c4628388a\": rpc error: code = NotFound desc = could not find container \"beec2db948cda1b74aef624f8f8d250d452fb7db7024a3dc05d3be4c4628388a\": container with ID starting with beec2db948cda1b74aef624f8f8d250d452fb7db7024a3dc05d3be4c4628388a not found: ID does not exist"
Sep 11 17:00:26.780034 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:26.779947    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ff7416-6bcdb89b7c-s6fs9"]
Sep 11 17:00:26.785040 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:26.785010    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ff7416-6bcdb89b7c-s6fs9"]
Sep 11 17:00:26.926754 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:26.926719    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 17:00:26.988462 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:26.988432    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9619fa9c-b818-4634-9d4f-6591dc6a328f" path="/var/lib/kubelet/pods/9619fa9c-b818-4634-9d4f-6591dc6a328f/volumes"
Sep 11 17:00:26.988716 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:26.988704    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9125af3-0d09-4c45-851e-6c922e97f28a" path="/var/lib/kubelet/pods/d9125af3-0d09-4c45-851e-6c922e97f28a/volumes"
Sep 11 17:00:33.328865 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:33.328833    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 17:00:33.427285 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:33.427256    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 17:00:33.609321 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:33.609248    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 17:00:34.098306 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:34.098274    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 17:00:44.573405 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:44.573376    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-ce902a-5c84787ff7-wh8rr"]
Sep 11 17:00:44.573882 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:44.573601    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ce902a-5c84787ff7-wh8rr" podUID="53b02782-f4d4-4751-af2d-61bf1144d2e3" containerName="payload-processing" containerID="cri-o://395c61baf5168c0b1fcb098893953fff129279965a7e50ca7d579d7fc3568720" gracePeriod=30
Sep 11 17:00:44.573882 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:44.573775    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 17:00:44.582848 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:44.582814    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-ce902a-677d9c78bb-2zw6g"]
Sep 11 17:00:44.583055 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:44.583014    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-ce902a-677d9c78bb-2zw6g" podUID="a9aad7de-775e-4b4d-b2d9-bf04e909f5f5" containerName="payload-pre-processing" containerID="cri-o://d95a2326bceca7b87f2b41acde4dae864d2584c58e15ed65a4fd8f2900dfe36c" gracePeriod=30
Sep 11 17:00:44.673674 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:44.673647    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 17:00:44.769802 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:44.769744    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 17:00:44.822971 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:44.822941    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ce902a-5c84787ff7-wh8rr"
Sep 11 17:00:44.839182 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:44.839076    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 17:00:44.845840 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:44.845811    2581 generic.go:356] "Generic (PLEG): container finished" podID="53b02782-f4d4-4751-af2d-61bf1144d2e3" containerID="395c61baf5168c0b1fcb098893953fff129279965a7e50ca7d579d7fc3568720" exitCode=0
Sep 11 17:00:44.846003 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:44.845865    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ce902a-5c84787ff7-wh8rr"
Sep 11 17:00:44.846003 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:44.845905    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ce902a-5c84787ff7-wh8rr" event={"ID":"53b02782-f4d4-4751-af2d-61bf1144d2e3","Type":"ContainerDied","Data":"395c61baf5168c0b1fcb098893953fff129279965a7e50ca7d579d7fc3568720"}
Sep 11 17:00:44.846003 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:44.845996    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ce902a-5c84787ff7-wh8rr" event={"ID":"53b02782-f4d4-4751-af2d-61bf1144d2e3","Type":"ContainerDied","Data":"7af96028093cc8a6af40766489c9e9cb1e8ccfb22e0de8695c07c2f56242b501"}
Sep 11 17:00:44.846268 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:44.846034    2581 scope.go:117] "RemoveContainer" containerID="395c61baf5168c0b1fcb098893953fff129279965a7e50ca7d579d7fc3568720"
Sep 11 17:00:44.848269 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:44.848232    2581 generic.go:356] "Generic (PLEG): container finished" podID="a9aad7de-775e-4b4d-b2d9-bf04e909f5f5" containerID="d95a2326bceca7b87f2b41acde4dae864d2584c58e15ed65a4fd8f2900dfe36c" exitCode=0
Sep 11 17:00:44.848386 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:44.848374    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-ce902a-677d9c78bb-2zw6g" event={"ID":"a9aad7de-775e-4b4d-b2d9-bf04e909f5f5","Type":"ContainerDied","Data":"d95a2326bceca7b87f2b41acde4dae864d2584c58e15ed65a4fd8f2900dfe36c"}
Sep 11 17:00:44.857943 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:44.857916    2581 scope.go:117] "RemoveContainer" containerID="395c61baf5168c0b1fcb098893953fff129279965a7e50ca7d579d7fc3568720"
Sep 11 17:00:44.858242 ip-10-0-140-192 kubenswrapper[2581]: E0911 17:00:44.858220    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"395c61baf5168c0b1fcb098893953fff129279965a7e50ca7d579d7fc3568720\": container with ID starting with 395c61baf5168c0b1fcb098893953fff129279965a7e50ca7d579d7fc3568720 not found: ID does not exist" containerID="395c61baf5168c0b1fcb098893953fff129279965a7e50ca7d579d7fc3568720"
Sep 11 17:00:44.858324 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:44.858251    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"395c61baf5168c0b1fcb098893953fff129279965a7e50ca7d579d7fc3568720"} err="failed to get container status \"395c61baf5168c0b1fcb098893953fff129279965a7e50ca7d579d7fc3568720\": rpc error: code = NotFound desc = could not find container \"395c61baf5168c0b1fcb098893953fff129279965a7e50ca7d579d7fc3568720\": container with ID starting with 395c61baf5168c0b1fcb098893953fff129279965a7e50ca7d579d7fc3568720 not found: ID does not exist"
Sep 11 17:00:44.861740 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:44.861717    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-ce902a-677d9c78bb-2zw6g"
Sep 11 17:00:44.885565 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:44.885530    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53b02782-f4d4-4751-af2d-61bf1144d2e3-plugins-config-volume\") pod \"53b02782-f4d4-4751-af2d-61bf1144d2e3\" (UID: \"53b02782-f4d4-4751-af2d-61bf1144d2e3\") "
Sep 11 17:00:44.885734 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:44.885585    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qcvj\" (UniqueName: \"kubernetes.io/projected/53b02782-f4d4-4751-af2d-61bf1144d2e3-kube-api-access-5qcvj\") pod \"53b02782-f4d4-4751-af2d-61bf1144d2e3\" (UID: \"53b02782-f4d4-4751-af2d-61bf1144d2e3\") "
Sep 11 17:00:44.885945 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:44.885919    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53b02782-f4d4-4751-af2d-61bf1144d2e3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "53b02782-f4d4-4751-af2d-61bf1144d2e3" (UID: "53b02782-f4d4-4751-af2d-61bf1144d2e3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:00:44.887941 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:44.887919    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53b02782-f4d4-4751-af2d-61bf1144d2e3-kube-api-access-5qcvj" (OuterVolumeSpecName: "kube-api-access-5qcvj") pod "53b02782-f4d4-4751-af2d-61bf1144d2e3" (UID: "53b02782-f4d4-4751-af2d-61bf1144d2e3"). InnerVolumeSpecName "kube-api-access-5qcvj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:00:44.986459 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:44.986429    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttgkt\" (UniqueName: \"kubernetes.io/projected/a9aad7de-775e-4b4d-b2d9-bf04e909f5f5-kube-api-access-ttgkt\") pod \"a9aad7de-775e-4b4d-b2d9-bf04e909f5f5\" (UID: \"a9aad7de-775e-4b4d-b2d9-bf04e909f5f5\") "
Sep 11 17:00:44.986682 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:44.986530    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9aad7de-775e-4b4d-b2d9-bf04e909f5f5-plugins-config-volume\") pod \"a9aad7de-775e-4b4d-b2d9-bf04e909f5f5\" (UID: \"a9aad7de-775e-4b4d-b2d9-bf04e909f5f5\") "
Sep 11 17:00:44.986768 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:44.986750    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53b02782-f4d4-4751-af2d-61bf1144d2e3-plugins-config-volume\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 17:00:44.986822 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:44.986773    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qcvj\" (UniqueName: \"kubernetes.io/projected/53b02782-f4d4-4751-af2d-61bf1144d2e3-kube-api-access-5qcvj\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 17:00:44.986880 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:44.986858    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9aad7de-775e-4b4d-b2d9-bf04e909f5f5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a9aad7de-775e-4b4d-b2d9-bf04e909f5f5" (UID: "a9aad7de-775e-4b4d-b2d9-bf04e909f5f5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:00:44.988653 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:44.988633    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9aad7de-775e-4b4d-b2d9-bf04e909f5f5-kube-api-access-ttgkt" (OuterVolumeSpecName: "kube-api-access-ttgkt") pod "a9aad7de-775e-4b4d-b2d9-bf04e909f5f5" (UID: "a9aad7de-775e-4b4d-b2d9-bf04e909f5f5"). InnerVolumeSpecName "kube-api-access-ttgkt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:00:45.087870 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:45.087814    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9aad7de-775e-4b4d-b2d9-bf04e909f5f5-plugins-config-volume\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 17:00:45.087870 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:45.087850    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttgkt\" (UniqueName: \"kubernetes.io/projected/a9aad7de-775e-4b4d-b2d9-bf04e909f5f5-kube-api-access-ttgkt\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 17:00:45.151387 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:45.151306    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 17:00:45.165833 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:45.165737    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-ce902a-5c84787ff7-wh8rr"]
Sep 11 17:00:45.167940 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:45.167910    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-ce902a-5c84787ff7-wh8rr"]
Sep 11 17:00:45.855666 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:45.855582    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-ce902a-677d9c78bb-2zw6g" event={"ID":"a9aad7de-775e-4b4d-b2d9-bf04e909f5f5","Type":"ContainerDied","Data":"d795d5f4fa1a4b70b84feb4d8b976738fd386f4ef980bd3ef11401c46821f7ac"}
Sep 11 17:00:45.855666 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:45.855615    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-ce902a-677d9c78bb-2zw6g"
Sep 11 17:00:45.855666 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:45.855651    2581 scope.go:117] "RemoveContainer" containerID="d95a2326bceca7b87f2b41acde4dae864d2584c58e15ed65a4fd8f2900dfe36c"
Sep 11 17:00:45.880336 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:45.880303    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-ce902a-677d9c78bb-2zw6g"]
Sep 11 17:00:45.886632 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:45.886600    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-ce902a-677d9c78bb-2zw6g"]
Sep 11 17:00:46.986983 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:46.986948    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53b02782-f4d4-4751-af2d-61bf1144d2e3" path="/var/lib/kubelet/pods/53b02782-f4d4-4751-af2d-61bf1144d2e3/volumes"
Sep 11 17:00:46.987393 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:46.987378    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9aad7de-775e-4b4d-b2d9-bf04e909f5f5" path="/var/lib/kubelet/pods/a9aad7de-775e-4b4d-b2d9-bf04e909f5f5/volumes"
Sep 11 17:00:51.740938 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:51.740900    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 17:00:51.840993 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:51.840941    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 17:00:52.013760 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:00:52.013678    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 17:01:19.623994 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:01:19.623952    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 17:02:05.709994 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:02:05.709960    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 17:02:05.810953 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:02:05.810920    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 17:02:16.673662 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:02:16.673628    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 17:02:17.769823 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:02:17.769786    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 17:02:19.333375 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:02:19.333338    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 17:03:27.902401 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:03:27.902322    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 17:03:28.004043 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:03:28.004002    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 17:03:38.316692 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:03:38.316643    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 17:05:15.172370 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:05:15.172336    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 17:05:21.047454 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:05:21.047425    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 17:05:45.973286 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:05:45.973245    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 17:05:47.055106 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:05:47.055060    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 17:06:06.417386 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:06.417352    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6b9dddc78b-9gwtx"]
Sep 11 17:06:06.419796 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:06.417675    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9aad7de-775e-4b4d-b2d9-bf04e909f5f5" containerName="payload-pre-processing"
Sep 11 17:06:06.419796 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:06.417685    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9aad7de-775e-4b4d-b2d9-bf04e909f5f5" containerName="payload-pre-processing"
Sep 11 17:06:06.419796 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:06.417695    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc934fde-e662-4163-92af-df6e5b0125de" containerName="cleanup"
Sep 11 17:06:06.419796 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:06.417701    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc934fde-e662-4163-92af-df6e5b0125de" containerName="cleanup"
Sep 11 17:06:06.419796 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:06.417707    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9125af3-0d09-4c45-851e-6c922e97f28a" containerName="cleanup"
Sep 11 17:06:06.419796 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:06.417712    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9125af3-0d09-4c45-851e-6c922e97f28a" containerName="cleanup"
Sep 11 17:06:06.419796 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:06.417722    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53b02782-f4d4-4751-af2d-61bf1144d2e3" containerName="payload-processing"
Sep 11 17:06:06.419796 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:06.417728    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="53b02782-f4d4-4751-af2d-61bf1144d2e3" containerName="payload-processing"
Sep 11 17:06:06.419796 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:06.417736    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40a81310-979c-4277-b5a8-be1735f689a4" containerName="payload-processing"
Sep 11 17:06:06.419796 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:06.417741    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="40a81310-979c-4277-b5a8-be1735f689a4" containerName="payload-processing"
Sep 11 17:06:06.419796 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:06.417753    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9619fa9c-b818-4634-9d4f-6591dc6a328f" containerName="maas-api"
Sep 11 17:06:06.419796 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:06.417758    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9619fa9c-b818-4634-9d4f-6591dc6a328f" containerName="maas-api"
Sep 11 17:06:06.419796 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:06.417805    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9aad7de-775e-4b4d-b2d9-bf04e909f5f5" containerName="payload-pre-processing"
Sep 11 17:06:06.419796 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:06.417814    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="40a81310-979c-4277-b5a8-be1735f689a4" containerName="payload-processing"
Sep 11 17:06:06.419796 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:06.417823    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9619fa9c-b818-4634-9d4f-6591dc6a328f" containerName="maas-api"
Sep 11 17:06:06.419796 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:06.417830    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="53b02782-f4d4-4751-af2d-61bf1144d2e3" containerName="payload-processing"
Sep 11 17:06:06.419796 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:06.417836    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc934fde-e662-4163-92af-df6e5b0125de" containerName="cleanup"
Sep 11 17:06:06.419796 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:06.417842    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9125af3-0d09-4c45-851e-6c922e97f28a" containerName="cleanup"
Sep 11 17:06:06.420591 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:06.420576    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b9dddc78b-9gwtx"
Sep 11 17:06:06.423563 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:06.423539    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 17:06:06.423563 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:06.423558    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 11 17:06:06.424758 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:06.424742    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 17:06:06.424851 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:06.424758    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 11 17:06:06.424851 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:06.424837    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kfp69\""
Sep 11 17:06:06.433565 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:06.433544    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b9dddc78b-9gwtx"]
Sep 11 17:06:06.464360 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:06.464326    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3638d498-fa31-42fb-abca-aa2dc1128241-openshift-service-ca\") pod \"maas-api-6b9dddc78b-9gwtx\" (UID: \"3638d498-fa31-42fb-abca-aa2dc1128241\") " pod="odh-ai-gateway-infra/maas-api-6b9dddc78b-9gwtx"
Sep 11 17:06:06.464482 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:06.464429    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3638d498-fa31-42fb-abca-aa2dc1128241-metrics-certs\") pod \"maas-api-6b9dddc78b-9gwtx\" (UID: \"3638d498-fa31-42fb-abca-aa2dc1128241\") " pod="odh-ai-gateway-infra/maas-api-6b9dddc78b-9gwtx"
Sep 11 17:06:06.464607 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:06.464507    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hzzs\" (UniqueName: \"kubernetes.io/projected/3638d498-fa31-42fb-abca-aa2dc1128241-kube-api-access-8hzzs\") pod \"maas-api-6b9dddc78b-9gwtx\" (UID: \"3638d498-fa31-42fb-abca-aa2dc1128241\") " pod="odh-ai-gateway-infra/maas-api-6b9dddc78b-9gwtx"
Sep 11 17:06:06.464607 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:06.464592    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3638d498-fa31-42fb-abca-aa2dc1128241-maas-api-tls\") pod \"maas-api-6b9dddc78b-9gwtx\" (UID: \"3638d498-fa31-42fb-abca-aa2dc1128241\") " pod="odh-ai-gateway-infra/maas-api-6b9dddc78b-9gwtx"
Sep 11 17:06:06.565896 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:06.565876    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hzzs\" (UniqueName: \"kubernetes.io/projected/3638d498-fa31-42fb-abca-aa2dc1128241-kube-api-access-8hzzs\") pod \"maas-api-6b9dddc78b-9gwtx\" (UID: \"3638d498-fa31-42fb-abca-aa2dc1128241\") " pod="odh-ai-gateway-infra/maas-api-6b9dddc78b-9gwtx"
Sep 11 17:06:06.565998 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:06.565931    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3638d498-fa31-42fb-abca-aa2dc1128241-maas-api-tls\") pod \"maas-api-6b9dddc78b-9gwtx\" (UID: \"3638d498-fa31-42fb-abca-aa2dc1128241\") " pod="odh-ai-gateway-infra/maas-api-6b9dddc78b-9gwtx"
Sep 11 17:06:06.566082 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:06.566063    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3638d498-fa31-42fb-abca-aa2dc1128241-openshift-service-ca\") pod \"maas-api-6b9dddc78b-9gwtx\" (UID: \"3638d498-fa31-42fb-abca-aa2dc1128241\") " pod="odh-ai-gateway-infra/maas-api-6b9dddc78b-9gwtx"
Sep 11 17:06:06.566183 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:06.566161    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3638d498-fa31-42fb-abca-aa2dc1128241-metrics-certs\") pod \"maas-api-6b9dddc78b-9gwtx\" (UID: \"3638d498-fa31-42fb-abca-aa2dc1128241\") " pod="odh-ai-gateway-infra/maas-api-6b9dddc78b-9gwtx"
Sep 11 17:06:06.566659 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:06.566642    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3638d498-fa31-42fb-abca-aa2dc1128241-openshift-service-ca\") pod \"maas-api-6b9dddc78b-9gwtx\" (UID: \"3638d498-fa31-42fb-abca-aa2dc1128241\") " pod="odh-ai-gateway-infra/maas-api-6b9dddc78b-9gwtx"
Sep 11 17:06:06.568483 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:06.568462    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3638d498-fa31-42fb-abca-aa2dc1128241-maas-api-tls\") pod \"maas-api-6b9dddc78b-9gwtx\" (UID: \"3638d498-fa31-42fb-abca-aa2dc1128241\") " pod="odh-ai-gateway-infra/maas-api-6b9dddc78b-9gwtx"
Sep 11 17:06:06.568561 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:06.568503    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3638d498-fa31-42fb-abca-aa2dc1128241-metrics-certs\") pod \"maas-api-6b9dddc78b-9gwtx\" (UID: \"3638d498-fa31-42fb-abca-aa2dc1128241\") " pod="odh-ai-gateway-infra/maas-api-6b9dddc78b-9gwtx"
Sep 11 17:06:06.575309 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:06.575285    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hzzs\" (UniqueName: \"kubernetes.io/projected/3638d498-fa31-42fb-abca-aa2dc1128241-kube-api-access-8hzzs\") pod \"maas-api-6b9dddc78b-9gwtx\" (UID: \"3638d498-fa31-42fb-abca-aa2dc1128241\") " pod="odh-ai-gateway-infra/maas-api-6b9dddc78b-9gwtx"
Sep 11 17:06:06.731211 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:06.731183    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b9dddc78b-9gwtx"
Sep 11 17:06:07.002922 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:07.002898    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b9dddc78b-9gwtx"]
Sep 11 17:06:07.004995 ip-10-0-140-192 kubenswrapper[2581]: W0911 17:06:07.004957    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3638d498_fa31_42fb_abca_aa2dc1128241.slice/crio-6df662ffb49d6d552604b1dd48702f954a17e2d7cf378b5a6ddccf75df0a5cac WatchSource:0}: Error finding container 6df662ffb49d6d552604b1dd48702f954a17e2d7cf378b5a6ddccf75df0a5cac: Status 404 returned error can't find the container with id 6df662ffb49d6d552604b1dd48702f954a17e2d7cf378b5a6ddccf75df0a5cac
Sep 11 17:06:07.006331 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:07.006313    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 17:06:07.326884 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:07.326813    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b9dddc78b-9gwtx" event={"ID":"3638d498-fa31-42fb-abca-aa2dc1128241","Type":"ContainerStarted","Data":"6df662ffb49d6d552604b1dd48702f954a17e2d7cf378b5a6ddccf75df0a5cac"}
Sep 11 17:06:08.333246 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:08.333208    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b9dddc78b-9gwtx" event={"ID":"3638d498-fa31-42fb-abca-aa2dc1128241","Type":"ContainerStarted","Data":"4756c7d699e64706f4c5ce5fd4fbe1863e7c16baeb2b50d3766e5fa4562ca615"}
Sep 11 17:06:08.333612 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:08.333336    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6b9dddc78b-9gwtx"
Sep 11 17:06:08.353506 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:08.353458    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6b9dddc78b-9gwtx" podStartSLOduration=1.869870623 podStartE2EDuration="2.353443956s" totalImagesPullingTime="483.573333ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:06:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:06:08.351513479 +0000 UTC m=+2167.968270557" watchObservedRunningTime="2026-09-11 17:06:08.353443956 +0000 UTC m=+2167.970201022"
Sep 11 17:06:13.957811 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:13.957778    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b9dddc78b-9gwtx"]
Sep 11 17:06:13.958182 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:13.957965    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-6b9dddc78b-9gwtx" podUID="3638d498-fa31-42fb-abca-aa2dc1128241" containerName="maas-api" containerID="cri-o://4756c7d699e64706f4c5ce5fd4fbe1863e7c16baeb2b50d3766e5fa4562ca615" gracePeriod=30
Sep 11 17:06:13.962800 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:13.962778    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6b9dddc78b-9gwtx"
Sep 11 17:06:14.006868 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:14.006839    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-dbdb6b6cd-s289b"]
Sep 11 17:06:14.010039 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:14.010022    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-dbdb6b6cd-s289b"
Sep 11 17:06:14.028238 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:14.028213    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-dbdb6b6cd-s289b"]
Sep 11 17:06:14.136612 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:14.136579    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/373aa771-6371-4aa6-ab02-a90766629fc3-openshift-service-ca\") pod \"maas-api-dbdb6b6cd-s289b\" (UID: \"373aa771-6371-4aa6-ab02-a90766629fc3\") " pod="odh-ai-gateway-infra/maas-api-dbdb6b6cd-s289b"
Sep 11 17:06:14.136762 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:14.136634    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/373aa771-6371-4aa6-ab02-a90766629fc3-maas-api-tls\") pod \"maas-api-dbdb6b6cd-s289b\" (UID: \"373aa771-6371-4aa6-ab02-a90766629fc3\") " pod="odh-ai-gateway-infra/maas-api-dbdb6b6cd-s289b"
Sep 11 17:06:14.136762 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:14.136740    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvvsf\" (UniqueName: \"kubernetes.io/projected/373aa771-6371-4aa6-ab02-a90766629fc3-kube-api-access-lvvsf\") pod \"maas-api-dbdb6b6cd-s289b\" (UID: \"373aa771-6371-4aa6-ab02-a90766629fc3\") " pod="odh-ai-gateway-infra/maas-api-dbdb6b6cd-s289b"
Sep 11 17:06:14.136849 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:14.136829    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/373aa771-6371-4aa6-ab02-a90766629fc3-metrics-certs\") pod \"maas-api-dbdb6b6cd-s289b\" (UID: \"373aa771-6371-4aa6-ab02-a90766629fc3\") " pod="odh-ai-gateway-infra/maas-api-dbdb6b6cd-s289b"
Sep 11 17:06:14.198652 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:14.198631    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b9dddc78b-9gwtx"
Sep 11 17:06:14.237704 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:14.237645    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/373aa771-6371-4aa6-ab02-a90766629fc3-maas-api-tls\") pod \"maas-api-dbdb6b6cd-s289b\" (UID: \"373aa771-6371-4aa6-ab02-a90766629fc3\") " pod="odh-ai-gateway-infra/maas-api-dbdb6b6cd-s289b"
Sep 11 17:06:14.237823 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:14.237710    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvvsf\" (UniqueName: \"kubernetes.io/projected/373aa771-6371-4aa6-ab02-a90766629fc3-kube-api-access-lvvsf\") pod \"maas-api-dbdb6b6cd-s289b\" (UID: \"373aa771-6371-4aa6-ab02-a90766629fc3\") " pod="odh-ai-gateway-infra/maas-api-dbdb6b6cd-s289b"
Sep 11 17:06:14.237823 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:14.237773    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/373aa771-6371-4aa6-ab02-a90766629fc3-metrics-certs\") pod \"maas-api-dbdb6b6cd-s289b\" (UID: \"373aa771-6371-4aa6-ab02-a90766629fc3\") " pod="odh-ai-gateway-infra/maas-api-dbdb6b6cd-s289b"
Sep 11 17:06:14.237907 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:14.237828    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/373aa771-6371-4aa6-ab02-a90766629fc3-openshift-service-ca\") pod \"maas-api-dbdb6b6cd-s289b\" (UID: \"373aa771-6371-4aa6-ab02-a90766629fc3\") " pod="odh-ai-gateway-infra/maas-api-dbdb6b6cd-s289b"
Sep 11 17:06:14.238627 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:14.238601    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/373aa771-6371-4aa6-ab02-a90766629fc3-openshift-service-ca\") pod \"maas-api-dbdb6b6cd-s289b\" (UID: \"373aa771-6371-4aa6-ab02-a90766629fc3\") " pod="odh-ai-gateway-infra/maas-api-dbdb6b6cd-s289b"
Sep 11 17:06:14.240210 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:14.240188    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/373aa771-6371-4aa6-ab02-a90766629fc3-metrics-certs\") pod \"maas-api-dbdb6b6cd-s289b\" (UID: \"373aa771-6371-4aa6-ab02-a90766629fc3\") " pod="odh-ai-gateway-infra/maas-api-dbdb6b6cd-s289b"
Sep 11 17:06:14.240382 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:14.240358    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/373aa771-6371-4aa6-ab02-a90766629fc3-maas-api-tls\") pod \"maas-api-dbdb6b6cd-s289b\" (UID: \"373aa771-6371-4aa6-ab02-a90766629fc3\") " pod="odh-ai-gateway-infra/maas-api-dbdb6b6cd-s289b"
Sep 11 17:06:14.247148 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:14.247127    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvvsf\" (UniqueName: \"kubernetes.io/projected/373aa771-6371-4aa6-ab02-a90766629fc3-kube-api-access-lvvsf\") pod \"maas-api-dbdb6b6cd-s289b\" (UID: \"373aa771-6371-4aa6-ab02-a90766629fc3\") " pod="odh-ai-gateway-infra/maas-api-dbdb6b6cd-s289b"
Sep 11 17:06:14.338836 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:14.338805    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-dbdb6b6cd-s289b"
Sep 11 17:06:14.338939 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:14.338833    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8hzzs\" (UniqueName: \"kubernetes.io/projected/3638d498-fa31-42fb-abca-aa2dc1128241-kube-api-access-8hzzs\") pod \"3638d498-fa31-42fb-abca-aa2dc1128241\" (UID: \"3638d498-fa31-42fb-abca-aa2dc1128241\") "
Sep 11 17:06:14.338939 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:14.338862    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3638d498-fa31-42fb-abca-aa2dc1128241-metrics-certs\") pod \"3638d498-fa31-42fb-abca-aa2dc1128241\" (UID: \"3638d498-fa31-42fb-abca-aa2dc1128241\") "
Sep 11 17:06:14.338939 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:14.338911    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3638d498-fa31-42fb-abca-aa2dc1128241-maas-api-tls\") pod \"3638d498-fa31-42fb-abca-aa2dc1128241\" (UID: \"3638d498-fa31-42fb-abca-aa2dc1128241\") "
Sep 11 17:06:14.339082 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:14.338955    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3638d498-fa31-42fb-abca-aa2dc1128241-openshift-service-ca\") pod \"3638d498-fa31-42fb-abca-aa2dc1128241\" (UID: \"3638d498-fa31-42fb-abca-aa2dc1128241\") "
Sep 11 17:06:14.339339 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:14.339312    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3638d498-fa31-42fb-abca-aa2dc1128241-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3638d498-fa31-42fb-abca-aa2dc1128241" (UID: "3638d498-fa31-42fb-abca-aa2dc1128241"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:06:14.340884 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:14.340863    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3638d498-fa31-42fb-abca-aa2dc1128241-kube-api-access-8hzzs" (OuterVolumeSpecName: "kube-api-access-8hzzs") pod "3638d498-fa31-42fb-abca-aa2dc1128241" (UID: "3638d498-fa31-42fb-abca-aa2dc1128241"). InnerVolumeSpecName "kube-api-access-8hzzs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:06:14.340958 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:14.340944    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3638d498-fa31-42fb-abca-aa2dc1128241-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3638d498-fa31-42fb-abca-aa2dc1128241" (UID: "3638d498-fa31-42fb-abca-aa2dc1128241"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:06:14.341042 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:14.341022    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3638d498-fa31-42fb-abca-aa2dc1128241-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3638d498-fa31-42fb-abca-aa2dc1128241" (UID: "3638d498-fa31-42fb-abca-aa2dc1128241"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:06:14.364819 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:14.364781    2581 generic.go:356] "Generic (PLEG): container finished" podID="3638d498-fa31-42fb-abca-aa2dc1128241" containerID="4756c7d699e64706f4c5ce5fd4fbe1863e7c16baeb2b50d3766e5fa4562ca615" exitCode=0
Sep 11 17:06:14.364937 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:14.364833    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b9dddc78b-9gwtx" event={"ID":"3638d498-fa31-42fb-abca-aa2dc1128241","Type":"ContainerDied","Data":"4756c7d699e64706f4c5ce5fd4fbe1863e7c16baeb2b50d3766e5fa4562ca615"}
Sep 11 17:06:14.365006 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:14.364974    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b9dddc78b-9gwtx" event={"ID":"3638d498-fa31-42fb-abca-aa2dc1128241","Type":"ContainerDied","Data":"6df662ffb49d6d552604b1dd48702f954a17e2d7cf378b5a6ddccf75df0a5cac"}
Sep 11 17:06:14.365061 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:14.365012    2581 scope.go:117] "RemoveContainer" containerID="4756c7d699e64706f4c5ce5fd4fbe1863e7c16baeb2b50d3766e5fa4562ca615"
Sep 11 17:06:14.365182 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:14.364960    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b9dddc78b-9gwtx"
Sep 11 17:06:14.375793 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:14.375776    2581 scope.go:117] "RemoveContainer" containerID="4756c7d699e64706f4c5ce5fd4fbe1863e7c16baeb2b50d3766e5fa4562ca615"
Sep 11 17:06:14.376132 ip-10-0-140-192 kubenswrapper[2581]: E0911 17:06:14.376082    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4756c7d699e64706f4c5ce5fd4fbe1863e7c16baeb2b50d3766e5fa4562ca615\": container with ID starting with 4756c7d699e64706f4c5ce5fd4fbe1863e7c16baeb2b50d3766e5fa4562ca615 not found: ID does not exist" containerID="4756c7d699e64706f4c5ce5fd4fbe1863e7c16baeb2b50d3766e5fa4562ca615"
Sep 11 17:06:14.376230 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:14.376142    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4756c7d699e64706f4c5ce5fd4fbe1863e7c16baeb2b50d3766e5fa4562ca615"} err="failed to get container status \"4756c7d699e64706f4c5ce5fd4fbe1863e7c16baeb2b50d3766e5fa4562ca615\": rpc error: code = NotFound desc = could not find container \"4756c7d699e64706f4c5ce5fd4fbe1863e7c16baeb2b50d3766e5fa4562ca615\": container with ID starting with 4756c7d699e64706f4c5ce5fd4fbe1863e7c16baeb2b50d3766e5fa4562ca615 not found: ID does not exist"
Sep 11 17:06:14.398526 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:14.398499    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b9dddc78b-9gwtx"]
Sep 11 17:06:14.413242 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:14.413214    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b9dddc78b-9gwtx"]
Sep 11 17:06:14.440436 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:14.440415    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3638d498-fa31-42fb-abca-aa2dc1128241-openshift-service-ca\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 17:06:14.440529 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:14.440437    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hzzs\" (UniqueName: \"kubernetes.io/projected/3638d498-fa31-42fb-abca-aa2dc1128241-kube-api-access-8hzzs\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 17:06:14.440529 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:14.440449    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3638d498-fa31-42fb-abca-aa2dc1128241-metrics-certs\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 17:06:14.440529 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:14.440458    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3638d498-fa31-42fb-abca-aa2dc1128241-maas-api-tls\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 11 17:06:14.612906 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:14.612879    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-dbdb6b6cd-s289b"]
Sep 11 17:06:14.614249 ip-10-0-140-192 kubenswrapper[2581]: W0911 17:06:14.614223    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod373aa771_6371_4aa6_ab02_a90766629fc3.slice/crio-db34696d509cdcd3964ddbfa65adecb4692281024def6141ad272a52b2d46164 WatchSource:0}: Error finding container db34696d509cdcd3964ddbfa65adecb4692281024def6141ad272a52b2d46164: Status 404 returned error can't find the container with id db34696d509cdcd3964ddbfa65adecb4692281024def6141ad272a52b2d46164
Sep 11 17:06:14.987446 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:14.987421    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3638d498-fa31-42fb-abca-aa2dc1128241" path="/var/lib/kubelet/pods/3638d498-fa31-42fb-abca-aa2dc1128241/volumes"
Sep 11 17:06:15.373143 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:15.373049    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-dbdb6b6cd-s289b" event={"ID":"373aa771-6371-4aa6-ab02-a90766629fc3","Type":"ContainerStarted","Data":"bf46a2b232b37cfe869ad4237dbb983fe86dda5d049026958c6e178371f80ca7"}
Sep 11 17:06:15.373143 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:15.373119    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-dbdb6b6cd-s289b" event={"ID":"373aa771-6371-4aa6-ab02-a90766629fc3","Type":"ContainerStarted","Data":"db34696d509cdcd3964ddbfa65adecb4692281024def6141ad272a52b2d46164"}
Sep 11 17:06:15.373373 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:15.373208    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-dbdb6b6cd-s289b"
Sep 11 17:06:15.392062 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:15.392021    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-dbdb6b6cd-s289b" podStartSLOduration=2.0370030630000002 podStartE2EDuration="2.392004138s" totalImagesPullingTime="355.001075ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:06:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:06:15.390632856 +0000 UTC m=+2175.007389942" watchObservedRunningTime="2026-09-11 17:06:15.392004138 +0000 UTC m=+2175.008761205"
Sep 11 17:06:21.383163 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:21.383132    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-dbdb6b6cd-s289b"
Sep 11 17:06:43.314254 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:43.314204    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-665d69bffd-cgl5h_90cc4dbc-457c-4926-ac97-3ff3803f941e/manager/0.log"
Sep 11 17:06:43.321697 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:43.321677    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-665d69bffd-cgl5h_90cc4dbc-457c-4926-ac97-3ff3803f941e/copy-manifests/0.log"
Sep 11 17:06:43.919568 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:43.919527    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-dbdb6b6cd-s289b_373aa771-6371-4aa6-ab02-a90766629fc3/maas-api/0.log"
Sep 11 17:06:46.196652 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:46.196620    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-s5xm5_eb0ca823-78c9-4bd5-873d-3ba791e02fdc/discovery/0.log"
Sep 11 17:06:46.308394 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:46.308366    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d87f6b9bb-2jpvk_c796fb9f-e246-4980-97b1-da83ad477c1f/kube-auth-proxy/0.log"
Sep 11 17:06:46.920856 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:46.920828    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-fbfb97c5b-bzcrd_b5b8288f-0e0e-430e-b78d-d4d9b565ad4b/router/0.log"
Sep 11 17:06:47.859140 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:47.859107    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-2sxz7_c1febd99-c9df-4c7f-813c-9747b1b7b424/main/0.log"
Sep 11 17:06:53.593269 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:53.593223    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 17:06:55.379277 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:55.379241    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 17:06:56.761526 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:56.761495    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xkz2b_e52d92c8-b840-42dd-9e4b-ea9f196e7623/global-pull-secret-syncer/0.log"
Sep 11 17:06:56.830740 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:56.830709    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log"
Sep 11 17:06:57.027140 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:06:57.027013    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-192.ec2.internal_c12b764bd8b3cb219479257da5703361/haproxy/0.log"
Sep 11 17:07:00.926068 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:00.926033    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ws5_d6754d1f-d663-4e69-aad4-a0c1523b1559/konnectivity-agent/0.log" limit=1024
Sep 11 17:07:01.168972 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:01.168885    2581 scope.go:117] "RemoveContainer" containerID="a1b504405896a4b6cc6be677eb7b9f81d0026468ad6ec5dcd021ed4531389098"
Sep 11 17:07:01.176913 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:01.176893    2581 scope.go:117] "RemoveContainer" containerID="7188ac42fefc76b18cffe0037d5138b5aafdbc04ef2972d3e05374af171727e8"
Sep 11 17:07:03.667788 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:03.667743    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-vckn9_6599cc8f-4bf4-402f-941b-86ae7d47633b/cluster-monitoring-operator/0.log"
Sep 11 17:07:03.698057 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:03.698036    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-4m2kg_1ab259bc-8df8-4940-93cc-16929031ec96/kube-state-metrics/0.log"
Sep 11 17:07:03.724527 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:03.724505    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-4m2kg_1ab259bc-8df8-4940-93cc-16929031ec96/kube-rbac-proxy-main/0.log"
Sep 11 17:07:03.759543 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:03.759524    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-4m2kg_1ab259bc-8df8-4940-93cc-16929031ec96/kube-rbac-proxy-self/0.log"
Sep 11 17:07:03.979579 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:03.979511    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bf9nx_655288ef-fded-482e-b887-f4426090b444/node-exporter/0.log"
Sep 11 17:07:04.009756 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:04.009737    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bf9nx_655288ef-fded-482e-b887-f4426090b444/kube-rbac-proxy/0.log"
Sep 11 17:07:04.038400 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:04.038381    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bf9nx_655288ef-fded-482e-b887-f4426090b444/init-textfile/0.log"
Sep 11 17:07:04.168411 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:04.168380    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-27xkj_ed1a5e93-70d7-4e4a-86fd-3bb38c5dcdb8/kube-rbac-proxy-main/0.log"
Sep 11 17:07:04.196901 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:04.196883    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-27xkj_ed1a5e93-70d7-4e4a-86fd-3bb38c5dcdb8/kube-rbac-proxy-self/0.log"
Sep 11 17:07:04.227619 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:04.227594    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-27xkj_ed1a5e93-70d7-4e4a-86fd-3bb38c5dcdb8/openshift-state-metrics/0.log"
Sep 11 17:07:04.282871 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:04.282813    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_75bc9382-5461-4180-b8fa-a6ae3a336994/prometheus/0.log"
Sep 11 17:07:04.314480 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:04.314462    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_75bc9382-5461-4180-b8fa-a6ae3a336994/config-reloader/0.log"
Sep 11 17:07:04.345677 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:04.345655    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_75bc9382-5461-4180-b8fa-a6ae3a336994/thanos-sidecar/0.log"
Sep 11 17:07:04.374383 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:04.374366    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_75bc9382-5461-4180-b8fa-a6ae3a336994/kube-rbac-proxy-web/0.log"
Sep 11 17:07:04.402740 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:04.402718    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_75bc9382-5461-4180-b8fa-a6ae3a336994/kube-rbac-proxy/0.log"
Sep 11 17:07:04.431765 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:04.431745    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_75bc9382-5461-4180-b8fa-a6ae3a336994/kube-rbac-proxy-thanos/0.log"
Sep 11 17:07:04.464955 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:04.464938    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_75bc9382-5461-4180-b8fa-a6ae3a336994/init-config-reloader/0.log"
Sep 11 17:07:04.573128 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:04.573056    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-bbkt6_5218d2f0-919d-4d59-9596-25a64fcff283/prometheus-operator-admission-webhook/0.log"
Sep 11 17:07:04.712888 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:04.712866    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67d77dc547-r72tq_266e29d6-e342-434b-aec9-d4ce4240507d/thanos-query/0.log"
Sep 11 17:07:04.741650 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:04.741630    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67d77dc547-r72tq_266e29d6-e342-434b-aec9-d4ce4240507d/kube-rbac-proxy-web/0.log"
Sep 11 17:07:04.771064 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:04.771043    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67d77dc547-r72tq_266e29d6-e342-434b-aec9-d4ce4240507d/kube-rbac-proxy/0.log"
Sep 11 17:07:04.798375 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:04.798352    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67d77dc547-r72tq_266e29d6-e342-434b-aec9-d4ce4240507d/prom-label-proxy/0.log"
Sep 11 17:07:04.827611 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:04.827560    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67d77dc547-r72tq_266e29d6-e342-434b-aec9-d4ce4240507d/kube-rbac-proxy-rules/0.log"
Sep 11 17:07:04.856371 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:04.856351    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67d77dc547-r72tq_266e29d6-e342-434b-aec9-d4ce4240507d/kube-rbac-proxy-metrics/0.log"
Sep 11 17:07:06.093899 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:06.093871    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-4wgq4_27d75414-6608-4c7f-909d-35914483d31b/networking-console-plugin/0.log"
Sep 11 17:07:06.282991 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:06.282956    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-df522/perf-node-gather-daemonset-4659v"]
Sep 11 17:07:06.283350 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:06.283337    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3638d498-fa31-42fb-abca-aa2dc1128241" containerName="maas-api"
Sep 11 17:07:06.283401 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:06.283352    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3638d498-fa31-42fb-abca-aa2dc1128241" containerName="maas-api"
Sep 11 17:07:06.283437 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:06.283414    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3638d498-fa31-42fb-abca-aa2dc1128241" containerName="maas-api"
Sep 11 17:07:06.285614 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:06.285595    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-df522/perf-node-gather-daemonset-4659v"
Sep 11 17:07:06.288320 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:06.288296    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-df522\"/\"kube-root-ca.crt\""
Sep 11 17:07:06.288420 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:06.288336    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-df522\"/\"openshift-service-ca.crt\""
Sep 11 17:07:06.289407 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:06.289391    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-df522\"/\"default-dockercfg-m8sb2\""
Sep 11 17:07:06.294354 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:06.294335    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-df522/perf-node-gather-daemonset-4659v"]
Sep 11 17:07:06.367353 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:06.367277    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/537dfd76-96b6-44ab-85f9-57179a0ca5d6-podres\") pod \"perf-node-gather-daemonset-4659v\" (UID: \"537dfd76-96b6-44ab-85f9-57179a0ca5d6\") " pod="openshift-must-gather-df522/perf-node-gather-daemonset-4659v"
Sep 11 17:07:06.367353 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:06.367325    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/537dfd76-96b6-44ab-85f9-57179a0ca5d6-lib-modules\") pod \"perf-node-gather-daemonset-4659v\" (UID: \"537dfd76-96b6-44ab-85f9-57179a0ca5d6\") " pod="openshift-must-gather-df522/perf-node-gather-daemonset-4659v"
Sep 11 17:07:06.367353 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:06.367350    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56pkj\" (UniqueName: \"kubernetes.io/projected/537dfd76-96b6-44ab-85f9-57179a0ca5d6-kube-api-access-56pkj\") pod \"perf-node-gather-daemonset-4659v\" (UID: \"537dfd76-96b6-44ab-85f9-57179a0ca5d6\") " pod="openshift-must-gather-df522/perf-node-gather-daemonset-4659v"
Sep 11 17:07:06.367556 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:06.367401    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/537dfd76-96b6-44ab-85f9-57179a0ca5d6-proc\") pod \"perf-node-gather-daemonset-4659v\" (UID: \"537dfd76-96b6-44ab-85f9-57179a0ca5d6\") " pod="openshift-must-gather-df522/perf-node-gather-daemonset-4659v"
Sep 11 17:07:06.367556 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:06.367449    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/537dfd76-96b6-44ab-85f9-57179a0ca5d6-sys\") pod \"perf-node-gather-daemonset-4659v\" (UID: \"537dfd76-96b6-44ab-85f9-57179a0ca5d6\") " pod="openshift-must-gather-df522/perf-node-gather-daemonset-4659v"
Sep 11 17:07:06.468807 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:06.468767    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/537dfd76-96b6-44ab-85f9-57179a0ca5d6-proc\") pod \"perf-node-gather-daemonset-4659v\" (UID: \"537dfd76-96b6-44ab-85f9-57179a0ca5d6\") " pod="openshift-must-gather-df522/perf-node-gather-daemonset-4659v"
Sep 11 17:07:06.468990 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:06.468836    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/537dfd76-96b6-44ab-85f9-57179a0ca5d6-sys\") pod \"perf-node-gather-daemonset-4659v\" (UID: \"537dfd76-96b6-44ab-85f9-57179a0ca5d6\") " pod="openshift-must-gather-df522/perf-node-gather-daemonset-4659v"
Sep 11 17:07:06.468990 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:06.468883    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/537dfd76-96b6-44ab-85f9-57179a0ca5d6-podres\") pod \"perf-node-gather-daemonset-4659v\" (UID: \"537dfd76-96b6-44ab-85f9-57179a0ca5d6\") " pod="openshift-must-gather-df522/perf-node-gather-daemonset-4659v"
Sep 11 17:07:06.468990 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:06.468902    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/537dfd76-96b6-44ab-85f9-57179a0ca5d6-proc\") pod \"perf-node-gather-daemonset-4659v\" (UID: \"537dfd76-96b6-44ab-85f9-57179a0ca5d6\") " pod="openshift-must-gather-df522/perf-node-gather-daemonset-4659v"
Sep 11 17:07:06.468990 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:06.468935    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/537dfd76-96b6-44ab-85f9-57179a0ca5d6-lib-modules\") pod \"perf-node-gather-daemonset-4659v\" (UID: \"537dfd76-96b6-44ab-85f9-57179a0ca5d6\") " pod="openshift-must-gather-df522/perf-node-gather-daemonset-4659v"
Sep 11 17:07:06.468990 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:06.468970    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56pkj\" (UniqueName: \"kubernetes.io/projected/537dfd76-96b6-44ab-85f9-57179a0ca5d6-kube-api-access-56pkj\") pod \"perf-node-gather-daemonset-4659v\" (UID: \"537dfd76-96b6-44ab-85f9-57179a0ca5d6\") " pod="openshift-must-gather-df522/perf-node-gather-daemonset-4659v"
Sep 11 17:07:06.469203 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:06.469043    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/537dfd76-96b6-44ab-85f9-57179a0ca5d6-sys\") pod \"perf-node-gather-daemonset-4659v\" (UID: \"537dfd76-96b6-44ab-85f9-57179a0ca5d6\") " pod="openshift-must-gather-df522/perf-node-gather-daemonset-4659v"
Sep 11 17:07:06.469203 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:06.469119    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/537dfd76-96b6-44ab-85f9-57179a0ca5d6-podres\") pod \"perf-node-gather-daemonset-4659v\" (UID: \"537dfd76-96b6-44ab-85f9-57179a0ca5d6\") " pod="openshift-must-gather-df522/perf-node-gather-daemonset-4659v"
Sep 11 17:07:06.469203 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:06.469124    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/537dfd76-96b6-44ab-85f9-57179a0ca5d6-lib-modules\") pod \"perf-node-gather-daemonset-4659v\" (UID: \"537dfd76-96b6-44ab-85f9-57179a0ca5d6\") " pod="openshift-must-gather-df522/perf-node-gather-daemonset-4659v"
Sep 11 17:07:06.479940 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:06.479904    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56pkj\" (UniqueName: \"kubernetes.io/projected/537dfd76-96b6-44ab-85f9-57179a0ca5d6-kube-api-access-56pkj\") pod \"perf-node-gather-daemonset-4659v\" (UID: \"537dfd76-96b6-44ab-85f9-57179a0ca5d6\") " pod="openshift-must-gather-df522/perf-node-gather-daemonset-4659v"
Sep 11 17:07:06.595571 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:06.595537    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-df522/perf-node-gather-daemonset-4659v"
Sep 11 17:07:06.867716 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:06.867681    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-df522/perf-node-gather-daemonset-4659v"]
Sep 11 17:07:06.869414 ip-10-0-140-192 kubenswrapper[2581]: W0911 17:07:06.869381    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod537dfd76_96b6_44ab_85f9_57179a0ca5d6.slice/crio-884614b1c3b85a201a9ea23db76a266b7c25f48e02e3ae0b2f86e2bacb07edc9 WatchSource:0}: Error finding container 884614b1c3b85a201a9ea23db76a266b7c25f48e02e3ae0b2f86e2bacb07edc9: Status 404 returned error can't find the container with id 884614b1c3b85a201a9ea23db76a266b7c25f48e02e3ae0b2f86e2bacb07edc9
Sep 11 17:07:07.412405 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:07.412371    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-w7cgp_7ac41677-2158-4c4b-98f0-af93b7524e0d/download-server/0.log"
Sep 11 17:07:07.614924 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:07.614881    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-df522/perf-node-gather-daemonset-4659v" event={"ID":"537dfd76-96b6-44ab-85f9-57179a0ca5d6","Type":"ContainerStarted","Data":"66bc6b6815a2e2f3722edb88c76333a7695a7698d0a961fb477e9dbb4e463be1"}
Sep 11 17:07:07.614924 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:07.614932    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-df522/perf-node-gather-daemonset-4659v" event={"ID":"537dfd76-96b6-44ab-85f9-57179a0ca5d6","Type":"ContainerStarted","Data":"884614b1c3b85a201a9ea23db76a266b7c25f48e02e3ae0b2f86e2bacb07edc9"}
Sep 11 17:07:07.615213 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:07.614967    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-df522/perf-node-gather-daemonset-4659v"
Sep 11 17:07:07.634423 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:07.634374    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-df522/perf-node-gather-daemonset-4659v" podStartSLOduration=1.634358362 podStartE2EDuration="1.634358362s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 17:07:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:07:07.632010546 +0000 UTC m=+2227.248767613" watchObservedRunningTime="2026-09-11 17:07:07.634358362 +0000 UTC m=+2227.251115429"
Sep 11 17:07:09.371813 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:09.371786    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nt2jf_ea2d453f-d6ae-437a-a922-140017dedf14/dns/0.log"
Sep 11 17:07:09.399308 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:09.399281    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nt2jf_ea2d453f-d6ae-437a-a922-140017dedf14/kube-rbac-proxy/0.log"
Sep 11 17:07:09.524659 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:09.524633    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nk4fp_41863045-9930-4c6f-a9a4-cb77f319ed93/dns-node-resolver/0.log"
Sep 11 17:07:10.240743 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:10.240711    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xsfcb_69e5eae6-9a55-49ac-a01c-70cbadab5acd/node-ca/0.log"
Sep 11 17:07:11.440592 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:11.440556    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-s5xm5_eb0ca823-78c9-4bd5-873d-3ba791e02fdc/discovery/0.log"
Sep 11 17:07:11.465429 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:11.465406    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d87f6b9bb-2jpvk_c796fb9f-e246-4980-97b1-da83ad477c1f/kube-auth-proxy/0.log"
Sep 11 17:07:11.696064 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:11.695990    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-fbfb97c5b-bzcrd_b5b8288f-0e0e-430e-b78d-d4d9b565ad4b/router/0.log"
Sep 11 17:07:12.722840 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:12.722805    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jwnrd_2e231c84-f297-44d1-bb39-b4cbea4c48b5/serve-healthcheck-canary/0.log"
Sep 11 17:07:13.228041 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:13.228006    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-h2rkv_4ac113fb-7b10-4927-87e6-a28c635d5f3c/insights-operator/0.log"
Sep 11 17:07:13.228886 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:13.228867    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-h2rkv_4ac113fb-7b10-4927-87e6-a28c635d5f3c/insights-operator/1.log"
Sep 11 17:07:13.256001 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:13.255983    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2bzlp_41052c18-7556-4976-9d93-c504e6dbfb2c/kube-rbac-proxy/0.log"
Sep 11 17:07:13.283195 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:13.283174    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2bzlp_41052c18-7556-4976-9d93-c504e6dbfb2c/exporter/0.log"
Sep 11 17:07:13.312864 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:13.312846    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2bzlp_41052c18-7556-4976-9d93-c504e6dbfb2c/extractor/0.log"
Sep 11 17:07:13.629477 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:13.629417    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-df522/perf-node-gather-daemonset-4659v"
Sep 11 17:07:16.906789 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:16.906764    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-665d69bffd-cgl5h_90cc4dbc-457c-4926-ac97-3ff3803f941e/manager/0.log"
Sep 11 17:07:16.935018 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:16.934997    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-665d69bffd-cgl5h_90cc4dbc-457c-4926-ac97-3ff3803f941e/copy-manifests/0.log"
Sep 11 17:07:17.232669 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:17.232639    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-s5xm5_eb0ca823-78c9-4bd5-873d-3ba791e02fdc/discovery/0.log"
Sep 11 17:07:17.250792 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:17.250769    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d87f6b9bb-2jpvk_c796fb9f-e246-4980-97b1-da83ad477c1f/kube-auth-proxy/0.log"
Sep 11 17:07:17.452571 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:17.452539    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-fbfb97c5b-bzcrd_b5b8288f-0e0e-430e-b78d-d4d9b565ad4b/router/0.log"
Sep 11 17:07:18.449940 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:18.449908    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5bd998d9c-pxjl2_178b8fe3-4bf4-4532-9141-2267293535af/manager/0.log"
Sep 11 17:07:19.136290 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:19.136260    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-s5xm5_eb0ca823-78c9-4bd5-873d-3ba791e02fdc/discovery/0.log"
Sep 11 17:07:19.151303 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:19.151283    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d87f6b9bb-2jpvk_c796fb9f-e246-4980-97b1-da83ad477c1f/kube-auth-proxy/0.log"
Sep 11 17:07:19.343417 ip-10-0-140-192 kubenswrapper[2581]: I0911 17:07:19.343384    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-fbfb97c5b-bzcrd_b5b8288f-0e0e-430e-b78d-d4d9b565ad4b/router/0.log"