Sep 09 06:51:05.043048 ip-10-0-132-176 systemd[1]: Starting Kubernetes Kubelet...
Sep 09 06:51:05.497796 ip-10-0-132-176 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 06:51:05.497796 ip-10-0-132-176 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 09 06:51:05.497796 ip-10-0-132-176 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 06:51:05.497796 ip-10-0-132-176 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 09 06:51:05.497796 ip-10-0-132-176 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 06:51:05.498427 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.497853    2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 09 06:51:05.501623 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501608    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 06:51:05.501623 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501624    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 06:51:05.501695 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501628    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 06:51:05.501695 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501631    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 06:51:05.501695 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501634    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 06:51:05.501695 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501637    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 06:51:05.501695 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501640    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 06:51:05.501695 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501644    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 06:51:05.501695 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501647    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 06:51:05.501695 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501649    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 06:51:05.501695 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501652    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 06:51:05.501695 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501654    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 06:51:05.501695 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501657    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 06:51:05.501695 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501659    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 06:51:05.501695 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501662    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 06:51:05.501695 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501664    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 06:51:05.501695 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501667    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 06:51:05.501695 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501670    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 06:51:05.501695 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501672    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 06:51:05.501695 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501675    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 06:51:05.501695 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501677    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 06:51:05.501695 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501680    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 06:51:05.502186 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501687    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 06:51:05.502186 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501689    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 06:51:05.502186 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501692    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 06:51:05.502186 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501694    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 06:51:05.502186 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501697    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 06:51:05.502186 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501700    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 06:51:05.502186 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501703    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 06:51:05.502186 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501705    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 06:51:05.502186 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501708    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 06:51:05.502186 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501710    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 06:51:05.502186 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501713    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 06:51:05.502186 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501716    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 06:51:05.502186 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501718    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 06:51:05.502186 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501721    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 06:51:05.502186 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501724    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 06:51:05.502186 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501726    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 06:51:05.502186 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501729    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 06:51:05.502186 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501731    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 06:51:05.502186 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501734    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 06:51:05.502657 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501738    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 06:51:05.502657 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501741    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 06:51:05.502657 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501760    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 06:51:05.502657 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501764    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 06:51:05.502657 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501768    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 06:51:05.502657 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501773    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 06:51:05.502657 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501776    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 06:51:05.502657 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501781    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 06:51:05.502657 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501784    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 06:51:05.502657 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501787    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 06:51:05.502657 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501791    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 06:51:05.502657 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501794    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 06:51:05.502657 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501796    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 06:51:05.502657 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501800    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 06:51:05.502657 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501803    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 06:51:05.502657 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501806    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 06:51:05.502657 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501808    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 06:51:05.502657 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501811    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 06:51:05.503111 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501813    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 06:51:05.503111 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501816    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 06:51:05.503111 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501819    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 06:51:05.503111 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501822    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 06:51:05.503111 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501824    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 06:51:05.503111 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501827    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 06:51:05.503111 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501829    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 06:51:05.503111 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501831    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 06:51:05.503111 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501834    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 06:51:05.503111 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501837    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 06:51:05.503111 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501839    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 06:51:05.503111 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501841    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 06:51:05.503111 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501844    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 06:51:05.503111 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501846    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 06:51:05.503111 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501848    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 06:51:05.503111 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501852    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 06:51:05.503111 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501854    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 06:51:05.503111 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501857    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 06:51:05.503111 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501860    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 06:51:05.503111 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501862    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 06:51:05.503585 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501865    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 06:51:05.503585 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501869    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 06:51:05.503585 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501872    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 06:51:05.503585 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501875    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 06:51:05.503585 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501877    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 06:51:05.503585 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501880    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 06:51:05.503585 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501882    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 06:51:05.503585 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501885    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 06:51:05.503585 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501888    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 06:51:05.503585 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501891    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 06:51:05.503585 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501893    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 06:51:05.503585 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501896    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 06:51:05.503585 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501898    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 06:51:05.503585 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501901    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 06:51:05.503585 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501903    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 06:51:05.503585 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501905    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 06:51:05.503585 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501908    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 06:51:05.503585 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501910    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 06:51:05.503585 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501912    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 06:51:05.503585 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.501914    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 06:51:05.504106 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502578    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 06:51:05.504106 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502585    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 06:51:05.504106 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502588    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 06:51:05.504106 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502591    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 06:51:05.504106 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502594    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 06:51:05.504106 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502596    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 06:51:05.504106 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502598    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 06:51:05.504106 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502601    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 06:51:05.504106 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502603    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 06:51:05.504106 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502606    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 06:51:05.504106 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502608    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 06:51:05.504106 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502611    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 06:51:05.504106 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502614    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 06:51:05.504106 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502617    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 06:51:05.504106 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502619    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 06:51:05.504106 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502622    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 06:51:05.504106 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502624    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 06:51:05.504106 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502626    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 06:51:05.504106 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502629    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 06:51:05.504106 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502632    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 06:51:05.504610 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502635    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 06:51:05.504610 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502637    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 06:51:05.504610 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502640    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 06:51:05.504610 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502642    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 06:51:05.504610 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502645    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 06:51:05.504610 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502648    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 06:51:05.504610 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502650    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 06:51:05.504610 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502653    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 06:51:05.504610 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502656    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 06:51:05.504610 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502658    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 06:51:05.504610 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502661    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 06:51:05.504610 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502664    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 06:51:05.504610 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502666    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 06:51:05.504610 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502669    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 06:51:05.504610 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502672    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 06:51:05.504610 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502674    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 06:51:05.504610 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502678    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 06:51:05.504610 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502682    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 06:51:05.504610 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502685    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 06:51:05.504610 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502687    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 06:51:05.505105 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502689    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 06:51:05.505105 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502692    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 06:51:05.505105 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502694    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 06:51:05.505105 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502697    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 06:51:05.505105 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502700    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 06:51:05.505105 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502703    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 06:51:05.505105 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502705    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 06:51:05.505105 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502707    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 06:51:05.505105 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502710    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 06:51:05.505105 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502712    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 06:51:05.505105 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502717    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 06:51:05.505105 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502721    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 06:51:05.505105 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502724    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 06:51:05.505105 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502727    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 06:51:05.505105 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502730    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 06:51:05.505105 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502733    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 06:51:05.505105 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502736    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 06:51:05.505105 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502739    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 06:51:05.505105 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502755    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 06:51:05.505579 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502758    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 06:51:05.505579 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502762    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 06:51:05.505579 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502765    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 06:51:05.505579 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502768    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 06:51:05.505579 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502771    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 06:51:05.505579 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502774    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 06:51:05.505579 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502777    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 06:51:05.505579 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502779    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 06:51:05.505579 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502782    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 06:51:05.505579 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502784    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 06:51:05.505579 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502787    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 06:51:05.505579 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502789    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 06:51:05.505579 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502792    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 06:51:05.505579 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502794    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 06:51:05.505579 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502797    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 06:51:05.505579 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502799    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 06:51:05.505579 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502803    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 06:51:05.505579 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502805    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 06:51:05.505579 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502809    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 06:51:05.505579 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502811    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 06:51:05.506085 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502814    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 06:51:05.506085 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502816    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 06:51:05.506085 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502819    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 06:51:05.506085 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502821    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 06:51:05.506085 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502825    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 06:51:05.506085 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502828    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 06:51:05.506085 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502831    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 06:51:05.506085 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502833    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 06:51:05.506085 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502836    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 06:51:05.506085 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502838    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 06:51:05.506085 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502841    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 06:51:05.506085 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502843    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 06:51:05.506085 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502846    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 06:51:05.506085 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502848    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 06:51:05.506085 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502850    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 06:51:05.506085 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502853    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 06:51:05.506085 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502855    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 06:51:05.506085 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502858    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 06:51:05.506085 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502860    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 06:51:05.506085 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.502863    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 06:51:05.506585 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503240    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 06:51:05.506585 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503246    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 06:51:05.506585 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503251    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 06:51:05.506585 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503254    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 06:51:05.506585 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503257    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 06:51:05.506585 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503260    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 06:51:05.506585 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503263    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 06:51:05.506585 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503266    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 06:51:05.506585 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503269    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 06:51:05.506585 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503272    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 06:51:05.506585 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503275    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 06:51:05.506585 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503278    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 06:51:05.506585 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503280    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 06:51:05.506585 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503283    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 06:51:05.506585 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503286    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 06:51:05.506585 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503288    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 06:51:05.506585 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503291    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 06:51:05.506585 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503294    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 06:51:05.506585 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503297    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 06:51:05.507050 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503300    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 06:51:05.507050 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503302    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 06:51:05.507050 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503305    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 06:51:05.507050 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503309    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 06:51:05.507050 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503312    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 06:51:05.507050 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503315    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 06:51:05.507050 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503318    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 06:51:05.507050 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503320    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 06:51:05.507050 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503323    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 06:51:05.507050 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503325    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 06:51:05.507050 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503328    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 06:51:05.507050 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503331    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 06:51:05.507050 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503333    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 06:51:05.507050 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503336    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 06:51:05.507050 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503338    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 06:51:05.507050 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503341    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 06:51:05.507050 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503343    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 06:51:05.507050 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503345    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 06:51:05.507050 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503348    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 06:51:05.507605 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503350    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 06:51:05.507605 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503353    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 06:51:05.507605 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503356    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 06:51:05.507605 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503358    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 06:51:05.507605 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503360    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 06:51:05.507605 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503364    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 06:51:05.507605 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503366    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 06:51:05.507605 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503369    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 06:51:05.507605 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503371    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 06:51:05.507605 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503373    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 06:51:05.507605 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503377    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 06:51:05.507605 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503379    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 06:51:05.507605 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503382    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 06:51:05.507605 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503384    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 06:51:05.507605 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503387    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 06:51:05.507605 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503389    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 06:51:05.507605 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503392    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 06:51:05.507605 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503394    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 06:51:05.507605 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503397    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 06:51:05.507605 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503399    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 06:51:05.508119 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503402    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 06:51:05.508119 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503404    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 06:51:05.508119 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503406    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 06:51:05.508119 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503409    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 06:51:05.508119 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503411    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 06:51:05.508119 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503413    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 06:51:05.508119 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503416    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 06:51:05.508119 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503419    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 06:51:05.508119 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503421    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 06:51:05.508119 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503425    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 06:51:05.508119 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503427    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 06:51:05.508119 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503430    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 06:51:05.508119 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503432    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 06:51:05.508119 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503434    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 06:51:05.508119 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503437    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 06:51:05.508119 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503439    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 06:51:05.508119 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503442    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 06:51:05.508119 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503444    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 06:51:05.508119 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503447    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 06:51:05.508119 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503449    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 06:51:05.508607 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503452    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 06:51:05.508607 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503454    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 06:51:05.508607 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503457    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 06:51:05.508607 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503460    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 06:51:05.508607 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503462    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 06:51:05.508607 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503465    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 06:51:05.508607 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503467    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 06:51:05.508607 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503470    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 06:51:05.508607 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503472    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 06:51:05.508607 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503475    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 06:51:05.508607 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503477    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 06:51:05.508607 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503480    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 06:51:05.508607 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503482    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 06:51:05.508607 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503485    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 06:51:05.508607 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503488    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 06:51:05.508607 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503490    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 06:51:05.508607 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503493    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 06:51:05.508607 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503495    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 06:51:05.508607 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503497    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 06:51:05.508607 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503500    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 06:51:05.509140 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.503502    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 06:51:05.509140 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503571    2575 flags.go:64] FLAG: --address="0.0.0.0"
Sep 09 06:51:05.509140 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503613    2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 09 06:51:05.509140 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503621    2575 flags.go:64] FLAG: --anonymous-auth="true"
Sep 09 06:51:05.509140 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503625    2575 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 09 06:51:05.509140 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503629    2575 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 09 06:51:05.509140 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503632    2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 09 06:51:05.509140 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503636    2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 09 06:51:05.509140 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503640    2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 09 06:51:05.509140 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503643    2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 09 06:51:05.509140 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503646    2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 09 06:51:05.509140 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503650    2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 09 06:51:05.509140 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503653    2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 09 06:51:05.509140 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503656    2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 09 06:51:05.509140 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503661    2575 flags.go:64] FLAG: --cgroup-root=""
Sep 09 06:51:05.509140 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503664    2575 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 09 06:51:05.509140 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503667    2575 flags.go:64] FLAG: --client-ca-file=""
Sep 09 06:51:05.509140 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503670    2575 flags.go:64] FLAG: --cloud-provider="external"
Sep 09 06:51:05.509140 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503673    2575 flags.go:64] FLAG: --cluster-dns="[]"
Sep 09 06:51:05.509140 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503677    2575 flags.go:64] FLAG: --cluster-domain=""
Sep 09 06:51:05.509140 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503680    2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 09 06:51:05.509140 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503683    2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 09 06:51:05.509140 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503686    2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 09 06:51:05.509140 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503689    2575 flags.go:64] FLAG: --container-log-max-files="5"
Sep 09 06:51:05.509720 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503692    2575 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 09 06:51:05.509720 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503695    2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 09 06:51:05.509720 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503698    2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 09 06:51:05.509720 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503701    2575 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 09 06:51:05.509720 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503704    2575 flags.go:64] FLAG: --contention-profiling="false"
Sep 09 06:51:05.509720 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503707    2575 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 09 06:51:05.509720 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503710    2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 09 06:51:05.509720 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503713    2575 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 09 06:51:05.509720 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503716    2575 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 09 06:51:05.509720 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503720    2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 09 06:51:05.509720 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503722    2575 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 09 06:51:05.509720 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503725    2575 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 09 06:51:05.509720 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503728    2575 flags.go:64] FLAG: --enable-load-reader="false"
Sep 09 06:51:05.509720 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503730    2575 flags.go:64] FLAG: --enable-server="true"
Sep 09 06:51:05.509720 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503733    2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 09 06:51:05.509720 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503737    2575 flags.go:64] FLAG: --event-burst="100"
Sep 09 06:51:05.509720 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503740    2575 flags.go:64] FLAG: --event-qps="50"
Sep 09 06:51:05.509720 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503758    2575 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 09 06:51:05.509720 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503761    2575 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 09 06:51:05.509720 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503763    2575 flags.go:64] FLAG: --eviction-hard=""
Sep 09 06:51:05.509720 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503767    2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 09 06:51:05.509720 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503770    2575 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 09 06:51:05.509720 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503774    2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 09 06:51:05.509720 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503777    2575 flags.go:64] FLAG: --eviction-soft=""
Sep 09 06:51:05.509720 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503780    2575 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 09 06:51:05.510404 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503783    2575 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 09 06:51:05.510404 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503786    2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 09 06:51:05.510404 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503789    2575 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 09 06:51:05.510404 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503791    2575 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 09 06:51:05.510404 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503794    2575 flags.go:64] FLAG: --fail-swap-on="true"
Sep 09 06:51:05.510404 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503797    2575 flags.go:64] FLAG: --feature-gates=""
Sep 09 06:51:05.510404 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503800    2575 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 09 06:51:05.510404 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503803    2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 09 06:51:05.510404 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503806    2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 09 06:51:05.510404 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503809    2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 09 06:51:05.510404 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503812    2575 flags.go:64] FLAG: --healthz-port="10248"
Sep 09 06:51:05.510404 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503815    2575 flags.go:64] FLAG: --help="false"
Sep 09 06:51:05.510404 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503817    2575 flags.go:64] FLAG: --hostname-override="ip-10-0-132-176.ec2.internal"
Sep 09 06:51:05.510404 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503821    2575 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 09 06:51:05.510404 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503823    2575 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 09 06:51:05.510404 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503826    2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 09 06:51:05.510404 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503829    2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 09 06:51:05.510404 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503832    2575 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 09 06:51:05.510404 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503835    2575 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 09 06:51:05.510404 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503838    2575 flags.go:64] FLAG: --image-service-endpoint=""
Sep 09 06:51:05.510404 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503840    2575 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 09 06:51:05.510404 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503843    2575 flags.go:64] FLAG: --kube-api-burst="100"
Sep 09 06:51:05.510404 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503846    2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 09 06:51:05.511086 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503849    2575 flags.go:64] FLAG: --kube-api-qps="50"
Sep 09 06:51:05.511086 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503851    2575 flags.go:64] FLAG: --kube-reserved=""
Sep 09 06:51:05.511086 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503854    2575 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 09 06:51:05.511086 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503857    2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 09 06:51:05.511086 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503860    2575 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 09 06:51:05.511086 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503863    2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 09 06:51:05.511086 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503868    2575 flags.go:64] FLAG: --lock-file=""
Sep 09 06:51:05.511086 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503871    2575 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 09 06:51:05.511086 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503874    2575 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 09 06:51:05.511086 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503877    2575 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 09 06:51:05.511086 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503882    2575 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 09 06:51:05.511086 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503884    2575 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 09 06:51:05.511086 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503887    2575 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 09 06:51:05.511086 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503890    2575 flags.go:64] FLAG: --logging-format="text"
Sep 09 06:51:05.511086 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503893    2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 09 06:51:05.511086 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503896    2575 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 09 06:51:05.511086 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503899    2575 flags.go:64] FLAG: --manifest-url=""
Sep 09 06:51:05.511086 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503901    2575 flags.go:64] FLAG: --manifest-url-header=""
Sep 09 06:51:05.511086 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503905    2575 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 09 06:51:05.511086 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503908    2575 flags.go:64] FLAG: --max-open-files="1000000"
Sep 09 06:51:05.511086 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503911    2575 flags.go:64] FLAG: --max-pods="110"
Sep 09 06:51:05.511086 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503914    2575 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 09 06:51:05.511086 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503917    2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 09 06:51:05.511086 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503921    2575 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 09 06:51:05.511086 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503923    2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 09 06:51:05.511784 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503926    2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 09 06:51:05.511784 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503929    2575 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 09 06:51:05.511784 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503932    2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 09 06:51:05.511784 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503938    2575 flags.go:64] FLAG: --node-status-max-images="50"
Sep 09 06:51:05.511784 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503941    2575 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 09 06:51:05.511784 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503944    2575 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 09 06:51:05.511784 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503947    2575 flags.go:64] FLAG: --pod-cidr=""
Sep 09 06:51:05.511784 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503949    2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 09 06:51:05.511784 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503954    2575 flags.go:64] FLAG: --pod-manifest-path=""
Sep 09 06:51:05.511784 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503957    2575 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 09 06:51:05.511784 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503960    2575 flags.go:64] FLAG: --pods-per-core="0"
Sep 09 06:51:05.511784 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503963    2575 flags.go:64] FLAG: --port="10250"
Sep 09 06:51:05.511784 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503965    2575 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 09 06:51:05.511784 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503969    2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b51a088b39b7cfff"
Sep 09 06:51:05.511784 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503973    2575 flags.go:64] FLAG: --qos-reserved=""
Sep 09 06:51:05.511784 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503976    2575 flags.go:64] FLAG: --read-only-port="10255"
Sep 09 06:51:05.511784 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503979    2575 flags.go:64] FLAG: --register-node="true"
Sep 09 06:51:05.511784 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503982    2575 flags.go:64] FLAG: --register-with-taints=""
Sep 09 06:51:05.511784 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503985    2575 flags.go:64] FLAG: --registry-burst="10"
Sep 09 06:51:05.511784 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503988    2575 flags.go:64] FLAG: --registry-qps="5"
Sep 09 06:51:05.511784 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503991    2575 flags.go:64] FLAG: --reserved-cpus=""
Sep 09 06:51:05.511784 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503993    2575 flags.go:64] FLAG: --reserved-memory=""
Sep 09 06:51:05.511784 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.503997    2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 09 06:51:05.511784 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.504000    2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 09 06:51:05.511784 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.504003    2575 flags.go:64] FLAG: --rotate-certificates="false"
Sep 09 06:51:05.512452 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.504005    2575 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 09 06:51:05.512452 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.504008    2575 flags.go:64] FLAG: --runonce="false"
Sep 09 06:51:05.512452 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.504011    2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 09 06:51:05.512452 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.504013    2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 09 06:51:05.512452 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.504016    2575 flags.go:64] FLAG: --seccomp-default="false"
Sep 09 06:51:05.512452 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.504019    2575 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 09 06:51:05.512452 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.504022    2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 09 06:51:05.512452 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.504025    2575 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 09 06:51:05.512452 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.504027    2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 09 06:51:05.512452 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.504030    2575 flags.go:64] FLAG: --storage-driver-password="root"
Sep 09 06:51:05.512452 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.504033    2575 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 09 06:51:05.512452 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.504036    2575 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 09 06:51:05.512452 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.504039    2575 flags.go:64] FLAG: --storage-driver-user="root"
Sep 09 06:51:05.512452 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.504042    2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 09 06:51:05.512452 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.504045    2575 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 09 06:51:05.512452 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.504047    2575 flags.go:64] FLAG: --system-cgroups=""
Sep 09 06:51:05.512452 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.504050    2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 09 06:51:05.512452 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.504055    2575 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 09 06:51:05.512452 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.504058    2575 flags.go:64] FLAG: --tls-cert-file=""
Sep 09 06:51:05.512452 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.504062    2575 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 09 06:51:05.512452 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.504066    2575 flags.go:64] FLAG: --tls-min-version=""
Sep 09 06:51:05.512452 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.504070    2575 flags.go:64] FLAG: --tls-private-key-file=""
Sep 09 06:51:05.512452 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.504073    2575 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 09 06:51:05.512452 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.504076    2575 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 09 06:51:05.512452 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.504078    2575 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 09 06:51:05.513240 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.504081    2575 flags.go:64] FLAG: --v="2"
Sep 09 06:51:05.513240 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.504085    2575 flags.go:64] FLAG: --version="false"
Sep 09 06:51:05.513240 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.504088    2575 flags.go:64] FLAG: --vmodule=""
Sep 09 06:51:05.513240 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.504092    2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 09 06:51:05.513240 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.504095    2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 09 06:51:05.513240 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504204    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 06:51:05.513240 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504207    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 06:51:05.513240 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504210    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 06:51:05.513240 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504213    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 06:51:05.513240 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504216    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 06:51:05.513240 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504219    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 06:51:05.513240 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504221    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 06:51:05.513240 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504224    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 06:51:05.513240 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504227    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 06:51:05.513240 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504230    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 06:51:05.513240 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504232    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 06:51:05.513240 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504235    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 06:51:05.513240 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504237    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 06:51:05.513240 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504240    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 06:51:05.513240 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504242    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 06:51:05.513240 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504245    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 06:51:05.513837 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504248    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 06:51:05.513837 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504250    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 06:51:05.513837 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504252    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 06:51:05.513837 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504255    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 06:51:05.513837 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504257    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 06:51:05.513837 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504262    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 06:51:05.513837 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504265    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 06:51:05.513837 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504268    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 06:51:05.513837 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504271    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 06:51:05.513837 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504273    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 06:51:05.513837 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504276    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 06:51:05.513837 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504278    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 06:51:05.513837 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504280    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 06:51:05.513837 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504283    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 06:51:05.513837 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504285    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 06:51:05.513837 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504288    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 06:51:05.513837 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504290    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 06:51:05.513837 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504294    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 06:51:05.513837 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504297    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 06:51:05.514329 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504300    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 06:51:05.514329 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504303    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 06:51:05.514329 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504305    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 06:51:05.514329 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504308    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 06:51:05.514329 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504310    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 06:51:05.514329 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504313    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 06:51:05.514329 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504315    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 06:51:05.514329 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504317    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 06:51:05.514329 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504320    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 06:51:05.514329 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504322    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 06:51:05.514329 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504324    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 06:51:05.514329 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504327    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 06:51:05.514329 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504329    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 06:51:05.514329 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504332    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 06:51:05.514329 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504334    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 06:51:05.514329 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504337    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 06:51:05.514329 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504339    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 06:51:05.514329 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504343    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 06:51:05.514329 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504347    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 06:51:05.514830 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504350    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 06:51:05.514830 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504353    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 06:51:05.514830 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504356    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 06:51:05.514830 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504360    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 06:51:05.514830 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504363    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 06:51:05.514830 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504365    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 06:51:05.514830 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504368    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 06:51:05.514830 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504370    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 06:51:05.514830 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504373    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 06:51:05.514830 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504375    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 06:51:05.514830 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504378    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 06:51:05.514830 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504380    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 06:51:05.514830 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504382    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 06:51:05.514830 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504385    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 06:51:05.514830 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504387    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 06:51:05.514830 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504389    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 06:51:05.514830 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504392    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 06:51:05.514830 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504394    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 06:51:05.514830 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504398    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 06:51:05.514830 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504401    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 06:51:05.515316 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504403    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 06:51:05.515316 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504406    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 06:51:05.515316 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504408    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 06:51:05.515316 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504410    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 06:51:05.515316 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504413    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 06:51:05.515316 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504415    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 06:51:05.515316 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504417    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 06:51:05.515316 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504420    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 06:51:05.515316 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504422    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 06:51:05.515316 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504425    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 06:51:05.515316 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504427    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 06:51:05.515316 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504431    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 06:51:05.515316 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504433    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 06:51:05.515316 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504436    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 06:51:05.515316 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504438    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 06:51:05.515316 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504440    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 06:51:05.515316 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504443    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 06:51:05.515316 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504446    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 06:51:05.515316 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504448    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 06:51:05.515316 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504451    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 06:51:05.515834 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504454    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 06:51:05.515834 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504456    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 06:51:05.515834 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504458    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 06:51:05.515834 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504461    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 06:51:05.515834 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.504463    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 06:51:05.515834 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.504468    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 06:51:05.515834 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.511443    2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 09 06:51:05.515834 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.511459    2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 09 06:51:05.515834 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.511472    2575 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 09 06:51:05.515834 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.511481    2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 09 06:51:05.515834 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511536    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 06:51:05.515834 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511541    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 06:51:05.515834 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511545    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 06:51:05.515834 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511548    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 06:51:05.515834 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511551    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 06:51:05.516238 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511554    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 06:51:05.516238 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511556    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 06:51:05.516238 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511559    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 06:51:05.516238 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511561    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 06:51:05.516238 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511564    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 06:51:05.516238 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511566    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 06:51:05.516238 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511569    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 06:51:05.516238 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511571    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 06:51:05.516238 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511574    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 06:51:05.516238 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511576    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 06:51:05.516238 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511579    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 06:51:05.516238 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511581    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 06:51:05.516238 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511583    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 06:51:05.516238 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511586    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 06:51:05.516238 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511588    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 06:51:05.516238 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511590    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 06:51:05.516238 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511593    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 06:51:05.516238 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511595    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 06:51:05.516238 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511598    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 06:51:05.516691 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511601    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 06:51:05.516691 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511603    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 06:51:05.516691 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511605    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 06:51:05.516691 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511608    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 06:51:05.516691 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511611    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 06:51:05.516691 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511615    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 06:51:05.516691 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511617    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 06:51:05.516691 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511620    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 06:51:05.516691 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511622    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 06:51:05.516691 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511625    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 06:51:05.516691 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511627    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 06:51:05.516691 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511630    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 06:51:05.516691 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511632    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 06:51:05.516691 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511635    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 06:51:05.516691 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511637    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 06:51:05.516691 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511640    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 06:51:05.516691 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511642    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 06:51:05.516691 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511645    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 06:51:05.516691 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511647    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 06:51:05.516691 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511649    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 06:51:05.517274 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511652    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 06:51:05.517274 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511654    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 06:51:05.517274 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511657    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 06:51:05.517274 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511659    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 06:51:05.517274 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511661    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 06:51:05.517274 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511664    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 06:51:05.517274 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511666    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 06:51:05.517274 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511668    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 06:51:05.517274 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511671    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 06:51:05.517274 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511673    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 06:51:05.517274 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511676    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 06:51:05.517274 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511678    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 06:51:05.517274 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511680    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 06:51:05.517274 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511683    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 06:51:05.517274 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511685    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 06:51:05.517274 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511687    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 06:51:05.517274 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511690    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 06:51:05.517274 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511693    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 06:51:05.517274 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511696    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 06:51:05.517274 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511699    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 06:51:05.517781 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511701    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 06:51:05.517781 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511703    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 06:51:05.517781 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511706    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 06:51:05.517781 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511709    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 06:51:05.517781 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511711    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 06:51:05.517781 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511713    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 06:51:05.517781 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511716    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 06:51:05.517781 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511718    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 06:51:05.517781 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511720    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 06:51:05.517781 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511723    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 06:51:05.517781 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511726    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 06:51:05.517781 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511729    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 06:51:05.517781 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511733    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 06:51:05.517781 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511735    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 06:51:05.517781 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511739    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 06:51:05.517781 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511764    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 06:51:05.517781 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511771    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 06:51:05.517781 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511774    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 06:51:05.517781 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511777    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 06:51:05.518250 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511780    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 06:51:05.518250 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511783    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 06:51:05.518250 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511785    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 06:51:05.518250 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511788    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 06:51:05.518250 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511790    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 06:51:05.518250 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511793    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 06:51:05.518250 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511795    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 06:51:05.518250 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511798    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 06:51:05.518250 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511800    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 06:51:05.518250 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511803    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 06:51:05.518250 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511806    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 06:51:05.518250 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511809    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 06:51:05.518250 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511813    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 06:51:05.518250 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511817    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 06:51:05.518250 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511820    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 06:51:05.518250 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511822    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 06:51:05.518638 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.511827    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 06:51:05.518638 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511934    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 06:51:05.518638 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511938    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 06:51:05.518638 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511941    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 06:51:05.518638 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511944    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 06:51:05.518638 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511946    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 06:51:05.518638 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511948    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 06:51:05.518638 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511951    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 06:51:05.518638 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511953    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 06:51:05.518638 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511956    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 06:51:05.518638 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511958    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 06:51:05.518638 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511960    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 06:51:05.518638 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511963    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 06:51:05.518638 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511965    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 06:51:05.518638 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511967    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 06:51:05.519025 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511970    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 06:51:05.519025 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511972    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 06:51:05.519025 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511974    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 06:51:05.519025 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511977    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 06:51:05.519025 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511979    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 06:51:05.519025 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511982    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 06:51:05.519025 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511984    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 06:51:05.519025 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511986    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 06:51:05.519025 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511989    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 06:51:05.519025 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511991    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 06:51:05.519025 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511995    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 06:51:05.519025 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.511999    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 06:51:05.519025 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512002    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 06:51:05.519025 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512005    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 06:51:05.519025 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512008    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 06:51:05.519025 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512011    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 06:51:05.519025 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512013    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 06:51:05.519025 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512016    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 06:51:05.519025 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512018    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 06:51:05.519025 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512020    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 06:51:05.519535 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512023    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 06:51:05.519535 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512026    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 06:51:05.519535 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512028    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 06:51:05.519535 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512030    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 06:51:05.519535 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512033    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 06:51:05.519535 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512035    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 06:51:05.519535 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512037    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 06:51:05.519535 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512040    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 06:51:05.519535 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512042    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 06:51:05.519535 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512044    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 06:51:05.519535 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512047    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 06:51:05.519535 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512049    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 06:51:05.519535 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512051    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 06:51:05.519535 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512054    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 06:51:05.519535 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512056    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 06:51:05.519535 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512059    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 06:51:05.519535 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512061    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 06:51:05.519535 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512064    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 06:51:05.519535 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512066    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 06:51:05.519535 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512068    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 06:51:05.520037 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512071    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 06:51:05.520037 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512073    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 06:51:05.520037 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512076    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 06:51:05.520037 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512079    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 06:51:05.520037 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512081    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 06:51:05.520037 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512084    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 06:51:05.520037 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512086    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 06:51:05.520037 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512089    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 06:51:05.520037 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512092    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 06:51:05.520037 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512094    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 06:51:05.520037 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512096    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 06:51:05.520037 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512098    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 06:51:05.520037 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512101    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 06:51:05.520037 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512103    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 06:51:05.520037 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512106    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 06:51:05.520037 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512108    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 06:51:05.520037 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512110    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 06:51:05.520037 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512113    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 06:51:05.520037 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512116    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 06:51:05.520491 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512118    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 06:51:05.520491 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512120    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 06:51:05.520491 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512122    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 06:51:05.520491 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512126    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 06:51:05.520491 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512130    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 06:51:05.520491 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512133    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 06:51:05.520491 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512135    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 06:51:05.520491 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512137    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 06:51:05.520491 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512140    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 06:51:05.520491 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512142    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 06:51:05.520491 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512145    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 06:51:05.520491 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512147    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 06:51:05.520491 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512151    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 06:51:05.520491 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512154    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 06:51:05.520491 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512157    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 06:51:05.520491 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512160    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 06:51:05.520491 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512163    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 06:51:05.520491 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512166    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 06:51:05.520491 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512169    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 06:51:05.520966 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512171    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 06:51:05.520966 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512174    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 06:51:05.520966 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512177    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 06:51:05.520966 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512179    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 06:51:05.520966 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512181    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 06:51:05.520966 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512184    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 06:51:05.520966 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:05.512186    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 06:51:05.520966 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.512191    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 06:51:05.520966 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.512313    2575 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 09 06:51:05.520966 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.514217    2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 09 06:51:05.520966 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.515277    2575 server.go:1019] "Starting client certificate rotation"
Sep 09 06:51:05.520966 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.515373    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 09 06:51:05.520966 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.515410    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 09 06:51:05.521284 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.518218    2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 09 06:51:05.522590 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.522573    2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 09 06:51:05.534460 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.534431    2575 log.go:25] "Validated CRI v1 runtime API"
Sep 09 06:51:05.537399 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.537386    2575 log.go:25] "Validated CRI v1 image API"
Sep 09 06:51:05.538210 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.538193    2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 09 06:51:05.542304 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.542283    2575 fs.go:135] Filesystem UUIDs: map[360885dc-4da6-4518-ae74-a4531c2d96ae:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d5c918d4-6f22-42cb-8f87-5d4608eb076a:/dev/nvme0n1p3]
Sep 09 06:51:05.543037 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.542303    2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 09 06:51:05.547691 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.547581    2575 manager.go:216] Machine: {Timestamp:2026-09-09 06:51:05.54627672 +0000 UTC m=+0.338086049 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3110592 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e315b33b046d0b41f91bc8484329d SystemUUID:ec2e315b-33b0-46d0-b41f-91bc8484329d BootID:e517a9c4-f719-4604-9ddf-ec59285955b2 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:7b:92:a8:46:91 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:7b:92:a8:46:91 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:46:8f:db:df:61:7a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 09 06:51:05.547691 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.547684    2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 09 06:51:05.547868 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.547795    2575 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 09 06:51:05.548728 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.548707    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 09 06:51:05.551465 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.551435    2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 09 06:51:05.551598 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.551468    2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-176.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 09 06:51:05.552706 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.552696    2575 topology_manager.go:138] "Creating topology manager with none policy"
Sep 09 06:51:05.552798 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.552709    2575 container_manager_linux.go:309] "Creating device plugin manager"
Sep 09 06:51:05.552798 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.552717    2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 09 06:51:05.552798 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.552730    2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 09 06:51:05.553889 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.553879    2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 09 06:51:05.557047 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.557037    2575 state_mem.go:36] "Initialized new in-memory state store"
Sep 09 06:51:05.557153 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.557143    2575 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 09 06:51:05.557201 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.557193    2575 kubelet.go:486] "Attempting to sync node with API server"
Sep 09 06:51:05.557236 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.557204    2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 09 06:51:05.557236 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.557218    2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 09 06:51:05.557236 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.557226    2575 kubelet.go:398] "Adding apiserver pod source"
Sep 09 06:51:05.557324 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.557241    2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 09 06:51:05.557615 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.557591    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 09 06:51:05.557659 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.557621    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 09 06:51:05.560938 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.560922    2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 09 06:51:05.562909 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.562895    2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 09 06:51:05.562951 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.562925    2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 09 06:51:05.563109 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.563099    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 09 06:51:05.563142 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.563116    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 09 06:51:05.563142 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.563122    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 09 06:51:05.563142 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.563130    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 09 06:51:05.563142 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.563142    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 09 06:51:05.563247 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.563150    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 09 06:51:05.563663 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.563651    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 09 06:51:05.563663 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.563661    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 09 06:51:05.563768 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.563667    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 09 06:51:05.563768 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.563672    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 09 06:51:05.563768 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.563687    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 09 06:51:05.563768 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.563697    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 09 06:51:05.565046 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.565035    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 09 06:51:05.565046 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.565046    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 09 06:51:05.569478 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.569464    2575 server.go:1268] "Started kubelet"
Sep 09 06:51:05.569590 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.569544    2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 09 06:51:05.569646 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.569571    2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 09 06:51:05.569646 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.569636    2575 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 09 06:51:05.569852 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:05.569831    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 09 06:51:05.569908 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.569867    2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-176.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 09 06:51:05.569954 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:05.569936    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-176.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 09 06:51:05.570358 ip-10-0-132-176 systemd[1]: Started Kubernetes Kubelet.
Sep 09 06:51:05.571143 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.571090    2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 09 06:51:05.572220 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.572204    2575 server.go:310] "Adding debug handlers to kubelet server"
Sep 09 06:51:05.575102 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:05.575080    2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 09 06:51:05.576003 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.575990    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 09 06:51:05.576543 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.576526    2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 09 06:51:05.576683 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:05.576660    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-176.ec2.internal\" not found"
Sep 09 06:51:05.577105 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.577088    2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 09 06:51:05.577105 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.577089    2575 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 09 06:51:05.577246 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.577113    2575 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 09 06:51:05.577246 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.577179    2575 reconstruct.go:97] "Volume reconstruction finished"
Sep 09 06:51:05.577246 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.577188    2575 reconciler.go:29] "Reconciler: start to sync state"
Sep 09 06:51:05.577433 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.577418    2575 factory.go:55] Registering systemd factory
Sep 09 06:51:05.577504 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.577436    2575 factory.go:223] Registration of the systemd container factory successfully
Sep 09 06:51:05.577571 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:05.576420    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-176.ec2.internal.18d3946b4cf01d46  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-176.ec2.internal,UID:ip-10-0-132-176.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-176.ec2.internal,},FirstTimestamp:2026-09-09 06:51:05.56943495 +0000 UTC m=+0.361244279,LastTimestamp:2026-09-09 06:51:05.56943495 +0000 UTC m=+0.361244279,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-176.ec2.internal,}"
Sep 09 06:51:05.577659 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.577646    2575 factory.go:153] Registering CRI-O factory
Sep 09 06:51:05.577689 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.577663    2575 factory.go:223] Registration of the crio container factory successfully
Sep 09 06:51:05.577720 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.577706    2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 09 06:51:05.577771 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.577721    2575 factory.go:103] Registering Raw factory
Sep 09 06:51:05.577771 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.577733    2575 manager.go:1196] Started watching for new ooms in manager
Sep 09 06:51:05.578045 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.578030    2575 manager.go:349] Starting recovery of all containers
Sep 09 06:51:05.583157 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:05.583019    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 09 06:51:05.583157 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:05.583116    2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-176.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 09 06:51:05.586027 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.585988    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 09 06:51:05.588081 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.588066    2575 manager.go:354] Recovery completed
Sep 09 06:51:05.592481 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.592468    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 06:51:05.595291 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.595273    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-176.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 06:51:05.595361 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.595310    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-176.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 06:51:05.595361 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.595325    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-176.ec2.internal" event="NodeHasSufficientPID"
Sep 09 06:51:05.596289 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.596273    2575 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 09 06:51:05.596289 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.596287    2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 09 06:51:05.596410 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.596293    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 06:51:05.596410 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.596305    2575 state_mem.go:36] "Initialized new in-memory state store"
Sep 09 06:51:05.596482 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.596410    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d9xpf"
Sep 09 06:51:05.597075 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.597050    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-176.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 06:51:05.597125 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.597086    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-176.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 06:51:05.597125 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.597097    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-176.ec2.internal" event="NodeHasSufficientPID"
Sep 09 06:51:05.597415 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.597405    2575 policy_none.go:49] "None policy: Start"
Sep 09 06:51:05.597454 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.597420    2575 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 09 06:51:05.597454 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.597429    2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 09 06:51:05.597762 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:05.597675    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-176.ec2.internal.18d3946b4e7aa530  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-176.ec2.internal,UID:ip-10-0-132-176.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-176.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-176.ec2.internal,},FirstTimestamp:2026-09-09 06:51:05.595290928 +0000 UTC m=+0.387100258,LastTimestamp:2026-09-09 06:51:05.595290928 +0000 UTC m=+0.387100258,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-176.ec2.internal,}"
Sep 09 06:51:05.598334 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.598324    2575 policy_none.go:47] "Start"
Sep 09 06:51:05.601833 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.601801    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d9xpf"
Sep 09 06:51:05.631290 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.631270    2575 manager.go:337] "Starting Device Plugin manager"
Sep 09 06:51:05.643334 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:05.631312    2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 09 06:51:05.643334 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.631325    2575 server.go:87] "Starting device plugin registration server"
Sep 09 06:51:05.643334 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.631563    2575 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 09 06:51:05.643334 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.631576    2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 09 06:51:05.643334 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.631671    2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 09 06:51:05.643334 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.631741    2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 09 06:51:05.643334 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.631770    2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 09 06:51:05.643334 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:05.632349    2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 09 06:51:05.643334 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:05.632394    2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-176.ec2.internal\" not found"
Sep 09 06:51:05.704778 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.704756    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 09 06:51:05.704851 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.704804    2575 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 09 06:51:05.704851 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.704824    2575 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 09 06:51:05.704924 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:05.704857    2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 09 06:51:05.707562 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.707547    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 06:51:05.732399 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.732385    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 06:51:05.733152 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.733137    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-176.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 06:51:05.733217 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.733164    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-176.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 06:51:05.733217 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.733174    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-176.ec2.internal" event="NodeHasSufficientPID"
Sep 09 06:51:05.733217 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.733194    2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-176.ec2.internal"
Sep 09 06:51:05.741948 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.741930    2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-176.ec2.internal"
Sep 09 06:51:05.741995 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:05.741951    2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-176.ec2.internal\": node \"ip-10-0-132-176.ec2.internal\" not found"
Sep 09 06:51:05.774512 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:05.774460    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-176.ec2.internal\" not found"
Sep 09 06:51:05.805138 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.805119    2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-176.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-176.ec2.internal"]
Sep 09 06:51:05.805185 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.805176    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 06:51:05.806403 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.806389    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-176.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 06:51:05.806506 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.806420    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-176.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 06:51:05.806506 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.806433    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-176.ec2.internal" event="NodeHasSufficientPID"
Sep 09 06:51:05.807431 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.807419    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 06:51:05.807549 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.807533    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-176.ec2.internal"
Sep 09 06:51:05.807593 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.807561    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 06:51:05.808113 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.808098    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-176.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 06:51:05.808190 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.808123    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-176.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 06:51:05.808190 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.808123    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-176.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 06:51:05.808190 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.808139    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-176.ec2.internal" event="NodeHasSufficientPID"
Sep 09 06:51:05.808190 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.808161    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-176.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 06:51:05.808190 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.808189    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-176.ec2.internal" event="NodeHasSufficientPID"
Sep 09 06:51:05.809225 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.809211    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-176.ec2.internal"
Sep 09 06:51:05.809275 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.809240    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 06:51:05.809922 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.809904    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-176.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 06:51:05.809994 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.809930    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-176.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 06:51:05.809994 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.809939    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-176.ec2.internal" event="NodeHasSufficientPID"
Sep 09 06:51:05.837331 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:05.837315    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-176.ec2.internal\" not found" node="ip-10-0-132-176.ec2.internal"
Sep 09 06:51:05.841642 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:05.841628    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-176.ec2.internal\" not found" node="ip-10-0-132-176.ec2.internal"
Sep 09 06:51:05.874811 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:05.874792    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-176.ec2.internal\" not found"
Sep 09 06:51:05.879144 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.879130    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/10ede7a8d76e64113edb635ab66c3e5e-config\") pod \"kube-apiserver-proxy-ip-10-0-132-176.ec2.internal\" (UID: \"10ede7a8d76e64113edb635ab66c3e5e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-176.ec2.internal"
Sep 09 06:51:05.879204 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.879155    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e4ae816a232fd3409ce4266a67ae4820-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-176.ec2.internal\" (UID: \"e4ae816a232fd3409ce4266a67ae4820\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-176.ec2.internal"
Sep 09 06:51:05.879204 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.879172    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4ae816a232fd3409ce4266a67ae4820-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-176.ec2.internal\" (UID: \"e4ae816a232fd3409ce4266a67ae4820\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-176.ec2.internal"
Sep 09 06:51:05.975156 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:05.975138    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-176.ec2.internal\" not found"
Sep 09 06:51:05.979463 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.979446    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/10ede7a8d76e64113edb635ab66c3e5e-config\") pod \"kube-apiserver-proxy-ip-10-0-132-176.ec2.internal\" (UID: \"10ede7a8d76e64113edb635ab66c3e5e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-176.ec2.internal"
Sep 09 06:51:05.979510 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.979471    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e4ae816a232fd3409ce4266a67ae4820-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-176.ec2.internal\" (UID: \"e4ae816a232fd3409ce4266a67ae4820\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-176.ec2.internal"
Sep 09 06:51:05.979510 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.979487    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4ae816a232fd3409ce4266a67ae4820-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-176.ec2.internal\" (UID: \"e4ae816a232fd3409ce4266a67ae4820\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-176.ec2.internal"
Sep 09 06:51:05.979605 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.979522    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4ae816a232fd3409ce4266a67ae4820-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-176.ec2.internal\" (UID: \"e4ae816a232fd3409ce4266a67ae4820\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-176.ec2.internal"
Sep 09 06:51:05.979605 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.979548    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/10ede7a8d76e64113edb635ab66c3e5e-config\") pod \"kube-apiserver-proxy-ip-10-0-132-176.ec2.internal\" (UID: \"10ede7a8d76e64113edb635ab66c3e5e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-176.ec2.internal"
Sep 09 06:51:05.979605 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:05.979595    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e4ae816a232fd3409ce4266a67ae4820-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-176.ec2.internal\" (UID: \"e4ae816a232fd3409ce4266a67ae4820\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-176.ec2.internal"
Sep 09 06:51:06.075589 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:06.075545    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-176.ec2.internal\" not found"
Sep 09 06:51:06.141036 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:06.141009    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-176.ec2.internal"
Sep 09 06:51:06.144781 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:06.144739    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-176.ec2.internal"
Sep 09 06:51:06.176459 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:06.176431    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-176.ec2.internal\" not found"
Sep 09 06:51:06.276885 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:06.276862    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-176.ec2.internal\" not found"
Sep 09 06:51:06.377279 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:06.377255    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-176.ec2.internal\" not found"
Sep 09 06:51:06.477607 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:06.477577    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-176.ec2.internal\" not found"
Sep 09 06:51:06.515894 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:06.515879    2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 09 06:51:06.516307 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:06.516011    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 09 06:51:06.578448 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:06.578427    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-176.ec2.internal\" not found"
Sep 09 06:51:06.603461 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:06.603427    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-08 06:46:05 +0000 UTC" deadline="2028-06-02 20:55:33.856331744 +0000 UTC"
Sep 09 06:51:06.603461 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:06.603459    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15182h4m27.252875602s"
Sep 09 06:51:06.643584 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:06.643538    2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 06:51:06.677635 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:06.677614    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-176.ec2.internal"
Sep 09 06:51:06.691572 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:06.691556    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 09 06:51:06.693456 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:06.693444    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-176.ec2.internal"
Sep 09 06:51:06.702415 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:06.702402    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 09 06:51:06.925509 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:06.925471    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4ae816a232fd3409ce4266a67ae4820.slice/crio-3e7217c4612999b09a32f8c6df8d9231259cd9c565daf940d0922ef470382511 WatchSource:0}: Error finding container 3e7217c4612999b09a32f8c6df8d9231259cd9c565daf940d0922ef470382511: Status 404 returned error can't find the container with id 3e7217c4612999b09a32f8c6df8d9231259cd9c565daf940d0922ef470382511
Sep 09 06:51:06.925788 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:06.925769    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10ede7a8d76e64113edb635ab66c3e5e.slice/crio-5428a7568c20575ce1608b29a9a4fa0aa893c4c84aa653457022ec9f792e10cc WatchSource:0}: Error finding container 5428a7568c20575ce1608b29a9a4fa0aa893c4c84aa653457022ec9f792e10cc: Status 404 returned error can't find the container with id 5428a7568c20575ce1608b29a9a4fa0aa893c4c84aa653457022ec9f792e10cc
Sep 09 06:51:06.930490 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:06.930475    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 06:51:07.020850 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.020833    2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 06:51:07.034152 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.034131    2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 06:51:07.561166 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.561138    2575 apiserver.go:52] "Watching apiserver"
Sep 09 06:51:07.572574 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.572546    2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 09 06:51:07.572973 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.572947    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-pj9sz","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mkgx","openshift-image-registry/node-ca-rljvj","openshift-multus/multus-additional-cni-plugins-2p2z8","openshift-network-diagnostics/network-check-target-fmhfw","openshift-network-operator/iptables-alerter-csxxw","openshift-ovn-kubernetes/ovnkube-node-xt6cr","kube-system/global-pull-secret-syncer-tlg4m","kube-system/konnectivity-agent-xv8b9","kube-system/kube-apiserver-proxy-ip-10-0-132-176.ec2.internal","openshift-cluster-node-tuning-operator/tuned-mcwsw","openshift-dns/node-resolver-cr4hg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-176.ec2.internal","openshift-multus/multus-blbwl"]
Sep 09 06:51:07.575276 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.575251    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pj9sz"
Sep 09 06:51:07.575372 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:07.575339    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pj9sz" podUID="96676d24-b303-4849-bdc0-e5b99b9b8602"
Sep 09 06:51:07.576445 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.576426    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mkgx"
Sep 09 06:51:07.577292 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.577275    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 09 06:51:07.577581 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.577557    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rljvj"
Sep 09 06:51:07.579398 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.579374    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 09 06:51:07.579503 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.579473    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 09 06:51:07.579559 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.579500    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qqkbb\""
Sep 09 06:51:07.579559 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.579475    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 09 06:51:07.579835 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.579816    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2p2z8"
Sep 09 06:51:07.580561 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.580537    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-psk5w\""
Sep 09 06:51:07.580561 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.580554    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 09 06:51:07.580692 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.580578    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 09 06:51:07.580692 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.580598    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 09 06:51:07.581295 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.581278    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fmhfw"
Sep 09 06:51:07.581393 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:07.581340    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fmhfw" podUID="941d7367-69f9-4dbd-b23c-35441173231c"
Sep 09 06:51:07.582305 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.582291    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 09 06:51:07.582387 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.582291    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 09 06:51:07.582798 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.582744    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-csxxw"
Sep 09 06:51:07.582915 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.582853    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lh8xw\""
Sep 09 06:51:07.582915 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.582892    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 09 06:51:07.583046 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.582954    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 09 06:51:07.583242 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.583222    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 09 06:51:07.584154 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.584136    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.585488 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.585469    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 09 06:51:07.585580 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.585486    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 09 06:51:07.585580 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.585555    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 09 06:51:07.585689 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.585620    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tlg4m"
Sep 09 06:51:07.585729 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:07.585691    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tlg4m" podUID="fa0cd37d-c6ff-4f45-9954-b2abc2645a4c"
Sep 09 06:51:07.586075 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.586059    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-t7hvw\""
Sep 09 06:51:07.586389 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.586346    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c6df37d2-594a-4f35-bcda-246740bf683b-etc-selinux\") pod \"aws-ebs-csi-driver-node-6mkgx\" (UID: \"c6df37d2-594a-4f35-bcda-246740bf683b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mkgx"
Sep 09 06:51:07.586462 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.586392    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cssv\" (UniqueName: \"kubernetes.io/projected/96676d24-b303-4849-bdc0-e5b99b9b8602-kube-api-access-8cssv\") pod \"network-metrics-daemon-pj9sz\" (UID: \"96676d24-b303-4849-bdc0-e5b99b9b8602\") " pod="openshift-multus/network-metrics-daemon-pj9sz"
Sep 09 06:51:07.586462 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.586422    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/761f8c97-f2c7-4769-9c0b-924a4877cd38-serviceca\") pod \"node-ca-rljvj\" (UID: \"761f8c97-f2c7-4769-9c0b-924a4877cd38\") " pod="openshift-image-registry/node-ca-rljvj"
Sep 09 06:51:07.586553 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.586467    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qckkl\" (UniqueName: \"kubernetes.io/projected/761f8c97-f2c7-4769-9c0b-924a4877cd38-kube-api-access-qckkl\") pod \"node-ca-rljvj\" (UID: \"761f8c97-f2c7-4769-9c0b-924a4877cd38\") " pod="openshift-image-registry/node-ca-rljvj"
Sep 09 06:51:07.586553 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.586495    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c6df37d2-594a-4f35-bcda-246740bf683b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6mkgx\" (UID: \"c6df37d2-594a-4f35-bcda-246740bf683b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mkgx"
Sep 09 06:51:07.586553 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.586521    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c6df37d2-594a-4f35-bcda-246740bf683b-socket-dir\") pod \"aws-ebs-csi-driver-node-6mkgx\" (UID: \"c6df37d2-594a-4f35-bcda-246740bf683b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mkgx"
Sep 09 06:51:07.586688 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.586555    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c6df37d2-594a-4f35-bcda-246740bf683b-sys-fs\") pod \"aws-ebs-csi-driver-node-6mkgx\" (UID: \"c6df37d2-594a-4f35-bcda-246740bf683b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mkgx"
Sep 09 06:51:07.586688 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.586583    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm9w8\" (UniqueName: \"kubernetes.io/projected/c6df37d2-594a-4f35-bcda-246740bf683b-kube-api-access-qm9w8\") pod \"aws-ebs-csi-driver-node-6mkgx\" (UID: \"c6df37d2-594a-4f35-bcda-246740bf683b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mkgx"
Sep 09 06:51:07.586688 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.586608    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/761f8c97-f2c7-4769-9c0b-924a4877cd38-host\") pod \"node-ca-rljvj\" (UID: \"761f8c97-f2c7-4769-9c0b-924a4877cd38\") " pod="openshift-image-registry/node-ca-rljvj"
Sep 09 06:51:07.586688 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.586631    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96676d24-b303-4849-bdc0-e5b99b9b8602-metrics-certs\") pod \"network-metrics-daemon-pj9sz\" (UID: \"96676d24-b303-4849-bdc0-e5b99b9b8602\") " pod="openshift-multus/network-metrics-daemon-pj9sz"
Sep 09 06:51:07.586688 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.586657    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c6df37d2-594a-4f35-bcda-246740bf683b-registration-dir\") pod \"aws-ebs-csi-driver-node-6mkgx\" (UID: \"c6df37d2-594a-4f35-bcda-246740bf683b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mkgx"
Sep 09 06:51:07.586688 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.586680    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c6df37d2-594a-4f35-bcda-246740bf683b-device-dir\") pod \"aws-ebs-csi-driver-node-6mkgx\" (UID: \"c6df37d2-594a-4f35-bcda-246740bf683b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mkgx"
Sep 09 06:51:07.587054 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.586972    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 09 06:51:07.587109 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.587085    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xv8b9"
Sep 09 06:51:07.587500 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.587476    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2hhfc\""
Sep 09 06:51:07.587603 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.587516    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 09 06:51:07.587675 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.587607    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 09 06:51:07.587880 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.587860    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 09 06:51:07.587880 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.587873    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 09 06:51:07.588156 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.588139    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 09 06:51:07.588295 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.588278    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mcwsw"
Sep 09 06:51:07.589560 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.589541    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 09 06:51:07.589667 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.589601    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lxk2j\""
Sep 09 06:51:07.589667 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.589608    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cr4hg"
Sep 09 06:51:07.589984 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.589966    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 09 06:51:07.590699 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.590636    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 09 06:51:07.590872 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.590812    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 09 06:51:07.591015 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.590988    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 09 06:51:07.591088 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.591044    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pfhz4\""
Sep 09 06:51:07.591088 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.591075    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-blbwl"
Sep 09 06:51:07.593847 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.592618    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 09 06:51:07.593847 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.592897    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dwxjt\""
Sep 09 06:51:07.593847 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.592912    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 09 06:51:07.593847 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.593619    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kn26q\""
Sep 09 06:51:07.593847 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.593772    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 09 06:51:07.617623 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.617605    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-l7dzc"
Sep 09 06:51:07.627412 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.627392    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-l7dzc"
Sep 09 06:51:07.678221 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.678201    2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 09 06:51:07.687122 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.687099    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/306002f3-75e6-40e8-b651-a3ffb4180d43-etc-openvswitch\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.687218 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.687129    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/306002f3-75e6-40e8-b651-a3ffb4180d43-host-cni-netd\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.687218 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.687146    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/306002f3-75e6-40e8-b651-a3ffb4180d43-ovnkube-config\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.687218 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.687164    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/25fed217-b55a-417b-87be-cae14b802dc3-agent-certs\") pod \"konnectivity-agent-xv8b9\" (UID: \"25fed217-b55a-417b-87be-cae14b802dc3\") " pod="kube-system/konnectivity-agent-xv8b9"
Sep 09 06:51:07.687218 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.687183    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/25fed217-b55a-417b-87be-cae14b802dc3-konnectivity-ca\") pod \"konnectivity-agent-xv8b9\" (UID: \"25fed217-b55a-417b-87be-cae14b802dc3\") " pod="kube-system/konnectivity-agent-xv8b9"
Sep 09 06:51:07.687218 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.687208    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/919417d2-9658-4035-87e5-a82416654da8-system-cni-dir\") pod \"multus-blbwl\" (UID: \"919417d2-9658-4035-87e5-a82416654da8\") " pod="openshift-multus/multus-blbwl"
Sep 09 06:51:07.687456 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.687231    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/306002f3-75e6-40e8-b651-a3ffb4180d43-run-systemd\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.687456 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.687254    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c6df37d2-594a-4f35-bcda-246740bf683b-sys-fs\") pod \"aws-ebs-csi-driver-node-6mkgx\" (UID: \"c6df37d2-594a-4f35-bcda-246740bf683b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mkgx"
Sep 09 06:51:07.687456 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.687269    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/306002f3-75e6-40e8-b651-a3ffb4180d43-host-slash\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.687456 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.687285    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/306002f3-75e6-40e8-b651-a3ffb4180d43-run-ovn\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.687456 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.687333    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/306002f3-75e6-40e8-b651-a3ffb4180d43-ovnkube-script-lib\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.687456 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.687391    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scfvw\" (UniqueName: \"kubernetes.io/projected/ae5d6c9d-7110-4b99-ae5b-1d562f10234c-kube-api-access-scfvw\") pod \"iptables-alerter-csxxw\" (UID: \"ae5d6c9d-7110-4b99-ae5b-1d562f10234c\") " pod="openshift-network-operator/iptables-alerter-csxxw"
Sep 09 06:51:07.687456 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.687406    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c6df37d2-594a-4f35-bcda-246740bf683b-sys-fs\") pod \"aws-ebs-csi-driver-node-6mkgx\" (UID: \"c6df37d2-594a-4f35-bcda-246740bf683b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mkgx"
Sep 09 06:51:07.687456 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.687410    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/919417d2-9658-4035-87e5-a82416654da8-host-run-multus-certs\") pod \"multus-blbwl\" (UID: \"919417d2-9658-4035-87e5-a82416654da8\") " pod="openshift-multus/multus-blbwl"
Sep 09 06:51:07.687770 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.687459    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/761f8c97-f2c7-4769-9c0b-924a4877cd38-host\") pod \"node-ca-rljvj\" (UID: \"761f8c97-f2c7-4769-9c0b-924a4877cd38\") " pod="openshift-image-registry/node-ca-rljvj"
Sep 09 06:51:07.687770 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.687497    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/761f8c97-f2c7-4769-9c0b-924a4877cd38-host\") pod \"node-ca-rljvj\" (UID: \"761f8c97-f2c7-4769-9c0b-924a4877cd38\") " pod="openshift-image-registry/node-ca-rljvj"
Sep 09 06:51:07.687770 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.687504    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpz6n\" (UniqueName: \"kubernetes.io/projected/00e0c40f-e508-4900-9f82-94f5ef3c04a8-kube-api-access-rpz6n\") pod \"multus-additional-cni-plugins-2p2z8\" (UID: \"00e0c40f-e508-4900-9f82-94f5ef3c04a8\") " pod="openshift-multus/multus-additional-cni-plugins-2p2z8"
Sep 09 06:51:07.687770 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.687532    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fa0cd37d-c6ff-4f45-9954-b2abc2645a4c-dbus\") pod \"global-pull-secret-syncer-tlg4m\" (UID: \"fa0cd37d-c6ff-4f45-9954-b2abc2645a4c\") " pod="kube-system/global-pull-secret-syncer-tlg4m"
Sep 09 06:51:07.687770 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.687549    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e0b0062-4ae5-4229-98a1-613f64c98142-sys\") pod \"tuned-mcwsw\" (UID: \"5e0b0062-4ae5-4229-98a1-613f64c98142\") " pod="openshift-cluster-node-tuning-operator/tuned-mcwsw"
Sep 09 06:51:07.687770 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.687581    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/919417d2-9658-4035-87e5-a82416654da8-multus-daemon-config\") pod \"multus-blbwl\" (UID: \"919417d2-9658-4035-87e5-a82416654da8\") " pod="openshift-multus/multus-blbwl"
Sep 09 06:51:07.687770 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.687601    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qckkl\" (UniqueName: \"kubernetes.io/projected/761f8c97-f2c7-4769-9c0b-924a4877cd38-kube-api-access-qckkl\") pod \"node-ca-rljvj\" (UID: \"761f8c97-f2c7-4769-9c0b-924a4877cd38\") " pod="openshift-image-registry/node-ca-rljvj"
Sep 09 06:51:07.687770 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.687640    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/306002f3-75e6-40e8-b651-a3ffb4180d43-env-overrides\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.687770 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.687667    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5e0b0062-4ae5-4229-98a1-613f64c98142-etc-systemd\") pod \"tuned-mcwsw\" (UID: \"5e0b0062-4ae5-4229-98a1-613f64c98142\") " pod="openshift-cluster-node-tuning-operator/tuned-mcwsw"
Sep 09 06:51:07.687770 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.687702    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c6df37d2-594a-4f35-bcda-246740bf683b-socket-dir\") pod \"aws-ebs-csi-driver-node-6mkgx\" (UID: \"c6df37d2-594a-4f35-bcda-246740bf683b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mkgx"
Sep 09 06:51:07.687770 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.687735    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/00e0c40f-e508-4900-9f82-94f5ef3c04a8-cni-binary-copy\") pod \"multus-additional-cni-plugins-2p2z8\" (UID: \"00e0c40f-e508-4900-9f82-94f5ef3c04a8\") " pod="openshift-multus/multus-additional-cni-plugins-2p2z8"
Sep 09 06:51:07.688190 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.687792    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/00e0c40f-e508-4900-9f82-94f5ef3c04a8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2p2z8\" (UID: \"00e0c40f-e508-4900-9f82-94f5ef3c04a8\") " pod="openshift-multus/multus-additional-cni-plugins-2p2z8"
Sep 09 06:51:07.688190 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.687822    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/306002f3-75e6-40e8-b651-a3ffb4180d43-host-run-ovn-kubernetes\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.688190 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.687855    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e0b0062-4ae5-4229-98a1-613f64c98142-etc-kubernetes\") pod \"tuned-mcwsw\" (UID: \"5e0b0062-4ae5-4229-98a1-613f64c98142\") " pod="openshift-cluster-node-tuning-operator/tuned-mcwsw"
Sep 09 06:51:07.688190 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.687881    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5e0b0062-4ae5-4229-98a1-613f64c98142-etc-sysctl-d\") pod \"tuned-mcwsw\" (UID: \"5e0b0062-4ae5-4229-98a1-613f64c98142\") " pod="openshift-cluster-node-tuning-operator/tuned-mcwsw"
Sep 09 06:51:07.688190 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.687902    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e0b0062-4ae5-4229-98a1-613f64c98142-tmp\") pod \"tuned-mcwsw\" (UID: \"5e0b0062-4ae5-4229-98a1-613f64c98142\") " pod="openshift-cluster-node-tuning-operator/tuned-mcwsw"
Sep 09 06:51:07.688190 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.687940    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/919417d2-9658-4035-87e5-a82416654da8-cnibin\") pod \"multus-blbwl\" (UID: \"919417d2-9658-4035-87e5-a82416654da8\") " pod="openshift-multus/multus-blbwl"
Sep 09 06:51:07.688190 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.687978    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c6df37d2-594a-4f35-bcda-246740bf683b-registration-dir\") pod \"aws-ebs-csi-driver-node-6mkgx\" (UID: \"c6df37d2-594a-4f35-bcda-246740bf683b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mkgx"
Sep 09 06:51:07.688190 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.687993    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c6df37d2-594a-4f35-bcda-246740bf683b-device-dir\") pod \"aws-ebs-csi-driver-node-6mkgx\" (UID: \"c6df37d2-594a-4f35-bcda-246740bf683b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mkgx"
Sep 09 06:51:07.688190 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.688008    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/306002f3-75e6-40e8-b651-a3ffb4180d43-systemd-units\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.688190 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.688023    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/306002f3-75e6-40e8-b651-a3ffb4180d43-node-log\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.688190 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.688040    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ae5d6c9d-7110-4b99-ae5b-1d562f10234c-iptables-alerter-script\") pod \"iptables-alerter-csxxw\" (UID: \"ae5d6c9d-7110-4b99-ae5b-1d562f10234c\") " pod="openshift-network-operator/iptables-alerter-csxxw"
Sep 09 06:51:07.688190 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.688064    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e0b0062-4ae5-4229-98a1-613f64c98142-var-lib-kubelet\") pod \"tuned-mcwsw\" (UID: \"5e0b0062-4ae5-4229-98a1-613f64c98142\") " pod="openshift-cluster-node-tuning-operator/tuned-mcwsw"
Sep 09 06:51:07.688190 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.688074    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c6df37d2-594a-4f35-bcda-246740bf683b-registration-dir\") pod \"aws-ebs-csi-driver-node-6mkgx\" (UID: \"c6df37d2-594a-4f35-bcda-246740bf683b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mkgx"
Sep 09 06:51:07.688190 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.688093    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/919417d2-9658-4035-87e5-a82416654da8-host-run-k8s-cni-cncf-io\") pod \"multus-blbwl\" (UID: \"919417d2-9658-4035-87e5-a82416654da8\") " pod="openshift-multus/multus-blbwl"
Sep 09 06:51:07.688190 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.688112    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/919417d2-9658-4035-87e5-a82416654da8-etc-kubernetes\") pod \"multus-blbwl\" (UID: \"919417d2-9658-4035-87e5-a82416654da8\") " pod="openshift-multus/multus-blbwl"
Sep 09 06:51:07.688190 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.688128    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5e0b0062-4ae5-4229-98a1-613f64c98142-etc-sysconfig\") pod \"tuned-mcwsw\" (UID: \"5e0b0062-4ae5-4229-98a1-613f64c98142\") " pod="openshift-cluster-node-tuning-operator/tuned-mcwsw"
Sep 09 06:51:07.688753 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.688148    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5e0b0062-4ae5-4229-98a1-613f64c98142-etc-sysctl-conf\") pod \"tuned-mcwsw\" (UID: \"5e0b0062-4ae5-4229-98a1-613f64c98142\") " pod="openshift-cluster-node-tuning-operator/tuned-mcwsw"
Sep 09 06:51:07.688753 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.688153    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c6df37d2-594a-4f35-bcda-246740bf683b-device-dir\") pod \"aws-ebs-csi-driver-node-6mkgx\" (UID: \"c6df37d2-594a-4f35-bcda-246740bf683b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mkgx"
Sep 09 06:51:07.688753 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.688174    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/919417d2-9658-4035-87e5-a82416654da8-host-var-lib-kubelet\") pod \"multus-blbwl\" (UID: \"919417d2-9658-4035-87e5-a82416654da8\") " pod="openshift-multus/multus-blbwl"
Sep 09 06:51:07.688753 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.688191    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/919417d2-9658-4035-87e5-a82416654da8-hostroot\") pod \"multus-blbwl\" (UID: \"919417d2-9658-4035-87e5-a82416654da8\") " pod="openshift-multus/multus-blbwl"
Sep 09 06:51:07.688753 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.688207    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c6df37d2-594a-4f35-bcda-246740bf683b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6mkgx\" (UID: \"c6df37d2-594a-4f35-bcda-246740bf683b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mkgx"
Sep 09 06:51:07.688753 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.688222    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkllm\" (UniqueName: \"kubernetes.io/projected/48a06719-7aab-46cf-a45e-76754185735a-kube-api-access-zkllm\") pod \"node-resolver-cr4hg\" (UID: \"48a06719-7aab-46cf-a45e-76754185735a\") " pod="openshift-dns/node-resolver-cr4hg"
Sep 09 06:51:07.688753 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.688238    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fx2fc\" (UniqueName: \"kubernetes.io/projected/941d7367-69f9-4dbd-b23c-35441173231c-kube-api-access-fx2fc\") pod \"network-check-target-fmhfw\" (UID: \"941d7367-69f9-4dbd-b23c-35441173231c\") " pod="openshift-network-diagnostics/network-check-target-fmhfw"
Sep 09 06:51:07.688753 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.688260    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/919417d2-9658-4035-87e5-a82416654da8-host-var-lib-cni-multus\") pod \"multus-blbwl\" (UID: \"919417d2-9658-4035-87e5-a82416654da8\") " pod="openshift-multus/multus-blbwl"
Sep 09 06:51:07.688753 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.688281    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c6df37d2-594a-4f35-bcda-246740bf683b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6mkgx\" (UID: \"c6df37d2-594a-4f35-bcda-246740bf683b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mkgx"
Sep 09 06:51:07.688753 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.688294    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/306002f3-75e6-40e8-b651-a3ffb4180d43-host-run-netns\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.688753 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.688321    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/306002f3-75e6-40e8-b651-a3ffb4180d43-log-socket\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.688753 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.688339    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn9hm\" (UniqueName: \"kubernetes.io/projected/306002f3-75e6-40e8-b651-a3ffb4180d43-kube-api-access-xn9hm\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.688753 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.688355    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fa0cd37d-c6ff-4f45-9954-b2abc2645a4c-kubelet-config\") pod \"global-pull-secret-syncer-tlg4m\" (UID: \"fa0cd37d-c6ff-4f45-9954-b2abc2645a4c\") " pod="kube-system/global-pull-secret-syncer-tlg4m"
Sep 09 06:51:07.688753 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.688379    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/919417d2-9658-4035-87e5-a82416654da8-multus-cni-dir\") pod \"multus-blbwl\" (UID: \"919417d2-9658-4035-87e5-a82416654da8\") " pod="openshift-multus/multus-blbwl"
Sep 09 06:51:07.688753 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.688406    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96676d24-b303-4849-bdc0-e5b99b9b8602-metrics-certs\") pod \"network-metrics-daemon-pj9sz\" (UID: \"96676d24-b303-4849-bdc0-e5b99b9b8602\") " pod="openshift-multus/network-metrics-daemon-pj9sz"
Sep 09 06:51:07.688753 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.688423    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c6df37d2-594a-4f35-bcda-246740bf683b-etc-selinux\") pod \"aws-ebs-csi-driver-node-6mkgx\" (UID: \"c6df37d2-594a-4f35-bcda-246740bf683b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mkgx"
Sep 09 06:51:07.689430 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.688440    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/00e0c40f-e508-4900-9f82-94f5ef3c04a8-cnibin\") pod \"multus-additional-cni-plugins-2p2z8\" (UID: \"00e0c40f-e508-4900-9f82-94f5ef3c04a8\") " pod="openshift-multus/multus-additional-cni-plugins-2p2z8"
Sep 09 06:51:07.689430 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.688443    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c6df37d2-594a-4f35-bcda-246740bf683b-socket-dir\") pod \"aws-ebs-csi-driver-node-6mkgx\" (UID: \"c6df37d2-594a-4f35-bcda-246740bf683b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mkgx"
Sep 09 06:51:07.689430 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.688454    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/306002f3-75e6-40e8-b651-a3ffb4180d43-host-cni-bin\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.689430 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.688469    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/48a06719-7aab-46cf-a45e-76754185735a-hosts-file\") pod \"node-resolver-cr4hg\" (UID: \"48a06719-7aab-46cf-a45e-76754185735a\") " pod="openshift-dns/node-resolver-cr4hg"
Sep 09 06:51:07.689430 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:07.688501    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 06:51:07.689430 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.688523    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c6df37d2-594a-4f35-bcda-246740bf683b-etc-selinux\") pod \"aws-ebs-csi-driver-node-6mkgx\" (UID: \"c6df37d2-594a-4f35-bcda-246740bf683b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mkgx"
Sep 09 06:51:07.689430 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.688501    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48a06719-7aab-46cf-a45e-76754185735a-tmp-dir\") pod \"node-resolver-cr4hg\" (UID: \"48a06719-7aab-46cf-a45e-76754185735a\") " pod="openshift-dns/node-resolver-cr4hg"
Sep 09 06:51:07.689430 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:07.688558    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96676d24-b303-4849-bdc0-e5b99b9b8602-metrics-certs podName:96676d24-b303-4849-bdc0-e5b99b9b8602 nodeName:}" failed. No retries permitted until 2026-09-09 06:51:08.18853962 +0000 UTC m=+2.980348940 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96676d24-b303-4849-bdc0-e5b99b9b8602-metrics-certs") pod "network-metrics-daemon-pj9sz" (UID: "96676d24-b303-4849-bdc0-e5b99b9b8602") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 06:51:07.689430 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.688588    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ae5d6c9d-7110-4b99-ae5b-1d562f10234c-host-slash\") pod \"iptables-alerter-csxxw\" (UID: \"ae5d6c9d-7110-4b99-ae5b-1d562f10234c\") " pod="openshift-network-operator/iptables-alerter-csxxw"
Sep 09 06:51:07.689430 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.688619    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e0b0062-4ae5-4229-98a1-613f64c98142-lib-modules\") pod \"tuned-mcwsw\" (UID: \"5e0b0062-4ae5-4229-98a1-613f64c98142\") " pod="openshift-cluster-node-tuning-operator/tuned-mcwsw"
Sep 09 06:51:07.689430 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.688636    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cssv\" (UniqueName: \"kubernetes.io/projected/96676d24-b303-4849-bdc0-e5b99b9b8602-kube-api-access-8cssv\") pod \"network-metrics-daemon-pj9sz\" (UID: \"96676d24-b303-4849-bdc0-e5b99b9b8602\") " pod="openshift-multus/network-metrics-daemon-pj9sz"
Sep 09 06:51:07.689430 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.688655    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/00e0c40f-e508-4900-9f82-94f5ef3c04a8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2p2z8\" (UID: \"00e0c40f-e508-4900-9f82-94f5ef3c04a8\") " pod="openshift-multus/multus-additional-cni-plugins-2p2z8"
Sep 09 06:51:07.689430 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.688689    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/306002f3-75e6-40e8-b651-a3ffb4180d43-var-lib-openvswitch\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.689430 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.688705    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5e0b0062-4ae5-4229-98a1-613f64c98142-etc-tuned\") pod \"tuned-mcwsw\" (UID: \"5e0b0062-4ae5-4229-98a1-613f64c98142\") " pod="openshift-cluster-node-tuning-operator/tuned-mcwsw"
Sep 09 06:51:07.689430 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.688720    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/919417d2-9658-4035-87e5-a82416654da8-cni-binary-copy\") pod \"multus-blbwl\" (UID: \"919417d2-9658-4035-87e5-a82416654da8\") " pod="openshift-multus/multus-blbwl"
Sep 09 06:51:07.689430 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.688743    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/919417d2-9658-4035-87e5-a82416654da8-multus-socket-dir-parent\") pod \"multus-blbwl\" (UID: \"919417d2-9658-4035-87e5-a82416654da8\") " pod="openshift-multus/multus-blbwl"
Sep 09 06:51:07.689936 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.688783    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/919417d2-9658-4035-87e5-a82416654da8-multus-conf-dir\") pod \"multus-blbwl\" (UID: \"919417d2-9658-4035-87e5-a82416654da8\") " pod="openshift-multus/multus-blbwl"
Sep 09 06:51:07.689936 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.688806    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/761f8c97-f2c7-4769-9c0b-924a4877cd38-serviceca\") pod \"node-ca-rljvj\" (UID: \"761f8c97-f2c7-4769-9c0b-924a4877cd38\") " pod="openshift-image-registry/node-ca-rljvj"
Sep 09 06:51:07.689936 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.688862    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/00e0c40f-e508-4900-9f82-94f5ef3c04a8-system-cni-dir\") pod \"multus-additional-cni-plugins-2p2z8\" (UID: \"00e0c40f-e508-4900-9f82-94f5ef3c04a8\") " pod="openshift-multus/multus-additional-cni-plugins-2p2z8"
Sep 09 06:51:07.689936 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.688889    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5e0b0062-4ae5-4229-98a1-613f64c98142-etc-modprobe-d\") pod \"tuned-mcwsw\" (UID: \"5e0b0062-4ae5-4229-98a1-613f64c98142\") " pod="openshift-cluster-node-tuning-operator/tuned-mcwsw"
Sep 09 06:51:07.689936 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.688912    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/919417d2-9658-4035-87e5-a82416654da8-host-run-netns\") pod \"multus-blbwl\" (UID: \"919417d2-9658-4035-87e5-a82416654da8\") " pod="openshift-multus/multus-blbwl"
Sep 09 06:51:07.689936 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.688937    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm9w8\" (UniqueName: \"kubernetes.io/projected/c6df37d2-594a-4f35-bcda-246740bf683b-kube-api-access-qm9w8\") pod \"aws-ebs-csi-driver-node-6mkgx\" (UID: \"c6df37d2-594a-4f35-bcda-246740bf683b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mkgx"
Sep 09 06:51:07.689936 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.688962    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/00e0c40f-e508-4900-9f82-94f5ef3c04a8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2p2z8\" (UID: \"00e0c40f-e508-4900-9f82-94f5ef3c04a8\") " pod="openshift-multus/multus-additional-cni-plugins-2p2z8"
Sep 09 06:51:07.689936 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.688986    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5e0b0062-4ae5-4229-98a1-613f64c98142-run\") pod \"tuned-mcwsw\" (UID: \"5e0b0062-4ae5-4229-98a1-613f64c98142\") " pod="openshift-cluster-node-tuning-operator/tuned-mcwsw"
Sep 09 06:51:07.689936 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.689135    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e0b0062-4ae5-4229-98a1-613f64c98142-host\") pod \"tuned-mcwsw\" (UID: \"5e0b0062-4ae5-4229-98a1-613f64c98142\") " pod="openshift-cluster-node-tuning-operator/tuned-mcwsw"
Sep 09 06:51:07.689936 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.689167    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzg2h\" (UniqueName: \"kubernetes.io/projected/5e0b0062-4ae5-4229-98a1-613f64c98142-kube-api-access-nzg2h\") pod \"tuned-mcwsw\" (UID: \"5e0b0062-4ae5-4229-98a1-613f64c98142\") " pod="openshift-cluster-node-tuning-operator/tuned-mcwsw"
Sep 09 06:51:07.689936 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.689196    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/919417d2-9658-4035-87e5-a82416654da8-host-var-lib-cni-bin\") pod \"multus-blbwl\" (UID: \"919417d2-9658-4035-87e5-a82416654da8\") " pod="openshift-multus/multus-blbwl"
Sep 09 06:51:07.689936 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.689228    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/761f8c97-f2c7-4769-9c0b-924a4877cd38-serviceca\") pod \"node-ca-rljvj\" (UID: \"761f8c97-f2c7-4769-9c0b-924a4877cd38\") " pod="openshift-image-registry/node-ca-rljvj"
Sep 09 06:51:07.689936 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.689233    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/306002f3-75e6-40e8-b651-a3ffb4180d43-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.689936 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.689266    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa0cd37d-c6ff-4f45-9954-b2abc2645a4c-original-pull-secret\") pod \"global-pull-secret-syncer-tlg4m\" (UID: \"fa0cd37d-c6ff-4f45-9954-b2abc2645a4c\") " pod="kube-system/global-pull-secret-syncer-tlg4m"
Sep 09 06:51:07.689936 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.689287    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mc9n\" (UniqueName: \"kubernetes.io/projected/919417d2-9658-4035-87e5-a82416654da8-kube-api-access-7mc9n\") pod \"multus-blbwl\" (UID: \"919417d2-9658-4035-87e5-a82416654da8\") " pod="openshift-multus/multus-blbwl"
Sep 09 06:51:07.689936 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.689304    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/306002f3-75e6-40e8-b651-a3ffb4180d43-host-kubelet\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.690445 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.689319    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/306002f3-75e6-40e8-b651-a3ffb4180d43-run-openvswitch\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.690445 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.689354    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/306002f3-75e6-40e8-b651-a3ffb4180d43-ovn-node-metrics-cert\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.695333 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.695309    2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 09 06:51:07.699248 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.699221    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qckkl\" (UniqueName: \"kubernetes.io/projected/761f8c97-f2c7-4769-9c0b-924a4877cd38-kube-api-access-qckkl\") pod \"node-ca-rljvj\" (UID: \"761f8c97-f2c7-4769-9c0b-924a4877cd38\") " pod="openshift-image-registry/node-ca-rljvj"
Sep 09 06:51:07.699315 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.699223    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cssv\" (UniqueName: \"kubernetes.io/projected/96676d24-b303-4849-bdc0-e5b99b9b8602-kube-api-access-8cssv\") pod \"network-metrics-daemon-pj9sz\" (UID: \"96676d24-b303-4849-bdc0-e5b99b9b8602\") " pod="openshift-multus/network-metrics-daemon-pj9sz"
Sep 09 06:51:07.699315 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.699226    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm9w8\" (UniqueName: \"kubernetes.io/projected/c6df37d2-594a-4f35-bcda-246740bf683b-kube-api-access-qm9w8\") pod \"aws-ebs-csi-driver-node-6mkgx\" (UID: \"c6df37d2-594a-4f35-bcda-246740bf683b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mkgx"
Sep 09 06:51:07.709139 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.709105    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-176.ec2.internal" event={"ID":"e4ae816a232fd3409ce4266a67ae4820","Type":"ContainerStarted","Data":"3e7217c4612999b09a32f8c6df8d9231259cd9c565daf940d0922ef470382511"}
Sep 09 06:51:07.710128 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.710110    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-176.ec2.internal" event={"ID":"10ede7a8d76e64113edb635ab66c3e5e","Type":"ContainerStarted","Data":"5428a7568c20575ce1608b29a9a4fa0aa893c4c84aa653457022ec9f792e10cc"}
Sep 09 06:51:07.789648 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.789585    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/919417d2-9658-4035-87e5-a82416654da8-system-cni-dir\") pod \"multus-blbwl\" (UID: \"919417d2-9658-4035-87e5-a82416654da8\") " pod="openshift-multus/multus-blbwl"
Sep 09 06:51:07.789648 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.789614    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/306002f3-75e6-40e8-b651-a3ffb4180d43-run-systemd\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.789648 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.789631    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/306002f3-75e6-40e8-b651-a3ffb4180d43-host-slash\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.789648 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.789647    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/306002f3-75e6-40e8-b651-a3ffb4180d43-run-ovn\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.789983 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.789662    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/306002f3-75e6-40e8-b651-a3ffb4180d43-ovnkube-script-lib\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.789983 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.789682    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scfvw\" (UniqueName: \"kubernetes.io/projected/ae5d6c9d-7110-4b99-ae5b-1d562f10234c-kube-api-access-scfvw\") pod \"iptables-alerter-csxxw\" (UID: \"ae5d6c9d-7110-4b99-ae5b-1d562f10234c\") " pod="openshift-network-operator/iptables-alerter-csxxw"
Sep 09 06:51:07.789983 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.789723    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/306002f3-75e6-40e8-b651-a3ffb4180d43-run-systemd\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.789983 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.789739    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/306002f3-75e6-40e8-b651-a3ffb4180d43-host-slash\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.789983 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.789764    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/306002f3-75e6-40e8-b651-a3ffb4180d43-run-ovn\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.789983 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.789794    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/919417d2-9658-4035-87e5-a82416654da8-system-cni-dir\") pod \"multus-blbwl\" (UID: \"919417d2-9658-4035-87e5-a82416654da8\") " pod="openshift-multus/multus-blbwl"
Sep 09 06:51:07.789983 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.789828    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/919417d2-9658-4035-87e5-a82416654da8-host-run-multus-certs\") pod \"multus-blbwl\" (UID: \"919417d2-9658-4035-87e5-a82416654da8\") " pod="openshift-multus/multus-blbwl"
Sep 09 06:51:07.789983 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.789882    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpz6n\" (UniqueName: \"kubernetes.io/projected/00e0c40f-e508-4900-9f82-94f5ef3c04a8-kube-api-access-rpz6n\") pod \"multus-additional-cni-plugins-2p2z8\" (UID: \"00e0c40f-e508-4900-9f82-94f5ef3c04a8\") " pod="openshift-multus/multus-additional-cni-plugins-2p2z8"
Sep 09 06:51:07.789983 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.789907    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fa0cd37d-c6ff-4f45-9954-b2abc2645a4c-dbus\") pod \"global-pull-secret-syncer-tlg4m\" (UID: \"fa0cd37d-c6ff-4f45-9954-b2abc2645a4c\") " pod="kube-system/global-pull-secret-syncer-tlg4m"
Sep 09 06:51:07.789983 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.789917    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/919417d2-9658-4035-87e5-a82416654da8-host-run-multus-certs\") pod \"multus-blbwl\" (UID: \"919417d2-9658-4035-87e5-a82416654da8\") " pod="openshift-multus/multus-blbwl"
Sep 09 06:51:07.789983 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.789935    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e0b0062-4ae5-4229-98a1-613f64c98142-sys\") pod \"tuned-mcwsw\" (UID: \"5e0b0062-4ae5-4229-98a1-613f64c98142\") " pod="openshift-cluster-node-tuning-operator/tuned-mcwsw"
Sep 09 06:51:07.789983 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.789963    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/919417d2-9658-4035-87e5-a82416654da8-multus-daemon-config\") pod \"multus-blbwl\" (UID: \"919417d2-9658-4035-87e5-a82416654da8\") " pod="openshift-multus/multus-blbwl"
Sep 09 06:51:07.789983 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.789988    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fa0cd37d-c6ff-4f45-9954-b2abc2645a4c-dbus\") pod \"global-pull-secret-syncer-tlg4m\" (UID: \"fa0cd37d-c6ff-4f45-9954-b2abc2645a4c\") " pod="kube-system/global-pull-secret-syncer-tlg4m"
Sep 09 06:51:07.790598 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.789989    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/306002f3-75e6-40e8-b651-a3ffb4180d43-env-overrides\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.790598 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.790028    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5e0b0062-4ae5-4229-98a1-613f64c98142-etc-systemd\") pod \"tuned-mcwsw\" (UID: \"5e0b0062-4ae5-4229-98a1-613f64c98142\") " pod="openshift-cluster-node-tuning-operator/tuned-mcwsw"
Sep 09 06:51:07.790598 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.790054    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e0b0062-4ae5-4229-98a1-613f64c98142-sys\") pod \"tuned-mcwsw\" (UID: \"5e0b0062-4ae5-4229-98a1-613f64c98142\") " pod="openshift-cluster-node-tuning-operator/tuned-mcwsw"
Sep 09 06:51:07.790598 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.790083    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5e0b0062-4ae5-4229-98a1-613f64c98142-etc-systemd\") pod \"tuned-mcwsw\" (UID: \"5e0b0062-4ae5-4229-98a1-613f64c98142\") " pod="openshift-cluster-node-tuning-operator/tuned-mcwsw"
Sep 09 06:51:07.790598 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.790098    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/00e0c40f-e508-4900-9f82-94f5ef3c04a8-cni-binary-copy\") pod \"multus-additional-cni-plugins-2p2z8\" (UID: \"00e0c40f-e508-4900-9f82-94f5ef3c04a8\") " pod="openshift-multus/multus-additional-cni-plugins-2p2z8"
Sep 09 06:51:07.790598 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.790128    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/00e0c40f-e508-4900-9f82-94f5ef3c04a8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2p2z8\" (UID: \"00e0c40f-e508-4900-9f82-94f5ef3c04a8\") " pod="openshift-multus/multus-additional-cni-plugins-2p2z8"
Sep 09 06:51:07.790598 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.790147    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/306002f3-75e6-40e8-b651-a3ffb4180d43-host-run-ovn-kubernetes\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.790598 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.790169    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e0b0062-4ae5-4229-98a1-613f64c98142-etc-kubernetes\") pod \"tuned-mcwsw\" (UID: \"5e0b0062-4ae5-4229-98a1-613f64c98142\") " pod="openshift-cluster-node-tuning-operator/tuned-mcwsw"
Sep 09 06:51:07.790598 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.790194    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5e0b0062-4ae5-4229-98a1-613f64c98142-etc-sysctl-d\") pod \"tuned-mcwsw\" (UID: \"5e0b0062-4ae5-4229-98a1-613f64c98142\") " pod="openshift-cluster-node-tuning-operator/tuned-mcwsw"
Sep 09 06:51:07.790598 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.790217    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e0b0062-4ae5-4229-98a1-613f64c98142-tmp\") pod \"tuned-mcwsw\" (UID: \"5e0b0062-4ae5-4229-98a1-613f64c98142\") " pod="openshift-cluster-node-tuning-operator/tuned-mcwsw"
Sep 09 06:51:07.790598 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.790242    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/919417d2-9658-4035-87e5-a82416654da8-cnibin\") pod \"multus-blbwl\" (UID: \"919417d2-9658-4035-87e5-a82416654da8\") " pod="openshift-multus/multus-blbwl"
Sep 09 06:51:07.790598 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.790269    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/306002f3-75e6-40e8-b651-a3ffb4180d43-systemd-units\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.790598 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.790249    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e0b0062-4ae5-4229-98a1-613f64c98142-etc-kubernetes\") pod \"tuned-mcwsw\" (UID: \"5e0b0062-4ae5-4229-98a1-613f64c98142\") " pod="openshift-cluster-node-tuning-operator/tuned-mcwsw"
Sep 09 06:51:07.790598 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.790317    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/306002f3-75e6-40e8-b651-a3ffb4180d43-node-log\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.790598 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.790343    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ae5d6c9d-7110-4b99-ae5b-1d562f10234c-iptables-alerter-script\") pod \"iptables-alerter-csxxw\" (UID: \"ae5d6c9d-7110-4b99-ae5b-1d562f10234c\") " pod="openshift-network-operator/iptables-alerter-csxxw"
Sep 09 06:51:07.790598 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.790358    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/306002f3-75e6-40e8-b651-a3ffb4180d43-host-run-ovn-kubernetes\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.790598 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.790368    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e0b0062-4ae5-4229-98a1-613f64c98142-var-lib-kubelet\") pod \"tuned-mcwsw\" (UID: \"5e0b0062-4ae5-4229-98a1-613f64c98142\") " pod="openshift-cluster-node-tuning-operator/tuned-mcwsw"
Sep 09 06:51:07.791442 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.790397    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/306002f3-75e6-40e8-b651-a3ffb4180d43-env-overrides\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.791442 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.790403    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/919417d2-9658-4035-87e5-a82416654da8-host-run-k8s-cni-cncf-io\") pod \"multus-blbwl\" (UID: \"919417d2-9658-4035-87e5-a82416654da8\") " pod="openshift-multus/multus-blbwl"
Sep 09 06:51:07.791442 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.790407    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/306002f3-75e6-40e8-b651-a3ffb4180d43-ovnkube-script-lib\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.791442 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.790414    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e0b0062-4ae5-4229-98a1-613f64c98142-var-lib-kubelet\") pod \"tuned-mcwsw\" (UID: \"5e0b0062-4ae5-4229-98a1-613f64c98142\") " pod="openshift-cluster-node-tuning-operator/tuned-mcwsw"
Sep 09 06:51:07.791442 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.790431    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/919417d2-9658-4035-87e5-a82416654da8-etc-kubernetes\") pod \"multus-blbwl\" (UID: \"919417d2-9658-4035-87e5-a82416654da8\") " pod="openshift-multus/multus-blbwl"
Sep 09 06:51:07.791442 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.790461    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/306002f3-75e6-40e8-b651-a3ffb4180d43-systemd-units\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.791442 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.790465    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/919417d2-9658-4035-87e5-a82416654da8-host-run-k8s-cni-cncf-io\") pod \"multus-blbwl\" (UID: \"919417d2-9658-4035-87e5-a82416654da8\") " pod="openshift-multus/multus-blbwl"
Sep 09 06:51:07.791442 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.790469    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5e0b0062-4ae5-4229-98a1-613f64c98142-etc-sysctl-d\") pod \"tuned-mcwsw\" (UID: \"5e0b0062-4ae5-4229-98a1-613f64c98142\") " pod="openshift-cluster-node-tuning-operator/tuned-mcwsw"
Sep 09 06:51:07.791442 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.790504    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/306002f3-75e6-40e8-b651-a3ffb4180d43-node-log\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.791442 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.790524    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/919417d2-9658-4035-87e5-a82416654da8-cnibin\") pod \"multus-blbwl\" (UID: \"919417d2-9658-4035-87e5-a82416654da8\") " pod="openshift-multus/multus-blbwl"
Sep 09 06:51:07.791442 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.790544    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/919417d2-9658-4035-87e5-a82416654da8-etc-kubernetes\") pod \"multus-blbwl\" (UID: \"919417d2-9658-4035-87e5-a82416654da8\") " pod="openshift-multus/multus-blbwl"
Sep 09 06:51:07.791442 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.790581    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/919417d2-9658-4035-87e5-a82416654da8-multus-daemon-config\") pod \"multus-blbwl\" (UID: \"919417d2-9658-4035-87e5-a82416654da8\") " pod="openshift-multus/multus-blbwl"
Sep 09 06:51:07.791442 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.790667    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5e0b0062-4ae5-4229-98a1-613f64c98142-etc-sysconfig\") pod \"tuned-mcwsw\" (UID: \"5e0b0062-4ae5-4229-98a1-613f64c98142\") " pod="openshift-cluster-node-tuning-operator/tuned-mcwsw"
Sep 09 06:51:07.791442 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.790854    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/00e0c40f-e508-4900-9f82-94f5ef3c04a8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2p2z8\" (UID: \"00e0c40f-e508-4900-9f82-94f5ef3c04a8\") " pod="openshift-multus/multus-additional-cni-plugins-2p2z8"
Sep 09 06:51:07.791442 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.790928    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5e0b0062-4ae5-4229-98a1-613f64c98142-etc-sysconfig\") pod \"tuned-mcwsw\" (UID: \"5e0b0062-4ae5-4229-98a1-613f64c98142\") " pod="openshift-cluster-node-tuning-operator/tuned-mcwsw"
Sep 09 06:51:07.791442 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.790972    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ae5d6c9d-7110-4b99-ae5b-1d562f10234c-iptables-alerter-script\") pod \"iptables-alerter-csxxw\" (UID: \"ae5d6c9d-7110-4b99-ae5b-1d562f10234c\") " pod="openshift-network-operator/iptables-alerter-csxxw"
Sep 09 06:51:07.791442 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.790973    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5e0b0062-4ae5-4229-98a1-613f64c98142-etc-sysctl-conf\") pod \"tuned-mcwsw\" (UID: \"5e0b0062-4ae5-4229-98a1-613f64c98142\") " pod="openshift-cluster-node-tuning-operator/tuned-mcwsw"
Sep 09 06:51:07.791442 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791008    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/00e0c40f-e508-4900-9f82-94f5ef3c04a8-cni-binary-copy\") pod \"multus-additional-cni-plugins-2p2z8\" (UID: \"00e0c40f-e508-4900-9f82-94f5ef3c04a8\") " pod="openshift-multus/multus-additional-cni-plugins-2p2z8"
Sep 09 06:51:07.792276 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791013    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/919417d2-9658-4035-87e5-a82416654da8-host-var-lib-kubelet\") pod \"multus-blbwl\" (UID: \"919417d2-9658-4035-87e5-a82416654da8\") " pod="openshift-multus/multus-blbwl"
Sep 09 06:51:07.792276 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791051    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/919417d2-9658-4035-87e5-a82416654da8-host-var-lib-kubelet\") pod \"multus-blbwl\" (UID: \"919417d2-9658-4035-87e5-a82416654da8\") " pod="openshift-multus/multus-blbwl"
Sep 09 06:51:07.792276 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791060    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/919417d2-9658-4035-87e5-a82416654da8-hostroot\") pod \"multus-blbwl\" (UID: \"919417d2-9658-4035-87e5-a82416654da8\") " pod="openshift-multus/multus-blbwl"
Sep 09 06:51:07.792276 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791078    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkllm\" (UniqueName: \"kubernetes.io/projected/48a06719-7aab-46cf-a45e-76754185735a-kube-api-access-zkllm\") pod \"node-resolver-cr4hg\" (UID: \"48a06719-7aab-46cf-a45e-76754185735a\") " pod="openshift-dns/node-resolver-cr4hg"
Sep 09 06:51:07.792276 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791093    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fx2fc\" (UniqueName: \"kubernetes.io/projected/941d7367-69f9-4dbd-b23c-35441173231c-kube-api-access-fx2fc\") pod \"network-check-target-fmhfw\" (UID: \"941d7367-69f9-4dbd-b23c-35441173231c\") " pod="openshift-network-diagnostics/network-check-target-fmhfw"
Sep 09 06:51:07.792276 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791109    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/919417d2-9658-4035-87e5-a82416654da8-host-var-lib-cni-multus\") pod \"multus-blbwl\" (UID: \"919417d2-9658-4035-87e5-a82416654da8\") " pod="openshift-multus/multus-blbwl"
Sep 09 06:51:07.792276 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791123    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/306002f3-75e6-40e8-b651-a3ffb4180d43-host-run-netns\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.792276 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791138    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/306002f3-75e6-40e8-b651-a3ffb4180d43-log-socket\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.792276 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791155    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5e0b0062-4ae5-4229-98a1-613f64c98142-etc-sysctl-conf\") pod \"tuned-mcwsw\" (UID: \"5e0b0062-4ae5-4229-98a1-613f64c98142\") " pod="openshift-cluster-node-tuning-operator/tuned-mcwsw"
Sep 09 06:51:07.792276 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791157    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn9hm\" (UniqueName: \"kubernetes.io/projected/306002f3-75e6-40e8-b651-a3ffb4180d43-kube-api-access-xn9hm\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.792276 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791184    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/919417d2-9658-4035-87e5-a82416654da8-host-var-lib-cni-multus\") pod \"multus-blbwl\" (UID: \"919417d2-9658-4035-87e5-a82416654da8\") " pod="openshift-multus/multus-blbwl"
Sep 09 06:51:07.792276 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791200    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fa0cd37d-c6ff-4f45-9954-b2abc2645a4c-kubelet-config\") pod \"global-pull-secret-syncer-tlg4m\" (UID: \"fa0cd37d-c6ff-4f45-9954-b2abc2645a4c\") " pod="kube-system/global-pull-secret-syncer-tlg4m"
Sep 09 06:51:07.792276 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791223    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/919417d2-9658-4035-87e5-a82416654da8-hostroot\") pod \"multus-blbwl\" (UID: \"919417d2-9658-4035-87e5-a82416654da8\") " pod="openshift-multus/multus-blbwl"
Sep 09 06:51:07.792276 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791227    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/919417d2-9658-4035-87e5-a82416654da8-multus-cni-dir\") pod \"multus-blbwl\" (UID: \"919417d2-9658-4035-87e5-a82416654da8\") " pod="openshift-multus/multus-blbwl"
Sep 09 06:51:07.792276 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791268    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/306002f3-75e6-40e8-b651-a3ffb4180d43-host-run-netns\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.792276 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791270    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/00e0c40f-e508-4900-9f82-94f5ef3c04a8-cnibin\") pod \"multus-additional-cni-plugins-2p2z8\" (UID: \"00e0c40f-e508-4900-9f82-94f5ef3c04a8\") " pod="openshift-multus/multus-additional-cni-plugins-2p2z8"
Sep 09 06:51:07.792276 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791296    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/306002f3-75e6-40e8-b651-a3ffb4180d43-log-socket\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.792276 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791307    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/306002f3-75e6-40e8-b651-a3ffb4180d43-host-cni-bin\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.793405 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791328    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fa0cd37d-c6ff-4f45-9954-b2abc2645a4c-kubelet-config\") pod \"global-pull-secret-syncer-tlg4m\" (UID: \"fa0cd37d-c6ff-4f45-9954-b2abc2645a4c\") " pod="kube-system/global-pull-secret-syncer-tlg4m"
Sep 09 06:51:07.793405 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791337    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/48a06719-7aab-46cf-a45e-76754185735a-hosts-file\") pod \"node-resolver-cr4hg\" (UID: \"48a06719-7aab-46cf-a45e-76754185735a\") " pod="openshift-dns/node-resolver-cr4hg"
Sep 09 06:51:07.793405 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791368    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48a06719-7aab-46cf-a45e-76754185735a-tmp-dir\") pod \"node-resolver-cr4hg\" (UID: \"48a06719-7aab-46cf-a45e-76754185735a\") " pod="openshift-dns/node-resolver-cr4hg"
Sep 09 06:51:07.793405 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791373    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/306002f3-75e6-40e8-b651-a3ffb4180d43-host-cni-bin\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.793405 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791355    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/919417d2-9658-4035-87e5-a82416654da8-multus-cni-dir\") pod \"multus-blbwl\" (UID: \"919417d2-9658-4035-87e5-a82416654da8\") " pod="openshift-multus/multus-blbwl"
Sep 09 06:51:07.793405 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791384    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/48a06719-7aab-46cf-a45e-76754185735a-hosts-file\") pod \"node-resolver-cr4hg\" (UID: \"48a06719-7aab-46cf-a45e-76754185735a\") " pod="openshift-dns/node-resolver-cr4hg"
Sep 09 06:51:07.793405 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791310    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/00e0c40f-e508-4900-9f82-94f5ef3c04a8-cnibin\") pod \"multus-additional-cni-plugins-2p2z8\" (UID: \"00e0c40f-e508-4900-9f82-94f5ef3c04a8\") " pod="openshift-multus/multus-additional-cni-plugins-2p2z8"
Sep 09 06:51:07.793405 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791407    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ae5d6c9d-7110-4b99-ae5b-1d562f10234c-host-slash\") pod \"iptables-alerter-csxxw\" (UID: \"ae5d6c9d-7110-4b99-ae5b-1d562f10234c\") " pod="openshift-network-operator/iptables-alerter-csxxw"
Sep 09 06:51:07.793405 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791473    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e0b0062-4ae5-4229-98a1-613f64c98142-lib-modules\") pod \"tuned-mcwsw\" (UID: \"5e0b0062-4ae5-4229-98a1-613f64c98142\") " pod="openshift-cluster-node-tuning-operator/tuned-mcwsw"
Sep 09 06:51:07.793405 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791476    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ae5d6c9d-7110-4b99-ae5b-1d562f10234c-host-slash\") pod \"iptables-alerter-csxxw\" (UID: \"ae5d6c9d-7110-4b99-ae5b-1d562f10234c\") " pod="openshift-network-operator/iptables-alerter-csxxw"
Sep 09 06:51:07.793405 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791506    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/00e0c40f-e508-4900-9f82-94f5ef3c04a8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2p2z8\" (UID: \"00e0c40f-e508-4900-9f82-94f5ef3c04a8\") " pod="openshift-multus/multus-additional-cni-plugins-2p2z8"
Sep 09 06:51:07.793405 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791535    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/306002f3-75e6-40e8-b651-a3ffb4180d43-var-lib-openvswitch\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.793405 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791561    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5e0b0062-4ae5-4229-98a1-613f64c98142-etc-tuned\") pod \"tuned-mcwsw\" (UID: \"5e0b0062-4ae5-4229-98a1-613f64c98142\") " pod="openshift-cluster-node-tuning-operator/tuned-mcwsw"
Sep 09 06:51:07.793405 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791585    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/919417d2-9658-4035-87e5-a82416654da8-cni-binary-copy\") pod \"multus-blbwl\" (UID: \"919417d2-9658-4035-87e5-a82416654da8\") " pod="openshift-multus/multus-blbwl"
Sep 09 06:51:07.793405 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791609    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e0b0062-4ae5-4229-98a1-613f64c98142-lib-modules\") pod \"tuned-mcwsw\" (UID: \"5e0b0062-4ae5-4229-98a1-613f64c98142\") " pod="openshift-cluster-node-tuning-operator/tuned-mcwsw"
Sep 09 06:51:07.793405 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791614    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/306002f3-75e6-40e8-b651-a3ffb4180d43-var-lib-openvswitch\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.793405 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791615    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/919417d2-9658-4035-87e5-a82416654da8-multus-socket-dir-parent\") pod \"multus-blbwl\" (UID: \"919417d2-9658-4035-87e5-a82416654da8\") " pod="openshift-multus/multus-blbwl"
Sep 09 06:51:07.793405 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791652    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/919417d2-9658-4035-87e5-a82416654da8-multus-conf-dir\") pod \"multus-blbwl\" (UID: \"919417d2-9658-4035-87e5-a82416654da8\") " pod="openshift-multus/multus-blbwl"
Sep 09 06:51:07.794363 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791617    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48a06719-7aab-46cf-a45e-76754185735a-tmp-dir\") pod \"node-resolver-cr4hg\" (UID: \"48a06719-7aab-46cf-a45e-76754185735a\") " pod="openshift-dns/node-resolver-cr4hg"
Sep 09 06:51:07.794363 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791677    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/00e0c40f-e508-4900-9f82-94f5ef3c04a8-system-cni-dir\") pod \"multus-additional-cni-plugins-2p2z8\" (UID: \"00e0c40f-e508-4900-9f82-94f5ef3c04a8\") " pod="openshift-multus/multus-additional-cni-plugins-2p2z8"
Sep 09 06:51:07.794363 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791704    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5e0b0062-4ae5-4229-98a1-613f64c98142-etc-modprobe-d\") pod \"tuned-mcwsw\" (UID: \"5e0b0062-4ae5-4229-98a1-613f64c98142\") " pod="openshift-cluster-node-tuning-operator/tuned-mcwsw"
Sep 09 06:51:07.794363 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791710    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/919417d2-9658-4035-87e5-a82416654da8-multus-conf-dir\") pod \"multus-blbwl\" (UID: \"919417d2-9658-4035-87e5-a82416654da8\") " pod="openshift-multus/multus-blbwl"
Sep 09 06:51:07.794363 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791671    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/919417d2-9658-4035-87e5-a82416654da8-multus-socket-dir-parent\") pod \"multus-blbwl\" (UID: \"919417d2-9658-4035-87e5-a82416654da8\") " pod="openshift-multus/multus-blbwl"
Sep 09 06:51:07.794363 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791778    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/00e0c40f-e508-4900-9f82-94f5ef3c04a8-system-cni-dir\") pod \"multus-additional-cni-plugins-2p2z8\" (UID: \"00e0c40f-e508-4900-9f82-94f5ef3c04a8\") " pod="openshift-multus/multus-additional-cni-plugins-2p2z8"
Sep 09 06:51:07.794363 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791724    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/919417d2-9658-4035-87e5-a82416654da8-host-run-netns\") pod \"multus-blbwl\" (UID: \"919417d2-9658-4035-87e5-a82416654da8\") " pod="openshift-multus/multus-blbwl"
Sep 09 06:51:07.794363 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791799    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/00e0c40f-e508-4900-9f82-94f5ef3c04a8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2p2z8\" (UID: \"00e0c40f-e508-4900-9f82-94f5ef3c04a8\") " pod="openshift-multus/multus-additional-cni-plugins-2p2z8"
Sep 09 06:51:07.794363 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791817    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5e0b0062-4ae5-4229-98a1-613f64c98142-etc-modprobe-d\") pod \"tuned-mcwsw\" (UID: \"5e0b0062-4ae5-4229-98a1-613f64c98142\") " pod="openshift-cluster-node-tuning-operator/tuned-mcwsw"
Sep 09 06:51:07.794363 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791825    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/919417d2-9658-4035-87e5-a82416654da8-host-run-netns\") pod \"multus-blbwl\" (UID: \"919417d2-9658-4035-87e5-a82416654da8\") " pod="openshift-multus/multus-blbwl"
Sep 09 06:51:07.794363 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791822    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/00e0c40f-e508-4900-9f82-94f5ef3c04a8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2p2z8\" (UID: \"00e0c40f-e508-4900-9f82-94f5ef3c04a8\") " pod="openshift-multus/multus-additional-cni-plugins-2p2z8"
Sep 09 06:51:07.794363 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791861    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5e0b0062-4ae5-4229-98a1-613f64c98142-run\") pod \"tuned-mcwsw\" (UID: \"5e0b0062-4ae5-4229-98a1-613f64c98142\") " pod="openshift-cluster-node-tuning-operator/tuned-mcwsw"
Sep 09 06:51:07.794363 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791880    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e0b0062-4ae5-4229-98a1-613f64c98142-host\") pod \"tuned-mcwsw\" (UID: \"5e0b0062-4ae5-4229-98a1-613f64c98142\") " pod="openshift-cluster-node-tuning-operator/tuned-mcwsw"
Sep 09 06:51:07.794363 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791932    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5e0b0062-4ae5-4229-98a1-613f64c98142-run\") pod \"tuned-mcwsw\" (UID: \"5e0b0062-4ae5-4229-98a1-613f64c98142\") " pod="openshift-cluster-node-tuning-operator/tuned-mcwsw"
Sep 09 06:51:07.794363 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791936    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e0b0062-4ae5-4229-98a1-613f64c98142-host\") pod \"tuned-mcwsw\" (UID: \"5e0b0062-4ae5-4229-98a1-613f64c98142\") " pod="openshift-cluster-node-tuning-operator/tuned-mcwsw"
Sep 09 06:51:07.794363 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791962    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzg2h\" (UniqueName: \"kubernetes.io/projected/5e0b0062-4ae5-4229-98a1-613f64c98142-kube-api-access-nzg2h\") pod \"tuned-mcwsw\" (UID: \"5e0b0062-4ae5-4229-98a1-613f64c98142\") " pod="openshift-cluster-node-tuning-operator/tuned-mcwsw"
Sep 09 06:51:07.794363 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.791983    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/919417d2-9658-4035-87e5-a82416654da8-host-var-lib-cni-bin\") pod \"multus-blbwl\" (UID: \"919417d2-9658-4035-87e5-a82416654da8\") " pod="openshift-multus/multus-blbwl"
Sep 09 06:51:07.794363 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.792016    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/306002f3-75e6-40e8-b651-a3ffb4180d43-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.795189 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.792048    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa0cd37d-c6ff-4f45-9954-b2abc2645a4c-original-pull-secret\") pod \"global-pull-secret-syncer-tlg4m\" (UID: \"fa0cd37d-c6ff-4f45-9954-b2abc2645a4c\") " pod="kube-system/global-pull-secret-syncer-tlg4m"
Sep 09 06:51:07.795189 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.792073    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mc9n\" (UniqueName: \"kubernetes.io/projected/919417d2-9658-4035-87e5-a82416654da8-kube-api-access-7mc9n\") pod \"multus-blbwl\" (UID: \"919417d2-9658-4035-87e5-a82416654da8\") " pod="openshift-multus/multus-blbwl"
Sep 09 06:51:07.795189 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.792099    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/306002f3-75e6-40e8-b651-a3ffb4180d43-host-kubelet\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.795189 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.792113    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/306002f3-75e6-40e8-b651-a3ffb4180d43-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.795189 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.792121    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/306002f3-75e6-40e8-b651-a3ffb4180d43-run-openvswitch\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.795189 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.792157    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/306002f3-75e6-40e8-b651-a3ffb4180d43-ovn-node-metrics-cert\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.795189 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.792164    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/306002f3-75e6-40e8-b651-a3ffb4180d43-run-openvswitch\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.795189 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.792189    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/306002f3-75e6-40e8-b651-a3ffb4180d43-etc-openvswitch\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.795189 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.792216    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/306002f3-75e6-40e8-b651-a3ffb4180d43-host-cni-netd\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.795189 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.792240    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/00e0c40f-e508-4900-9f82-94f5ef3c04a8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2p2z8\" (UID: \"00e0c40f-e508-4900-9f82-94f5ef3c04a8\") " pod="openshift-multus/multus-additional-cni-plugins-2p2z8"
Sep 09 06:51:07.795189 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.792242    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/306002f3-75e6-40e8-b651-a3ffb4180d43-ovnkube-config\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.795189 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.792285    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/25fed217-b55a-417b-87be-cae14b802dc3-agent-certs\") pod \"konnectivity-agent-xv8b9\" (UID: \"25fed217-b55a-417b-87be-cae14b802dc3\") " pod="kube-system/konnectivity-agent-xv8b9"
Sep 09 06:51:07.795189 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.792311    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/25fed217-b55a-417b-87be-cae14b802dc3-konnectivity-ca\") pod \"konnectivity-agent-xv8b9\" (UID: \"25fed217-b55a-417b-87be-cae14b802dc3\") " pod="kube-system/konnectivity-agent-xv8b9"
Sep 09 06:51:07.795189 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.792573    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/306002f3-75e6-40e8-b651-a3ffb4180d43-etc-openvswitch\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.795189 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.792074    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/919417d2-9658-4035-87e5-a82416654da8-cni-binary-copy\") pod \"multus-blbwl\" (UID: \"919417d2-9658-4035-87e5-a82416654da8\") " pod="openshift-multus/multus-blbwl"
Sep 09 06:51:07.795189 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:07.792244    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 06:51:07.795189 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.792668    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/306002f3-75e6-40e8-b651-a3ffb4180d43-host-kubelet\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.795899 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:07.792678    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa0cd37d-c6ff-4f45-9954-b2abc2645a4c-original-pull-secret podName:fa0cd37d-c6ff-4f45-9954-b2abc2645a4c nodeName:}" failed. No retries permitted until 2026-09-09 06:51:08.292658894 +0000 UTC m=+3.084468227 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fa0cd37d-c6ff-4f45-9954-b2abc2645a4c-original-pull-secret") pod "global-pull-secret-syncer-tlg4m" (UID: "fa0cd37d-c6ff-4f45-9954-b2abc2645a4c") : object "kube-system"/"original-pull-secret" not registered
Sep 09 06:51:07.795899 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.792716    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/306002f3-75e6-40e8-b651-a3ffb4180d43-host-cni-netd\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.795899 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.792751    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/306002f3-75e6-40e8-b651-a3ffb4180d43-ovnkube-config\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.795899 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.792814    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/919417d2-9658-4035-87e5-a82416654da8-host-var-lib-cni-bin\") pod \"multus-blbwl\" (UID: \"919417d2-9658-4035-87e5-a82416654da8\") " pod="openshift-multus/multus-blbwl"
Sep 09 06:51:07.795899 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.792872    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/25fed217-b55a-417b-87be-cae14b802dc3-konnectivity-ca\") pod \"konnectivity-agent-xv8b9\" (UID: \"25fed217-b55a-417b-87be-cae14b802dc3\") " pod="kube-system/konnectivity-agent-xv8b9"
Sep 09 06:51:07.795899 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.794178    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e0b0062-4ae5-4229-98a1-613f64c98142-tmp\") pod \"tuned-mcwsw\" (UID: \"5e0b0062-4ae5-4229-98a1-613f64c98142\") " pod="openshift-cluster-node-tuning-operator/tuned-mcwsw"
Sep 09 06:51:07.795899 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.794900    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5e0b0062-4ae5-4229-98a1-613f64c98142-etc-tuned\") pod \"tuned-mcwsw\" (UID: \"5e0b0062-4ae5-4229-98a1-613f64c98142\") " pod="openshift-cluster-node-tuning-operator/tuned-mcwsw"
Sep 09 06:51:07.795899 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.794963    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/306002f3-75e6-40e8-b651-a3ffb4180d43-ovn-node-metrics-cert\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.795899 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.795448    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/25fed217-b55a-417b-87be-cae14b802dc3-agent-certs\") pod \"konnectivity-agent-xv8b9\" (UID: \"25fed217-b55a-417b-87be-cae14b802dc3\") " pod="kube-system/konnectivity-agent-xv8b9"
Sep 09 06:51:07.799549 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.799520    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpz6n\" (UniqueName: \"kubernetes.io/projected/00e0c40f-e508-4900-9f82-94f5ef3c04a8-kube-api-access-rpz6n\") pod \"multus-additional-cni-plugins-2p2z8\" (UID: \"00e0c40f-e508-4900-9f82-94f5ef3c04a8\") " pod="openshift-multus/multus-additional-cni-plugins-2p2z8"
Sep 09 06:51:07.801365 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.801344    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkllm\" (UniqueName: \"kubernetes.io/projected/48a06719-7aab-46cf-a45e-76754185735a-kube-api-access-zkllm\") pod \"node-resolver-cr4hg\" (UID: \"48a06719-7aab-46cf-a45e-76754185735a\") " pod="openshift-dns/node-resolver-cr4hg"
Sep 09 06:51:07.801981 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.801963    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scfvw\" (UniqueName: \"kubernetes.io/projected/ae5d6c9d-7110-4b99-ae5b-1d562f10234c-kube-api-access-scfvw\") pod \"iptables-alerter-csxxw\" (UID: \"ae5d6c9d-7110-4b99-ae5b-1d562f10234c\") " pod="openshift-network-operator/iptables-alerter-csxxw"
Sep 09 06:51:07.802069 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.802019    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn9hm\" (UniqueName: \"kubernetes.io/projected/306002f3-75e6-40e8-b651-a3ffb4180d43-kube-api-access-xn9hm\") pod \"ovnkube-node-xt6cr\" (UID: \"306002f3-75e6-40e8-b651-a3ffb4180d43\") " pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.806273 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:07.805983    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 06:51:07.806273 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:07.806008    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 06:51:07.806273 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:07.806022    2575 projected.go:196] Error preparing data for projected volume kube-api-access-fx2fc for pod openshift-network-diagnostics/network-check-target-fmhfw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 06:51:07.806273 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:07.806085    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/941d7367-69f9-4dbd-b23c-35441173231c-kube-api-access-fx2fc podName:941d7367-69f9-4dbd-b23c-35441173231c nodeName:}" failed. No retries permitted until 2026-09-09 06:51:08.306065985 +0000 UTC m=+3.097875315 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fx2fc" (UniqueName: "kubernetes.io/projected/941d7367-69f9-4dbd-b23c-35441173231c-kube-api-access-fx2fc") pod "network-check-target-fmhfw" (UID: "941d7367-69f9-4dbd-b23c-35441173231c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 06:51:07.810665 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.810646    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mc9n\" (UniqueName: \"kubernetes.io/projected/919417d2-9658-4035-87e5-a82416654da8-kube-api-access-7mc9n\") pod \"multus-blbwl\" (UID: \"919417d2-9658-4035-87e5-a82416654da8\") " pod="openshift-multus/multus-blbwl"
Sep 09 06:51:07.810771 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.810653    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzg2h\" (UniqueName: \"kubernetes.io/projected/5e0b0062-4ae5-4229-98a1-613f64c98142-kube-api-access-nzg2h\") pod \"tuned-mcwsw\" (UID: \"5e0b0062-4ae5-4229-98a1-613f64c98142\") " pod="openshift-cluster-node-tuning-operator/tuned-mcwsw"
Sep 09 06:51:07.888659 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.888617    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mkgx"
Sep 09 06:51:07.895869 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.895843    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rljvj"
Sep 09 06:51:07.901363 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:07.901325    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6df37d2_594a_4f35_bcda_246740bf683b.slice/crio-65390b9c188528dbec2d18ca84706fd4e4e2fb3710d893fba0fd32ce48bed175 WatchSource:0}: Error finding container 65390b9c188528dbec2d18ca84706fd4e4e2fb3710d893fba0fd32ce48bed175: Status 404 returned error can't find the container with id 65390b9c188528dbec2d18ca84706fd4e4e2fb3710d893fba0fd32ce48bed175
Sep 09 06:51:07.902236 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.902217    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2p2z8"
Sep 09 06:51:07.907553 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.907364    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-csxxw"
Sep 09 06:51:07.908109 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:07.908082    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod761f8c97_f2c7_4769_9c0b_924a4877cd38.slice/crio-a71e31165027335856bca85ae528122cf784bf7e654ad0d2d64ea10c175e904b WatchSource:0}: Error finding container a71e31165027335856bca85ae528122cf784bf7e654ad0d2d64ea10c175e904b: Status 404 returned error can't find the container with id a71e31165027335856bca85ae528122cf784bf7e654ad0d2d64ea10c175e904b
Sep 09 06:51:07.912917 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:07.912888    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00e0c40f_e508_4900_9f82_94f5ef3c04a8.slice/crio-ef46ba1585978a2021e45a0b069dcddcd45ad82ecf1dc99dd7220120be7a39bd WatchSource:0}: Error finding container ef46ba1585978a2021e45a0b069dcddcd45ad82ecf1dc99dd7220120be7a39bd: Status 404 returned error can't find the container with id ef46ba1585978a2021e45a0b069dcddcd45ad82ecf1dc99dd7220120be7a39bd
Sep 09 06:51:07.913719 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.913595    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:07.918379 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.918361    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xv8b9"
Sep 09 06:51:07.924243 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.924218    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mcwsw"
Sep 09 06:51:07.924657 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:07.924622    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod306002f3_75e6_40e8_b651_a3ffb4180d43.slice/crio-62f21c3697e4e61bbe09b10d7a5b29b8e13d6164eacc1b29da31d72273410e26 WatchSource:0}: Error finding container 62f21c3697e4e61bbe09b10d7a5b29b8e13d6164eacc1b29da31d72273410e26: Status 404 returned error can't find the container with id 62f21c3697e4e61bbe09b10d7a5b29b8e13d6164eacc1b29da31d72273410e26
Sep 09 06:51:07.929926 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.929909    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cr4hg"
Sep 09 06:51:07.933317 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:07.933291    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e0b0062_4ae5_4229_98a1_613f64c98142.slice/crio-4883ac26287b37180c47a9a0153a92f34ef6dc854622705dd73ff3a8ca12c1a3 WatchSource:0}: Error finding container 4883ac26287b37180c47a9a0153a92f34ef6dc854622705dd73ff3a8ca12c1a3: Status 404 returned error can't find the container with id 4883ac26287b37180c47a9a0153a92f34ef6dc854622705dd73ff3a8ca12c1a3
Sep 09 06:51:07.934738 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.934719    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-blbwl"
Sep 09 06:51:07.937187 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:07.937137    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 06:51:07.939360 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:07.939337    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48a06719_7aab_46cf_a45e_76754185735a.slice/crio-452be1b989c0cbcd648f14cd89dfa431a86ea32f16c153d311de73a21d373839 WatchSource:0}: Error finding container 452be1b989c0cbcd648f14cd89dfa431a86ea32f16c153d311de73a21d373839: Status 404 returned error can't find the container with id 452be1b989c0cbcd648f14cd89dfa431a86ea32f16c153d311de73a21d373839
Sep 09 06:51:07.943432 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:07.943409    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod919417d2_9658_4035_87e5_a82416654da8.slice/crio-e5b991dabc4e8a6a7fad15f45c2f4174e07c2ffcf18200679d2bb45a40e2cd6f WatchSource:0}: Error finding container e5b991dabc4e8a6a7fad15f45c2f4174e07c2ffcf18200679d2bb45a40e2cd6f: Status 404 returned error can't find the container with id e5b991dabc4e8a6a7fad15f45c2f4174e07c2ffcf18200679d2bb45a40e2cd6f
Sep 09 06:51:08.195186 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:08.195150    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96676d24-b303-4849-bdc0-e5b99b9b8602-metrics-certs\") pod \"network-metrics-daemon-pj9sz\" (UID: \"96676d24-b303-4849-bdc0-e5b99b9b8602\") " pod="openshift-multus/network-metrics-daemon-pj9sz"
Sep 09 06:51:08.195369 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:08.195274    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 06:51:08.195369 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:08.195337    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96676d24-b303-4849-bdc0-e5b99b9b8602-metrics-certs podName:96676d24-b303-4849-bdc0-e5b99b9b8602 nodeName:}" failed. No retries permitted until 2026-09-09 06:51:09.195318186 +0000 UTC m=+3.987127505 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96676d24-b303-4849-bdc0-e5b99b9b8602-metrics-certs") pod "network-metrics-daemon-pj9sz" (UID: "96676d24-b303-4849-bdc0-e5b99b9b8602") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 06:51:08.296041 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:08.296003    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa0cd37d-c6ff-4f45-9954-b2abc2645a4c-original-pull-secret\") pod \"global-pull-secret-syncer-tlg4m\" (UID: \"fa0cd37d-c6ff-4f45-9954-b2abc2645a4c\") " pod="kube-system/global-pull-secret-syncer-tlg4m"
Sep 09 06:51:08.296202 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:08.296138    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 06:51:08.296253 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:08.296203    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa0cd37d-c6ff-4f45-9954-b2abc2645a4c-original-pull-secret podName:fa0cd37d-c6ff-4f45-9954-b2abc2645a4c nodeName:}" failed. No retries permitted until 2026-09-09 06:51:09.296182192 +0000 UTC m=+4.087991517 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fa0cd37d-c6ff-4f45-9954-b2abc2645a4c-original-pull-secret") pod "global-pull-secret-syncer-tlg4m" (UID: "fa0cd37d-c6ff-4f45-9954-b2abc2645a4c") : object "kube-system"/"original-pull-secret" not registered
Sep 09 06:51:08.397265 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:08.396809    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fx2fc\" (UniqueName: \"kubernetes.io/projected/941d7367-69f9-4dbd-b23c-35441173231c-kube-api-access-fx2fc\") pod \"network-check-target-fmhfw\" (UID: \"941d7367-69f9-4dbd-b23c-35441173231c\") " pod="openshift-network-diagnostics/network-check-target-fmhfw"
Sep 09 06:51:08.397265 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:08.396977    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 06:51:08.397265 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:08.397001    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 06:51:08.397265 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:08.397014    2575 projected.go:196] Error preparing data for projected volume kube-api-access-fx2fc for pod openshift-network-diagnostics/network-check-target-fmhfw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 06:51:08.397265 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:08.397083    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/941d7367-69f9-4dbd-b23c-35441173231c-kube-api-access-fx2fc podName:941d7367-69f9-4dbd-b23c-35441173231c nodeName:}" failed. No retries permitted until 2026-09-09 06:51:09.397064279 +0000 UTC m=+4.188873602 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fx2fc" (UniqueName: "kubernetes.io/projected/941d7367-69f9-4dbd-b23c-35441173231c-kube-api-access-fx2fc") pod "network-check-target-fmhfw" (UID: "941d7367-69f9-4dbd-b23c-35441173231c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 06:51:08.629887 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:08.629784    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 06:46:07 +0000 UTC" deadline="2028-03-07 07:43:30.035826565 +0000 UTC"
Sep 09 06:51:08.629887 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:08.629822    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13080h52m21.406009953s"
Sep 09 06:51:08.722171 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:08.722125    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2p2z8" event={"ID":"00e0c40f-e508-4900-9f82-94f5ef3c04a8","Type":"ContainerStarted","Data":"ef46ba1585978a2021e45a0b069dcddcd45ad82ecf1dc99dd7220120be7a39bd"}
Sep 09 06:51:08.724087 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:08.724000    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-blbwl" event={"ID":"919417d2-9658-4035-87e5-a82416654da8","Type":"ContainerStarted","Data":"e5b991dabc4e8a6a7fad15f45c2f4174e07c2ffcf18200679d2bb45a40e2cd6f"}
Sep 09 06:51:08.726456 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:08.726374    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xv8b9" event={"ID":"25fed217-b55a-417b-87be-cae14b802dc3","Type":"ContainerStarted","Data":"d2fbc20d65b72ab0d543a853e103a71f2c39523571ac04ae56648d0f062359e3"}
Sep 09 06:51:08.731358 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:08.731336    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr" event={"ID":"306002f3-75e6-40e8-b651-a3ffb4180d43","Type":"ContainerStarted","Data":"62f21c3697e4e61bbe09b10d7a5b29b8e13d6164eacc1b29da31d72273410e26"}
Sep 09 06:51:08.734159 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:08.734134    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-csxxw" event={"ID":"ae5d6c9d-7110-4b99-ae5b-1d562f10234c","Type":"ContainerStarted","Data":"43c9db57a5ca1905b161a4fc27b9a1f7dc6b4ad923b98f559306c8bfb1e5c13d"}
Sep 09 06:51:08.736998 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:08.736975    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rljvj" event={"ID":"761f8c97-f2c7-4769-9c0b-924a4877cd38","Type":"ContainerStarted","Data":"a71e31165027335856bca85ae528122cf784bf7e654ad0d2d64ea10c175e904b"}
Sep 09 06:51:08.738904 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:08.738880    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mkgx" event={"ID":"c6df37d2-594a-4f35-bcda-246740bf683b","Type":"ContainerStarted","Data":"65390b9c188528dbec2d18ca84706fd4e4e2fb3710d893fba0fd32ce48bed175"}
Sep 09 06:51:08.744949 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:08.744911    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cr4hg" event={"ID":"48a06719-7aab-46cf-a45e-76754185735a","Type":"ContainerStarted","Data":"452be1b989c0cbcd648f14cd89dfa431a86ea32f16c153d311de73a21d373839"}
Sep 09 06:51:08.748718 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:08.748656    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mcwsw" event={"ID":"5e0b0062-4ae5-4229-98a1-613f64c98142","Type":"ContainerStarted","Data":"4883ac26287b37180c47a9a0153a92f34ef6dc854622705dd73ff3a8ca12c1a3"}
Sep 09 06:51:09.203817 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:09.203778    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96676d24-b303-4849-bdc0-e5b99b9b8602-metrics-certs\") pod \"network-metrics-daemon-pj9sz\" (UID: \"96676d24-b303-4849-bdc0-e5b99b9b8602\") " pod="openshift-multus/network-metrics-daemon-pj9sz"
Sep 09 06:51:09.203994 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:09.203929    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 06:51:09.204061 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:09.204001    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96676d24-b303-4849-bdc0-e5b99b9b8602-metrics-certs podName:96676d24-b303-4849-bdc0-e5b99b9b8602 nodeName:}" failed. No retries permitted until 2026-09-09 06:51:11.203980556 +0000 UTC m=+5.995789881 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96676d24-b303-4849-bdc0-e5b99b9b8602-metrics-certs") pod "network-metrics-daemon-pj9sz" (UID: "96676d24-b303-4849-bdc0-e5b99b9b8602") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 06:51:09.305007 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:09.304379    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa0cd37d-c6ff-4f45-9954-b2abc2645a4c-original-pull-secret\") pod \"global-pull-secret-syncer-tlg4m\" (UID: \"fa0cd37d-c6ff-4f45-9954-b2abc2645a4c\") " pod="kube-system/global-pull-secret-syncer-tlg4m"
Sep 09 06:51:09.305007 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:09.304532    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 06:51:09.305007 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:09.304599    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa0cd37d-c6ff-4f45-9954-b2abc2645a4c-original-pull-secret podName:fa0cd37d-c6ff-4f45-9954-b2abc2645a4c nodeName:}" failed. No retries permitted until 2026-09-09 06:51:11.304579618 +0000 UTC m=+6.096388938 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fa0cd37d-c6ff-4f45-9954-b2abc2645a4c-original-pull-secret") pod "global-pull-secret-syncer-tlg4m" (UID: "fa0cd37d-c6ff-4f45-9954-b2abc2645a4c") : object "kube-system"/"original-pull-secret" not registered
Sep 09 06:51:09.405101 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:09.405063    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fx2fc\" (UniqueName: \"kubernetes.io/projected/941d7367-69f9-4dbd-b23c-35441173231c-kube-api-access-fx2fc\") pod \"network-check-target-fmhfw\" (UID: \"941d7367-69f9-4dbd-b23c-35441173231c\") " pod="openshift-network-diagnostics/network-check-target-fmhfw"
Sep 09 06:51:09.405292 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:09.405273    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 06:51:09.405365 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:09.405298    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 06:51:09.405365 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:09.405312    2575 projected.go:196] Error preparing data for projected volume kube-api-access-fx2fc for pod openshift-network-diagnostics/network-check-target-fmhfw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 06:51:09.405440 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:09.405374    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/941d7367-69f9-4dbd-b23c-35441173231c-kube-api-access-fx2fc podName:941d7367-69f9-4dbd-b23c-35441173231c nodeName:}" failed. No retries permitted until 2026-09-09 06:51:11.405354283 +0000 UTC m=+6.197163607 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fx2fc" (UniqueName: "kubernetes.io/projected/941d7367-69f9-4dbd-b23c-35441173231c-kube-api-access-fx2fc") pod "network-check-target-fmhfw" (UID: "941d7367-69f9-4dbd-b23c-35441173231c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 06:51:09.630355 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:09.630286    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 06:46:07 +0000 UTC" deadline="2028-06-21 06:35:32.40860807 +0000 UTC"
Sep 09 06:51:09.630355 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:09.630352    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15623h44m22.77826s"
Sep 09 06:51:09.707206 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:09.706941    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pj9sz"
Sep 09 06:51:09.707206 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:09.706955    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tlg4m"
Sep 09 06:51:09.707206 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:09.707079    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pj9sz" podUID="96676d24-b303-4849-bdc0-e5b99b9b8602"
Sep 09 06:51:09.707206 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:09.707124    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tlg4m" podUID="fa0cd37d-c6ff-4f45-9954-b2abc2645a4c"
Sep 09 06:51:09.707206 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:09.707181    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fmhfw"
Sep 09 06:51:09.707490 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:09.707250    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fmhfw" podUID="941d7367-69f9-4dbd-b23c-35441173231c"
Sep 09 06:51:11.222416 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:11.222376    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96676d24-b303-4849-bdc0-e5b99b9b8602-metrics-certs\") pod \"network-metrics-daemon-pj9sz\" (UID: \"96676d24-b303-4849-bdc0-e5b99b9b8602\") " pod="openshift-multus/network-metrics-daemon-pj9sz"
Sep 09 06:51:11.222911 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:11.222637    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 06:51:11.222911 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:11.222709    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96676d24-b303-4849-bdc0-e5b99b9b8602-metrics-certs podName:96676d24-b303-4849-bdc0-e5b99b9b8602 nodeName:}" failed. No retries permitted until 2026-09-09 06:51:15.222687863 +0000 UTC m=+10.014497188 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96676d24-b303-4849-bdc0-e5b99b9b8602-metrics-certs") pod "network-metrics-daemon-pj9sz" (UID: "96676d24-b303-4849-bdc0-e5b99b9b8602") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 06:51:11.323767 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:11.323107    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa0cd37d-c6ff-4f45-9954-b2abc2645a4c-original-pull-secret\") pod \"global-pull-secret-syncer-tlg4m\" (UID: \"fa0cd37d-c6ff-4f45-9954-b2abc2645a4c\") " pod="kube-system/global-pull-secret-syncer-tlg4m"
Sep 09 06:51:11.323767 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:11.323259    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 06:51:11.323767 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:11.323321    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa0cd37d-c6ff-4f45-9954-b2abc2645a4c-original-pull-secret podName:fa0cd37d-c6ff-4f45-9954-b2abc2645a4c nodeName:}" failed. No retries permitted until 2026-09-09 06:51:15.323304256 +0000 UTC m=+10.115113574 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fa0cd37d-c6ff-4f45-9954-b2abc2645a4c-original-pull-secret") pod "global-pull-secret-syncer-tlg4m" (UID: "fa0cd37d-c6ff-4f45-9954-b2abc2645a4c") : object "kube-system"/"original-pull-secret" not registered
Sep 09 06:51:11.428319 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:11.424009    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fx2fc\" (UniqueName: \"kubernetes.io/projected/941d7367-69f9-4dbd-b23c-35441173231c-kube-api-access-fx2fc\") pod \"network-check-target-fmhfw\" (UID: \"941d7367-69f9-4dbd-b23c-35441173231c\") " pod="openshift-network-diagnostics/network-check-target-fmhfw"
Sep 09 06:51:11.428319 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:11.424186    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 06:51:11.428319 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:11.424207    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 06:51:11.428319 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:11.424219    2575 projected.go:196] Error preparing data for projected volume kube-api-access-fx2fc for pod openshift-network-diagnostics/network-check-target-fmhfw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 06:51:11.428319 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:11.424275    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/941d7367-69f9-4dbd-b23c-35441173231c-kube-api-access-fx2fc podName:941d7367-69f9-4dbd-b23c-35441173231c nodeName:}" failed. No retries permitted until 2026-09-09 06:51:15.424257635 +0000 UTC m=+10.216066971 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fx2fc" (UniqueName: "kubernetes.io/projected/941d7367-69f9-4dbd-b23c-35441173231c-kube-api-access-fx2fc") pod "network-check-target-fmhfw" (UID: "941d7367-69f9-4dbd-b23c-35441173231c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 06:51:11.706542 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:11.705828    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pj9sz"
Sep 09 06:51:11.706542 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:11.705968    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pj9sz" podUID="96676d24-b303-4849-bdc0-e5b99b9b8602"
Sep 09 06:51:11.706542 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:11.706356    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tlg4m"
Sep 09 06:51:11.706542 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:11.706493    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tlg4m" podUID="fa0cd37d-c6ff-4f45-9954-b2abc2645a4c"
Sep 09 06:51:11.707098 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:11.706803    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fmhfw"
Sep 09 06:51:11.707098 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:11.706888    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fmhfw" podUID="941d7367-69f9-4dbd-b23c-35441173231c"
Sep 09 06:51:13.707304 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:13.707273    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pj9sz"
Sep 09 06:51:13.707791 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:13.707408    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pj9sz" podUID="96676d24-b303-4849-bdc0-e5b99b9b8602"
Sep 09 06:51:13.707881 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:13.707804    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tlg4m"
Sep 09 06:51:13.707934 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:13.707910    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tlg4m" podUID="fa0cd37d-c6ff-4f45-9954-b2abc2645a4c"
Sep 09 06:51:13.707993 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:13.707940    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fmhfw"
Sep 09 06:51:13.708044 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:13.708015    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fmhfw" podUID="941d7367-69f9-4dbd-b23c-35441173231c"
Sep 09 06:51:15.256872 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:15.256318    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96676d24-b303-4849-bdc0-e5b99b9b8602-metrics-certs\") pod \"network-metrics-daemon-pj9sz\" (UID: \"96676d24-b303-4849-bdc0-e5b99b9b8602\") " pod="openshift-multus/network-metrics-daemon-pj9sz"
Sep 09 06:51:15.256872 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:15.256446    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 06:51:15.256872 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:15.256502    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96676d24-b303-4849-bdc0-e5b99b9b8602-metrics-certs podName:96676d24-b303-4849-bdc0-e5b99b9b8602 nodeName:}" failed. No retries permitted until 2026-09-09 06:51:23.256488505 +0000 UTC m=+18.048297822 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96676d24-b303-4849-bdc0-e5b99b9b8602-metrics-certs") pod "network-metrics-daemon-pj9sz" (UID: "96676d24-b303-4849-bdc0-e5b99b9b8602") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 06:51:15.356659 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:15.356621    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa0cd37d-c6ff-4f45-9954-b2abc2645a4c-original-pull-secret\") pod \"global-pull-secret-syncer-tlg4m\" (UID: \"fa0cd37d-c6ff-4f45-9954-b2abc2645a4c\") " pod="kube-system/global-pull-secret-syncer-tlg4m"
Sep 09 06:51:15.356826 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:15.356772    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 06:51:15.356873 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:15.356831    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa0cd37d-c6ff-4f45-9954-b2abc2645a4c-original-pull-secret podName:fa0cd37d-c6ff-4f45-9954-b2abc2645a4c nodeName:}" failed. No retries permitted until 2026-09-09 06:51:23.356819101 +0000 UTC m=+18.148628418 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fa0cd37d-c6ff-4f45-9954-b2abc2645a4c-original-pull-secret") pod "global-pull-secret-syncer-tlg4m" (UID: "fa0cd37d-c6ff-4f45-9954-b2abc2645a4c") : object "kube-system"/"original-pull-secret" not registered
Sep 09 06:51:15.457453 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:15.457413    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fx2fc\" (UniqueName: \"kubernetes.io/projected/941d7367-69f9-4dbd-b23c-35441173231c-kube-api-access-fx2fc\") pod \"network-check-target-fmhfw\" (UID: \"941d7367-69f9-4dbd-b23c-35441173231c\") " pod="openshift-network-diagnostics/network-check-target-fmhfw"
Sep 09 06:51:15.457627 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:15.457602    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 06:51:15.457627 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:15.457625    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 06:51:15.457740 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:15.457635    2575 projected.go:196] Error preparing data for projected volume kube-api-access-fx2fc for pod openshift-network-diagnostics/network-check-target-fmhfw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 06:51:15.457740 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:15.457689    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/941d7367-69f9-4dbd-b23c-35441173231c-kube-api-access-fx2fc podName:941d7367-69f9-4dbd-b23c-35441173231c nodeName:}" failed. No retries permitted until 2026-09-09 06:51:23.457674052 +0000 UTC m=+18.249483369 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fx2fc" (UniqueName: "kubernetes.io/projected/941d7367-69f9-4dbd-b23c-35441173231c-kube-api-access-fx2fc") pod "network-check-target-fmhfw" (UID: "941d7367-69f9-4dbd-b23c-35441173231c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 06:51:15.706010 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:15.705975    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pj9sz"
Sep 09 06:51:15.706198 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:15.706110    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pj9sz" podUID="96676d24-b303-4849-bdc0-e5b99b9b8602"
Sep 09 06:51:15.706511 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:15.706490    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tlg4m"
Sep 09 06:51:15.706643 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:15.706593    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tlg4m" podUID="fa0cd37d-c6ff-4f45-9954-b2abc2645a4c"
Sep 09 06:51:15.706792 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:15.706763    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fmhfw"
Sep 09 06:51:15.706879 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:15.706849    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fmhfw" podUID="941d7367-69f9-4dbd-b23c-35441173231c"
Sep 09 06:51:17.705704 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:17.705671    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tlg4m"
Sep 09 06:51:17.706154 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:17.705671    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pj9sz"
Sep 09 06:51:17.706154 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:17.705818    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tlg4m" podUID="fa0cd37d-c6ff-4f45-9954-b2abc2645a4c"
Sep 09 06:51:17.706154 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:17.705671    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fmhfw"
Sep 09 06:51:17.706154 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:17.705894    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pj9sz" podUID="96676d24-b303-4849-bdc0-e5b99b9b8602"
Sep 09 06:51:17.706154 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:17.705930    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fmhfw" podUID="941d7367-69f9-4dbd-b23c-35441173231c"
Sep 09 06:51:19.705136 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:19.705101    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pj9sz"
Sep 09 06:51:19.705658 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:19.705110    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tlg4m"
Sep 09 06:51:19.705658 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:19.705243    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fmhfw"
Sep 09 06:51:19.705658 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:19.705245    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pj9sz" podUID="96676d24-b303-4849-bdc0-e5b99b9b8602"
Sep 09 06:51:19.705658 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:19.705353    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tlg4m" podUID="fa0cd37d-c6ff-4f45-9954-b2abc2645a4c"
Sep 09 06:51:19.705658 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:19.705431    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fmhfw" podUID="941d7367-69f9-4dbd-b23c-35441173231c"
Sep 09 06:51:21.705720 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:21.705683    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pj9sz"
Sep 09 06:51:21.706176 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:21.705696    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fmhfw"
Sep 09 06:51:21.706176 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:21.705835    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pj9sz" podUID="96676d24-b303-4849-bdc0-e5b99b9b8602"
Sep 09 06:51:21.706176 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:21.705696    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tlg4m"
Sep 09 06:51:21.706176 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:21.705918    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fmhfw" podUID="941d7367-69f9-4dbd-b23c-35441173231c"
Sep 09 06:51:21.706176 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:21.705953    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tlg4m" podUID="fa0cd37d-c6ff-4f45-9954-b2abc2645a4c"
Sep 09 06:51:23.318273 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:23.318238    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96676d24-b303-4849-bdc0-e5b99b9b8602-metrics-certs\") pod \"network-metrics-daemon-pj9sz\" (UID: \"96676d24-b303-4849-bdc0-e5b99b9b8602\") " pod="openshift-multus/network-metrics-daemon-pj9sz"
Sep 09 06:51:23.318706 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:23.318367    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 06:51:23.318706 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:23.318427    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96676d24-b303-4849-bdc0-e5b99b9b8602-metrics-certs podName:96676d24-b303-4849-bdc0-e5b99b9b8602 nodeName:}" failed. No retries permitted until 2026-09-09 06:51:39.318413387 +0000 UTC m=+34.110222704 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96676d24-b303-4849-bdc0-e5b99b9b8602-metrics-certs") pod "network-metrics-daemon-pj9sz" (UID: "96676d24-b303-4849-bdc0-e5b99b9b8602") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 06:51:23.418914 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:23.418883    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa0cd37d-c6ff-4f45-9954-b2abc2645a4c-original-pull-secret\") pod \"global-pull-secret-syncer-tlg4m\" (UID: \"fa0cd37d-c6ff-4f45-9954-b2abc2645a4c\") " pod="kube-system/global-pull-secret-syncer-tlg4m"
Sep 09 06:51:23.419076 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:23.418990    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 06:51:23.419076 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:23.419046    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa0cd37d-c6ff-4f45-9954-b2abc2645a4c-original-pull-secret podName:fa0cd37d-c6ff-4f45-9954-b2abc2645a4c nodeName:}" failed. No retries permitted until 2026-09-09 06:51:39.419029164 +0000 UTC m=+34.210838481 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fa0cd37d-c6ff-4f45-9954-b2abc2645a4c-original-pull-secret") pod "global-pull-secret-syncer-tlg4m" (UID: "fa0cd37d-c6ff-4f45-9954-b2abc2645a4c") : object "kube-system"/"original-pull-secret" not registered
Sep 09 06:51:23.519167 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:23.519127    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fx2fc\" (UniqueName: \"kubernetes.io/projected/941d7367-69f9-4dbd-b23c-35441173231c-kube-api-access-fx2fc\") pod \"network-check-target-fmhfw\" (UID: \"941d7367-69f9-4dbd-b23c-35441173231c\") " pod="openshift-network-diagnostics/network-check-target-fmhfw"
Sep 09 06:51:23.519328 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:23.519316    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 06:51:23.519370 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:23.519335    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 06:51:23.519370 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:23.519344    2575 projected.go:196] Error preparing data for projected volume kube-api-access-fx2fc for pod openshift-network-diagnostics/network-check-target-fmhfw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 06:51:23.519455 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:23.519398    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/941d7367-69f9-4dbd-b23c-35441173231c-kube-api-access-fx2fc podName:941d7367-69f9-4dbd-b23c-35441173231c nodeName:}" failed. No retries permitted until 2026-09-09 06:51:39.519385679 +0000 UTC m=+34.311194997 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fx2fc" (UniqueName: "kubernetes.io/projected/941d7367-69f9-4dbd-b23c-35441173231c-kube-api-access-fx2fc") pod "network-check-target-fmhfw" (UID: "941d7367-69f9-4dbd-b23c-35441173231c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 06:51:23.705784 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:23.705694    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pj9sz"
Sep 09 06:51:23.705784 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:23.705773    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fmhfw"
Sep 09 06:51:23.705784 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:23.705769    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tlg4m"
Sep 09 06:51:23.706044 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:23.705912    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pj9sz" podUID="96676d24-b303-4849-bdc0-e5b99b9b8602"
Sep 09 06:51:23.706313 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:23.706286    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fmhfw" podUID="941d7367-69f9-4dbd-b23c-35441173231c"
Sep 09 06:51:23.706412 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:23.706360    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tlg4m" podUID="fa0cd37d-c6ff-4f45-9954-b2abc2645a4c"
Sep 09 06:51:25.706205 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:25.706159    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fmhfw"
Sep 09 06:51:25.706638 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:25.706274    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fmhfw" podUID="941d7367-69f9-4dbd-b23c-35441173231c"
Sep 09 06:51:25.706638 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:25.706623    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pj9sz"
Sep 09 06:51:25.706763 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:25.706728    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pj9sz" podUID="96676d24-b303-4849-bdc0-e5b99b9b8602"
Sep 09 06:51:25.706821 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:25.706802    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tlg4m"
Sep 09 06:51:25.706878 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:25.706859    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tlg4m" podUID="fa0cd37d-c6ff-4f45-9954-b2abc2645a4c"
Sep 09 06:51:27.706093 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:27.705799    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tlg4m"
Sep 09 06:51:27.706767 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:27.705798    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pj9sz"
Sep 09 06:51:27.706767 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:27.705807    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fmhfw"
Sep 09 06:51:27.706767 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:27.706275    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pj9sz" podUID="96676d24-b303-4849-bdc0-e5b99b9b8602"
Sep 09 06:51:27.706767 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:27.706163    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tlg4m" podUID="fa0cd37d-c6ff-4f45-9954-b2abc2645a4c"
Sep 09 06:51:27.706767 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:27.706330    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fmhfw" podUID="941d7367-69f9-4dbd-b23c-35441173231c"
Sep 09 06:51:27.785376 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:27.785338    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-176.ec2.internal" event={"ID":"10ede7a8d76e64113edb635ab66c3e5e","Type":"ContainerStarted","Data":"675d125e01ec552bf8b98217b27507b12cc07bf31e3b05b98ea8f1df86da6540"}
Sep 09 06:51:27.786849 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:27.786827    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-blbwl" event={"ID":"919417d2-9658-4035-87e5-a82416654da8","Type":"ContainerStarted","Data":"ebc9302df9cc5a818549acf0a8a0437b0ad3e04a3fa81f0d48be784c09809afc"}
Sep 09 06:51:27.788262 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:27.788244    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xv8b9" event={"ID":"25fed217-b55a-417b-87be-cae14b802dc3","Type":"ContainerStarted","Data":"5fb2aac6415a36f6c4162882255d84137e4fc50e69f3bec9f3cc69a0285c0214"}
Sep 09 06:51:27.791208 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:27.791186    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr" event={"ID":"306002f3-75e6-40e8-b651-a3ffb4180d43","Type":"ContainerStarted","Data":"aa3ef4d59b768d2d528e3400898b342a620d55823ab51010c2f6a3b490982b1a"}
Sep 09 06:51:27.791290 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:27.791261    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr" event={"ID":"306002f3-75e6-40e8-b651-a3ffb4180d43","Type":"ContainerStarted","Data":"66ead4560ba1e77eeaeb73bd920176d30c21b1f7604210ac7e28d4ac305c85ec"}
Sep 09 06:51:27.791336 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:27.791314    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr" event={"ID":"306002f3-75e6-40e8-b651-a3ffb4180d43","Type":"ContainerStarted","Data":"74bca98acedf99b2a30f1afaddf275c67de0de3aeda893ae68dfab47b1c84b8d"}
Sep 09 06:51:27.791369 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:27.791361    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr" event={"ID":"306002f3-75e6-40e8-b651-a3ffb4180d43","Type":"ContainerStarted","Data":"8fe5097b386ed6adee1fec7f6e6ac844afdbc088d21941586f2b1c73a20ec251"}
Sep 09 06:51:27.791420 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:27.791408    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr" event={"ID":"306002f3-75e6-40e8-b651-a3ffb4180d43","Type":"ContainerStarted","Data":"b6e5adcfc39fad9fcc369b596a13a091f4e839601c1d09334d80c9869e3f4e91"}
Sep 09 06:51:27.791460 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:27.791442    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr" event={"ID":"306002f3-75e6-40e8-b651-a3ffb4180d43","Type":"ContainerStarted","Data":"535c6ddb1245059bcd4201724787a8490393dbea5cafb8d78c622fe66e2f65ac"}
Sep 09 06:51:27.794363 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:27.794345    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rljvj" event={"ID":"761f8c97-f2c7-4769-9c0b-924a4877cd38","Type":"ContainerStarted","Data":"1219b6170cfd20a2dc5178ec43cf30ccaee5a46b0930bcd501acc5dc0eb4fc45"}
Sep 09 06:51:27.795639 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:27.795624    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mkgx" event={"ID":"c6df37d2-594a-4f35-bcda-246740bf683b","Type":"ContainerStarted","Data":"cf66c351a800c1d62dd8b97a4067a8269909f214f4640d3f80d6d51c3acb6c73"}
Sep 09 06:51:27.796957 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:27.796927    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cr4hg" event={"ID":"48a06719-7aab-46cf-a45e-76754185735a","Type":"ContainerStarted","Data":"db2dc6408d3dba56b68b8ddb76cfe2182f8e16581143854ba41cded4bb29c940"}
Sep 09 06:51:27.798206 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:27.798190    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mcwsw" event={"ID":"5e0b0062-4ae5-4229-98a1-613f64c98142","Type":"ContainerStarted","Data":"754eeb93475c12ef0266eae90fcd6cb4423ab21d194b2e416248f1488dc83a24"}
Sep 09 06:51:27.799468 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:27.799451    2575 generic.go:356] "Generic (PLEG): container finished" podID="00e0c40f-e508-4900-9f82-94f5ef3c04a8" containerID="be66496cfa523b3056e67331536c05b6cb285c026100e4aa20762a18fa1bc3c6" exitCode=0
Sep 09 06:51:27.799534 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:27.799503    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2p2z8" event={"ID":"00e0c40f-e508-4900-9f82-94f5ef3c04a8","Type":"ContainerDied","Data":"be66496cfa523b3056e67331536c05b6cb285c026100e4aa20762a18fa1bc3c6"}
Sep 09 06:51:27.801120 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:27.801102    2575 generic.go:356] "Generic (PLEG): container finished" podID="e4ae816a232fd3409ce4266a67ae4820" containerID="ea29ac622d61be7eac9648ca5ab0a215767e8ce05cd199598d24f5fb916ba605" exitCode=0
Sep 09 06:51:27.801204 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:27.801129    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-176.ec2.internal" event={"ID":"e4ae816a232fd3409ce4266a67ae4820","Type":"ContainerDied","Data":"ea29ac622d61be7eac9648ca5ab0a215767e8ce05cd199598d24f5fb916ba605"}
Sep 09 06:51:27.801405 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:27.801364    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-176.ec2.internal" podStartSLOduration=21.801350844 podStartE2EDuration="21.801350844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 06:51:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:51:27.800882875 +0000 UTC m=+22.592692215" watchObservedRunningTime="2026-09-09 06:51:27.801350844 +0000 UTC m=+22.593160183"
Sep 09 06:51:27.815941 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:27.815903    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rljvj" podStartSLOduration=3.2988945689999998 podStartE2EDuration="21.815895152s" totalImagesPullingTime="18.517000583s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 06:51:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:51:27.815669023 +0000 UTC m=+22.607478362" watchObservedRunningTime="2026-09-09 06:51:27.815895152 +0000 UTC m=+22.607704491"
Sep 09 06:51:27.830533 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:27.830490    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xv8b9" podStartSLOduration=3.069821227 podStartE2EDuration="21.830477487s" totalImagesPullingTime="18.76065626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:51:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:51:27.830425337 +0000 UTC m=+22.622234676" watchObservedRunningTime="2026-09-09 06:51:27.830477487 +0000 UTC m=+22.622286828"
Sep 09 06:51:27.847012 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:27.846791    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-cr4hg" podStartSLOduration=3.360720628 podStartE2EDuration="21.846775791s" totalImagesPullingTime="18.486055163s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 06:51:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:51:27.846266256 +0000 UTC m=+22.638075596" watchObservedRunningTime="2026-09-09 06:51:27.846775791 +0000 UTC m=+22.638585131"
Sep 09 06:51:27.865275 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:27.865244    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-blbwl" podStartSLOduration=2.997002997 podStartE2EDuration="21.865233229s" totalImagesPullingTime="18.868230232s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 06:51:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:51:27.865015892 +0000 UTC m=+22.656825230" watchObservedRunningTime="2026-09-09 06:51:27.865233229 +0000 UTC m=+22.657042568"
Sep 09 06:51:27.917487 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:27.917445    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mcwsw" podStartSLOduration=3.163068538 podStartE2EDuration="21.917432021s" totalImagesPullingTime="18.754363483s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 06:51:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:51:27.90019386 +0000 UTC m=+22.692003199" watchObservedRunningTime="2026-09-09 06:51:27.917432021 +0000 UTC m=+22.709241399"
Sep 09 06:51:28.411344 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:28.411322    2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 09 06:51:28.643789 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:28.643667    2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-09T06:51:28.411341457Z","UUID":"84ac0a0d-b9b4-45d1-a947-dad09ba2a346","Handler":null,"Name":"","Endpoint":""}
Sep 09 06:51:28.645198 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:28.645176    2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 09 06:51:28.645336 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:28.645206    2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 09 06:51:28.805473 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:28.805434    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-176.ec2.internal" event={"ID":"e4ae816a232fd3409ce4266a67ae4820","Type":"ContainerStarted","Data":"13461605da9d1421d19644f02e04fe36872ced8d29eecba045ccb7d50215f283"}
Sep 09 06:51:28.807901 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:28.807664    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-csxxw" event={"ID":"ae5d6c9d-7110-4b99-ae5b-1d562f10234c","Type":"ContainerStarted","Data":"1d82eeeff8842325d9476d037ffa331c7fe53c93e1512169ee102b091bd5996e"}
Sep 09 06:51:28.812275 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:28.812209    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mkgx" event={"ID":"c6df37d2-594a-4f35-bcda-246740bf683b","Type":"ContainerStarted","Data":"f8c6addfcfd0a4e08f9dfc938f36caf3896438efa0fc16fa437e190b9e24bd7a"}
Sep 09 06:51:28.820577 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:28.820541    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-176.ec2.internal" podStartSLOduration=22.820529059 podStartE2EDuration="22.820529059s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 06:51:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:51:28.820483292 +0000 UTC m=+23.612292635" watchObservedRunningTime="2026-09-09 06:51:28.820529059 +0000 UTC m=+23.612338399"
Sep 09 06:51:28.834514 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:28.834467    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-csxxw" podStartSLOduration=12.284248967 podStartE2EDuration="22.834454018s" totalImagesPullingTime="10.550205051s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 06:51:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:51:28.833890728 +0000 UTC m=+23.625700068" watchObservedRunningTime="2026-09-09 06:51:28.834454018 +0000 UTC m=+23.626263356"
Sep 09 06:51:29.705659 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:29.705635    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tlg4m"
Sep 09 06:51:29.705778 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:29.705635    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pj9sz"
Sep 09 06:51:29.705852 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:29.705777    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tlg4m" podUID="fa0cd37d-c6ff-4f45-9954-b2abc2645a4c"
Sep 09 06:51:29.705906 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:29.705846    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pj9sz" podUID="96676d24-b303-4849-bdc0-e5b99b9b8602"
Sep 09 06:51:29.705906 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:29.705635    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fmhfw"
Sep 09 06:51:29.705997 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:29.705917    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fmhfw" podUID="941d7367-69f9-4dbd-b23c-35441173231c"
Sep 09 06:51:29.820513 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:29.820474    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr" event={"ID":"306002f3-75e6-40e8-b651-a3ffb4180d43","Type":"ContainerStarted","Data":"d06ed65fd72eafa29d6055e48b1e6437562b1cfa10a1a83dd644178e5ca87af8"}
Sep 09 06:51:30.827084 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:30.827050    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mkgx" event={"ID":"c6df37d2-594a-4f35-bcda-246740bf683b","Type":"ContainerStarted","Data":"89db8674b290fb545421e5e1aafa8a1444fde9cd6d94aba850927f38573c6645"}
Sep 09 06:51:30.846555 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:30.846497    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6mkgx" podStartSLOduration=3.431677041 podStartE2EDuration="24.846476503s" totalImagesPullingTime="21.414799462s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 06:51:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:51:30.846354272 +0000 UTC m=+25.638163623" watchObservedRunningTime="2026-09-09 06:51:30.846476503 +0000 UTC m=+25.638285843"
Sep 09 06:51:31.705486 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:31.705458    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tlg4m"
Sep 09 06:51:31.705486 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:31.705473    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pj9sz"
Sep 09 06:51:31.705721 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:31.705461    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fmhfw"
Sep 09 06:51:31.705721 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:31.705574    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tlg4m" podUID="fa0cd37d-c6ff-4f45-9954-b2abc2645a4c"
Sep 09 06:51:31.705721 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:31.705637    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fmhfw" podUID="941d7367-69f9-4dbd-b23c-35441173231c"
Sep 09 06:51:31.705870 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:31.705765    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pj9sz" podUID="96676d24-b303-4849-bdc0-e5b99b9b8602"
Sep 09 06:51:31.842066 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:31.842032    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xv8b9"
Sep 09 06:51:31.842722 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:31.842701    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xv8b9"
Sep 09 06:51:32.835724 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:32.835552    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr" event={"ID":"306002f3-75e6-40e8-b651-a3ffb4180d43","Type":"ContainerStarted","Data":"ed540de790fb505e9d3bcfe12d11dc8110142487887b57c5c09012748e61f600"}
Sep 09 06:51:32.835872 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:32.835798    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:32.837471 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:32.837447    2575 generic.go:356] "Generic (PLEG): container finished" podID="00e0c40f-e508-4900-9f82-94f5ef3c04a8" containerID="d193843310027df85846fa21a346ab03b85317a8ebc726460c514112b74345cb" exitCode=0
Sep 09 06:51:32.837584 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:32.837533    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2p2z8" event={"ID":"00e0c40f-e508-4900-9f82-94f5ef3c04a8","Type":"ContainerDied","Data":"d193843310027df85846fa21a346ab03b85317a8ebc726460c514112b74345cb"}
Sep 09 06:51:32.837793 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:32.837774    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xv8b9"
Sep 09 06:51:32.838633 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:32.838081    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xv8b9"
Sep 09 06:51:32.851824 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:32.851805    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:32.865035 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:32.864971    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr" podStartSLOduration=8.046364947 podStartE2EDuration="26.864954773s" totalImagesPullingTime="18.818589826s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 06:51:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:51:32.864825658 +0000 UTC m=+27.656634999" watchObservedRunningTime="2026-09-09 06:51:32.864954773 +0000 UTC m=+27.656764111"
Sep 09 06:51:33.706099 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:33.706069    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fmhfw"
Sep 09 06:51:33.706270 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:33.706129    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tlg4m"
Sep 09 06:51:33.706270 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:33.706148    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pj9sz"
Sep 09 06:51:33.706356 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:33.706258    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fmhfw" podUID="941d7367-69f9-4dbd-b23c-35441173231c"
Sep 09 06:51:33.706356 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:33.706329    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tlg4m" podUID="fa0cd37d-c6ff-4f45-9954-b2abc2645a4c"
Sep 09 06:51:33.706444 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:33.706395    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pj9sz" podUID="96676d24-b303-4849-bdc0-e5b99b9b8602"
Sep 09 06:51:33.839336 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:33.839314    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:33.839494 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:33.839387    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:33.855066 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:33.855010    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:51:34.271310 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:34.271250    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fmhfw"]
Sep 09 06:51:34.271489 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:34.271335    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fmhfw"
Sep 09 06:51:34.271489 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:34.271426    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fmhfw" podUID="941d7367-69f9-4dbd-b23c-35441173231c"
Sep 09 06:51:34.274302 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:34.274272    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tlg4m"]
Sep 09 06:51:34.274457 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:34.274371    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tlg4m"
Sep 09 06:51:34.274512 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:34.274495    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tlg4m" podUID="fa0cd37d-c6ff-4f45-9954-b2abc2645a4c"
Sep 09 06:51:34.274961 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:34.274936    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pj9sz"]
Sep 09 06:51:34.275058 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:34.275036    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pj9sz"
Sep 09 06:51:34.275155 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:34.275134    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pj9sz" podUID="96676d24-b303-4849-bdc0-e5b99b9b8602"
Sep 09 06:51:34.843151 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:34.843124    2575 generic.go:356] "Generic (PLEG): container finished" podID="00e0c40f-e508-4900-9f82-94f5ef3c04a8" containerID="8dd5882113982918a5173b95a965a6aba271e38757fcce3904f25a04b19e4862" exitCode=0
Sep 09 06:51:34.843324 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:34.843197    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2p2z8" event={"ID":"00e0c40f-e508-4900-9f82-94f5ef3c04a8","Type":"ContainerDied","Data":"8dd5882113982918a5173b95a965a6aba271e38757fcce3904f25a04b19e4862"}
Sep 09 06:51:35.706591 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:35.706521    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fmhfw"
Sep 09 06:51:35.707112 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:35.706591    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fmhfw" podUID="941d7367-69f9-4dbd-b23c-35441173231c"
Sep 09 06:51:35.707112 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:35.706641    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pj9sz"
Sep 09 06:51:35.707112 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:35.706767    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pj9sz" podUID="96676d24-b303-4849-bdc0-e5b99b9b8602"
Sep 09 06:51:35.707112 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:35.706780    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tlg4m"
Sep 09 06:51:35.707112 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:35.706863    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tlg4m" podUID="fa0cd37d-c6ff-4f45-9954-b2abc2645a4c"
Sep 09 06:51:35.849618 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:35.849592    2575 generic.go:356] "Generic (PLEG): container finished" podID="00e0c40f-e508-4900-9f82-94f5ef3c04a8" containerID="a392caff24e7efc3a5415561e39e1d1f214182e17ac61ff727db1d5e83378c9c" exitCode=0
Sep 09 06:51:35.849841 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:35.849804    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2p2z8" event={"ID":"00e0c40f-e508-4900-9f82-94f5ef3c04a8","Type":"ContainerDied","Data":"a392caff24e7efc3a5415561e39e1d1f214182e17ac61ff727db1d5e83378c9c"}
Sep 09 06:51:37.706276 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:37.706083    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fmhfw"
Sep 09 06:51:37.706648 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:37.706373    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fmhfw" podUID="941d7367-69f9-4dbd-b23c-35441173231c"
Sep 09 06:51:37.706648 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:37.706122    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pj9sz"
Sep 09 06:51:37.706648 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:37.706476    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pj9sz" podUID="96676d24-b303-4849-bdc0-e5b99b9b8602"
Sep 09 06:51:37.706648 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:37.706083    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tlg4m"
Sep 09 06:51:37.706648 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:37.706557    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tlg4m" podUID="fa0cd37d-c6ff-4f45-9954-b2abc2645a4c"
Sep 09 06:51:39.334200 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.334170    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96676d24-b303-4849-bdc0-e5b99b9b8602-metrics-certs\") pod \"network-metrics-daemon-pj9sz\" (UID: \"96676d24-b303-4849-bdc0-e5b99b9b8602\") " pod="openshift-multus/network-metrics-daemon-pj9sz"
Sep 09 06:51:39.334581 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:39.334343    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 06:51:39.334581 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:39.334415    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96676d24-b303-4849-bdc0-e5b99b9b8602-metrics-certs podName:96676d24-b303-4849-bdc0-e5b99b9b8602 nodeName:}" failed. No retries permitted until 2026-09-09 06:52:11.33439408 +0000 UTC m=+66.126203402 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96676d24-b303-4849-bdc0-e5b99b9b8602-metrics-certs") pod "network-metrics-daemon-pj9sz" (UID: "96676d24-b303-4849-bdc0-e5b99b9b8602") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 06:51:39.435457 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.435427    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa0cd37d-c6ff-4f45-9954-b2abc2645a4c-original-pull-secret\") pod \"global-pull-secret-syncer-tlg4m\" (UID: \"fa0cd37d-c6ff-4f45-9954-b2abc2645a4c\") " pod="kube-system/global-pull-secret-syncer-tlg4m"
Sep 09 06:51:39.435603 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:39.435554    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 06:51:39.435658 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:39.435620    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa0cd37d-c6ff-4f45-9954-b2abc2645a4c-original-pull-secret podName:fa0cd37d-c6ff-4f45-9954-b2abc2645a4c nodeName:}" failed. No retries permitted until 2026-09-09 06:52:11.435602262 +0000 UTC m=+66.227411579 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fa0cd37d-c6ff-4f45-9954-b2abc2645a4c-original-pull-secret") pod "global-pull-secret-syncer-tlg4m" (UID: "fa0cd37d-c6ff-4f45-9954-b2abc2645a4c") : object "kube-system"/"original-pull-secret" not registered
Sep 09 06:51:39.445303 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.445283    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-176.ec2.internal" event="NodeReady"
Sep 09 06:51:39.445411 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.445397    2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 09 06:51:39.479046 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.479024    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-dbf5fc6cf-j5f62"]
Sep 09 06:51:39.497187 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.497162    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hq6f8"]
Sep 09 06:51:39.497361 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.497341    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-dbf5fc6cf-j5f62"
Sep 09 06:51:39.500355 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.500260    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 09 06:51:39.500355 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.500298    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 09 06:51:39.500497 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.500260    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 09 06:51:39.500637 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.500622    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4qwcc\""
Sep 09 06:51:39.505509 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.505336    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 09 06:51:39.509182 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.509161    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wbd57"]
Sep 09 06:51:39.509297 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.509279    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hq6f8"
Sep 09 06:51:39.512070 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.511899    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 09 06:51:39.512070 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.511948    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-n7krz\""
Sep 09 06:51:39.512070 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.512021    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 09 06:51:39.525271 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.525244    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-dbf5fc6cf-j5f62"]
Sep 09 06:51:39.525347 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.525284    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hq6f8"]
Sep 09 06:51:39.525347 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.525308    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wbd57"]
Sep 09 06:51:39.525413 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.525372    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wbd57"
Sep 09 06:51:39.528209 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.528192    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dk92v\""
Sep 09 06:51:39.528291 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.528212    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 09 06:51:39.528357 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.528317    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 09 06:51:39.528440 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.528425    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 09 06:51:39.536216 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.536193    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fx2fc\" (UniqueName: \"kubernetes.io/projected/941d7367-69f9-4dbd-b23c-35441173231c-kube-api-access-fx2fc\") pod \"network-check-target-fmhfw\" (UID: \"941d7367-69f9-4dbd-b23c-35441173231c\") " pod="openshift-network-diagnostics/network-check-target-fmhfw"
Sep 09 06:51:39.536346 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:39.536330    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 06:51:39.536401 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:39.536355    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 06:51:39.536401 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:39.536366    2575 projected.go:196] Error preparing data for projected volume kube-api-access-fx2fc for pod openshift-network-diagnostics/network-check-target-fmhfw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 06:51:39.536488 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:39.536425    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/941d7367-69f9-4dbd-b23c-35441173231c-kube-api-access-fx2fc podName:941d7367-69f9-4dbd-b23c-35441173231c nodeName:}" failed. No retries permitted until 2026-09-09 06:52:11.53640876 +0000 UTC m=+66.328218078 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fx2fc" (UniqueName: "kubernetes.io/projected/941d7367-69f9-4dbd-b23c-35441173231c-kube-api-access-fx2fc") pod "network-check-target-fmhfw" (UID: "941d7367-69f9-4dbd-b23c-35441173231c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 06:51:39.636777 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.636717    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18e9c162-f015-4a2f-bc71-d4403466dcf6-tmp-dir\") pod \"dns-default-hq6f8\" (UID: \"18e9c162-f015-4a2f-bc71-d4403466dcf6\") " pod="openshift-dns/dns-default-hq6f8"
Sep 09 06:51:39.636950 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.636798    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-image-registry-private-configuration\") pod \"image-registry-dbf5fc6cf-j5f62\" (UID: \"eb5cd0d7-4682-4760-8f8a-8a221c4a682b\") " pod="openshift-image-registry/image-registry-dbf5fc6cf-j5f62"
Sep 09 06:51:39.636950 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.636828    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/450d68be-a858-4505-abdf-9a43aca25ad9-cert\") pod \"ingress-canary-wbd57\" (UID: \"450d68be-a858-4505-abdf-9a43aca25ad9\") " pod="openshift-ingress-canary/ingress-canary-wbd57"
Sep 09 06:51:39.636950 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.636860    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/18e9c162-f015-4a2f-bc71-d4403466dcf6-metrics-tls\") pod \"dns-default-hq6f8\" (UID: \"18e9c162-f015-4a2f-bc71-d4403466dcf6\") " pod="openshift-dns/dns-default-hq6f8"
Sep 09 06:51:39.636950 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.636885    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqqt8\" (UniqueName: \"kubernetes.io/projected/450d68be-a858-4505-abdf-9a43aca25ad9-kube-api-access-sqqt8\") pod \"ingress-canary-wbd57\" (UID: \"450d68be-a858-4505-abdf-9a43aca25ad9\") " pod="openshift-ingress-canary/ingress-canary-wbd57"
Sep 09 06:51:39.637147 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.636963    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnvwj\" (UniqueName: \"kubernetes.io/projected/18e9c162-f015-4a2f-bc71-d4403466dcf6-kube-api-access-bnvwj\") pod \"dns-default-hq6f8\" (UID: \"18e9c162-f015-4a2f-bc71-d4403466dcf6\") " pod="openshift-dns/dns-default-hq6f8"
Sep 09 06:51:39.637147 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.637015    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-ca-trust-extracted\") pod \"image-registry-dbf5fc6cf-j5f62\" (UID: \"eb5cd0d7-4682-4760-8f8a-8a221c4a682b\") " pod="openshift-image-registry/image-registry-dbf5fc6cf-j5f62"
Sep 09 06:51:39.637147 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.637054    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-installation-pull-secrets\") pod \"image-registry-dbf5fc6cf-j5f62\" (UID: \"eb5cd0d7-4682-4760-8f8a-8a221c4a682b\") " pod="openshift-image-registry/image-registry-dbf5fc6cf-j5f62"
Sep 09 06:51:39.637147 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.637079    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg2hh\" (UniqueName: \"kubernetes.io/projected/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-kube-api-access-qg2hh\") pod \"image-registry-dbf5fc6cf-j5f62\" (UID: \"eb5cd0d7-4682-4760-8f8a-8a221c4a682b\") " pod="openshift-image-registry/image-registry-dbf5fc6cf-j5f62"
Sep 09 06:51:39.637147 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.637121    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-registry-certificates\") pod \"image-registry-dbf5fc6cf-j5f62\" (UID: \"eb5cd0d7-4682-4760-8f8a-8a221c4a682b\") " pod="openshift-image-registry/image-registry-dbf5fc6cf-j5f62"
Sep 09 06:51:39.637147 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.637141    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/18e9c162-f015-4a2f-bc71-d4403466dcf6-config-volume\") pod \"dns-default-hq6f8\" (UID: \"18e9c162-f015-4a2f-bc71-d4403466dcf6\") " pod="openshift-dns/dns-default-hq6f8"
Sep 09 06:51:39.637409 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.637182    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-trusted-ca\") pod \"image-registry-dbf5fc6cf-j5f62\" (UID: \"eb5cd0d7-4682-4760-8f8a-8a221c4a682b\") " pod="openshift-image-registry/image-registry-dbf5fc6cf-j5f62"
Sep 09 06:51:39.637409 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.637219    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-bound-sa-token\") pod \"image-registry-dbf5fc6cf-j5f62\" (UID: \"eb5cd0d7-4682-4760-8f8a-8a221c4a682b\") " pod="openshift-image-registry/image-registry-dbf5fc6cf-j5f62"
Sep 09 06:51:39.637409 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.637317    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-registry-tls\") pod \"image-registry-dbf5fc6cf-j5f62\" (UID: \"eb5cd0d7-4682-4760-8f8a-8a221c4a682b\") " pod="openshift-image-registry/image-registry-dbf5fc6cf-j5f62"
Sep 09 06:51:39.705227 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.705196    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fmhfw"
Sep 09 06:51:39.705364 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.705196    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pj9sz"
Sep 09 06:51:39.705364 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.705323    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tlg4m"
Sep 09 06:51:39.709570 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.709532    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 09 06:51:39.709570 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.709563    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wxxvd\""
Sep 09 06:51:39.709789 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.709622    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bgwvj\""
Sep 09 06:51:39.709882 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.709833    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 09 06:51:39.709937 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.709895    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 09 06:51:39.709937 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.709912    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 09 06:51:39.737794 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.737773    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-registry-certificates\") pod \"image-registry-dbf5fc6cf-j5f62\" (UID: \"eb5cd0d7-4682-4760-8f8a-8a221c4a682b\") " pod="openshift-image-registry/image-registry-dbf5fc6cf-j5f62"
Sep 09 06:51:39.737894 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.737800    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/18e9c162-f015-4a2f-bc71-d4403466dcf6-config-volume\") pod \"dns-default-hq6f8\" (UID: \"18e9c162-f015-4a2f-bc71-d4403466dcf6\") " pod="openshift-dns/dns-default-hq6f8"
Sep 09 06:51:39.737894 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.737824    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-trusted-ca\") pod \"image-registry-dbf5fc6cf-j5f62\" (UID: \"eb5cd0d7-4682-4760-8f8a-8a221c4a682b\") " pod="openshift-image-registry/image-registry-dbf5fc6cf-j5f62"
Sep 09 06:51:39.737894 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.737846    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-bound-sa-token\") pod \"image-registry-dbf5fc6cf-j5f62\" (UID: \"eb5cd0d7-4682-4760-8f8a-8a221c4a682b\") " pod="openshift-image-registry/image-registry-dbf5fc6cf-j5f62"
Sep 09 06:51:39.737894 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.737881    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-registry-tls\") pod \"image-registry-dbf5fc6cf-j5f62\" (UID: \"eb5cd0d7-4682-4760-8f8a-8a221c4a682b\") " pod="openshift-image-registry/image-registry-dbf5fc6cf-j5f62"
Sep 09 06:51:39.738098 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.737930    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18e9c162-f015-4a2f-bc71-d4403466dcf6-tmp-dir\") pod \"dns-default-hq6f8\" (UID: \"18e9c162-f015-4a2f-bc71-d4403466dcf6\") " pod="openshift-dns/dns-default-hq6f8"
Sep 09 06:51:39.738098 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.737959    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-image-registry-private-configuration\") pod \"image-registry-dbf5fc6cf-j5f62\" (UID: \"eb5cd0d7-4682-4760-8f8a-8a221c4a682b\") " pod="openshift-image-registry/image-registry-dbf5fc6cf-j5f62"
Sep 09 06:51:39.738098 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.737983    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/450d68be-a858-4505-abdf-9a43aca25ad9-cert\") pod \"ingress-canary-wbd57\" (UID: \"450d68be-a858-4505-abdf-9a43aca25ad9\") " pod="openshift-ingress-canary/ingress-canary-wbd57"
Sep 09 06:51:39.738098 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.738019    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/18e9c162-f015-4a2f-bc71-d4403466dcf6-metrics-tls\") pod \"dns-default-hq6f8\" (UID: \"18e9c162-f015-4a2f-bc71-d4403466dcf6\") " pod="openshift-dns/dns-default-hq6f8"
Sep 09 06:51:39.738098 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.738042    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqqt8\" (UniqueName: \"kubernetes.io/projected/450d68be-a858-4505-abdf-9a43aca25ad9-kube-api-access-sqqt8\") pod \"ingress-canary-wbd57\" (UID: \"450d68be-a858-4505-abdf-9a43aca25ad9\") " pod="openshift-ingress-canary/ingress-canary-wbd57"
Sep 09 06:51:39.738098 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.738065    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnvwj\" (UniqueName: \"kubernetes.io/projected/18e9c162-f015-4a2f-bc71-d4403466dcf6-kube-api-access-bnvwj\") pod \"dns-default-hq6f8\" (UID: \"18e9c162-f015-4a2f-bc71-d4403466dcf6\") " pod="openshift-dns/dns-default-hq6f8"
Sep 09 06:51:39.738357 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.738104    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-ca-trust-extracted\") pod \"image-registry-dbf5fc6cf-j5f62\" (UID: \"eb5cd0d7-4682-4760-8f8a-8a221c4a682b\") " pod="openshift-image-registry/image-registry-dbf5fc6cf-j5f62"
Sep 09 06:51:39.738357 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.738164    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-installation-pull-secrets\") pod \"image-registry-dbf5fc6cf-j5f62\" (UID: \"eb5cd0d7-4682-4760-8f8a-8a221c4a682b\") " pod="openshift-image-registry/image-registry-dbf5fc6cf-j5f62"
Sep 09 06:51:39.738357 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.738196    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg2hh\" (UniqueName: \"kubernetes.io/projected/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-kube-api-access-qg2hh\") pod \"image-registry-dbf5fc6cf-j5f62\" (UID: \"eb5cd0d7-4682-4760-8f8a-8a221c4a682b\") " pod="openshift-image-registry/image-registry-dbf5fc6cf-j5f62"
Sep 09 06:51:39.744126 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.743586    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-registry-certificates\") pod \"image-registry-dbf5fc6cf-j5f62\" (UID: \"eb5cd0d7-4682-4760-8f8a-8a221c4a682b\") " pod="openshift-image-registry/image-registry-dbf5fc6cf-j5f62"
Sep 09 06:51:39.744126 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.743774    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-ca-trust-extracted\") pod \"image-registry-dbf5fc6cf-j5f62\" (UID: \"eb5cd0d7-4682-4760-8f8a-8a221c4a682b\") " pod="openshift-image-registry/image-registry-dbf5fc6cf-j5f62"
Sep 09 06:51:39.744126 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:39.743900    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 06:51:39.744126 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:39.743967    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18e9c162-f015-4a2f-bc71-d4403466dcf6-metrics-tls podName:18e9c162-f015-4a2f-bc71-d4403466dcf6 nodeName:}" failed. No retries permitted until 2026-09-09 06:51:40.24394709 +0000 UTC m=+35.035756406 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/18e9c162-f015-4a2f-bc71-d4403466dcf6-metrics-tls") pod "dns-default-hq6f8" (UID: "18e9c162-f015-4a2f-bc71-d4403466dcf6") : secret "dns-default-metrics-tls" not found
Sep 09 06:51:39.744126 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.744009    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-trusted-ca\") pod \"image-registry-dbf5fc6cf-j5f62\" (UID: \"eb5cd0d7-4682-4760-8f8a-8a221c4a682b\") " pod="openshift-image-registry/image-registry-dbf5fc6cf-j5f62"
Sep 09 06:51:39.744126 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:39.744085    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 06:51:39.744126 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:39.744100    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dbf5fc6cf-j5f62: secret "image-registry-tls" not found
Sep 09 06:51:39.744434 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.744412    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18e9c162-f015-4a2f-bc71-d4403466dcf6-tmp-dir\") pod \"dns-default-hq6f8\" (UID: \"18e9c162-f015-4a2f-bc71-d4403466dcf6\") " pod="openshift-dns/dns-default-hq6f8"
Sep 09 06:51:39.744499 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:39.744481    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-registry-tls podName:eb5cd0d7-4682-4760-8f8a-8a221c4a682b nodeName:}" failed. No retries permitted until 2026-09-09 06:51:40.24414748 +0000 UTC m=+35.035956803 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-registry-tls") pod "image-registry-dbf5fc6cf-j5f62" (UID: "eb5cd0d7-4682-4760-8f8a-8a221c4a682b") : secret "image-registry-tls" not found
Sep 09 06:51:39.744764 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.744721    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/18e9c162-f015-4a2f-bc71-d4403466dcf6-config-volume\") pod \"dns-default-hq6f8\" (UID: \"18e9c162-f015-4a2f-bc71-d4403466dcf6\") " pod="openshift-dns/dns-default-hq6f8"
Sep 09 06:51:39.748276 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.748256    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-image-registry-private-configuration\") pod \"image-registry-dbf5fc6cf-j5f62\" (UID: \"eb5cd0d7-4682-4760-8f8a-8a221c4a682b\") " pod="openshift-image-registry/image-registry-dbf5fc6cf-j5f62"
Sep 09 06:51:39.748276 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.748269    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/450d68be-a858-4505-abdf-9a43aca25ad9-cert\") pod \"ingress-canary-wbd57\" (UID: \"450d68be-a858-4505-abdf-9a43aca25ad9\") " pod="openshift-ingress-canary/ingress-canary-wbd57"
Sep 09 06:51:39.748434 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.748283    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-installation-pull-secrets\") pod \"image-registry-dbf5fc6cf-j5f62\" (UID: \"eb5cd0d7-4682-4760-8f8a-8a221c4a682b\") " pod="openshift-image-registry/image-registry-dbf5fc6cf-j5f62"
Sep 09 06:51:39.752854 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.752832    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqqt8\" (UniqueName: \"kubernetes.io/projected/450d68be-a858-4505-abdf-9a43aca25ad9-kube-api-access-sqqt8\") pod \"ingress-canary-wbd57\" (UID: \"450d68be-a858-4505-abdf-9a43aca25ad9\") " pod="openshift-ingress-canary/ingress-canary-wbd57"
Sep 09 06:51:39.753055 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.753038    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg2hh\" (UniqueName: \"kubernetes.io/projected/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-kube-api-access-qg2hh\") pod \"image-registry-dbf5fc6cf-j5f62\" (UID: \"eb5cd0d7-4682-4760-8f8a-8a221c4a682b\") " pod="openshift-image-registry/image-registry-dbf5fc6cf-j5f62"
Sep 09 06:51:39.753128 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.753080    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnvwj\" (UniqueName: \"kubernetes.io/projected/18e9c162-f015-4a2f-bc71-d4403466dcf6-kube-api-access-bnvwj\") pod \"dns-default-hq6f8\" (UID: \"18e9c162-f015-4a2f-bc71-d4403466dcf6\") " pod="openshift-dns/dns-default-hq6f8"
Sep 09 06:51:39.754433 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.754394    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-bound-sa-token\") pod \"image-registry-dbf5fc6cf-j5f62\" (UID: \"eb5cd0d7-4682-4760-8f8a-8a221c4a682b\") " pod="openshift-image-registry/image-registry-dbf5fc6cf-j5f62"
Sep 09 06:51:39.835259 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:39.835225    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wbd57"
Sep 09 06:51:40.342431 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:40.342393    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/18e9c162-f015-4a2f-bc71-d4403466dcf6-metrics-tls\") pod \"dns-default-hq6f8\" (UID: \"18e9c162-f015-4a2f-bc71-d4403466dcf6\") " pod="openshift-dns/dns-default-hq6f8"
Sep 09 06:51:40.342895 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:40.342481    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-registry-tls\") pod \"image-registry-dbf5fc6cf-j5f62\" (UID: \"eb5cd0d7-4682-4760-8f8a-8a221c4a682b\") " pod="openshift-image-registry/image-registry-dbf5fc6cf-j5f62"
Sep 09 06:51:40.342895 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:40.342566    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 06:51:40.342895 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:40.342576    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 06:51:40.342895 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:40.342587    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dbf5fc6cf-j5f62: secret "image-registry-tls" not found
Sep 09 06:51:40.342895 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:40.342630    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18e9c162-f015-4a2f-bc71-d4403466dcf6-metrics-tls podName:18e9c162-f015-4a2f-bc71-d4403466dcf6 nodeName:}" failed. No retries permitted until 2026-09-09 06:51:41.342611163 +0000 UTC m=+36.134420493 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/18e9c162-f015-4a2f-bc71-d4403466dcf6-metrics-tls") pod "dns-default-hq6f8" (UID: "18e9c162-f015-4a2f-bc71-d4403466dcf6") : secret "dns-default-metrics-tls" not found
Sep 09 06:51:40.342895 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:40.342647    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-registry-tls podName:eb5cd0d7-4682-4760-8f8a-8a221c4a682b nodeName:}" failed. No retries permitted until 2026-09-09 06:51:41.342639209 +0000 UTC m=+36.134448527 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-registry-tls") pod "image-registry-dbf5fc6cf-j5f62" (UID: "eb5cd0d7-4682-4760-8f8a-8a221c4a682b") : secret "image-registry-tls" not found
Sep 09 06:51:41.036670 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:41.036545    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wbd57"]
Sep 09 06:51:41.039208 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:51:41.039185    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod450d68be_a858_4505_abdf_9a43aca25ad9.slice/crio-cef6dcb166e5554beca2d6656b17365d40921553dd2e288fad2d77cb00c0d9c9 WatchSource:0}: Error finding container cef6dcb166e5554beca2d6656b17365d40921553dd2e288fad2d77cb00c0d9c9: Status 404 returned error can't find the container with id cef6dcb166e5554beca2d6656b17365d40921553dd2e288fad2d77cb00c0d9c9
Sep 09 06:51:41.350263 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:41.350201    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-registry-tls\") pod \"image-registry-dbf5fc6cf-j5f62\" (UID: \"eb5cd0d7-4682-4760-8f8a-8a221c4a682b\") " pod="openshift-image-registry/image-registry-dbf5fc6cf-j5f62"
Sep 09 06:51:41.350263 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:41.350258    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/18e9c162-f015-4a2f-bc71-d4403466dcf6-metrics-tls\") pod \"dns-default-hq6f8\" (UID: \"18e9c162-f015-4a2f-bc71-d4403466dcf6\") " pod="openshift-dns/dns-default-hq6f8"
Sep 09 06:51:41.350587 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:41.350352    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 06:51:41.350587 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:41.350359    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 06:51:41.350587 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:41.350377    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dbf5fc6cf-j5f62: secret "image-registry-tls" not found
Sep 09 06:51:41.350587 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:41.350418    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18e9c162-f015-4a2f-bc71-d4403466dcf6-metrics-tls podName:18e9c162-f015-4a2f-bc71-d4403466dcf6 nodeName:}" failed. No retries permitted until 2026-09-09 06:51:43.350403496 +0000 UTC m=+38.142212813 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/18e9c162-f015-4a2f-bc71-d4403466dcf6-metrics-tls") pod "dns-default-hq6f8" (UID: "18e9c162-f015-4a2f-bc71-d4403466dcf6") : secret "dns-default-metrics-tls" not found
Sep 09 06:51:41.350587 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:41.350431    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-registry-tls podName:eb5cd0d7-4682-4760-8f8a-8a221c4a682b nodeName:}" failed. No retries permitted until 2026-09-09 06:51:43.350425114 +0000 UTC m=+38.142234431 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-registry-tls") pod "image-registry-dbf5fc6cf-j5f62" (UID: "eb5cd0d7-4682-4760-8f8a-8a221c4a682b") : secret "image-registry-tls" not found
Sep 09 06:51:41.870013 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:41.869982    2575 generic.go:356] "Generic (PLEG): container finished" podID="00e0c40f-e508-4900-9f82-94f5ef3c04a8" containerID="ed8721207e4c5f4956865d684fd3224dc35f8506a00a2bf396afad2b03cc7770" exitCode=0
Sep 09 06:51:41.870171 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:41.870025    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2p2z8" event={"ID":"00e0c40f-e508-4900-9f82-94f5ef3c04a8","Type":"ContainerDied","Data":"ed8721207e4c5f4956865d684fd3224dc35f8506a00a2bf396afad2b03cc7770"}
Sep 09 06:51:41.871410 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:41.871361    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wbd57" event={"ID":"450d68be-a858-4505-abdf-9a43aca25ad9","Type":"ContainerStarted","Data":"cef6dcb166e5554beca2d6656b17365d40921553dd2e288fad2d77cb00c0d9c9"}
Sep 09 06:51:42.876802 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:42.876769    2575 generic.go:356] "Generic (PLEG): container finished" podID="00e0c40f-e508-4900-9f82-94f5ef3c04a8" containerID="deb429114f4ebfeb329fae661ee35c99f35c167230fc83275cde335b0e097caa" exitCode=0
Sep 09 06:51:42.877265 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:42.876833    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2p2z8" event={"ID":"00e0c40f-e508-4900-9f82-94f5ef3c04a8","Type":"ContainerDied","Data":"deb429114f4ebfeb329fae661ee35c99f35c167230fc83275cde335b0e097caa"}
Sep 09 06:51:43.365624 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:43.365537    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/18e9c162-f015-4a2f-bc71-d4403466dcf6-metrics-tls\") pod \"dns-default-hq6f8\" (UID: \"18e9c162-f015-4a2f-bc71-d4403466dcf6\") " pod="openshift-dns/dns-default-hq6f8"
Sep 09 06:51:43.365804 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:43.365645    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-registry-tls\") pod \"image-registry-dbf5fc6cf-j5f62\" (UID: \"eb5cd0d7-4682-4760-8f8a-8a221c4a682b\") " pod="openshift-image-registry/image-registry-dbf5fc6cf-j5f62"
Sep 09 06:51:43.365804 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:43.365692    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 06:51:43.365804 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:43.365780    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18e9c162-f015-4a2f-bc71-d4403466dcf6-metrics-tls podName:18e9c162-f015-4a2f-bc71-d4403466dcf6 nodeName:}" failed. No retries permitted until 2026-09-09 06:51:47.365764043 +0000 UTC m=+42.157573381 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/18e9c162-f015-4a2f-bc71-d4403466dcf6-metrics-tls") pod "dns-default-hq6f8" (UID: "18e9c162-f015-4a2f-bc71-d4403466dcf6") : secret "dns-default-metrics-tls" not found
Sep 09 06:51:43.365804 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:43.365799    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 06:51:43.366017 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:43.365819    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dbf5fc6cf-j5f62: secret "image-registry-tls" not found
Sep 09 06:51:43.366017 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:43.365876    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-registry-tls podName:eb5cd0d7-4682-4760-8f8a-8a221c4a682b nodeName:}" failed. No retries permitted until 2026-09-09 06:51:47.365860207 +0000 UTC m=+42.157669538 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-registry-tls") pod "image-registry-dbf5fc6cf-j5f62" (UID: "eb5cd0d7-4682-4760-8f8a-8a221c4a682b") : secret "image-registry-tls" not found
Sep 09 06:51:43.882552 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:43.882520    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2p2z8" event={"ID":"00e0c40f-e508-4900-9f82-94f5ef3c04a8","Type":"ContainerStarted","Data":"9e70f133f591fd30ac766a8b5382434ba22e8af58f9298a085c02f9f65ede8aa"}
Sep 09 06:51:43.907523 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:43.907477    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2p2z8" podStartSLOduration=8.073371364 podStartE2EDuration="37.907463715s" totalImagesPullingTime="29.834092351s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 06:51:06 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:51:43.905828135 +0000 UTC m=+38.697637473" watchObservedRunningTime="2026-09-09 06:51:43.907463715 +0000 UTC m=+38.699273094"
Sep 09 06:51:44.886585 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:44.886555    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wbd57" event={"ID":"450d68be-a858-4505-abdf-9a43aca25ad9","Type":"ContainerStarted","Data":"044da622a99f3a8edaf5f68ea2ec5e3cda5a047166823f698a88cbdb8604abdd"}
Sep 09 06:51:44.902995 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:44.902948    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wbd57" podStartSLOduration=2.65184533 podStartE2EDuration="5.902932812s" totalImagesPullingTime="3.251087482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:51:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:51:44.902679127 +0000 UTC m=+39.694488465" watchObservedRunningTime="2026-09-09 06:51:44.902932812 +0000 UTC m=+39.694742151"
Sep 09 06:51:47.397044 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:47.397006    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-registry-tls\") pod \"image-registry-dbf5fc6cf-j5f62\" (UID: \"eb5cd0d7-4682-4760-8f8a-8a221c4a682b\") " pod="openshift-image-registry/image-registry-dbf5fc6cf-j5f62"
Sep 09 06:51:47.397405 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:47.397067    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/18e9c162-f015-4a2f-bc71-d4403466dcf6-metrics-tls\") pod \"dns-default-hq6f8\" (UID: \"18e9c162-f015-4a2f-bc71-d4403466dcf6\") " pod="openshift-dns/dns-default-hq6f8"
Sep 09 06:51:47.397405 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:47.397148    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 06:51:47.397405 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:47.397154    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 06:51:47.397405 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:47.397172    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dbf5fc6cf-j5f62: secret "image-registry-tls" not found
Sep 09 06:51:47.397405 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:47.397197    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18e9c162-f015-4a2f-bc71-d4403466dcf6-metrics-tls podName:18e9c162-f015-4a2f-bc71-d4403466dcf6 nodeName:}" failed. No retries permitted until 2026-09-09 06:51:55.397183186 +0000 UTC m=+50.188992503 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/18e9c162-f015-4a2f-bc71-d4403466dcf6-metrics-tls") pod "dns-default-hq6f8" (UID: "18e9c162-f015-4a2f-bc71-d4403466dcf6") : secret "dns-default-metrics-tls" not found
Sep 09 06:51:47.397405 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:47.397214    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-registry-tls podName:eb5cd0d7-4682-4760-8f8a-8a221c4a682b nodeName:}" failed. No retries permitted until 2026-09-09 06:51:55.397201814 +0000 UTC m=+50.189011132 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-registry-tls") pod "image-registry-dbf5fc6cf-j5f62" (UID: "eb5cd0d7-4682-4760-8f8a-8a221c4a682b") : secret "image-registry-tls" not found
Sep 09 06:51:53.454349 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:53.454316    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-gk2bj"]
Sep 09 06:51:53.512218 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:53.512192    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-mq6bf"]
Sep 09 06:51:53.512351 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:53.512312    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-gk2bj"
Sep 09 06:51:53.514726 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:53.514705    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-k5fc6\""
Sep 09 06:51:53.514726 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:53.514712    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 09 06:51:53.515883 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:53.515868    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 09 06:51:53.527434 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:53.527415    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-gk2bj"]
Sep 09 06:51:53.527519 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:53.527465    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-mq6bf"]
Sep 09 06:51:53.527519 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:53.527423    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-mq6bf"
Sep 09 06:51:53.529827 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:53.529812    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 09 06:51:53.529927 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:53.529912    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 09 06:51:53.530149 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:53.530134    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-49sdm\""
Sep 09 06:51:53.531635 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:53.531593    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 09 06:51:53.531729 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:53.531676    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 09 06:51:53.558734 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:53.558718    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-cqckd"]
Sep 09 06:51:53.580471 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:53.580453    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-cqckd"
Sep 09 06:51:53.580471 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:53.580459    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-cqckd"]
Sep 09 06:51:53.582985 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:53.582968    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 09 06:51:53.583062 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:53.582992    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-qndmb\""
Sep 09 06:51:53.583201 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:53.583179    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 09 06:51:53.583551 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:53.583531    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 09 06:51:53.640783 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:53.640759    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e983cf46-9062-43cc-a0da-3c6827751b97-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-mq6bf\" (UID: \"e983cf46-9062-43cc-a0da-3c6827751b97\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-mq6bf"
Sep 09 06:51:53.640878 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:53.640789    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e983cf46-9062-43cc-a0da-3c6827751b97-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-mq6bf\" (UID: \"e983cf46-9062-43cc-a0da-3c6827751b97\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-mq6bf"
Sep 09 06:51:53.640878 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:53.640807    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rljdq\" (UniqueName: \"kubernetes.io/projected/e983cf46-9062-43cc-a0da-3c6827751b97-kube-api-access-rljdq\") pod \"cluster-monitoring-operator-6cdcc96965-mq6bf\" (UID: \"e983cf46-9062-43cc-a0da-3c6827751b97\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-mq6bf"
Sep 09 06:51:53.640878 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:53.640823    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fba513b1-0c6e-49c0-b171-29ef7cb39608-nginx-conf\") pod \"networking-console-plugin-79977f9844-gk2bj\" (UID: \"fba513b1-0c6e-49c0-b171-29ef7cb39608\") " pod="openshift-network-console/networking-console-plugin-79977f9844-gk2bj"
Sep 09 06:51:53.640985 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:53.640913    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fba513b1-0c6e-49c0-b171-29ef7cb39608-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-gk2bj\" (UID: \"fba513b1-0c6e-49c0-b171-29ef7cb39608\") " pod="openshift-network-console/networking-console-plugin-79977f9844-gk2bj"
Sep 09 06:51:53.742231 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:53.742174    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e983cf46-9062-43cc-a0da-3c6827751b97-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-mq6bf\" (UID: \"e983cf46-9062-43cc-a0da-3c6827751b97\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-mq6bf"
Sep 09 06:51:53.742231 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:53.742201    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e983cf46-9062-43cc-a0da-3c6827751b97-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-mq6bf\" (UID: \"e983cf46-9062-43cc-a0da-3c6827751b97\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-mq6bf"
Sep 09 06:51:53.742231 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:53.742219    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rljdq\" (UniqueName: \"kubernetes.io/projected/e983cf46-9062-43cc-a0da-3c6827751b97-kube-api-access-rljdq\") pod \"cluster-monitoring-operator-6cdcc96965-mq6bf\" (UID: \"e983cf46-9062-43cc-a0da-3c6827751b97\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-mq6bf"
Sep 09 06:51:53.742392 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:53.742234    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fba513b1-0c6e-49c0-b171-29ef7cb39608-nginx-conf\") pod \"networking-console-plugin-79977f9844-gk2bj\" (UID: \"fba513b1-0c6e-49c0-b171-29ef7cb39608\") " pod="openshift-network-console/networking-console-plugin-79977f9844-gk2bj"
Sep 09 06:51:53.742392 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:53.742306    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 06:51:53.742392 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:53.742368    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e983cf46-9062-43cc-a0da-3c6827751b97-cluster-monitoring-operator-tls podName:e983cf46-9062-43cc-a0da-3c6827751b97 nodeName:}" failed. No retries permitted until 2026-09-09 06:51:54.242342673 +0000 UTC m=+49.034151990 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e983cf46-9062-43cc-a0da-3c6827751b97-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-mq6bf" (UID: "e983cf46-9062-43cc-a0da-3c6827751b97") : secret "cluster-monitoring-operator-tls" not found
Sep 09 06:51:53.742392 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:53.742362    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f13e7dfd-1d89-4714-b65f-1a8e3dc264e5-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-cqckd\" (UID: \"f13e7dfd-1d89-4714-b65f-1a8e3dc264e5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-cqckd"
Sep 09 06:51:53.742527 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:53.742436    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2qqq\" (UniqueName: \"kubernetes.io/projected/f13e7dfd-1d89-4714-b65f-1a8e3dc264e5-kube-api-access-m2qqq\") pod \"cluster-samples-operator-7cdcfcf76c-cqckd\" (UID: \"f13e7dfd-1d89-4714-b65f-1a8e3dc264e5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-cqckd"
Sep 09 06:51:53.742527 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:53.742490    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fba513b1-0c6e-49c0-b171-29ef7cb39608-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-gk2bj\" (UID: \"fba513b1-0c6e-49c0-b171-29ef7cb39608\") " pod="openshift-network-console/networking-console-plugin-79977f9844-gk2bj"
Sep 09 06:51:53.742614 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:53.742598    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 06:51:53.742671 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:53.742661    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fba513b1-0c6e-49c0-b171-29ef7cb39608-networking-console-plugin-cert podName:fba513b1-0c6e-49c0-b171-29ef7cb39608 nodeName:}" failed. No retries permitted until 2026-09-09 06:51:54.242644895 +0000 UTC m=+49.034454213 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fba513b1-0c6e-49c0-b171-29ef7cb39608-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-gk2bj" (UID: "fba513b1-0c6e-49c0-b171-29ef7cb39608") : secret "networking-console-plugin-cert" not found
Sep 09 06:51:53.742981 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:53.742963    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e983cf46-9062-43cc-a0da-3c6827751b97-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-mq6bf\" (UID: \"e983cf46-9062-43cc-a0da-3c6827751b97\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-mq6bf"
Sep 09 06:51:53.743028 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:53.742969    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fba513b1-0c6e-49c0-b171-29ef7cb39608-nginx-conf\") pod \"networking-console-plugin-79977f9844-gk2bj\" (UID: \"fba513b1-0c6e-49c0-b171-29ef7cb39608\") " pod="openshift-network-console/networking-console-plugin-79977f9844-gk2bj"
Sep 09 06:51:53.752319 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:53.752292    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rljdq\" (UniqueName: \"kubernetes.io/projected/e983cf46-9062-43cc-a0da-3c6827751b97-kube-api-access-rljdq\") pod \"cluster-monitoring-operator-6cdcc96965-mq6bf\" (UID: \"e983cf46-9062-43cc-a0da-3c6827751b97\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-mq6bf"
Sep 09 06:51:53.843374 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:53.843356    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2qqq\" (UniqueName: \"kubernetes.io/projected/f13e7dfd-1d89-4714-b65f-1a8e3dc264e5-kube-api-access-m2qqq\") pod \"cluster-samples-operator-7cdcfcf76c-cqckd\" (UID: \"f13e7dfd-1d89-4714-b65f-1a8e3dc264e5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-cqckd"
Sep 09 06:51:53.843470 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:53.843451    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f13e7dfd-1d89-4714-b65f-1a8e3dc264e5-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-cqckd\" (UID: \"f13e7dfd-1d89-4714-b65f-1a8e3dc264e5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-cqckd"
Sep 09 06:51:53.843550 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:53.843538    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 09 06:51:53.843608 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:53.843598    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f13e7dfd-1d89-4714-b65f-1a8e3dc264e5-samples-operator-tls podName:f13e7dfd-1d89-4714-b65f-1a8e3dc264e5 nodeName:}" failed. No retries permitted until 2026-09-09 06:51:54.3435824 +0000 UTC m=+49.135391720 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f13e7dfd-1d89-4714-b65f-1a8e3dc264e5-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-cqckd" (UID: "f13e7dfd-1d89-4714-b65f-1a8e3dc264e5") : secret "samples-operator-tls" not found
Sep 09 06:51:53.852489 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:53.852463    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2qqq\" (UniqueName: \"kubernetes.io/projected/f13e7dfd-1d89-4714-b65f-1a8e3dc264e5-kube-api-access-m2qqq\") pod \"cluster-samples-operator-7cdcfcf76c-cqckd\" (UID: \"f13e7dfd-1d89-4714-b65f-1a8e3dc264e5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-cqckd"
Sep 09 06:51:54.246734 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:54.246697    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fba513b1-0c6e-49c0-b171-29ef7cb39608-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-gk2bj\" (UID: \"fba513b1-0c6e-49c0-b171-29ef7cb39608\") " pod="openshift-network-console/networking-console-plugin-79977f9844-gk2bj"
Sep 09 06:51:54.246945 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:54.246802    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e983cf46-9062-43cc-a0da-3c6827751b97-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-mq6bf\" (UID: \"e983cf46-9062-43cc-a0da-3c6827751b97\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-mq6bf"
Sep 09 06:51:54.246945 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:54.246850    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 06:51:54.246945 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:54.246915    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fba513b1-0c6e-49c0-b171-29ef7cb39608-networking-console-plugin-cert podName:fba513b1-0c6e-49c0-b171-29ef7cb39608 nodeName:}" failed. No retries permitted until 2026-09-09 06:51:55.24690019 +0000 UTC m=+50.038709507 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fba513b1-0c6e-49c0-b171-29ef7cb39608-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-gk2bj" (UID: "fba513b1-0c6e-49c0-b171-29ef7cb39608") : secret "networking-console-plugin-cert" not found
Sep 09 06:51:54.246945 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:54.246915    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 06:51:54.247110 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:54.246969    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e983cf46-9062-43cc-a0da-3c6827751b97-cluster-monitoring-operator-tls podName:e983cf46-9062-43cc-a0da-3c6827751b97 nodeName:}" failed. No retries permitted until 2026-09-09 06:51:55.24695231 +0000 UTC m=+50.038761651 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e983cf46-9062-43cc-a0da-3c6827751b97-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-mq6bf" (UID: "e983cf46-9062-43cc-a0da-3c6827751b97") : secret "cluster-monitoring-operator-tls" not found
Sep 09 06:51:54.347532 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:54.347495    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f13e7dfd-1d89-4714-b65f-1a8e3dc264e5-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-cqckd\" (UID: \"f13e7dfd-1d89-4714-b65f-1a8e3dc264e5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-cqckd"
Sep 09 06:51:54.347661 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:54.347642    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 09 06:51:54.347729 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:54.347719    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f13e7dfd-1d89-4714-b65f-1a8e3dc264e5-samples-operator-tls podName:f13e7dfd-1d89-4714-b65f-1a8e3dc264e5 nodeName:}" failed. No retries permitted until 2026-09-09 06:51:55.347702289 +0000 UTC m=+50.139511605 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f13e7dfd-1d89-4714-b65f-1a8e3dc264e5-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-cqckd" (UID: "f13e7dfd-1d89-4714-b65f-1a8e3dc264e5") : secret "samples-operator-tls" not found
Sep 09 06:51:55.254557 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:55.254522    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e983cf46-9062-43cc-a0da-3c6827751b97-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-mq6bf\" (UID: \"e983cf46-9062-43cc-a0da-3c6827751b97\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-mq6bf"
Sep 09 06:51:55.254955 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:55.254625    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fba513b1-0c6e-49c0-b171-29ef7cb39608-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-gk2bj\" (UID: \"fba513b1-0c6e-49c0-b171-29ef7cb39608\") " pod="openshift-network-console/networking-console-plugin-79977f9844-gk2bj"
Sep 09 06:51:55.254955 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:55.254676    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 06:51:55.254955 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:55.254709    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 06:51:55.254955 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:55.254782    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e983cf46-9062-43cc-a0da-3c6827751b97-cluster-monitoring-operator-tls podName:e983cf46-9062-43cc-a0da-3c6827751b97 nodeName:}" failed. No retries permitted until 2026-09-09 06:51:57.254730834 +0000 UTC m=+52.046540164 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e983cf46-9062-43cc-a0da-3c6827751b97-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-mq6bf" (UID: "e983cf46-9062-43cc-a0da-3c6827751b97") : secret "cluster-monitoring-operator-tls" not found
Sep 09 06:51:55.254955 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:55.254800    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fba513b1-0c6e-49c0-b171-29ef7cb39608-networking-console-plugin-cert podName:fba513b1-0c6e-49c0-b171-29ef7cb39608 nodeName:}" failed. No retries permitted until 2026-09-09 06:51:57.254790736 +0000 UTC m=+52.046600056 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fba513b1-0c6e-49c0-b171-29ef7cb39608-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-gk2bj" (UID: "fba513b1-0c6e-49c0-b171-29ef7cb39608") : secret "networking-console-plugin-cert" not found
Sep 09 06:51:55.355059 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:55.355030    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f13e7dfd-1d89-4714-b65f-1a8e3dc264e5-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-cqckd\" (UID: \"f13e7dfd-1d89-4714-b65f-1a8e3dc264e5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-cqckd"
Sep 09 06:51:55.355225 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:55.355207    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 09 06:51:55.355291 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:55.355275    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f13e7dfd-1d89-4714-b65f-1a8e3dc264e5-samples-operator-tls podName:f13e7dfd-1d89-4714-b65f-1a8e3dc264e5 nodeName:}" failed. No retries permitted until 2026-09-09 06:51:57.355256422 +0000 UTC m=+52.147065738 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f13e7dfd-1d89-4714-b65f-1a8e3dc264e5-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-cqckd" (UID: "f13e7dfd-1d89-4714-b65f-1a8e3dc264e5") : secret "samples-operator-tls" not found
Sep 09 06:51:55.455785 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:55.455759    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-registry-tls\") pod \"image-registry-dbf5fc6cf-j5f62\" (UID: \"eb5cd0d7-4682-4760-8f8a-8a221c4a682b\") " pod="openshift-image-registry/image-registry-dbf5fc6cf-j5f62"
Sep 09 06:51:55.455919 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:55.455842    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/18e9c162-f015-4a2f-bc71-d4403466dcf6-metrics-tls\") pod \"dns-default-hq6f8\" (UID: \"18e9c162-f015-4a2f-bc71-d4403466dcf6\") " pod="openshift-dns/dns-default-hq6f8"
Sep 09 06:51:55.455919 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:55.455881    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 06:51:55.455919 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:55.455896    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dbf5fc6cf-j5f62: secret "image-registry-tls" not found
Sep 09 06:51:55.456064 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:55.455945    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-registry-tls podName:eb5cd0d7-4682-4760-8f8a-8a221c4a682b nodeName:}" failed. No retries permitted until 2026-09-09 06:52:11.455931387 +0000 UTC m=+66.247740714 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-registry-tls") pod "image-registry-dbf5fc6cf-j5f62" (UID: "eb5cd0d7-4682-4760-8f8a-8a221c4a682b") : secret "image-registry-tls" not found
Sep 09 06:51:55.456064 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:55.455980    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 06:51:55.456064 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:55.456028    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18e9c162-f015-4a2f-bc71-d4403466dcf6-metrics-tls podName:18e9c162-f015-4a2f-bc71-d4403466dcf6 nodeName:}" failed. No retries permitted until 2026-09-09 06:52:11.456013929 +0000 UTC m=+66.247823249 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/18e9c162-f015-4a2f-bc71-d4403466dcf6-metrics-tls") pod "dns-default-hq6f8" (UID: "18e9c162-f015-4a2f-bc71-d4403466dcf6") : secret "dns-default-metrics-tls" not found
Sep 09 06:51:57.269393 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:57.269357    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e983cf46-9062-43cc-a0da-3c6827751b97-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-mq6bf\" (UID: \"e983cf46-9062-43cc-a0da-3c6827751b97\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-mq6bf"
Sep 09 06:51:57.269864 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:57.269435    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fba513b1-0c6e-49c0-b171-29ef7cb39608-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-gk2bj\" (UID: \"fba513b1-0c6e-49c0-b171-29ef7cb39608\") " pod="openshift-network-console/networking-console-plugin-79977f9844-gk2bj"
Sep 09 06:51:57.269864 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:57.269537    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 06:51:57.269864 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:57.269614    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e983cf46-9062-43cc-a0da-3c6827751b97-cluster-monitoring-operator-tls podName:e983cf46-9062-43cc-a0da-3c6827751b97 nodeName:}" failed. No retries permitted until 2026-09-09 06:52:01.269593822 +0000 UTC m=+56.061403143 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e983cf46-9062-43cc-a0da-3c6827751b97-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-mq6bf" (UID: "e983cf46-9062-43cc-a0da-3c6827751b97") : secret "cluster-monitoring-operator-tls" not found
Sep 09 06:51:57.269864 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:57.269540    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 06:51:57.269864 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:57.269683    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fba513b1-0c6e-49c0-b171-29ef7cb39608-networking-console-plugin-cert podName:fba513b1-0c6e-49c0-b171-29ef7cb39608 nodeName:}" failed. No retries permitted until 2026-09-09 06:52:01.269669378 +0000 UTC m=+56.061478694 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fba513b1-0c6e-49c0-b171-29ef7cb39608-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-gk2bj" (UID: "fba513b1-0c6e-49c0-b171-29ef7cb39608") : secret "networking-console-plugin-cert" not found
Sep 09 06:51:57.370290 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:57.370261    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f13e7dfd-1d89-4714-b65f-1a8e3dc264e5-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-cqckd\" (UID: \"f13e7dfd-1d89-4714-b65f-1a8e3dc264e5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-cqckd"
Sep 09 06:51:57.370430 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:57.370392    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 09 06:51:57.370470 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:57.370450    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f13e7dfd-1d89-4714-b65f-1a8e3dc264e5-samples-operator-tls podName:f13e7dfd-1d89-4714-b65f-1a8e3dc264e5 nodeName:}" failed. No retries permitted until 2026-09-09 06:52:01.370436346 +0000 UTC m=+56.162245669 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f13e7dfd-1d89-4714-b65f-1a8e3dc264e5-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-cqckd" (UID: "f13e7dfd-1d89-4714-b65f-1a8e3dc264e5") : secret "samples-operator-tls" not found
Sep 09 06:51:59.861939 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:59.861905    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6t86r"]
Sep 09 06:51:59.864244 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:59.864225    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6t86r"
Sep 09 06:51:59.866598 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:59.866573    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 09 06:51:59.866706 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:59.866573    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 09 06:51:59.866784 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:59.866711    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 09 06:51:59.866784 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:59.866719    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 09 06:51:59.867642 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:59.867629    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nqhdr\""
Sep 09 06:51:59.876245 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:59.876225    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6t86r"]
Sep 09 06:51:59.889729 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:59.889708    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c097e9a1-524c-4ac3-bc56-c3947efed719-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6t86r\" (UID: \"c097e9a1-524c-4ac3-bc56-c3947efed719\") " pod="openshift-insights/insights-runtime-extractor-6t86r"
Sep 09 06:51:59.889831 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:59.889781    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c097e9a1-524c-4ac3-bc56-c3947efed719-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6t86r\" (UID: \"c097e9a1-524c-4ac3-bc56-c3947efed719\") " pod="openshift-insights/insights-runtime-extractor-6t86r"
Sep 09 06:51:59.889870 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:59.889837    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kcbz\" (UniqueName: \"kubernetes.io/projected/c097e9a1-524c-4ac3-bc56-c3947efed719-kube-api-access-7kcbz\") pod \"insights-runtime-extractor-6t86r\" (UID: \"c097e9a1-524c-4ac3-bc56-c3947efed719\") " pod="openshift-insights/insights-runtime-extractor-6t86r"
Sep 09 06:51:59.889910 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:59.889879    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c097e9a1-524c-4ac3-bc56-c3947efed719-crio-socket\") pod \"insights-runtime-extractor-6t86r\" (UID: \"c097e9a1-524c-4ac3-bc56-c3947efed719\") " pod="openshift-insights/insights-runtime-extractor-6t86r"
Sep 09 06:51:59.889956 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:59.889944    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c097e9a1-524c-4ac3-bc56-c3947efed719-data-volume\") pod \"insights-runtime-extractor-6t86r\" (UID: \"c097e9a1-524c-4ac3-bc56-c3947efed719\") " pod="openshift-insights/insights-runtime-extractor-6t86r"
Sep 09 06:51:59.990314 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:59.990287    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c097e9a1-524c-4ac3-bc56-c3947efed719-data-volume\") pod \"insights-runtime-extractor-6t86r\" (UID: \"c097e9a1-524c-4ac3-bc56-c3947efed719\") " pod="openshift-insights/insights-runtime-extractor-6t86r"
Sep 09 06:51:59.990407 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:59.990344    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c097e9a1-524c-4ac3-bc56-c3947efed719-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6t86r\" (UID: \"c097e9a1-524c-4ac3-bc56-c3947efed719\") " pod="openshift-insights/insights-runtime-extractor-6t86r"
Sep 09 06:51:59.990456 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:59.990443    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 06:51:59.990491 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:59.990470    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c097e9a1-524c-4ac3-bc56-c3947efed719-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6t86r\" (UID: \"c097e9a1-524c-4ac3-bc56-c3947efed719\") " pod="openshift-insights/insights-runtime-extractor-6t86r"
Sep 09 06:51:59.990522 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:59.990504    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c097e9a1-524c-4ac3-bc56-c3947efed719-insights-runtime-extractor-tls podName:c097e9a1-524c-4ac3-bc56-c3947efed719 nodeName:}" failed. No retries permitted until 2026-09-09 06:52:00.490490342 +0000 UTC m=+55.282299659 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c097e9a1-524c-4ac3-bc56-c3947efed719-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6t86r" (UID: "c097e9a1-524c-4ac3-bc56-c3947efed719") : secret "insights-runtime-extractor-tls" not found
Sep 09 06:51:59.990570 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:59.990517    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kcbz\" (UniqueName: \"kubernetes.io/projected/c097e9a1-524c-4ac3-bc56-c3947efed719-kube-api-access-7kcbz\") pod \"insights-runtime-extractor-6t86r\" (UID: \"c097e9a1-524c-4ac3-bc56-c3947efed719\") " pod="openshift-insights/insights-runtime-extractor-6t86r"
Sep 09 06:51:59.990570 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:59.990531    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 06:51:59.990570 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:59.990562    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c097e9a1-524c-4ac3-bc56-c3947efed719-crio-socket\") pod \"insights-runtime-extractor-6t86r\" (UID: \"c097e9a1-524c-4ac3-bc56-c3947efed719\") " pod="openshift-insights/insights-runtime-extractor-6t86r"
Sep 09 06:51:59.990698 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:51:59.990590    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c097e9a1-524c-4ac3-bc56-c3947efed719-kube-rbac-proxy-cm podName:c097e9a1-524c-4ac3-bc56-c3947efed719 nodeName:}" failed. No retries permitted until 2026-09-09 06:52:00.490574137 +0000 UTC m=+55.282383467 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c097e9a1-524c-4ac3-bc56-c3947efed719-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6t86r" (UID: "c097e9a1-524c-4ac3-bc56-c3947efed719") : configmap "kube-rbac-proxy" not found
Sep 09 06:51:59.990698 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:59.990618    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c097e9a1-524c-4ac3-bc56-c3947efed719-crio-socket\") pod \"insights-runtime-extractor-6t86r\" (UID: \"c097e9a1-524c-4ac3-bc56-c3947efed719\") " pod="openshift-insights/insights-runtime-extractor-6t86r"
Sep 09 06:51:59.990698 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:51:59.990618    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c097e9a1-524c-4ac3-bc56-c3947efed719-data-volume\") pod \"insights-runtime-extractor-6t86r\" (UID: \"c097e9a1-524c-4ac3-bc56-c3947efed719\") " pod="openshift-insights/insights-runtime-extractor-6t86r"
Sep 09 06:52:00.002296 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:00.002278    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kcbz\" (UniqueName: \"kubernetes.io/projected/c097e9a1-524c-4ac3-bc56-c3947efed719-kube-api-access-7kcbz\") pod \"insights-runtime-extractor-6t86r\" (UID: \"c097e9a1-524c-4ac3-bc56-c3947efed719\") " pod="openshift-insights/insights-runtime-extractor-6t86r"
Sep 09 06:52:00.495091 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:00.495056    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c097e9a1-524c-4ac3-bc56-c3947efed719-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6t86r\" (UID: \"c097e9a1-524c-4ac3-bc56-c3947efed719\") " pod="openshift-insights/insights-runtime-extractor-6t86r"
Sep 09 06:52:00.495257 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:00.495109    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c097e9a1-524c-4ac3-bc56-c3947efed719-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6t86r\" (UID: \"c097e9a1-524c-4ac3-bc56-c3947efed719\") " pod="openshift-insights/insights-runtime-extractor-6t86r"
Sep 09 06:52:00.495257 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:52:00.495221    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 06:52:00.495326 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:52:00.495259    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 06:52:00.495326 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:52:00.495288    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c097e9a1-524c-4ac3-bc56-c3947efed719-insights-runtime-extractor-tls podName:c097e9a1-524c-4ac3-bc56-c3947efed719 nodeName:}" failed. No retries permitted until 2026-09-09 06:52:01.495271617 +0000 UTC m=+56.287080952 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c097e9a1-524c-4ac3-bc56-c3947efed719-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6t86r" (UID: "c097e9a1-524c-4ac3-bc56-c3947efed719") : secret "insights-runtime-extractor-tls" not found
Sep 09 06:52:00.495326 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:52:00.495320    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c097e9a1-524c-4ac3-bc56-c3947efed719-kube-rbac-proxy-cm podName:c097e9a1-524c-4ac3-bc56-c3947efed719 nodeName:}" failed. No retries permitted until 2026-09-09 06:52:01.495305946 +0000 UTC m=+56.287115266 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c097e9a1-524c-4ac3-bc56-c3947efed719-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6t86r" (UID: "c097e9a1-524c-4ac3-bc56-c3947efed719") : configmap "kube-rbac-proxy" not found
Sep 09 06:52:01.302700 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:01.302666    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e983cf46-9062-43cc-a0da-3c6827751b97-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-mq6bf\" (UID: \"e983cf46-9062-43cc-a0da-3c6827751b97\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-mq6bf"
Sep 09 06:52:01.303103 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:01.302821    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fba513b1-0c6e-49c0-b171-29ef7cb39608-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-gk2bj\" (UID: \"fba513b1-0c6e-49c0-b171-29ef7cb39608\") " pod="openshift-network-console/networking-console-plugin-79977f9844-gk2bj"
Sep 09 06:52:01.303103 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:52:01.302835    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 06:52:01.303103 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:52:01.302903    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e983cf46-9062-43cc-a0da-3c6827751b97-cluster-monitoring-operator-tls podName:e983cf46-9062-43cc-a0da-3c6827751b97 nodeName:}" failed. No retries permitted until 2026-09-09 06:52:09.302882198 +0000 UTC m=+64.094691532 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e983cf46-9062-43cc-a0da-3c6827751b97-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-mq6bf" (UID: "e983cf46-9062-43cc-a0da-3c6827751b97") : secret "cluster-monitoring-operator-tls" not found
Sep 09 06:52:01.303103 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:52:01.302931    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 06:52:01.303103 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:52:01.302964    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fba513b1-0c6e-49c0-b171-29ef7cb39608-networking-console-plugin-cert podName:fba513b1-0c6e-49c0-b171-29ef7cb39608 nodeName:}" failed. No retries permitted until 2026-09-09 06:52:09.302953706 +0000 UTC m=+64.094763026 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fba513b1-0c6e-49c0-b171-29ef7cb39608-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-gk2bj" (UID: "fba513b1-0c6e-49c0-b171-29ef7cb39608") : secret "networking-console-plugin-cert" not found
Sep 09 06:52:01.403455 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:01.403415    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f13e7dfd-1d89-4714-b65f-1a8e3dc264e5-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-cqckd\" (UID: \"f13e7dfd-1d89-4714-b65f-1a8e3dc264e5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-cqckd"
Sep 09 06:52:01.403622 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:52:01.403569    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 09 06:52:01.403666 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:52:01.403635    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f13e7dfd-1d89-4714-b65f-1a8e3dc264e5-samples-operator-tls podName:f13e7dfd-1d89-4714-b65f-1a8e3dc264e5 nodeName:}" failed. No retries permitted until 2026-09-09 06:52:09.403619656 +0000 UTC m=+64.195428977 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f13e7dfd-1d89-4714-b65f-1a8e3dc264e5-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-cqckd" (UID: "f13e7dfd-1d89-4714-b65f-1a8e3dc264e5") : secret "samples-operator-tls" not found
Sep 09 06:52:01.503994 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:01.503966    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c097e9a1-524c-4ac3-bc56-c3947efed719-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6t86r\" (UID: \"c097e9a1-524c-4ac3-bc56-c3947efed719\") " pod="openshift-insights/insights-runtime-extractor-6t86r"
Sep 09 06:52:01.504150 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:01.504018    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c097e9a1-524c-4ac3-bc56-c3947efed719-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6t86r\" (UID: \"c097e9a1-524c-4ac3-bc56-c3947efed719\") " pod="openshift-insights/insights-runtime-extractor-6t86r"
Sep 09 06:52:01.504150 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:52:01.504097    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 06:52:01.504150 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:52:01.504107    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 06:52:01.504150 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:52:01.504149    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c097e9a1-524c-4ac3-bc56-c3947efed719-kube-rbac-proxy-cm podName:c097e9a1-524c-4ac3-bc56-c3947efed719 nodeName:}" failed. No retries permitted until 2026-09-09 06:52:03.504135429 +0000 UTC m=+58.295944746 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c097e9a1-524c-4ac3-bc56-c3947efed719-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6t86r" (UID: "c097e9a1-524c-4ac3-bc56-c3947efed719") : configmap "kube-rbac-proxy" not found
Sep 09 06:52:01.504279 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:52:01.504163    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c097e9a1-524c-4ac3-bc56-c3947efed719-insights-runtime-extractor-tls podName:c097e9a1-524c-4ac3-bc56-c3947efed719 nodeName:}" failed. No retries permitted until 2026-09-09 06:52:03.504155892 +0000 UTC m=+58.295965209 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c097e9a1-524c-4ac3-bc56-c3947efed719-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6t86r" (UID: "c097e9a1-524c-4ac3-bc56-c3947efed719") : secret "insights-runtime-extractor-tls" not found
Sep 09 06:52:01.820128 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:01.820103    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cr4hg_48a06719-7aab-46cf-a45e-76754185735a/dns-node-resolver/0.log"
Sep 09 06:52:03.020518 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:03.020490    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rljvj_761f8c97-f2c7-4769-9c0b-924a4877cd38/node-ca/0.log"
Sep 09 06:52:03.521060 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:03.521023    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c097e9a1-524c-4ac3-bc56-c3947efed719-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6t86r\" (UID: \"c097e9a1-524c-4ac3-bc56-c3947efed719\") " pod="openshift-insights/insights-runtime-extractor-6t86r"
Sep 09 06:52:03.521228 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:52:03.521157    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 06:52:03.521228 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:03.521164    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c097e9a1-524c-4ac3-bc56-c3947efed719-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6t86r\" (UID: \"c097e9a1-524c-4ac3-bc56-c3947efed719\") " pod="openshift-insights/insights-runtime-extractor-6t86r"
Sep 09 06:52:03.521298 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:52:03.521238    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c097e9a1-524c-4ac3-bc56-c3947efed719-kube-rbac-proxy-cm podName:c097e9a1-524c-4ac3-bc56-c3947efed719 nodeName:}" failed. No retries permitted until 2026-09-09 06:52:07.521217921 +0000 UTC m=+62.313027258 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c097e9a1-524c-4ac3-bc56-c3947efed719-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6t86r" (UID: "c097e9a1-524c-4ac3-bc56-c3947efed719") : configmap "kube-rbac-proxy" not found
Sep 09 06:52:03.521298 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:52:03.521275    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 06:52:03.521365 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:52:03.521331    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c097e9a1-524c-4ac3-bc56-c3947efed719-insights-runtime-extractor-tls podName:c097e9a1-524c-4ac3-bc56-c3947efed719 nodeName:}" failed. No retries permitted until 2026-09-09 06:52:07.52131785 +0000 UTC m=+62.313127181 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c097e9a1-524c-4ac3-bc56-c3947efed719-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6t86r" (UID: "c097e9a1-524c-4ac3-bc56-c3947efed719") : secret "insights-runtime-extractor-tls" not found
Sep 09 06:52:03.622458 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:03.622431    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wbd57_450d68be-a858-4505-abdf-9a43aca25ad9/serve-healthcheck-canary/0.log"
Sep 09 06:52:05.860378 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:05.860353    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xt6cr"
Sep 09 06:52:07.550158 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:07.550126    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c097e9a1-524c-4ac3-bc56-c3947efed719-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6t86r\" (UID: \"c097e9a1-524c-4ac3-bc56-c3947efed719\") " pod="openshift-insights/insights-runtime-extractor-6t86r"
Sep 09 06:52:07.550592 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:07.550172    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c097e9a1-524c-4ac3-bc56-c3947efed719-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6t86r\" (UID: \"c097e9a1-524c-4ac3-bc56-c3947efed719\") " pod="openshift-insights/insights-runtime-extractor-6t86r"
Sep 09 06:52:07.550592 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:52:07.550250    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 06:52:07.550592 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:52:07.550281    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 06:52:07.550592 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:52:07.550315    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c097e9a1-524c-4ac3-bc56-c3947efed719-kube-rbac-proxy-cm podName:c097e9a1-524c-4ac3-bc56-c3947efed719 nodeName:}" failed. No retries permitted until 2026-09-09 06:52:15.550297484 +0000 UTC m=+70.342106821 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c097e9a1-524c-4ac3-bc56-c3947efed719-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6t86r" (UID: "c097e9a1-524c-4ac3-bc56-c3947efed719") : configmap "kube-rbac-proxy" not found
Sep 09 06:52:07.550592 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:52:07.550330    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c097e9a1-524c-4ac3-bc56-c3947efed719-insights-runtime-extractor-tls podName:c097e9a1-524c-4ac3-bc56-c3947efed719 nodeName:}" failed. No retries permitted until 2026-09-09 06:52:15.550323805 +0000 UTC m=+70.342133123 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c097e9a1-524c-4ac3-bc56-c3947efed719-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6t86r" (UID: "c097e9a1-524c-4ac3-bc56-c3947efed719") : secret "insights-runtime-extractor-tls" not found
Sep 09 06:52:09.363363 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:09.363311    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e983cf46-9062-43cc-a0da-3c6827751b97-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-mq6bf\" (UID: \"e983cf46-9062-43cc-a0da-3c6827751b97\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-mq6bf"
Sep 09 06:52:09.363791 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:09.363424    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fba513b1-0c6e-49c0-b171-29ef7cb39608-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-gk2bj\" (UID: \"fba513b1-0c6e-49c0-b171-29ef7cb39608\") " pod="openshift-network-console/networking-console-plugin-79977f9844-gk2bj"
Sep 09 06:52:09.363791 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:52:09.363453    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 06:52:09.363791 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:52:09.363521    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 06:52:09.363791 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:52:09.363526    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e983cf46-9062-43cc-a0da-3c6827751b97-cluster-monitoring-operator-tls podName:e983cf46-9062-43cc-a0da-3c6827751b97 nodeName:}" failed. No retries permitted until 2026-09-09 06:52:25.3635049 +0000 UTC m=+80.155314217 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e983cf46-9062-43cc-a0da-3c6827751b97-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-mq6bf" (UID: "e983cf46-9062-43cc-a0da-3c6827751b97") : secret "cluster-monitoring-operator-tls" not found
Sep 09 06:52:09.363791 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:52:09.363571    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fba513b1-0c6e-49c0-b171-29ef7cb39608-networking-console-plugin-cert podName:fba513b1-0c6e-49c0-b171-29ef7cb39608 nodeName:}" failed. No retries permitted until 2026-09-09 06:52:25.363558193 +0000 UTC m=+80.155367511 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fba513b1-0c6e-49c0-b171-29ef7cb39608-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-gk2bj" (UID: "fba513b1-0c6e-49c0-b171-29ef7cb39608") : secret "networking-console-plugin-cert" not found
Sep 09 06:52:09.464670 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:09.464638    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f13e7dfd-1d89-4714-b65f-1a8e3dc264e5-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-cqckd\" (UID: \"f13e7dfd-1d89-4714-b65f-1a8e3dc264e5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-cqckd"
Sep 09 06:52:09.467955 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:09.467933    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f13e7dfd-1d89-4714-b65f-1a8e3dc264e5-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-cqckd\" (UID: \"f13e7dfd-1d89-4714-b65f-1a8e3dc264e5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-cqckd"
Sep 09 06:52:09.494345 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:09.494321    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-qndmb\""
Sep 09 06:52:09.502631 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:09.502609    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-cqckd"
Sep 09 06:52:09.771849 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:09.771822    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-cqckd"]
Sep 09 06:52:09.944164 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:09.944140    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-cqckd" event={"ID":"f13e7dfd-1d89-4714-b65f-1a8e3dc264e5","Type":"ContainerStarted","Data":"db5ab511703b61fd3cee1cea6009aab3ae9edc7090a85160ccb78275fbb0eb86"}
Sep 09 06:52:11.379908 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:11.379873    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96676d24-b303-4849-bdc0-e5b99b9b8602-metrics-certs\") pod \"network-metrics-daemon-pj9sz\" (UID: \"96676d24-b303-4849-bdc0-e5b99b9b8602\") " pod="openshift-multus/network-metrics-daemon-pj9sz"
Sep 09 06:52:11.382792 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:11.382767    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 09 06:52:11.393347 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:11.393327    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96676d24-b303-4849-bdc0-e5b99b9b8602-metrics-certs\") pod \"network-metrics-daemon-pj9sz\" (UID: \"96676d24-b303-4849-bdc0-e5b99b9b8602\") " pod="openshift-multus/network-metrics-daemon-pj9sz"
Sep 09 06:52:11.480699 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:11.480672    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa0cd37d-c6ff-4f45-9954-b2abc2645a4c-original-pull-secret\") pod \"global-pull-secret-syncer-tlg4m\" (UID: \"fa0cd37d-c6ff-4f45-9954-b2abc2645a4c\") " pod="kube-system/global-pull-secret-syncer-tlg4m"
Sep 09 06:52:11.480699 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:11.480711    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/18e9c162-f015-4a2f-bc71-d4403466dcf6-metrics-tls\") pod \"dns-default-hq6f8\" (UID: \"18e9c162-f015-4a2f-bc71-d4403466dcf6\") " pod="openshift-dns/dns-default-hq6f8"
Sep 09 06:52:11.480946 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:11.480817    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-registry-tls\") pod \"image-registry-dbf5fc6cf-j5f62\" (UID: \"eb5cd0d7-4682-4760-8f8a-8a221c4a682b\") " pod="openshift-image-registry/image-registry-dbf5fc6cf-j5f62"
Sep 09 06:52:11.490017 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:11.489995    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 09 06:52:11.490144 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:11.490065    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/18e9c162-f015-4a2f-bc71-d4403466dcf6-metrics-tls\") pod \"dns-default-hq6f8\" (UID: \"18e9c162-f015-4a2f-bc71-d4403466dcf6\") " pod="openshift-dns/dns-default-hq6f8"
Sep 09 06:52:11.490204 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:11.490187    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-registry-tls\") pod \"image-registry-dbf5fc6cf-j5f62\" (UID: \"eb5cd0d7-4682-4760-8f8a-8a221c4a682b\") " pod="openshift-image-registry/image-registry-dbf5fc6cf-j5f62"
Sep 09 06:52:11.494311 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:11.494291    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa0cd37d-c6ff-4f45-9954-b2abc2645a4c-original-pull-secret\") pod \"global-pull-secret-syncer-tlg4m\" (UID: \"fa0cd37d-c6ff-4f45-9954-b2abc2645a4c\") " pod="kube-system/global-pull-secret-syncer-tlg4m"
Sep 09 06:52:11.525436 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:11.525413    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bgwvj\""
Sep 09 06:52:11.528706 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:11.528683    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tlg4m"
Sep 09 06:52:11.533184 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:11.533166    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pj9sz"
Sep 09 06:52:11.581556 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:11.581529    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fx2fc\" (UniqueName: \"kubernetes.io/projected/941d7367-69f9-4dbd-b23c-35441173231c-kube-api-access-fx2fc\") pod \"network-check-target-fmhfw\" (UID: \"941d7367-69f9-4dbd-b23c-35441173231c\") " pod="openshift-network-diagnostics/network-check-target-fmhfw"
Sep 09 06:52:11.584162 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:11.584142    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 09 06:52:11.594851 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:11.594824    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 09 06:52:11.606173 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:11.606140    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fx2fc\" (UniqueName: \"kubernetes.io/projected/941d7367-69f9-4dbd-b23c-35441173231c-kube-api-access-fx2fc\") pod \"network-check-target-fmhfw\" (UID: \"941d7367-69f9-4dbd-b23c-35441173231c\") " pod="openshift-network-diagnostics/network-check-target-fmhfw"
Sep 09 06:52:11.612253 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:11.612237    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4qwcc\""
Sep 09 06:52:11.620595 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:11.620415    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-dbf5fc6cf-j5f62"
Sep 09 06:52:11.622693 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:11.622677    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-n7krz\""
Sep 09 06:52:11.630771 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:11.630713    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hq6f8"
Sep 09 06:52:11.819452 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:11.819431    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wxxvd\""
Sep 09 06:52:11.826685 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:11.826663    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fmhfw"
Sep 09 06:52:11.931149 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:11.930568    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tlg4m"]
Sep 09 06:52:11.935224 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:52:11.935193    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa0cd37d_c6ff_4f45_9954_b2abc2645a4c.slice/crio-192192f7040e2d50128f7940cbf457cd4616779426017c62c4d364c88e36ecc0 WatchSource:0}: Error finding container 192192f7040e2d50128f7940cbf457cd4616779426017c62c4d364c88e36ecc0: Status 404 returned error can't find the container with id 192192f7040e2d50128f7940cbf457cd4616779426017c62c4d364c88e36ecc0
Sep 09 06:52:11.945686 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:11.945663    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pj9sz"]
Sep 09 06:52:11.947910 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:11.947852    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hq6f8"]
Sep 09 06:52:11.948170 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:52:11.948147    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96676d24_b303_4849_bdc0_e5b99b9b8602.slice/crio-f2c978af14edd5d6effe3c5ef33246d0a19ba8c36f54ea1a9873231ed2441b83 WatchSource:0}: Error finding container f2c978af14edd5d6effe3c5ef33246d0a19ba8c36f54ea1a9873231ed2441b83: Status 404 returned error can't find the container with id f2c978af14edd5d6effe3c5ef33246d0a19ba8c36f54ea1a9873231ed2441b83
Sep 09 06:52:11.948856 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:11.948831    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-dbf5fc6cf-j5f62"]
Sep 09 06:52:11.951761 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:52:11.951725    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18e9c162_f015_4a2f_bc71_d4403466dcf6.slice/crio-d3a037b323f8ea41adca1a5096937378462b8417ee9f1ca062cb7d2c7bf4a622 WatchSource:0}: Error finding container d3a037b323f8ea41adca1a5096937378462b8417ee9f1ca062cb7d2c7bf4a622: Status 404 returned error can't find the container with id d3a037b323f8ea41adca1a5096937378462b8417ee9f1ca062cb7d2c7bf4a622
Sep 09 06:52:11.952472 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:11.952448    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-cqckd" event={"ID":"f13e7dfd-1d89-4714-b65f-1a8e3dc264e5","Type":"ContainerStarted","Data":"251e7b00885209e561370c3717ec5cfcec1c7b9d7d0c7ec60067e5db1b152320"}
Sep 09 06:52:11.952543 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:11.952497    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-cqckd" event={"ID":"f13e7dfd-1d89-4714-b65f-1a8e3dc264e5","Type":"ContainerStarted","Data":"a4df743efe3cb84689242032e06f9688e5f4e65ecd6e54ba6d036583858b2920"}
Sep 09 06:52:11.952836 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:52:11.952759    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb5cd0d7_4682_4760_8f8a_8a221c4a682b.slice/crio-c913c5eed5883b777c60321f1957b57851c990b1320396bf52c02ac09c140c47 WatchSource:0}: Error finding container c913c5eed5883b777c60321f1957b57851c990b1320396bf52c02ac09c140c47: Status 404 returned error can't find the container with id c913c5eed5883b777c60321f1957b57851c990b1320396bf52c02ac09c140c47
Sep 09 06:52:11.953837 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:11.953824    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tlg4m" event={"ID":"fa0cd37d-c6ff-4f45-9954-b2abc2645a4c","Type":"ContainerStarted","Data":"192192f7040e2d50128f7940cbf457cd4616779426017c62c4d364c88e36ecc0"}
Sep 09 06:52:11.968652 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:11.968604    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-cqckd" podStartSLOduration=17.109455859 podStartE2EDuration="18.968588641s" totalImagesPullingTime="1.859132782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:51:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:52:11.968346927 +0000 UTC m=+66.760156267" watchObservedRunningTime="2026-09-09 06:52:11.968588641 +0000 UTC m=+66.760397980"
Sep 09 06:52:12.093731 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:12.093702    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fmhfw"]
Sep 09 06:52:12.097576 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:52:12.097553    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod941d7367_69f9_4dbd_b23c_35441173231c.slice/crio-3f6f925bae80f739c3ca845cd1ef0957b9e225f85556bec1b5e16b5430eee7a0 WatchSource:0}: Error finding container 3f6f925bae80f739c3ca845cd1ef0957b9e225f85556bec1b5e16b5430eee7a0: Status 404 returned error can't find the container with id 3f6f925bae80f739c3ca845cd1ef0957b9e225f85556bec1b5e16b5430eee7a0
Sep 09 06:52:12.959265 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:12.959154    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hq6f8" event={"ID":"18e9c162-f015-4a2f-bc71-d4403466dcf6","Type":"ContainerStarted","Data":"d3a037b323f8ea41adca1a5096937378462b8417ee9f1ca062cb7d2c7bf4a622"}
Sep 09 06:52:12.961553 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:12.961465    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pj9sz" event={"ID":"96676d24-b303-4849-bdc0-e5b99b9b8602","Type":"ContainerStarted","Data":"f2c978af14edd5d6effe3c5ef33246d0a19ba8c36f54ea1a9873231ed2441b83"}
Sep 09 06:52:12.964953 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:12.964066    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-dbf5fc6cf-j5f62" event={"ID":"eb5cd0d7-4682-4760-8f8a-8a221c4a682b","Type":"ContainerStarted","Data":"c30a58aff53d298a35a8b7ab2d53b5870eca5ec2aa3fabbb64c63781c424d630"}
Sep 09 06:52:12.964953 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:12.964104    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-dbf5fc6cf-j5f62" event={"ID":"eb5cd0d7-4682-4760-8f8a-8a221c4a682b","Type":"ContainerStarted","Data":"c913c5eed5883b777c60321f1957b57851c990b1320396bf52c02ac09c140c47"}
Sep 09 06:52:12.964953 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:12.964793    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-dbf5fc6cf-j5f62"
Sep 09 06:52:12.967053 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:12.966810    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fmhfw" event={"ID":"941d7367-69f9-4dbd-b23c-35441173231c","Type":"ContainerStarted","Data":"3f6f925bae80f739c3ca845cd1ef0957b9e225f85556bec1b5e16b5430eee7a0"}
Sep 09 06:52:12.990558 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:12.989066    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-dbf5fc6cf-j5f62" podStartSLOduration=66.989047791 podStartE2EDuration="1m6.989047791s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:51:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:52:12.987592657 +0000 UTC m=+67.779401996" watchObservedRunningTime="2026-09-09 06:52:12.989047791 +0000 UTC m=+67.780857122"
Sep 09 06:52:13.977196 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:13.977146    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pj9sz" event={"ID":"96676d24-b303-4849-bdc0-e5b99b9b8602","Type":"ContainerStarted","Data":"2fd8d0d8a12b7471bd652b0f870c1145ae9b051aa28af501fabe1f94d275f233"}
Sep 09 06:52:13.977657 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:13.977313    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pj9sz" event={"ID":"96676d24-b303-4849-bdc0-e5b99b9b8602","Type":"ContainerStarted","Data":"0120a6ba21266c6e7e83c70693e9069c2203551e82736d022ac0a30c79d5941e"}
Sep 09 06:52:13.994034 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:13.993989    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-pj9sz" podStartSLOduration=66.593260963 podStartE2EDuration="1m7.993975338s" totalImagesPullingTime="1.400714375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:51:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:52:13.993131566 +0000 UTC m=+68.784940905" watchObservedRunningTime="2026-09-09 06:52:13.993975338 +0000 UTC m=+68.785784697"
Sep 09 06:52:14.982929 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:14.982893    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hq6f8" event={"ID":"18e9c162-f015-4a2f-bc71-d4403466dcf6","Type":"ContainerStarted","Data":"77e5458c3318b1b53a5d0f5cf778fa42fc22018a5b0b3c82106419e144bce23b"}
Sep 09 06:52:14.983370 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:14.982957    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hq6f8" event={"ID":"18e9c162-f015-4a2f-bc71-d4403466dcf6","Type":"ContainerStarted","Data":"5537f19890014513bd09ccd507388ae55696d4c39c7d599a583426cce235ab5b"}
Sep 09 06:52:14.983370 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:14.983134    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hq6f8"
Sep 09 06:52:15.004372 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:15.004309    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hq6f8" podStartSLOduration=33.693067975 podStartE2EDuration="36.00429336s" totalImagesPullingTime="2.311225385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:51:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:52:15.003287089 +0000 UTC m=+69.795096431" watchObservedRunningTime="2026-09-09 06:52:15.00429336 +0000 UTC m=+69.796102699"
Sep 09 06:52:15.615762 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:15.615680    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c097e9a1-524c-4ac3-bc56-c3947efed719-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6t86r\" (UID: \"c097e9a1-524c-4ac3-bc56-c3947efed719\") " pod="openshift-insights/insights-runtime-extractor-6t86r"
Sep 09 06:52:15.615912 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:15.615778    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c097e9a1-524c-4ac3-bc56-c3947efed719-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6t86r\" (UID: \"c097e9a1-524c-4ac3-bc56-c3947efed719\") " pod="openshift-insights/insights-runtime-extractor-6t86r"
Sep 09 06:52:15.616311 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:15.616286    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c097e9a1-524c-4ac3-bc56-c3947efed719-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6t86r\" (UID: \"c097e9a1-524c-4ac3-bc56-c3947efed719\") " pod="openshift-insights/insights-runtime-extractor-6t86r"
Sep 09 06:52:15.618365 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:15.618343    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c097e9a1-524c-4ac3-bc56-c3947efed719-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6t86r\" (UID: \"c097e9a1-524c-4ac3-bc56-c3947efed719\") " pod="openshift-insights/insights-runtime-extractor-6t86r"
Sep 09 06:52:15.776733 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:15.776708    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nqhdr\""
Sep 09 06:52:15.784200 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:15.784180    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6t86r"
Sep 09 06:52:17.307426 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:17.307345    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6t86r"]
Sep 09 06:52:17.310081 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:52:17.310054    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc097e9a1_524c_4ac3_bc56_c3947efed719.slice/crio-8c5e6c4d1f9cbfc74ab3ce1f403b6ffc6019c5b9532a7c4268b29f8e8101785d WatchSource:0}: Error finding container 8c5e6c4d1f9cbfc74ab3ce1f403b6ffc6019c5b9532a7c4268b29f8e8101785d: Status 404 returned error can't find the container with id 8c5e6c4d1f9cbfc74ab3ce1f403b6ffc6019c5b9532a7c4268b29f8e8101785d
Sep 09 06:52:17.993532 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:17.993500    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tlg4m" event={"ID":"fa0cd37d-c6ff-4f45-9954-b2abc2645a4c","Type":"ContainerStarted","Data":"b093b5112917fff29ea692517ee7ddaee1f26f83fc1cc73c4ef2ccb5e4d2f4e0"}
Sep 09 06:52:17.995190 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:17.995163    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6t86r" event={"ID":"c097e9a1-524c-4ac3-bc56-c3947efed719","Type":"ContainerStarted","Data":"61f1d3e16e7641b816fb41f268c3ecaa2c9d5cf9c0b2a3d4c14523aed139e9aa"}
Sep 09 06:52:17.995295 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:17.995213    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6t86r" event={"ID":"c097e9a1-524c-4ac3-bc56-c3947efed719","Type":"ContainerStarted","Data":"8c5e6c4d1f9cbfc74ab3ce1f403b6ffc6019c5b9532a7c4268b29f8e8101785d"}
Sep 09 06:52:17.996493 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:17.996475    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fmhfw" event={"ID":"941d7367-69f9-4dbd-b23c-35441173231c","Type":"ContainerStarted","Data":"b48f8931d6ce15076277be6dc7adfb75374ed823ffc89af7468c0d40f40b26af"}
Sep 09 06:52:17.996608 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:17.996594    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fmhfw"
Sep 09 06:52:18.021179 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:18.021138    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tlg4m" podStartSLOduration=66.912979268 podStartE2EDuration="1m12.021124229s" totalImagesPullingTime="5.108144961s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 06:51:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:52:18.020257007 +0000 UTC m=+72.812066345" watchObservedRunningTime="2026-09-09 06:52:18.021124229 +0000 UTC m=+72.812933558"
Sep 09 06:52:18.057673 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:18.057635    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fmhfw" podStartSLOduration=67.117545573 podStartE2EDuration="1m12.057621963s" totalImagesPullingTime="4.94007639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:51:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:52:18.056928449 +0000 UTC m=+72.848737788" watchObservedRunningTime="2026-09-09 06:52:18.057621963 +0000 UTC m=+72.849431302"
Sep 09 06:52:19.002579 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:19.002543    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6t86r" event={"ID":"c097e9a1-524c-4ac3-bc56-c3947efed719","Type":"ContainerStarted","Data":"26999437e62d1afb1b44c241d576ccbffff1c258b7d62d434f2c0f722bfecefd"}
Sep 09 06:52:20.007992 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:20.007957    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6t86r" event={"ID":"c097e9a1-524c-4ac3-bc56-c3947efed719","Type":"ContainerStarted","Data":"9da92e0a8027df1b89d6a749d5d4e7f968d1f04865fc58ac5a5b48de5ea7b129"}
Sep 09 06:52:20.027862 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:20.027819    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6t86r" podStartSLOduration=19.223955717 podStartE2EDuration="21.027804621s" totalImagesPullingTime="1.803848904s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 06:51:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:52:20.026518549 +0000 UTC m=+74.818327888" watchObservedRunningTime="2026-09-09 06:52:20.027804621 +0000 UTC m=+74.819613959"
Sep 09 06:52:24.776478 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:24.776444    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6554fb7874-qn88n"]
Sep 09 06:52:24.779895 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:24.779879    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6554fb7874-qn88n"
Sep 09 06:52:24.782623 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:24.782600    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 09 06:52:24.783701 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:24.783682    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 09 06:52:24.783701 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:24.783694    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 09 06:52:24.783701 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:24.783694    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 09 06:52:24.802633 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:24.802610    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6554fb7874-qn88n"]
Sep 09 06:52:24.875702 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:24.875672    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv28q\" (UniqueName: \"kubernetes.io/projected/154dc404-b2e1-4d59-bfca-3b1364e0fe81-kube-api-access-zv28q\") pod \"klusterlet-addon-workmgr-6554fb7874-qn88n\" (UID: \"154dc404-b2e1-4d59-bfca-3b1364e0fe81\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6554fb7874-qn88n"
Sep 09 06:52:24.875702 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:24.875703    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/154dc404-b2e1-4d59-bfca-3b1364e0fe81-tmp\") pod \"klusterlet-addon-workmgr-6554fb7874-qn88n\" (UID: \"154dc404-b2e1-4d59-bfca-3b1364e0fe81\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6554fb7874-qn88n"
Sep 09 06:52:24.875912 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:24.875721    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/154dc404-b2e1-4d59-bfca-3b1364e0fe81-klusterlet-config\") pod \"klusterlet-addon-workmgr-6554fb7874-qn88n\" (UID: \"154dc404-b2e1-4d59-bfca-3b1364e0fe81\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6554fb7874-qn88n"
Sep 09 06:52:24.976811 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:24.976779    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zv28q\" (UniqueName: \"kubernetes.io/projected/154dc404-b2e1-4d59-bfca-3b1364e0fe81-kube-api-access-zv28q\") pod \"klusterlet-addon-workmgr-6554fb7874-qn88n\" (UID: \"154dc404-b2e1-4d59-bfca-3b1364e0fe81\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6554fb7874-qn88n"
Sep 09 06:52:24.976811 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:24.976808    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/154dc404-b2e1-4d59-bfca-3b1364e0fe81-tmp\") pod \"klusterlet-addon-workmgr-6554fb7874-qn88n\" (UID: \"154dc404-b2e1-4d59-bfca-3b1364e0fe81\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6554fb7874-qn88n"
Sep 09 06:52:24.977053 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:24.976828    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/154dc404-b2e1-4d59-bfca-3b1364e0fe81-klusterlet-config\") pod \"klusterlet-addon-workmgr-6554fb7874-qn88n\" (UID: \"154dc404-b2e1-4d59-bfca-3b1364e0fe81\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6554fb7874-qn88n"
Sep 09 06:52:24.977269 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:24.977245    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/154dc404-b2e1-4d59-bfca-3b1364e0fe81-tmp\") pod \"klusterlet-addon-workmgr-6554fb7874-qn88n\" (UID: \"154dc404-b2e1-4d59-bfca-3b1364e0fe81\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6554fb7874-qn88n"
Sep 09 06:52:24.979494 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:24.979476    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/154dc404-b2e1-4d59-bfca-3b1364e0fe81-klusterlet-config\") pod \"klusterlet-addon-workmgr-6554fb7874-qn88n\" (UID: \"154dc404-b2e1-4d59-bfca-3b1364e0fe81\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6554fb7874-qn88n"
Sep 09 06:52:24.991395 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:24.988272    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hq6f8"
Sep 09 06:52:25.002331 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:25.002281    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv28q\" (UniqueName: \"kubernetes.io/projected/154dc404-b2e1-4d59-bfca-3b1364e0fe81-kube-api-access-zv28q\") pod \"klusterlet-addon-workmgr-6554fb7874-qn88n\" (UID: \"154dc404-b2e1-4d59-bfca-3b1364e0fe81\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6554fb7874-qn88n"
Sep 09 06:52:25.088643 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:25.088563    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6554fb7874-qn88n"
Sep 09 06:52:25.358894 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:25.358873    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6554fb7874-qn88n"]
Sep 09 06:52:25.361295 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:52:25.361267    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod154dc404_b2e1_4d59_bfca_3b1364e0fe81.slice/crio-b31104d59a59888f8c20799890733dc9880b4e6ad17fa902d2f56b2175ce22bd WatchSource:0}: Error finding container b31104d59a59888f8c20799890733dc9880b4e6ad17fa902d2f56b2175ce22bd: Status 404 returned error can't find the container with id b31104d59a59888f8c20799890733dc9880b4e6ad17fa902d2f56b2175ce22bd
Sep 09 06:52:25.380264 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:25.380235    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e983cf46-9062-43cc-a0da-3c6827751b97-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-mq6bf\" (UID: \"e983cf46-9062-43cc-a0da-3c6827751b97\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-mq6bf"
Sep 09 06:52:25.380354 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:25.380290    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fba513b1-0c6e-49c0-b171-29ef7cb39608-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-gk2bj\" (UID: \"fba513b1-0c6e-49c0-b171-29ef7cb39608\") " pod="openshift-network-console/networking-console-plugin-79977f9844-gk2bj"
Sep 09 06:52:25.382615 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:25.382593    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fba513b1-0c6e-49c0-b171-29ef7cb39608-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-gk2bj\" (UID: \"fba513b1-0c6e-49c0-b171-29ef7cb39608\") " pod="openshift-network-console/networking-console-plugin-79977f9844-gk2bj"
Sep 09 06:52:25.382692 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:25.382654    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e983cf46-9062-43cc-a0da-3c6827751b97-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-mq6bf\" (UID: \"e983cf46-9062-43cc-a0da-3c6827751b97\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-mq6bf"
Sep 09 06:52:25.623133 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:25.623103    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-k5fc6\""
Sep 09 06:52:25.631297 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:25.631277    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-gk2bj"
Sep 09 06:52:25.637531 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:25.637515    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-49sdm\""
Sep 09 06:52:25.645716 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:25.645696    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-mq6bf"
Sep 09 06:52:25.909737 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:25.909647    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-gk2bj"]
Sep 09 06:52:25.912397 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:52:25.912371    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfba513b1_0c6e_49c0_b171_29ef7cb39608.slice/crio-c0046d1f6eee06cc354e45e813b660bb931f7c0c121b0b92268cff5fb5608ebb WatchSource:0}: Error finding container c0046d1f6eee06cc354e45e813b660bb931f7c0c121b0b92268cff5fb5608ebb: Status 404 returned error can't find the container with id c0046d1f6eee06cc354e45e813b660bb931f7c0c121b0b92268cff5fb5608ebb
Sep 09 06:52:25.930449 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:25.930429    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-mq6bf"]
Sep 09 06:52:25.932867 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:52:25.932842    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode983cf46_9062_43cc_a0da_3c6827751b97.slice/crio-fba90d726bdb012aa7fb506d61a2bf7c818246fd9297ae1832264c9ea4d4faf5 WatchSource:0}: Error finding container fba90d726bdb012aa7fb506d61a2bf7c818246fd9297ae1832264c9ea4d4faf5: Status 404 returned error can't find the container with id fba90d726bdb012aa7fb506d61a2bf7c818246fd9297ae1832264c9ea4d4faf5
Sep 09 06:52:26.027351 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:26.027307    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6554fb7874-qn88n" event={"ID":"154dc404-b2e1-4d59-bfca-3b1364e0fe81","Type":"ContainerStarted","Data":"b31104d59a59888f8c20799890733dc9880b4e6ad17fa902d2f56b2175ce22bd"}
Sep 09 06:52:26.028395 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:26.028374    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-mq6bf" event={"ID":"e983cf46-9062-43cc-a0da-3c6827751b97","Type":"ContainerStarted","Data":"fba90d726bdb012aa7fb506d61a2bf7c818246fd9297ae1832264c9ea4d4faf5"}
Sep 09 06:52:26.029454 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:26.029435    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-gk2bj" event={"ID":"fba513b1-0c6e-49c0-b171-29ef7cb39608","Type":"ContainerStarted","Data":"c0046d1f6eee06cc354e45e813b660bb931f7c0c121b0b92268cff5fb5608ebb"}
Sep 09 06:52:28.010413 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:28.010379    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-74d75b469-9mr4z"]
Sep 09 06:52:28.013583 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:28.013560    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74d75b469-9mr4z"
Sep 09 06:52:28.017317 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:28.017294    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 09 06:52:28.017459 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:28.017339    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-v2kwc\""
Sep 09 06:52:28.017561 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:28.017541    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 09 06:52:28.017626 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:28.017565    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 09 06:52:28.018085 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:28.017848    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 09 06:52:28.018085 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:28.017912    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 09 06:52:28.018085 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:28.017934    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 09 06:52:28.018085 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:28.017991    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 09 06:52:28.024493 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:28.024458    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74d75b469-9mr4z"]
Sep 09 06:52:28.101147 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:28.101113    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4-console-oauth-config\") pod \"console-74d75b469-9mr4z\" (UID: \"4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4\") " pod="openshift-console/console-74d75b469-9mr4z"
Sep 09 06:52:28.101366 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:28.101169    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4-console-serving-cert\") pod \"console-74d75b469-9mr4z\" (UID: \"4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4\") " pod="openshift-console/console-74d75b469-9mr4z"
Sep 09 06:52:28.101366 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:28.101229    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4-console-config\") pod \"console-74d75b469-9mr4z\" (UID: \"4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4\") " pod="openshift-console/console-74d75b469-9mr4z"
Sep 09 06:52:28.101366 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:28.101281    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4-service-ca\") pod \"console-74d75b469-9mr4z\" (UID: \"4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4\") " pod="openshift-console/console-74d75b469-9mr4z"
Sep 09 06:52:28.101366 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:28.101305    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4-oauth-serving-cert\") pod \"console-74d75b469-9mr4z\" (UID: \"4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4\") " pod="openshift-console/console-74d75b469-9mr4z"
Sep 09 06:52:28.101366 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:28.101327    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8vmq\" (UniqueName: \"kubernetes.io/projected/4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4-kube-api-access-b8vmq\") pod \"console-74d75b469-9mr4z\" (UID: \"4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4\") " pod="openshift-console/console-74d75b469-9mr4z"
Sep 09 06:52:28.202277 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:28.202241    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4-console-serving-cert\") pod \"console-74d75b469-9mr4z\" (UID: \"4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4\") " pod="openshift-console/console-74d75b469-9mr4z"
Sep 09 06:52:28.202438 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:28.202291    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4-console-config\") pod \"console-74d75b469-9mr4z\" (UID: \"4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4\") " pod="openshift-console/console-74d75b469-9mr4z"
Sep 09 06:52:28.202438 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:28.202342    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4-service-ca\") pod \"console-74d75b469-9mr4z\" (UID: \"4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4\") " pod="openshift-console/console-74d75b469-9mr4z"
Sep 09 06:52:28.202438 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:28.202366    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4-oauth-serving-cert\") pod \"console-74d75b469-9mr4z\" (UID: \"4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4\") " pod="openshift-console/console-74d75b469-9mr4z"
Sep 09 06:52:28.202438 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:28.202389    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8vmq\" (UniqueName: \"kubernetes.io/projected/4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4-kube-api-access-b8vmq\") pod \"console-74d75b469-9mr4z\" (UID: \"4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4\") " pod="openshift-console/console-74d75b469-9mr4z"
Sep 09 06:52:28.202438 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:28.202430    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4-console-oauth-config\") pod \"console-74d75b469-9mr4z\" (UID: \"4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4\") " pod="openshift-console/console-74d75b469-9mr4z"
Sep 09 06:52:28.203346 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:28.203006    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4-console-config\") pod \"console-74d75b469-9mr4z\" (UID: \"4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4\") " pod="openshift-console/console-74d75b469-9mr4z"
Sep 09 06:52:28.203346 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:28.203215    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4-oauth-serving-cert\") pod \"console-74d75b469-9mr4z\" (UID: \"4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4\") " pod="openshift-console/console-74d75b469-9mr4z"
Sep 09 06:52:28.203934 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:28.203907    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4-service-ca\") pod \"console-74d75b469-9mr4z\" (UID: \"4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4\") " pod="openshift-console/console-74d75b469-9mr4z"
Sep 09 06:52:28.205252 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:28.205233    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4-console-serving-cert\") pod \"console-74d75b469-9mr4z\" (UID: \"4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4\") " pod="openshift-console/console-74d75b469-9mr4z"
Sep 09 06:52:28.205490 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:28.205470    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4-console-oauth-config\") pod \"console-74d75b469-9mr4z\" (UID: \"4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4\") " pod="openshift-console/console-74d75b469-9mr4z"
Sep 09 06:52:28.211340 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:28.211314    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8vmq\" (UniqueName: \"kubernetes.io/projected/4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4-kube-api-access-b8vmq\") pod \"console-74d75b469-9mr4z\" (UID: \"4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4\") " pod="openshift-console/console-74d75b469-9mr4z"
Sep 09 06:52:28.326455 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:28.326373    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74d75b469-9mr4z"
Sep 09 06:52:29.046147 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:29.046110    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-mq6bf" event={"ID":"e983cf46-9062-43cc-a0da-3c6827751b97","Type":"ContainerStarted","Data":"55d8f91bfa2bc31282bdcaf2afb3e220ae9a8e504630e5951419cd9a9c0e9400"}
Sep 09 06:52:29.048645 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:29.048611    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-gk2bj" event={"ID":"fba513b1-0c6e-49c0-b171-29ef7cb39608","Type":"ContainerStarted","Data":"11d5b3cbb3a4cacc22f89845c4b93f2bda532908b7e3db1bdfefa2a5f2b55575"}
Sep 09 06:52:29.081080 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:29.081027    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-79977f9844-gk2bj" podStartSLOduration=34.571567097 podStartE2EDuration="36.081008045s" totalImagesPullingTime="1.509440948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:51:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:52:29.080137552 +0000 UTC m=+83.871946900" watchObservedRunningTime="2026-09-09 06:52:29.081008045 +0000 UTC m=+83.872817386"
Sep 09 06:52:29.081457 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:29.081425    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-mq6bf" podStartSLOduration=33.157465941 podStartE2EDuration="36.081414566s" totalImagesPullingTime="2.923948625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:51:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:52:29.063408549 +0000 UTC m=+83.855217888" watchObservedRunningTime="2026-09-09 06:52:29.081414566 +0000 UTC m=+83.873223905"
Sep 09 06:52:29.127980 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:29.127948    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74d75b469-9mr4z"]
Sep 09 06:52:29.398825 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:29.398736    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rhdzw"]
Sep 09 06:52:29.402306 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:29.402285    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rhdzw"
Sep 09 06:52:29.404933 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:29.404906    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 09 06:52:29.405203 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:29.405173    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-z6t26\""
Sep 09 06:52:29.413321 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:29.413292    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rhdzw"]
Sep 09 06:52:29.511200 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:29.511173    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/01d5c542-d3b9-4dfb-b368-81af9955d94d-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-rhdzw\" (UID: \"01d5c542-d3b9-4dfb-b368-81af9955d94d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rhdzw"
Sep 09 06:52:29.612418 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:29.612382    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/01d5c542-d3b9-4dfb-b368-81af9955d94d-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-rhdzw\" (UID: \"01d5c542-d3b9-4dfb-b368-81af9955d94d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rhdzw"
Sep 09 06:52:29.615325 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:29.615301    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/01d5c542-d3b9-4dfb-b368-81af9955d94d-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-rhdzw\" (UID: \"01d5c542-d3b9-4dfb-b368-81af9955d94d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rhdzw"
Sep 09 06:52:29.712964 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:29.712895    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rhdzw"
Sep 09 06:52:30.315601 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:52:30.315571    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f3d58e6_2ef4_4bfe_9ed1_5de6a82bc0b4.slice/crio-1e495cdcd93fb883462307d0a243e3d4b9439d6b9e1d9df8eb96d5afe8814efc WatchSource:0}: Error finding container 1e495cdcd93fb883462307d0a243e3d4b9439d6b9e1d9df8eb96d5afe8814efc: Status 404 returned error can't find the container with id 1e495cdcd93fb883462307d0a243e3d4b9439d6b9e1d9df8eb96d5afe8814efc
Sep 09 06:52:30.578806 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:30.578709    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rhdzw"]
Sep 09 06:52:30.582868 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:52:30.582843    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01d5c542_d3b9_4dfb_b368_81af9955d94d.slice/crio-a5714ffb26c9a84d719f8ffa66bdbe18095901ca4521079763ad9d85b4cdad53 WatchSource:0}: Error finding container a5714ffb26c9a84d719f8ffa66bdbe18095901ca4521079763ad9d85b4cdad53: Status 404 returned error can't find the container with id a5714ffb26c9a84d719f8ffa66bdbe18095901ca4521079763ad9d85b4cdad53
Sep 09 06:52:31.058573 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:31.058536    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rhdzw" event={"ID":"01d5c542-d3b9-4dfb-b368-81af9955d94d","Type":"ContainerStarted","Data":"a5714ffb26c9a84d719f8ffa66bdbe18095901ca4521079763ad9d85b4cdad53"}
Sep 09 06:52:31.059799 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:31.059773    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74d75b469-9mr4z" event={"ID":"4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4","Type":"ContainerStarted","Data":"1e495cdcd93fb883462307d0a243e3d4b9439d6b9e1d9df8eb96d5afe8814efc"}
Sep 09 06:52:31.061342 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:31.061319    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6554fb7874-qn88n" event={"ID":"154dc404-b2e1-4d59-bfca-3b1364e0fe81","Type":"ContainerStarted","Data":"5998c46a9b89a785505512c6925532a0cfb1ae9dbae99909e96f7822a85ca8ee"}
Sep 09 06:52:31.061529 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:31.061513    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6554fb7874-qn88n"
Sep 09 06:52:31.063160 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:31.063141    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6554fb7874-qn88n"
Sep 09 06:52:31.077775 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:31.077718    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6554fb7874-qn88n" podStartSLOduration=2.054562945 podStartE2EDuration="7.077705677s" totalImagesPullingTime="5.023142732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:52:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:52:31.076789096 +0000 UTC m=+85.868598436" watchObservedRunningTime="2026-09-09 06:52:31.077705677 +0000 UTC m=+85.869515016"
Sep 09 06:52:31.626502 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:31.626459    2575 patch_prober.go:28] interesting pod/image-registry-dbf5fc6cf-j5f62 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 06:52:31.626984 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:31.626525    2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-dbf5fc6cf-j5f62" podUID="eb5cd0d7-4682-4760-8f8a-8a221c4a682b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 06:52:32.067042 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:32.066954    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rhdzw" event={"ID":"01d5c542-d3b9-4dfb-b368-81af9955d94d","Type":"ContainerStarted","Data":"45cf397ee559ebdaabfb1756fe6986ce9fc21863cf614d67ccd54100239a6955"}
Sep 09 06:52:32.067204 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:32.067042    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rhdzw"
Sep 09 06:52:32.072313 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:32.072289    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rhdzw"
Sep 09 06:52:32.083647 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:32.083573    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rhdzw" podStartSLOduration=1.976077839 podStartE2EDuration="3.083555867s" totalImagesPullingTime="1.107478028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:52:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:52:32.08292866 +0000 UTC m=+86.874738000" watchObservedRunningTime="2026-09-09 06:52:32.083555867 +0000 UTC m=+86.875365204"
Sep 09 06:52:32.460088 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:32.460057    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-8bsmg"]
Sep 09 06:52:32.463231 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:32.463208    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-8bsmg"
Sep 09 06:52:32.466052 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:32.466028    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 09 06:52:32.466251 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:32.466236    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 09 06:52:32.466969 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:32.466948    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 09 06:52:32.466969 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:32.466963    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-x7h67\""
Sep 09 06:52:32.474123 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:32.474102    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-8bsmg"]
Sep 09 06:52:32.536376 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:32.536349    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/344a71e8-d7ae-4278-8cf4-8a72a4d7adac-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-8bsmg\" (UID: \"344a71e8-d7ae-4278-8cf4-8a72a4d7adac\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-8bsmg"
Sep 09 06:52:32.536376 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:32.536382    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft8qk\" (UniqueName: \"kubernetes.io/projected/344a71e8-d7ae-4278-8cf4-8a72a4d7adac-kube-api-access-ft8qk\") pod \"prometheus-operator-6f4946db56-8bsmg\" (UID: \"344a71e8-d7ae-4278-8cf4-8a72a4d7adac\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-8bsmg"
Sep 09 06:52:32.536561 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:32.536421    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/344a71e8-d7ae-4278-8cf4-8a72a4d7adac-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-8bsmg\" (UID: \"344a71e8-d7ae-4278-8cf4-8a72a4d7adac\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-8bsmg"
Sep 09 06:52:32.536561 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:32.536444    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/344a71e8-d7ae-4278-8cf4-8a72a4d7adac-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-8bsmg\" (UID: \"344a71e8-d7ae-4278-8cf4-8a72a4d7adac\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-8bsmg"
Sep 09 06:52:32.637557 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:32.637520    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/344a71e8-d7ae-4278-8cf4-8a72a4d7adac-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-8bsmg\" (UID: \"344a71e8-d7ae-4278-8cf4-8a72a4d7adac\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-8bsmg"
Sep 09 06:52:32.638004 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:32.637566    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/344a71e8-d7ae-4278-8cf4-8a72a4d7adac-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-8bsmg\" (UID: \"344a71e8-d7ae-4278-8cf4-8a72a4d7adac\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-8bsmg"
Sep 09 06:52:32.638004 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:32.637630    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/344a71e8-d7ae-4278-8cf4-8a72a4d7adac-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-8bsmg\" (UID: \"344a71e8-d7ae-4278-8cf4-8a72a4d7adac\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-8bsmg"
Sep 09 06:52:32.638004 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:32.637665    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft8qk\" (UniqueName: \"kubernetes.io/projected/344a71e8-d7ae-4278-8cf4-8a72a4d7adac-kube-api-access-ft8qk\") pod \"prometheus-operator-6f4946db56-8bsmg\" (UID: \"344a71e8-d7ae-4278-8cf4-8a72a4d7adac\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-8bsmg"
Sep 09 06:52:32.638004 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:52:32.637798    2575 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Sep 09 06:52:32.638004 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:52:32.637873    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/344a71e8-d7ae-4278-8cf4-8a72a4d7adac-prometheus-operator-tls podName:344a71e8-d7ae-4278-8cf4-8a72a4d7adac nodeName:}" failed. No retries permitted until 2026-09-09 06:52:33.137852917 +0000 UTC m=+87.929662256 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/344a71e8-d7ae-4278-8cf4-8a72a4d7adac-prometheus-operator-tls") pod "prometheus-operator-6f4946db56-8bsmg" (UID: "344a71e8-d7ae-4278-8cf4-8a72a4d7adac") : secret "prometheus-operator-tls" not found
Sep 09 06:52:32.638370 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:32.638346    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/344a71e8-d7ae-4278-8cf4-8a72a4d7adac-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-8bsmg\" (UID: \"344a71e8-d7ae-4278-8cf4-8a72a4d7adac\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-8bsmg"
Sep 09 06:52:32.640487 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:32.640464    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/344a71e8-d7ae-4278-8cf4-8a72a4d7adac-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-8bsmg\" (UID: \"344a71e8-d7ae-4278-8cf4-8a72a4d7adac\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-8bsmg"
Sep 09 06:52:32.647497 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:32.647469    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft8qk\" (UniqueName: \"kubernetes.io/projected/344a71e8-d7ae-4278-8cf4-8a72a4d7adac-kube-api-access-ft8qk\") pod \"prometheus-operator-6f4946db56-8bsmg\" (UID: \"344a71e8-d7ae-4278-8cf4-8a72a4d7adac\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-8bsmg"
Sep 09 06:52:33.141972 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:33.141934    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/344a71e8-d7ae-4278-8cf4-8a72a4d7adac-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-8bsmg\" (UID: \"344a71e8-d7ae-4278-8cf4-8a72a4d7adac\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-8bsmg"
Sep 09 06:52:33.144813 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:33.144770    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/344a71e8-d7ae-4278-8cf4-8a72a4d7adac-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-8bsmg\" (UID: \"344a71e8-d7ae-4278-8cf4-8a72a4d7adac\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-8bsmg"
Sep 09 06:52:33.375192 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:33.375155    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-8bsmg"
Sep 09 06:52:33.827304 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:33.827228    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-8bsmg"]
Sep 09 06:52:33.830196 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:52:33.830171    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod344a71e8_d7ae_4278_8cf4_8a72a4d7adac.slice/crio-57aafe7430b05ff87df7735ea287367f357b5d2df91cd79f5cab50d21435594c WatchSource:0}: Error finding container 57aafe7430b05ff87df7735ea287367f357b5d2df91cd79f5cab50d21435594c: Status 404 returned error can't find the container with id 57aafe7430b05ff87df7735ea287367f357b5d2df91cd79f5cab50d21435594c
Sep 09 06:52:34.075141 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:34.075102    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74d75b469-9mr4z" event={"ID":"4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4","Type":"ContainerStarted","Data":"2f7417c20eea7486940240272f15ecb01cb6dce6a54dbd44dd041bf353667954"}
Sep 09 06:52:34.076390 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:34.076365    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-8bsmg" event={"ID":"344a71e8-d7ae-4278-8cf4-8a72a4d7adac","Type":"ContainerStarted","Data":"57aafe7430b05ff87df7735ea287367f357b5d2df91cd79f5cab50d21435594c"}
Sep 09 06:52:34.100230 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:34.100148    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-74d75b469-9mr4z" podStartSLOduration=3.805423602 podStartE2EDuration="7.100131794s" totalImagesPullingTime="3.294708192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:52:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:52:34.099011656 +0000 UTC m=+88.890820994" watchObservedRunningTime="2026-09-09 06:52:34.100131794 +0000 UTC m=+88.891941188"
Sep 09 06:52:34.988165 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:34.988140    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-dbf5fc6cf-j5f62"
Sep 09 06:52:36.085610 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:36.085576    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-8bsmg" event={"ID":"344a71e8-d7ae-4278-8cf4-8a72a4d7adac","Type":"ContainerStarted","Data":"fae158da329570e926e729c2b4bf0c475c8c83ded5da2f0587e07db4fdb4c980"}
Sep 09 06:52:36.085995 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:36.085625    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-8bsmg" event={"ID":"344a71e8-d7ae-4278-8cf4-8a72a4d7adac","Type":"ContainerStarted","Data":"d1f48a6318e5aa6242ca6646b41f40ff3498a1470f69b68b45fd92e1ca47b6cd"}
Sep 09 06:52:36.105888 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:36.105850    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-8bsmg" podStartSLOduration=2.7274617279999998 podStartE2EDuration="4.105836315s" totalImagesPullingTime="1.378374587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:52:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:52:36.104793328 +0000 UTC m=+90.896602666" watchObservedRunningTime="2026-09-09 06:52:36.105836315 +0000 UTC m=+90.897645654"
Sep 09 06:52:37.808692 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:37.808661    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-82qcv"]
Sep 09 06:52:37.811987 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:37.811968    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-82qcv"
Sep 09 06:52:37.814614 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:37.814592    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 09 06:52:37.814726 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:37.814596    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 09 06:52:37.814982 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:37.814965    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-lgc5z\""
Sep 09 06:52:37.824617 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:37.824597    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-82qcv"]
Sep 09 06:52:37.829114 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:37.829097    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mtfrc"]
Sep 09 06:52:37.832083 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:37.832070    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mtfrc"
Sep 09 06:52:37.834789 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:37.834769    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 09 06:52:37.834877 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:37.834852    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 09 06:52:37.834877 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:37.834869    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 09 06:52:37.835001 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:37.834888    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-97pmt\""
Sep 09 06:52:37.846873 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:37.846852    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-5sphz"]
Sep 09 06:52:37.850009 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:37.849996    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-5sphz"
Sep 09 06:52:37.852708 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:37.852695    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 09 06:52:37.852849 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:37.852834    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 09 06:52:37.852927 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:37.852910    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-f74ng\""
Sep 09 06:52:37.852977 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:37.852937    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 09 06:52:37.863296 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:37.863277    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-5sphz"]
Sep 09 06:52:37.878027 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:37.878001    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e666d12c-e536-4e5e-85b9-74b773cfed35-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-82qcv\" (UID: \"e666d12c-e536-4e5e-85b9-74b773cfed35\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-82qcv"
Sep 09 06:52:37.878128 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:37.878043    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e666d12c-e536-4e5e-85b9-74b773cfed35-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-82qcv\" (UID: \"e666d12c-e536-4e5e-85b9-74b773cfed35\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-82qcv"
Sep 09 06:52:37.878128 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:37.878094    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e666d12c-e536-4e5e-85b9-74b773cfed35-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-82qcv\" (UID: \"e666d12c-e536-4e5e-85b9-74b773cfed35\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-82qcv"
Sep 09 06:52:37.878205 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:37.878166    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skkj6\" (UniqueName: \"kubernetes.io/projected/e666d12c-e536-4e5e-85b9-74b773cfed35-kube-api-access-skkj6\") pod \"openshift-state-metrics-657fd6c54-82qcv\" (UID: \"e666d12c-e536-4e5e-85b9-74b773cfed35\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-82qcv"
Sep 09 06:52:37.979010 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:37.978986    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8942k\" (UniqueName: \"kubernetes.io/projected/d1a74301-792f-4a92-a2e8-aa54ad25cadb-kube-api-access-8942k\") pod \"node-exporter-mtfrc\" (UID: \"d1a74301-792f-4a92-a2e8-aa54ad25cadb\") " pod="openshift-monitoring/node-exporter-mtfrc"
Sep 09 06:52:37.979116 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:37.979016    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d1a74301-792f-4a92-a2e8-aa54ad25cadb-node-exporter-textfile\") pod \"node-exporter-mtfrc\" (UID: \"d1a74301-792f-4a92-a2e8-aa54ad25cadb\") " pod="openshift-monitoring/node-exporter-mtfrc"
Sep 09 06:52:37.979116 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:37.979040    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e666d12c-e536-4e5e-85b9-74b773cfed35-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-82qcv\" (UID: \"e666d12c-e536-4e5e-85b9-74b773cfed35\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-82qcv"
Sep 09 06:52:37.979116 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:37.979070    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skkj6\" (UniqueName: \"kubernetes.io/projected/e666d12c-e536-4e5e-85b9-74b773cfed35-kube-api-access-skkj6\") pod \"openshift-state-metrics-657fd6c54-82qcv\" (UID: \"e666d12c-e536-4e5e-85b9-74b773cfed35\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-82qcv"
Sep 09 06:52:37.979116 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:37.979097    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4379c3c-fcea-44ae-9629-12fbb0c1581d-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-5sphz\" (UID: \"b4379c3c-fcea-44ae-9629-12fbb0c1581d\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-5sphz"
Sep 09 06:52:37.979281 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:37.979120    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4379c3c-fcea-44ae-9629-12fbb0c1581d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-5sphz\" (UID: \"b4379c3c-fcea-44ae-9629-12fbb0c1581d\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-5sphz"
Sep 09 06:52:37.979281 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:37.979143    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d1a74301-792f-4a92-a2e8-aa54ad25cadb-sys\") pod \"node-exporter-mtfrc\" (UID: \"d1a74301-792f-4a92-a2e8-aa54ad25cadb\") " pod="openshift-monitoring/node-exporter-mtfrc"
Sep 09 06:52:37.979281 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:52:37.979158    2575 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Sep 09 06:52:37.979281 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:52:37.979222    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e666d12c-e536-4e5e-85b9-74b773cfed35-openshift-state-metrics-tls podName:e666d12c-e536-4e5e-85b9-74b773cfed35 nodeName:}" failed. No retries permitted until 2026-09-09 06:52:38.479208273 +0000 UTC m=+93.271017590 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/e666d12c-e536-4e5e-85b9-74b773cfed35-openshift-state-metrics-tls") pod "openshift-state-metrics-657fd6c54-82qcv" (UID: "e666d12c-e536-4e5e-85b9-74b773cfed35") : secret "openshift-state-metrics-tls" not found
Sep 09 06:52:37.979420 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:37.979280    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d1a74301-792f-4a92-a2e8-aa54ad25cadb-node-exporter-accelerators-collector-config\") pod \"node-exporter-mtfrc\" (UID: \"d1a74301-792f-4a92-a2e8-aa54ad25cadb\") " pod="openshift-monitoring/node-exporter-mtfrc"
Sep 09 06:52:37.979420 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:37.979334    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d1a74301-792f-4a92-a2e8-aa54ad25cadb-node-exporter-wtmp\") pod \"node-exporter-mtfrc\" (UID: \"d1a74301-792f-4a92-a2e8-aa54ad25cadb\") " pod="openshift-monitoring/node-exporter-mtfrc"
Sep 09 06:52:37.979420 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:37.979364    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d1a74301-792f-4a92-a2e8-aa54ad25cadb-node-exporter-tls\") pod \"node-exporter-mtfrc\" (UID: \"d1a74301-792f-4a92-a2e8-aa54ad25cadb\") " pod="openshift-monitoring/node-exporter-mtfrc"
Sep 09 06:52:37.979420 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:37.979391    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d1a74301-792f-4a92-a2e8-aa54ad25cadb-metrics-client-ca\") pod \"node-exporter-mtfrc\" (UID: \"d1a74301-792f-4a92-a2e8-aa54ad25cadb\") " pod="openshift-monitoring/node-exporter-mtfrc"
Sep 09 06:52:37.979576 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:37.979422    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e666d12c-e536-4e5e-85b9-74b773cfed35-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-82qcv\" (UID: \"e666d12c-e536-4e5e-85b9-74b773cfed35\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-82qcv"
Sep 09 06:52:37.979576 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:37.979462    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b4379c3c-fcea-44ae-9629-12fbb0c1581d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-5sphz\" (UID: \"b4379c3c-fcea-44ae-9629-12fbb0c1581d\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-5sphz"
Sep 09 06:52:37.979576 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:37.979492    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b4379c3c-fcea-44ae-9629-12fbb0c1581d-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-5sphz\" (UID: \"b4379c3c-fcea-44ae-9629-12fbb0c1581d\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-5sphz"
Sep 09 06:52:37.979576 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:37.979510    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d1a74301-792f-4a92-a2e8-aa54ad25cadb-root\") pod \"node-exporter-mtfrc\" (UID: \"d1a74301-792f-4a92-a2e8-aa54ad25cadb\") " pod="openshift-monitoring/node-exporter-mtfrc"
Sep 09 06:52:37.979576 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:37.979540    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e666d12c-e536-4e5e-85b9-74b773cfed35-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-82qcv\" (UID: \"e666d12c-e536-4e5e-85b9-74b773cfed35\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-82qcv"
Sep 09 06:52:37.979853 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:37.979581    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4379c3c-fcea-44ae-9629-12fbb0c1581d-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-5sphz\" (UID: \"b4379c3c-fcea-44ae-9629-12fbb0c1581d\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-5sphz"
Sep 09 06:52:37.979853 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:37.979598    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4zwm\" (UniqueName: \"kubernetes.io/projected/b4379c3c-fcea-44ae-9629-12fbb0c1581d-kube-api-access-v4zwm\") pod \"kube-state-metrics-74cb57df7-5sphz\" (UID: \"b4379c3c-fcea-44ae-9629-12fbb0c1581d\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-5sphz"
Sep 09 06:52:37.979853 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:37.979617    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d1a74301-792f-4a92-a2e8-aa54ad25cadb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mtfrc\" (UID: \"d1a74301-792f-4a92-a2e8-aa54ad25cadb\") " pod="openshift-monitoring/node-exporter-mtfrc"
Sep 09 06:52:37.980221 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:37.980198    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e666d12c-e536-4e5e-85b9-74b773cfed35-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-82qcv\" (UID: \"e666d12c-e536-4e5e-85b9-74b773cfed35\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-82qcv"
Sep 09 06:52:37.981798 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:37.981782    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e666d12c-e536-4e5e-85b9-74b773cfed35-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-82qcv\" (UID: \"e666d12c-e536-4e5e-85b9-74b773cfed35\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-82qcv"
Sep 09 06:52:37.988259 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:37.988241    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skkj6\" (UniqueName: \"kubernetes.io/projected/e666d12c-e536-4e5e-85b9-74b773cfed35-kube-api-access-skkj6\") pod \"openshift-state-metrics-657fd6c54-82qcv\" (UID: \"e666d12c-e536-4e5e-85b9-74b773cfed35\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-82qcv"
Sep 09 06:52:38.080317 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:38.080265    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8942k\" (UniqueName: \"kubernetes.io/projected/d1a74301-792f-4a92-a2e8-aa54ad25cadb-kube-api-access-8942k\") pod \"node-exporter-mtfrc\" (UID: \"d1a74301-792f-4a92-a2e8-aa54ad25cadb\") " pod="openshift-monitoring/node-exporter-mtfrc"
Sep 09 06:52:38.080317 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:38.080295    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d1a74301-792f-4a92-a2e8-aa54ad25cadb-node-exporter-textfile\") pod \"node-exporter-mtfrc\" (UID: \"d1a74301-792f-4a92-a2e8-aa54ad25cadb\") " pod="openshift-monitoring/node-exporter-mtfrc"
Sep 09 06:52:38.080466 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:38.080326    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4379c3c-fcea-44ae-9629-12fbb0c1581d-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-5sphz\" (UID: \"b4379c3c-fcea-44ae-9629-12fbb0c1581d\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-5sphz"
Sep 09 06:52:38.080466 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:38.080342    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4379c3c-fcea-44ae-9629-12fbb0c1581d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-5sphz\" (UID: \"b4379c3c-fcea-44ae-9629-12fbb0c1581d\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-5sphz"
Sep 09 06:52:38.080572 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:38.080470    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d1a74301-792f-4a92-a2e8-aa54ad25cadb-sys\") pod \"node-exporter-mtfrc\" (UID: \"d1a74301-792f-4a92-a2e8-aa54ad25cadb\") " pod="openshift-monitoring/node-exporter-mtfrc"
Sep 09 06:52:38.080572 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:38.080513    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d1a74301-792f-4a92-a2e8-aa54ad25cadb-node-exporter-accelerators-collector-config\") pod \"node-exporter-mtfrc\" (UID: \"d1a74301-792f-4a92-a2e8-aa54ad25cadb\") " pod="openshift-monitoring/node-exporter-mtfrc"
Sep 09 06:52:38.080572 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:38.080552    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d1a74301-792f-4a92-a2e8-aa54ad25cadb-node-exporter-wtmp\") pod \"node-exporter-mtfrc\" (UID: \"d1a74301-792f-4a92-a2e8-aa54ad25cadb\") " pod="openshift-monitoring/node-exporter-mtfrc"
Sep 09 06:52:38.080572 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:38.080565    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d1a74301-792f-4a92-a2e8-aa54ad25cadb-sys\") pod \"node-exporter-mtfrc\" (UID: \"d1a74301-792f-4a92-a2e8-aa54ad25cadb\") " pod="openshift-monitoring/node-exporter-mtfrc"
Sep 09 06:52:38.080793 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:38.080580    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d1a74301-792f-4a92-a2e8-aa54ad25cadb-node-exporter-tls\") pod \"node-exporter-mtfrc\" (UID: \"d1a74301-792f-4a92-a2e8-aa54ad25cadb\") " pod="openshift-monitoring/node-exporter-mtfrc"
Sep 09 06:52:38.080793 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:38.080609    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d1a74301-792f-4a92-a2e8-aa54ad25cadb-metrics-client-ca\") pod \"node-exporter-mtfrc\" (UID: \"d1a74301-792f-4a92-a2e8-aa54ad25cadb\") " pod="openshift-monitoring/node-exporter-mtfrc"
Sep 09 06:52:38.080793 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:38.080638    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b4379c3c-fcea-44ae-9629-12fbb0c1581d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-5sphz\" (UID: \"b4379c3c-fcea-44ae-9629-12fbb0c1581d\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-5sphz"
Sep 09 06:52:38.080793 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:38.080667    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b4379c3c-fcea-44ae-9629-12fbb0c1581d-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-5sphz\" (UID: \"b4379c3c-fcea-44ae-9629-12fbb0c1581d\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-5sphz"
Sep 09 06:52:38.080793 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:38.080692    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d1a74301-792f-4a92-a2e8-aa54ad25cadb-node-exporter-wtmp\") pod \"node-exporter-mtfrc\" (UID: \"d1a74301-792f-4a92-a2e8-aa54ad25cadb\") " pod="openshift-monitoring/node-exporter-mtfrc"
Sep 09 06:52:38.080793 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:38.080696    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d1a74301-792f-4a92-a2e8-aa54ad25cadb-root\") pod \"node-exporter-mtfrc\" (UID: \"d1a74301-792f-4a92-a2e8-aa54ad25cadb\") " pod="openshift-monitoring/node-exporter-mtfrc"
Sep 09 06:52:38.080793 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:38.080776    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4379c3c-fcea-44ae-9629-12fbb0c1581d-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-5sphz\" (UID: \"b4379c3c-fcea-44ae-9629-12fbb0c1581d\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-5sphz"
Sep 09 06:52:38.081132 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:38.080805    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4zwm\" (UniqueName: \"kubernetes.io/projected/b4379c3c-fcea-44ae-9629-12fbb0c1581d-kube-api-access-v4zwm\") pod \"kube-state-metrics-74cb57df7-5sphz\" (UID: \"b4379c3c-fcea-44ae-9629-12fbb0c1581d\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-5sphz"
Sep 09 06:52:38.081132 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:38.080833    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d1a74301-792f-4a92-a2e8-aa54ad25cadb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mtfrc\" (UID: \"d1a74301-792f-4a92-a2e8-aa54ad25cadb\") " pod="openshift-monitoring/node-exporter-mtfrc"
Sep 09 06:52:38.081132 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:38.081093    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d1a74301-792f-4a92-a2e8-aa54ad25cadb-node-exporter-accelerators-collector-config\") pod \"node-exporter-mtfrc\" (UID: \"d1a74301-792f-4a92-a2e8-aa54ad25cadb\") " pod="openshift-monitoring/node-exporter-mtfrc"
Sep 09 06:52:38.081132 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:38.080636    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d1a74301-792f-4a92-a2e8-aa54ad25cadb-node-exporter-textfile\") pod \"node-exporter-mtfrc\" (UID: \"d1a74301-792f-4a92-a2e8-aa54ad25cadb\") " pod="openshift-monitoring/node-exporter-mtfrc"
Sep 09 06:52:38.081333 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:38.081184    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d1a74301-792f-4a92-a2e8-aa54ad25cadb-root\") pod \"node-exporter-mtfrc\" (UID: \"d1a74301-792f-4a92-a2e8-aa54ad25cadb\") " pod="openshift-monitoring/node-exporter-mtfrc"
Sep 09 06:52:38.081333 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:38.081275    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d1a74301-792f-4a92-a2e8-aa54ad25cadb-metrics-client-ca\") pod \"node-exporter-mtfrc\" (UID: \"d1a74301-792f-4a92-a2e8-aa54ad25cadb\") " pod="openshift-monitoring/node-exporter-mtfrc"
Sep 09 06:52:38.081410 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:38.081368    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b4379c3c-fcea-44ae-9629-12fbb0c1581d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-5sphz\" (UID: \"b4379c3c-fcea-44ae-9629-12fbb0c1581d\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-5sphz"
Sep 09 06:52:38.081510 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:38.081382    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b4379c3c-fcea-44ae-9629-12fbb0c1581d-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-5sphz\" (UID: \"b4379c3c-fcea-44ae-9629-12fbb0c1581d\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-5sphz"
Sep 09 06:52:38.081767 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:38.081727    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4379c3c-fcea-44ae-9629-12fbb0c1581d-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-5sphz\" (UID: \"b4379c3c-fcea-44ae-9629-12fbb0c1581d\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-5sphz"
Sep 09 06:52:38.083135 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:38.083111    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d1a74301-792f-4a92-a2e8-aa54ad25cadb-node-exporter-tls\") pod \"node-exporter-mtfrc\" (UID: \"d1a74301-792f-4a92-a2e8-aa54ad25cadb\") " pod="openshift-monitoring/node-exporter-mtfrc"
Sep 09 06:52:38.083454 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:38.083429    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4379c3c-fcea-44ae-9629-12fbb0c1581d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-5sphz\" (UID: \"b4379c3c-fcea-44ae-9629-12fbb0c1581d\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-5sphz"
Sep 09 06:52:38.083523 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:38.083474    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d1a74301-792f-4a92-a2e8-aa54ad25cadb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mtfrc\" (UID: \"d1a74301-792f-4a92-a2e8-aa54ad25cadb\") " pod="openshift-monitoring/node-exporter-mtfrc"
Sep 09 06:52:38.083523 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:38.083497    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4379c3c-fcea-44ae-9629-12fbb0c1581d-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-5sphz\" (UID: \"b4379c3c-fcea-44ae-9629-12fbb0c1581d\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-5sphz"
Sep 09 06:52:38.088201 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:38.088176    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8942k\" (UniqueName: \"kubernetes.io/projected/d1a74301-792f-4a92-a2e8-aa54ad25cadb-kube-api-access-8942k\") pod \"node-exporter-mtfrc\" (UID: \"d1a74301-792f-4a92-a2e8-aa54ad25cadb\") " pod="openshift-monitoring/node-exporter-mtfrc"
Sep 09 06:52:38.088776 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:38.088741    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4zwm\" (UniqueName: \"kubernetes.io/projected/b4379c3c-fcea-44ae-9629-12fbb0c1581d-kube-api-access-v4zwm\") pod \"kube-state-metrics-74cb57df7-5sphz\" (UID: \"b4379c3c-fcea-44ae-9629-12fbb0c1581d\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-5sphz"
Sep 09 06:52:38.140330 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:38.140308    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mtfrc"
Sep 09 06:52:38.154716 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:52:38.154681    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1a74301_792f_4a92_a2e8_aa54ad25cadb.slice/crio-0434ba6edf17d4af99dca32de54f046dce5cc0d8efc9eadb05ec0fb38701dc21 WatchSource:0}: Error finding container 0434ba6edf17d4af99dca32de54f046dce5cc0d8efc9eadb05ec0fb38701dc21: Status 404 returned error can't find the container with id 0434ba6edf17d4af99dca32de54f046dce5cc0d8efc9eadb05ec0fb38701dc21
Sep 09 06:52:38.158025 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:38.158004    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-5sphz"
Sep 09 06:52:38.326897 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:38.326872    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-74d75b469-9mr4z"
Sep 09 06:52:38.327013 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:38.326920    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74d75b469-9mr4z"
Sep 09 06:52:38.331475 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:38.331410    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-74d75b469-9mr4z"
Sep 09 06:52:38.430905 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:38.430886    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-5sphz"]
Sep 09 06:52:38.432900 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:52:38.432876    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4379c3c_fcea_44ae_9629_12fbb0c1581d.slice/crio-b6eaf4b490ebdd5a118f59882a8eaaf3c2a6f8ecc681e3e7aca64e35d662ec37 WatchSource:0}: Error finding container b6eaf4b490ebdd5a118f59882a8eaaf3c2a6f8ecc681e3e7aca64e35d662ec37: Status 404 returned error can't find the container with id b6eaf4b490ebdd5a118f59882a8eaaf3c2a6f8ecc681e3e7aca64e35d662ec37
Sep 09 06:52:38.486033 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:38.486002    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e666d12c-e536-4e5e-85b9-74b773cfed35-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-82qcv\" (UID: \"e666d12c-e536-4e5e-85b9-74b773cfed35\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-82qcv"
Sep 09 06:52:38.488739 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:38.488718    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e666d12c-e536-4e5e-85b9-74b773cfed35-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-82qcv\" (UID: \"e666d12c-e536-4e5e-85b9-74b773cfed35\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-82qcv"
Sep 09 06:52:38.721844 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:38.721814    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-82qcv"
Sep 09 06:52:39.002367 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:39.002248    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-82qcv"]
Sep 09 06:52:39.098110 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:39.098075    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-5sphz" event={"ID":"b4379c3c-fcea-44ae-9629-12fbb0c1581d","Type":"ContainerStarted","Data":"b6eaf4b490ebdd5a118f59882a8eaaf3c2a6f8ecc681e3e7aca64e35d662ec37"}
Sep 09 06:52:39.100134 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:39.100105    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mtfrc" event={"ID":"d1a74301-792f-4a92-a2e8-aa54ad25cadb","Type":"ContainerStarted","Data":"0434ba6edf17d4af99dca32de54f046dce5cc0d8efc9eadb05ec0fb38701dc21"}
Sep 09 06:52:39.105432 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:39.105408    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-74d75b469-9mr4z"
Sep 09 06:52:39.222933 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:52:39.222898    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode666d12c_e536_4e5e_85b9_74b773cfed35.slice/crio-4874c37960abc2178fa8583c29cf9daabbd47a7c799ce2d5838adc56e3aa52ef WatchSource:0}: Error finding container 4874c37960abc2178fa8583c29cf9daabbd47a7c799ce2d5838adc56e3aa52ef: Status 404 returned error can't find the container with id 4874c37960abc2178fa8583c29cf9daabbd47a7c799ce2d5838adc56e3aa52ef
Sep 09 06:52:40.107945 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:40.107860    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-5sphz" event={"ID":"b4379c3c-fcea-44ae-9629-12fbb0c1581d","Type":"ContainerStarted","Data":"12fe78cb9a1fef59e75b3063436abb83cae1f5e4772a3211890cb2c8d2999606"}
Sep 09 06:52:40.107945 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:40.107926    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-5sphz" event={"ID":"b4379c3c-fcea-44ae-9629-12fbb0c1581d","Type":"ContainerStarted","Data":"451f1a36ede1c930d8041a3e8ca42c3c0ac810daee447720337a605ad7025b66"}
Sep 09 06:52:40.108443 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:40.107955    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-5sphz" event={"ID":"b4379c3c-fcea-44ae-9629-12fbb0c1581d","Type":"ContainerStarted","Data":"0eece1bfafa991c4fbfc34cfaae223faabd5d4db1b19557bcfbb9f8904f345c5"}
Sep 09 06:52:40.110089 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:40.110061    2575 generic.go:356] "Generic (PLEG): container finished" podID="d1a74301-792f-4a92-a2e8-aa54ad25cadb" containerID="0b6911466292495c174c7b80eba2a5086dfabf6382abf60b1a9ed6266c372189" exitCode=0
Sep 09 06:52:40.110230 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:40.110145    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mtfrc" event={"ID":"d1a74301-792f-4a92-a2e8-aa54ad25cadb","Type":"ContainerDied","Data":"0b6911466292495c174c7b80eba2a5086dfabf6382abf60b1a9ed6266c372189"}
Sep 09 06:52:40.116026 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:40.115910    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-82qcv" event={"ID":"e666d12c-e536-4e5e-85b9-74b773cfed35","Type":"ContainerStarted","Data":"155664e3d93a8212a7448e0c56a134595e18e9929f66077300bfce332da436d3"}
Sep 09 06:52:40.116026 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:40.115974    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-82qcv" event={"ID":"e666d12c-e536-4e5e-85b9-74b773cfed35","Type":"ContainerStarted","Data":"826e72316d9e3175235d0a8a2c85c474102a2f9c4f982338eb18ed47ae652392"}
Sep 09 06:52:40.116026 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:40.116001    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-82qcv" event={"ID":"e666d12c-e536-4e5e-85b9-74b773cfed35","Type":"ContainerStarted","Data":"4874c37960abc2178fa8583c29cf9daabbd47a7c799ce2d5838adc56e3aa52ef"}
Sep 09 06:52:40.128113 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:40.128068    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-5sphz" podStartSLOduration=1.802649893 podStartE2EDuration="3.128048168s" totalImagesPullingTime="1.325398275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:52:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:52:40.127447864 +0000 UTC m=+94.919257204" watchObservedRunningTime="2026-09-09 06:52:40.128048168 +0000 UTC m=+94.919857512"
Sep 09 06:52:41.121863 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:41.121829    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mtfrc" event={"ID":"d1a74301-792f-4a92-a2e8-aa54ad25cadb","Type":"ContainerStarted","Data":"e04be70c0a90f629507e3734b44a5b929bcc8884ccf24a311dd960369b9cf929"}
Sep 09 06:52:41.122232 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:41.121893    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mtfrc" event={"ID":"d1a74301-792f-4a92-a2e8-aa54ad25cadb","Type":"ContainerStarted","Data":"d4df14a1bf5051578d43eb89de72e81ce19bee91eda406b4f5d8e72775d0dd38"}
Sep 09 06:52:41.123938 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:41.123915    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-82qcv" event={"ID":"e666d12c-e536-4e5e-85b9-74b773cfed35","Type":"ContainerStarted","Data":"2ab84b787f472c74db270c2aed1fdf57ee9bc5646593c5fecd393edff63fc731"}
Sep 09 06:52:41.148549 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:41.148505    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mtfrc" podStartSLOduration=2.942131794 podStartE2EDuration="4.148490479s" totalImagesPullingTime="1.124628654s" totalInitContainerRuntime="81.730031ms" isStatefulPod=true podCreationTimestamp="2026-09-09 06:52:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:52:41.147581085 +0000 UTC m=+95.939390423" watchObservedRunningTime="2026-09-09 06:52:41.148490479 +0000 UTC m=+95.940299817"
Sep 09 06:52:41.169636 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:41.169580    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-82qcv" podStartSLOduration=3.098790018 podStartE2EDuration="4.169563281s" totalImagesPullingTime="1.070773263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:52:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:52:41.16878301 +0000 UTC m=+95.960592351" watchObservedRunningTime="2026-09-09 06:52:41.169563281 +0000 UTC m=+95.961372620"
Sep 09 06:52:42.225771 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.225725    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7b575d98bf-fhppb"]
Sep 09 06:52:42.229836 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.229813    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7b575d98bf-fhppb"
Sep 09 06:52:42.233989 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.233966    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 09 06:52:42.234104 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.233966    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-1e3ldofkh1p0l\""
Sep 09 06:52:42.234104 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.233971    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 09 06:52:42.234104 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.233971    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-9lnx8\""
Sep 09 06:52:42.234262 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.233997    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 09 06:52:42.234262 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.234047    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 09 06:52:42.240168 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.240093    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7b575d98bf-fhppb"]
Sep 09 06:52:42.321766 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.321720    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e5966dfb-9cb2-4925-92fb-44bf3a79728c-secret-metrics-server-client-certs\") pod \"metrics-server-7b575d98bf-fhppb\" (UID: \"e5966dfb-9cb2-4925-92fb-44bf3a79728c\") " pod="openshift-monitoring/metrics-server-7b575d98bf-fhppb"
Sep 09 06:52:42.321887 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.321780    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5966dfb-9cb2-4925-92fb-44bf3a79728c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b575d98bf-fhppb\" (UID: \"e5966dfb-9cb2-4925-92fb-44bf3a79728c\") " pod="openshift-monitoring/metrics-server-7b575d98bf-fhppb"
Sep 09 06:52:42.321887 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.321808    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgqwd\" (UniqueName: \"kubernetes.io/projected/e5966dfb-9cb2-4925-92fb-44bf3a79728c-kube-api-access-bgqwd\") pod \"metrics-server-7b575d98bf-fhppb\" (UID: \"e5966dfb-9cb2-4925-92fb-44bf3a79728c\") " pod="openshift-monitoring/metrics-server-7b575d98bf-fhppb"
Sep 09 06:52:42.321887 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.321826    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e5966dfb-9cb2-4925-92fb-44bf3a79728c-secret-metrics-server-tls\") pod \"metrics-server-7b575d98bf-fhppb\" (UID: \"e5966dfb-9cb2-4925-92fb-44bf3a79728c\") " pod="openshift-monitoring/metrics-server-7b575d98bf-fhppb"
Sep 09 06:52:42.321887 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.321877    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e5966dfb-9cb2-4925-92fb-44bf3a79728c-metrics-server-audit-profiles\") pod \"metrics-server-7b575d98bf-fhppb\" (UID: \"e5966dfb-9cb2-4925-92fb-44bf3a79728c\") " pod="openshift-monitoring/metrics-server-7b575d98bf-fhppb"
Sep 09 06:52:42.322046 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.321917    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e5966dfb-9cb2-4925-92fb-44bf3a79728c-audit-log\") pod \"metrics-server-7b575d98bf-fhppb\" (UID: \"e5966dfb-9cb2-4925-92fb-44bf3a79728c\") " pod="openshift-monitoring/metrics-server-7b575d98bf-fhppb"
Sep 09 06:52:42.322046 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.321970    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5966dfb-9cb2-4925-92fb-44bf3a79728c-client-ca-bundle\") pod \"metrics-server-7b575d98bf-fhppb\" (UID: \"e5966dfb-9cb2-4925-92fb-44bf3a79728c\") " pod="openshift-monitoring/metrics-server-7b575d98bf-fhppb"
Sep 09 06:52:42.422776 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.422730    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5966dfb-9cb2-4925-92fb-44bf3a79728c-client-ca-bundle\") pod \"metrics-server-7b575d98bf-fhppb\" (UID: \"e5966dfb-9cb2-4925-92fb-44bf3a79728c\") " pod="openshift-monitoring/metrics-server-7b575d98bf-fhppb"
Sep 09 06:52:42.422897 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.422799    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e5966dfb-9cb2-4925-92fb-44bf3a79728c-secret-metrics-server-client-certs\") pod \"metrics-server-7b575d98bf-fhppb\" (UID: \"e5966dfb-9cb2-4925-92fb-44bf3a79728c\") " pod="openshift-monitoring/metrics-server-7b575d98bf-fhppb"
Sep 09 06:52:42.422897 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.422850    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5966dfb-9cb2-4925-92fb-44bf3a79728c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b575d98bf-fhppb\" (UID: \"e5966dfb-9cb2-4925-92fb-44bf3a79728c\") " pod="openshift-monitoring/metrics-server-7b575d98bf-fhppb"
Sep 09 06:52:42.422897 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.422888    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgqwd\" (UniqueName: \"kubernetes.io/projected/e5966dfb-9cb2-4925-92fb-44bf3a79728c-kube-api-access-bgqwd\") pod \"metrics-server-7b575d98bf-fhppb\" (UID: \"e5966dfb-9cb2-4925-92fb-44bf3a79728c\") " pod="openshift-monitoring/metrics-server-7b575d98bf-fhppb"
Sep 09 06:52:42.423032 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.422919    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e5966dfb-9cb2-4925-92fb-44bf3a79728c-secret-metrics-server-tls\") pod \"metrics-server-7b575d98bf-fhppb\" (UID: \"e5966dfb-9cb2-4925-92fb-44bf3a79728c\") " pod="openshift-monitoring/metrics-server-7b575d98bf-fhppb"
Sep 09 06:52:42.423032 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.422948    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e5966dfb-9cb2-4925-92fb-44bf3a79728c-metrics-server-audit-profiles\") pod \"metrics-server-7b575d98bf-fhppb\" (UID: \"e5966dfb-9cb2-4925-92fb-44bf3a79728c\") " pod="openshift-monitoring/metrics-server-7b575d98bf-fhppb"
Sep 09 06:52:42.423032 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.422978    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e5966dfb-9cb2-4925-92fb-44bf3a79728c-audit-log\") pod \"metrics-server-7b575d98bf-fhppb\" (UID: \"e5966dfb-9cb2-4925-92fb-44bf3a79728c\") " pod="openshift-monitoring/metrics-server-7b575d98bf-fhppb"
Sep 09 06:52:42.423517 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.423496    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e5966dfb-9cb2-4925-92fb-44bf3a79728c-audit-log\") pod \"metrics-server-7b575d98bf-fhppb\" (UID: \"e5966dfb-9cb2-4925-92fb-44bf3a79728c\") " pod="openshift-monitoring/metrics-server-7b575d98bf-fhppb"
Sep 09 06:52:42.423605 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.423545    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5966dfb-9cb2-4925-92fb-44bf3a79728c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b575d98bf-fhppb\" (UID: \"e5966dfb-9cb2-4925-92fb-44bf3a79728c\") " pod="openshift-monitoring/metrics-server-7b575d98bf-fhppb"
Sep 09 06:52:42.424041 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.424025    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e5966dfb-9cb2-4925-92fb-44bf3a79728c-metrics-server-audit-profiles\") pod \"metrics-server-7b575d98bf-fhppb\" (UID: \"e5966dfb-9cb2-4925-92fb-44bf3a79728c\") " pod="openshift-monitoring/metrics-server-7b575d98bf-fhppb"
Sep 09 06:52:42.425629 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.425607    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e5966dfb-9cb2-4925-92fb-44bf3a79728c-secret-metrics-server-tls\") pod \"metrics-server-7b575d98bf-fhppb\" (UID: \"e5966dfb-9cb2-4925-92fb-44bf3a79728c\") " pod="openshift-monitoring/metrics-server-7b575d98bf-fhppb"
Sep 09 06:52:42.425896 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.425876    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5966dfb-9cb2-4925-92fb-44bf3a79728c-client-ca-bundle\") pod \"metrics-server-7b575d98bf-fhppb\" (UID: \"e5966dfb-9cb2-4925-92fb-44bf3a79728c\") " pod="openshift-monitoring/metrics-server-7b575d98bf-fhppb"
Sep 09 06:52:42.425936 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.425919    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e5966dfb-9cb2-4925-92fb-44bf3a79728c-secret-metrics-server-client-certs\") pod \"metrics-server-7b575d98bf-fhppb\" (UID: \"e5966dfb-9cb2-4925-92fb-44bf3a79728c\") " pod="openshift-monitoring/metrics-server-7b575d98bf-fhppb"
Sep 09 06:52:42.430488 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.430472    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgqwd\" (UniqueName: \"kubernetes.io/projected/e5966dfb-9cb2-4925-92fb-44bf3a79728c-kube-api-access-bgqwd\") pod \"metrics-server-7b575d98bf-fhppb\" (UID: \"e5966dfb-9cb2-4925-92fb-44bf3a79728c\") " pod="openshift-monitoring/metrics-server-7b575d98bf-fhppb"
Sep 09 06:52:42.540307 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.540248    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7b575d98bf-fhppb"
Sep 09 06:52:42.653114 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.653077    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d9756b77f-8j828"]
Sep 09 06:52:42.657339 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.657319    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d9756b77f-8j828"
Sep 09 06:52:42.665553 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.665532    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 09 06:52:42.666768 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.666731    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d9756b77f-8j828"]
Sep 09 06:52:42.813688 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.813663    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7b575d98bf-fhppb"]
Sep 09 06:52:42.816207 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:52:42.816182    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5966dfb_9cb2_4925_92fb_44bf3a79728c.slice/crio-cf2b444e77b53781c135873085bf0981bade59eadf7f335c551edcf6e2717170 WatchSource:0}: Error finding container cf2b444e77b53781c135873085bf0981bade59eadf7f335c551edcf6e2717170: Status 404 returned error can't find the container with id cf2b444e77b53781c135873085bf0981bade59eadf7f335c551edcf6e2717170
Sep 09 06:52:42.825776 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.825732    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4ccd799-2317-48c7-bbbf-1174b44b48d3-trusted-ca-bundle\") pod \"console-7d9756b77f-8j828\" (UID: \"b4ccd799-2317-48c7-bbbf-1174b44b48d3\") " pod="openshift-console/console-7d9756b77f-8j828"
Sep 09 06:52:42.825856 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.825783    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flscq\" (UniqueName: \"kubernetes.io/projected/b4ccd799-2317-48c7-bbbf-1174b44b48d3-kube-api-access-flscq\") pod \"console-7d9756b77f-8j828\" (UID: \"b4ccd799-2317-48c7-bbbf-1174b44b48d3\") " pod="openshift-console/console-7d9756b77f-8j828"
Sep 09 06:52:42.825856 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.825807    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4ccd799-2317-48c7-bbbf-1174b44b48d3-console-config\") pod \"console-7d9756b77f-8j828\" (UID: \"b4ccd799-2317-48c7-bbbf-1174b44b48d3\") " pod="openshift-console/console-7d9756b77f-8j828"
Sep 09 06:52:42.825856 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.825830    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4ccd799-2317-48c7-bbbf-1174b44b48d3-oauth-serving-cert\") pod \"console-7d9756b77f-8j828\" (UID: \"b4ccd799-2317-48c7-bbbf-1174b44b48d3\") " pod="openshift-console/console-7d9756b77f-8j828"
Sep 09 06:52:42.825988 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.825914    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4ccd799-2317-48c7-bbbf-1174b44b48d3-service-ca\") pod \"console-7d9756b77f-8j828\" (UID: \"b4ccd799-2317-48c7-bbbf-1174b44b48d3\") " pod="openshift-console/console-7d9756b77f-8j828"
Sep 09 06:52:42.825988 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.825966    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4ccd799-2317-48c7-bbbf-1174b44b48d3-console-serving-cert\") pod \"console-7d9756b77f-8j828\" (UID: \"b4ccd799-2317-48c7-bbbf-1174b44b48d3\") " pod="openshift-console/console-7d9756b77f-8j828"
Sep 09 06:52:42.826074 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.826008    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4ccd799-2317-48c7-bbbf-1174b44b48d3-console-oauth-config\") pod \"console-7d9756b77f-8j828\" (UID: \"b4ccd799-2317-48c7-bbbf-1174b44b48d3\") " pod="openshift-console/console-7d9756b77f-8j828"
Sep 09 06:52:42.927357 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.927301    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4ccd799-2317-48c7-bbbf-1174b44b48d3-console-config\") pod \"console-7d9756b77f-8j828\" (UID: \"b4ccd799-2317-48c7-bbbf-1174b44b48d3\") " pod="openshift-console/console-7d9756b77f-8j828"
Sep 09 06:52:42.927357 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.927343    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4ccd799-2317-48c7-bbbf-1174b44b48d3-oauth-serving-cert\") pod \"console-7d9756b77f-8j828\" (UID: \"b4ccd799-2317-48c7-bbbf-1174b44b48d3\") " pod="openshift-console/console-7d9756b77f-8j828"
Sep 09 06:52:42.927619 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.927397    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4ccd799-2317-48c7-bbbf-1174b44b48d3-service-ca\") pod \"console-7d9756b77f-8j828\" (UID: \"b4ccd799-2317-48c7-bbbf-1174b44b48d3\") " pod="openshift-console/console-7d9756b77f-8j828"
Sep 09 06:52:42.927619 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.927428    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4ccd799-2317-48c7-bbbf-1174b44b48d3-console-serving-cert\") pod \"console-7d9756b77f-8j828\" (UID: \"b4ccd799-2317-48c7-bbbf-1174b44b48d3\") " pod="openshift-console/console-7d9756b77f-8j828"
Sep 09 06:52:42.927619 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.927460    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4ccd799-2317-48c7-bbbf-1174b44b48d3-console-oauth-config\") pod \"console-7d9756b77f-8j828\" (UID: \"b4ccd799-2317-48c7-bbbf-1174b44b48d3\") " pod="openshift-console/console-7d9756b77f-8j828"
Sep 09 06:52:42.927619 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.927479    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4ccd799-2317-48c7-bbbf-1174b44b48d3-trusted-ca-bundle\") pod \"console-7d9756b77f-8j828\" (UID: \"b4ccd799-2317-48c7-bbbf-1174b44b48d3\") " pod="openshift-console/console-7d9756b77f-8j828"
Sep 09 06:52:42.927619 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.927500    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flscq\" (UniqueName: \"kubernetes.io/projected/b4ccd799-2317-48c7-bbbf-1174b44b48d3-kube-api-access-flscq\") pod \"console-7d9756b77f-8j828\" (UID: \"b4ccd799-2317-48c7-bbbf-1174b44b48d3\") " pod="openshift-console/console-7d9756b77f-8j828"
Sep 09 06:52:42.928443 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.928383    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4ccd799-2317-48c7-bbbf-1174b44b48d3-oauth-serving-cert\") pod \"console-7d9756b77f-8j828\" (UID: \"b4ccd799-2317-48c7-bbbf-1174b44b48d3\") " pod="openshift-console/console-7d9756b77f-8j828"
Sep 09 06:52:42.928443 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.928411    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4ccd799-2317-48c7-bbbf-1174b44b48d3-service-ca\") pod \"console-7d9756b77f-8j828\" (UID: \"b4ccd799-2317-48c7-bbbf-1174b44b48d3\") " pod="openshift-console/console-7d9756b77f-8j828"
Sep 09 06:52:42.929152 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.929132    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4ccd799-2317-48c7-bbbf-1174b44b48d3-trusted-ca-bundle\") pod \"console-7d9756b77f-8j828\" (UID: \"b4ccd799-2317-48c7-bbbf-1174b44b48d3\") " pod="openshift-console/console-7d9756b77f-8j828"
Sep 09 06:52:42.929461 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.929439    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4ccd799-2317-48c7-bbbf-1174b44b48d3-console-config\") pod \"console-7d9756b77f-8j828\" (UID: \"b4ccd799-2317-48c7-bbbf-1174b44b48d3\") " pod="openshift-console/console-7d9756b77f-8j828"
Sep 09 06:52:42.930236 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.930169    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4ccd799-2317-48c7-bbbf-1174b44b48d3-console-oauth-config\") pod \"console-7d9756b77f-8j828\" (UID: \"b4ccd799-2317-48c7-bbbf-1174b44b48d3\") " pod="openshift-console/console-7d9756b77f-8j828"
Sep 09 06:52:42.930359 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.930342    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4ccd799-2317-48c7-bbbf-1174b44b48d3-console-serving-cert\") pod \"console-7d9756b77f-8j828\" (UID: \"b4ccd799-2317-48c7-bbbf-1174b44b48d3\") " pod="openshift-console/console-7d9756b77f-8j828"
Sep 09 06:52:42.936525 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.936500    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flscq\" (UniqueName: \"kubernetes.io/projected/b4ccd799-2317-48c7-bbbf-1174b44b48d3-kube-api-access-flscq\") pod \"console-7d9756b77f-8j828\" (UID: \"b4ccd799-2317-48c7-bbbf-1174b44b48d3\") " pod="openshift-console/console-7d9756b77f-8j828"
Sep 09 06:52:42.967494 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:42.967466    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d9756b77f-8j828"
Sep 09 06:52:43.131502 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:43.131471    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7b575d98bf-fhppb" event={"ID":"e5966dfb-9cb2-4925-92fb-44bf3a79728c","Type":"ContainerStarted","Data":"cf2b444e77b53781c135873085bf0981bade59eadf7f335c551edcf6e2717170"}
Sep 09 06:52:43.245138 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:43.245110    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d9756b77f-8j828"]
Sep 09 06:52:43.249038 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:52:43.249013    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4ccd799_2317_48c7_bbbf_1174b44b48d3.slice/crio-82abac757b0fca418ab53ad5b44cf584eac537757b24ec4d71ec93517ca834a3 WatchSource:0}: Error finding container 82abac757b0fca418ab53ad5b44cf584eac537757b24ec4d71ec93517ca834a3: Status 404 returned error can't find the container with id 82abac757b0fca418ab53ad5b44cf584eac537757b24ec4d71ec93517ca834a3
Sep 09 06:52:44.136658 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.136622    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d9756b77f-8j828" event={"ID":"b4ccd799-2317-48c7-bbbf-1174b44b48d3","Type":"ContainerStarted","Data":"5bca672fd34ed3667a3944da1c3bffd718620c7fd465ccf008f3c2a587b812a7"}
Sep 09 06:52:44.136842 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.136680    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d9756b77f-8j828" event={"ID":"b4ccd799-2317-48c7-bbbf-1174b44b48d3","Type":"ContainerStarted","Data":"82abac757b0fca418ab53ad5b44cf584eac537757b24ec4d71ec93517ca834a3"}
Sep 09 06:52:44.157965 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.157915    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d9756b77f-8j828" podStartSLOduration=2.1578948159999998 podStartE2EDuration="2.157894816s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:52:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:52:44.155856202 +0000 UTC m=+98.947665539" watchObservedRunningTime="2026-09-09 06:52:44.157894816 +0000 UTC m=+98.949704155"
Sep 09 06:52:44.235130 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.235100    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 06:52:44.239728 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.239705    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.242853 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.242357    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 09 06:52:44.242853 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.242593    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-qs96b\""
Sep 09 06:52:44.243003 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.242860    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 09 06:52:44.243050 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.243042    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 09 06:52:44.244259 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.243328    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 09 06:52:44.244259 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.243497    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 09 06:52:44.244259 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.243666    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 09 06:52:44.244259 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.243925    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 09 06:52:44.244422 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.244369    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 09 06:52:44.244625 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.244605    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 09 06:52:44.244872 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.244847    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 09 06:52:44.244991 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.244965    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 09 06:52:44.245060 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.244994    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 09 06:52:44.245277 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.245225    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7hco3bpu3asdb\""
Sep 09 06:52:44.256860 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.255683    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 09 06:52:44.260272 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.260248    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 09 06:52:44.265065 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.264433    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 06:52:44.338091 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.338061    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhqd9\" (UniqueName: \"kubernetes.io/projected/059680a7-5b9b-41c3-b46a-3194020b2dab-kube-api-access-rhqd9\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.338270 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.338098    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/059680a7-5b9b-41c3-b46a-3194020b2dab-web-config\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.338270 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.338126    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/059680a7-5b9b-41c3-b46a-3194020b2dab-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.338270 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.338149    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/059680a7-5b9b-41c3-b46a-3194020b2dab-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.338270 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.338200    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/059680a7-5b9b-41c3-b46a-3194020b2dab-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.338270 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.338264    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/059680a7-5b9b-41c3-b46a-3194020b2dab-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.338435 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.338284    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/059680a7-5b9b-41c3-b46a-3194020b2dab-config-out\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.338435 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.338310    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/059680a7-5b9b-41c3-b46a-3194020b2dab-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.338435 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.338343    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/059680a7-5b9b-41c3-b46a-3194020b2dab-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.338435 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.338381    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/059680a7-5b9b-41c3-b46a-3194020b2dab-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.338435 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.338402    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/059680a7-5b9b-41c3-b46a-3194020b2dab-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.338435 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.338419    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/059680a7-5b9b-41c3-b46a-3194020b2dab-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.338624 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.338439    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/059680a7-5b9b-41c3-b46a-3194020b2dab-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.338624 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.338460    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/059680a7-5b9b-41c3-b46a-3194020b2dab-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.338624 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.338476    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/059680a7-5b9b-41c3-b46a-3194020b2dab-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.338624 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.338518    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/059680a7-5b9b-41c3-b46a-3194020b2dab-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.338624 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.338562    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/059680a7-5b9b-41c3-b46a-3194020b2dab-config\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.338624 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.338581    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/059680a7-5b9b-41c3-b46a-3194020b2dab-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.338624 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.338598    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/059680a7-5b9b-41c3-b46a-3194020b2dab-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.338624 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.338620    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/059680a7-5b9b-41c3-b46a-3194020b2dab-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.439479 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.439386    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/059680a7-5b9b-41c3-b46a-3194020b2dab-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.439479 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.439432    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/059680a7-5b9b-41c3-b46a-3194020b2dab-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.439479 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.439463    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/059680a7-5b9b-41c3-b46a-3194020b2dab-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.439788 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.439493    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/059680a7-5b9b-41c3-b46a-3194020b2dab-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.439788 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.439523    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/059680a7-5b9b-41c3-b46a-3194020b2dab-config-out\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.440071 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.439558    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/059680a7-5b9b-41c3-b46a-3194020b2dab-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.440163 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.440102    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/059680a7-5b9b-41c3-b46a-3194020b2dab-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.440163 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.440134    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/059680a7-5b9b-41c3-b46a-3194020b2dab-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.440266 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.440172    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/059680a7-5b9b-41c3-b46a-3194020b2dab-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.440266 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.440201    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/059680a7-5b9b-41c3-b46a-3194020b2dab-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.440266 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.440241    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/059680a7-5b9b-41c3-b46a-3194020b2dab-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.440414 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.440260    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/059680a7-5b9b-41c3-b46a-3194020b2dab-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.440414 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.440283    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/059680a7-5b9b-41c3-b46a-3194020b2dab-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.440999 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.440776    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/059680a7-5b9b-41c3-b46a-3194020b2dab-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.441421 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.441394    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/059680a7-5b9b-41c3-b46a-3194020b2dab-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.441648 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.441630    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/059680a7-5b9b-41c3-b46a-3194020b2dab-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.441786 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.441770    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/059680a7-5b9b-41c3-b46a-3194020b2dab-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.441913 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.441899    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/059680a7-5b9b-41c3-b46a-3194020b2dab-config\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.442005 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.441981    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/059680a7-5b9b-41c3-b46a-3194020b2dab-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.442078 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.441997    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/059680a7-5b9b-41c3-b46a-3194020b2dab-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.442165 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.442152    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/059680a7-5b9b-41c3-b46a-3194020b2dab-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.442255 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.442233    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/059680a7-5b9b-41c3-b46a-3194020b2dab-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.442350 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.442281    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhqd9\" (UniqueName: \"kubernetes.io/projected/059680a7-5b9b-41c3-b46a-3194020b2dab-kube-api-access-rhqd9\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.442350 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.442312    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/059680a7-5b9b-41c3-b46a-3194020b2dab-web-config\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.442632 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.442610    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/059680a7-5b9b-41c3-b46a-3194020b2dab-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.444086 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.443216    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/059680a7-5b9b-41c3-b46a-3194020b2dab-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.444086 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.443242    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/059680a7-5b9b-41c3-b46a-3194020b2dab-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.444086 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.443486    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/059680a7-5b9b-41c3-b46a-3194020b2dab-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.445019 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.444997    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/059680a7-5b9b-41c3-b46a-3194020b2dab-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.445256 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.445232    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/059680a7-5b9b-41c3-b46a-3194020b2dab-web-config\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.446657 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.446249    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/059680a7-5b9b-41c3-b46a-3194020b2dab-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.446657 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.446285    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/059680a7-5b9b-41c3-b46a-3194020b2dab-config-out\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.446657 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.446602    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/059680a7-5b9b-41c3-b46a-3194020b2dab-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.447906 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.446783    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/059680a7-5b9b-41c3-b46a-3194020b2dab-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.447906 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.447468    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/059680a7-5b9b-41c3-b46a-3194020b2dab-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.447906 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.447828    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/059680a7-5b9b-41c3-b46a-3194020b2dab-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.449945 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.449907    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/059680a7-5b9b-41c3-b46a-3194020b2dab-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.450033 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.450015    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/059680a7-5b9b-41c3-b46a-3194020b2dab-config\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.450095 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.450025    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/059680a7-5b9b-41c3-b46a-3194020b2dab-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.452705 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.452687    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhqd9\" (UniqueName: \"kubernetes.io/projected/059680a7-5b9b-41c3-b46a-3194020b2dab-kube-api-access-rhqd9\") pod \"prometheus-k8s-0\" (UID: \"059680a7-5b9b-41c3-b46a-3194020b2dab\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.560157 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.560122    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:52:44.854217 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:44.854187    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 06:52:44.856642 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:52:44.856614    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod059680a7_5b9b_41c3_b46a_3194020b2dab.slice/crio-5b6f8e56144520e7710548239876078143a7147b4857118d3f47339d5b29f970 WatchSource:0}: Error finding container 5b6f8e56144520e7710548239876078143a7147b4857118d3f47339d5b29f970: Status 404 returned error can't find the container with id 5b6f8e56144520e7710548239876078143a7147b4857118d3f47339d5b29f970
Sep 09 06:52:45.142364 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:45.142337    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"059680a7-5b9b-41c3-b46a-3194020b2dab","Type":"ContainerStarted","Data":"5b6f8e56144520e7710548239876078143a7147b4857118d3f47339d5b29f970"}
Sep 09 06:52:45.143868 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:45.143843    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7b575d98bf-fhppb" event={"ID":"e5966dfb-9cb2-4925-92fb-44bf3a79728c","Type":"ContainerStarted","Data":"49e658cb99fd03697814de85726579275663ce5d55010cbae0cfe5ff6c576f34"}
Sep 09 06:52:45.163561 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:45.163518    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7b575d98bf-fhppb" podStartSLOduration=1.8332527079999998 podStartE2EDuration="3.163503345s" totalImagesPullingTime="1.330250637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:52:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:52:45.162841641 +0000 UTC m=+99.954650982" watchObservedRunningTime="2026-09-09 06:52:45.163503345 +0000 UTC m=+99.955312684"
Sep 09 06:52:46.149159 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:46.149127    2575 generic.go:356] "Generic (PLEG): container finished" podID="059680a7-5b9b-41c3-b46a-3194020b2dab" containerID="5ef3a374ec0688ebf3aa25e222d12328bb51169fe71e6e7f4ac0f2a93fd761b0" exitCode=0
Sep 09 06:52:46.149497 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:46.149224    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"059680a7-5b9b-41c3-b46a-3194020b2dab","Type":"ContainerDied","Data":"5ef3a374ec0688ebf3aa25e222d12328bb51169fe71e6e7f4ac0f2a93fd761b0"}
Sep 09 06:52:48.543557 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:48.543522    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-dbf5fc6cf-j5f62"]
Sep 09 06:52:49.006121 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:49.006089    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fmhfw"
Sep 09 06:52:50.168568 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:50.168539    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"059680a7-5b9b-41c3-b46a-3194020b2dab","Type":"ContainerStarted","Data":"f6ed75ac8ca8da8934d2615fb0077b3be3cba902802af22826c205a5b0f7dfdb"}
Sep 09 06:52:50.169026 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:50.168602    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"059680a7-5b9b-41c3-b46a-3194020b2dab","Type":"ContainerStarted","Data":"7dad4decc1d9783a8dbb73e16ae7dc908e53e660f990d8b146be61346f72a0f2"}
Sep 09 06:52:52.967897 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:52.967871    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d9756b77f-8j828"
Sep 09 06:52:52.968239 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:52.967928    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d9756b77f-8j828"
Sep 09 06:52:52.972543 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:52.972517    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d9756b77f-8j828"
Sep 09 06:52:53.183079 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:53.183042    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"059680a7-5b9b-41c3-b46a-3194020b2dab","Type":"ContainerStarted","Data":"a3f802fec897c22da224b47997d3ebcc1656e7a44cc0f4cb712798adc9b29a93"}
Sep 09 06:52:53.183256 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:53.183107    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"059680a7-5b9b-41c3-b46a-3194020b2dab","Type":"ContainerStarted","Data":"3ebf94435a51a91dc845f45f2225f609dbc226bf287ea04c19f3fa33ad5f776b"}
Sep 09 06:52:53.183256 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:53.183134    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"059680a7-5b9b-41c3-b46a-3194020b2dab","Type":"ContainerStarted","Data":"7c43ff7e8232960424f66045dd9f469e5c1fd8777193e356d46958556791f98c"}
Sep 09 06:52:53.183256 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:53.183164    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"059680a7-5b9b-41c3-b46a-3194020b2dab","Type":"ContainerStarted","Data":"9763b2ba0ff44cda85298e8fadc13ac2a52067dd2d58d950816ef498e742659c"}
Sep 09 06:52:53.187106 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:53.187082    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d9756b77f-8j828"
Sep 09 06:52:53.216490 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:53.216432    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.530908372 podStartE2EDuration="9.216413439s" totalImagesPullingTime="6.662028526s" totalInitContainerRuntime="23.476541ms" isStatefulPod=false podCreationTimestamp="2026-09-09 06:52:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:52:53.212247317 +0000 UTC m=+108.004056692" watchObservedRunningTime="2026-09-09 06:52:53.216413439 +0000 UTC m=+108.008222778"
Sep 09 06:52:53.268476 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:53.268399    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74d75b469-9mr4z"]
Sep 09 06:52:54.561214 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:52:54.561180    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:53:02.540834 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:02.540794    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7b575d98bf-fhppb"
Sep 09 06:53:02.541340 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:02.540864    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7b575d98bf-fhppb"
Sep 09 06:53:13.567831 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:13.567792    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-dbf5fc6cf-j5f62" podUID="eb5cd0d7-4682-4760-8f8a-8a221c4a682b" containerName="registry" containerID="cri-o://c30a58aff53d298a35a8b7ab2d53b5870eca5ec2aa3fabbb64c63781c424d630" gracePeriod=30
Sep 09 06:53:13.816810 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:13.816790    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-dbf5fc6cf-j5f62"
Sep 09 06:53:13.883763 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:13.883724    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qg2hh\" (UniqueName: \"kubernetes.io/projected/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-kube-api-access-qg2hh\") pod \"eb5cd0d7-4682-4760-8f8a-8a221c4a682b\" (UID: \"eb5cd0d7-4682-4760-8f8a-8a221c4a682b\") "
Sep 09 06:53:13.883882 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:13.883817    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-image-registry-private-configuration\") pod \"eb5cd0d7-4682-4760-8f8a-8a221c4a682b\" (UID: \"eb5cd0d7-4682-4760-8f8a-8a221c4a682b\") "
Sep 09 06:53:13.883882 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:13.883849    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-registry-certificates\") pod \"eb5cd0d7-4682-4760-8f8a-8a221c4a682b\" (UID: \"eb5cd0d7-4682-4760-8f8a-8a221c4a682b\") "
Sep 09 06:53:13.883975 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:13.883880    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-bound-sa-token\") pod \"eb5cd0d7-4682-4760-8f8a-8a221c4a682b\" (UID: \"eb5cd0d7-4682-4760-8f8a-8a221c4a682b\") "
Sep 09 06:53:13.883975 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:13.883913    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-registry-tls\") pod \"eb5cd0d7-4682-4760-8f8a-8a221c4a682b\" (UID: \"eb5cd0d7-4682-4760-8f8a-8a221c4a682b\") "
Sep 09 06:53:13.884078 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:13.883986    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-ca-trust-extracted\") pod \"eb5cd0d7-4682-4760-8f8a-8a221c4a682b\" (UID: \"eb5cd0d7-4682-4760-8f8a-8a221c4a682b\") "
Sep 09 06:53:13.884078 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:13.884010    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-installation-pull-secrets\") pod \"eb5cd0d7-4682-4760-8f8a-8a221c4a682b\" (UID: \"eb5cd0d7-4682-4760-8f8a-8a221c4a682b\") "
Sep 09 06:53:13.884078 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:13.884033    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-trusted-ca\") pod \"eb5cd0d7-4682-4760-8f8a-8a221c4a682b\" (UID: \"eb5cd0d7-4682-4760-8f8a-8a221c4a682b\") "
Sep 09 06:53:13.884341 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:13.884310    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "eb5cd0d7-4682-4760-8f8a-8a221c4a682b" (UID: "eb5cd0d7-4682-4760-8f8a-8a221c4a682b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 06:53:13.884948 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:13.884917    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "eb5cd0d7-4682-4760-8f8a-8a221c4a682b" (UID: "eb5cd0d7-4682-4760-8f8a-8a221c4a682b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 06:53:13.886268 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:13.886240    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "eb5cd0d7-4682-4760-8f8a-8a221c4a682b" (UID: "eb5cd0d7-4682-4760-8f8a-8a221c4a682b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:53:13.886370 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:13.886306    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "eb5cd0d7-4682-4760-8f8a-8a221c4a682b" (UID: "eb5cd0d7-4682-4760-8f8a-8a221c4a682b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 06:53:13.886496 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:13.886472    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-kube-api-access-qg2hh" (OuterVolumeSpecName: "kube-api-access-qg2hh") pod "eb5cd0d7-4682-4760-8f8a-8a221c4a682b" (UID: "eb5cd0d7-4682-4760-8f8a-8a221c4a682b"). InnerVolumeSpecName "kube-api-access-qg2hh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:53:13.886865 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:13.886835    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "eb5cd0d7-4682-4760-8f8a-8a221c4a682b" (UID: "eb5cd0d7-4682-4760-8f8a-8a221c4a682b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:53:13.886964 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:13.886916    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "eb5cd0d7-4682-4760-8f8a-8a221c4a682b" (UID: "eb5cd0d7-4682-4760-8f8a-8a221c4a682b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 06:53:13.895184 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:13.895160    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "eb5cd0d7-4682-4760-8f8a-8a221c4a682b" (UID: "eb5cd0d7-4682-4760-8f8a-8a221c4a682b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:53:13.985088 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:13.985064    2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-bound-sa-token\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 06:53:13.985088 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:13.985088    2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-registry-tls\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 06:53:13.985232 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:13.985097    2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-ca-trust-extracted\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 06:53:13.985232 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:13.985105    2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-installation-pull-secrets\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 06:53:13.985232 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:13.985114    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-trusted-ca\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 06:53:13.985232 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:13.985122    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qg2hh\" (UniqueName: \"kubernetes.io/projected/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-kube-api-access-qg2hh\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 06:53:13.985232 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:13.985132    2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-image-registry-private-configuration\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 06:53:13.985232 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:13.985141    2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eb5cd0d7-4682-4760-8f8a-8a221c4a682b-registry-certificates\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 06:53:14.264151 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:14.264081    2575 generic.go:356] "Generic (PLEG): container finished" podID="eb5cd0d7-4682-4760-8f8a-8a221c4a682b" containerID="c30a58aff53d298a35a8b7ab2d53b5870eca5ec2aa3fabbb64c63781c424d630" exitCode=0
Sep 09 06:53:14.264151 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:14.264121    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-dbf5fc6cf-j5f62" event={"ID":"eb5cd0d7-4682-4760-8f8a-8a221c4a682b","Type":"ContainerDied","Data":"c30a58aff53d298a35a8b7ab2d53b5870eca5ec2aa3fabbb64c63781c424d630"}
Sep 09 06:53:14.264151 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:14.264132    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-dbf5fc6cf-j5f62"
Sep 09 06:53:14.264312 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:14.264170    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-dbf5fc6cf-j5f62" event={"ID":"eb5cd0d7-4682-4760-8f8a-8a221c4a682b","Type":"ContainerDied","Data":"c913c5eed5883b777c60321f1957b57851c990b1320396bf52c02ac09c140c47"}
Sep 09 06:53:14.264312 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:14.264198    2575 scope.go:117] "RemoveContainer" containerID="c30a58aff53d298a35a8b7ab2d53b5870eca5ec2aa3fabbb64c63781c424d630"
Sep 09 06:53:14.275598 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:14.275574    2575 scope.go:117] "RemoveContainer" containerID="c30a58aff53d298a35a8b7ab2d53b5870eca5ec2aa3fabbb64c63781c424d630"
Sep 09 06:53:14.276006 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:53:14.275984    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c30a58aff53d298a35a8b7ab2d53b5870eca5ec2aa3fabbb64c63781c424d630\": container with ID starting with c30a58aff53d298a35a8b7ab2d53b5870eca5ec2aa3fabbb64c63781c424d630 not found: ID does not exist" containerID="c30a58aff53d298a35a8b7ab2d53b5870eca5ec2aa3fabbb64c63781c424d630"
Sep 09 06:53:14.276108 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:14.276026    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c30a58aff53d298a35a8b7ab2d53b5870eca5ec2aa3fabbb64c63781c424d630"} err="failed to get container status \"c30a58aff53d298a35a8b7ab2d53b5870eca5ec2aa3fabbb64c63781c424d630\": rpc error: code = NotFound desc = could not find container \"c30a58aff53d298a35a8b7ab2d53b5870eca5ec2aa3fabbb64c63781c424d630\": container with ID starting with c30a58aff53d298a35a8b7ab2d53b5870eca5ec2aa3fabbb64c63781c424d630 not found: ID does not exist"
Sep 09 06:53:14.286351 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:14.286330    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-dbf5fc6cf-j5f62"]
Sep 09 06:53:14.291722 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:14.291695    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-dbf5fc6cf-j5f62"]
Sep 09 06:53:15.710561 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:15.710518    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb5cd0d7-4682-4760-8f8a-8a221c4a682b" path="/var/lib/kubelet/pods/eb5cd0d7-4682-4760-8f8a-8a221c4a682b/volumes"
Sep 09 06:53:18.294055 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:18.294000    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-74d75b469-9mr4z" podUID="4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4" containerName="console" containerID="cri-o://2f7417c20eea7486940240272f15ecb01cb6dce6a54dbd44dd041bf353667954" gracePeriod=15
Sep 09 06:53:18.535603 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:18.535580    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74d75b469-9mr4z"
Sep 09 06:53:18.618608 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:18.618543    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8vmq\" (UniqueName: \"kubernetes.io/projected/4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4-kube-api-access-b8vmq\") pod \"4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4\" (UID: \"4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4\") "
Sep 09 06:53:18.618608 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:18.618582    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4-console-config\") pod \"4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4\" (UID: \"4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4\") "
Sep 09 06:53:18.618816 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:18.618612    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4-service-ca\") pod \"4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4\" (UID: \"4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4\") "
Sep 09 06:53:18.618816 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:18.618633    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4-oauth-serving-cert\") pod \"4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4\" (UID: \"4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4\") "
Sep 09 06:53:18.618816 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:18.618666    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4-console-serving-cert\") pod \"4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4\" (UID: \"4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4\") "
Sep 09 06:53:18.618816 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:18.618719    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4-console-oauth-config\") pod \"4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4\" (UID: \"4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4\") "
Sep 09 06:53:18.619047 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:18.619031    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4-service-ca" (OuterVolumeSpecName: "service-ca") pod "4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4" (UID: "4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 06:53:18.619107 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:18.619059    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4-console-config" (OuterVolumeSpecName: "console-config") pod "4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4" (UID: "4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 06:53:18.619164 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:18.619140    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4" (UID: "4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 06:53:18.621036 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:18.621016    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4" (UID: "4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 06:53:18.621475 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:18.621450    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4" (UID: "4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 06:53:18.621559 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:18.621488    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4-kube-api-access-b8vmq" (OuterVolumeSpecName: "kube-api-access-b8vmq") pod "4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4" (UID: "4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4"). InnerVolumeSpecName "kube-api-access-b8vmq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:53:18.719551 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:18.719520    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4-console-oauth-config\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 06:53:18.719551 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:18.719550    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8vmq\" (UniqueName: \"kubernetes.io/projected/4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4-kube-api-access-b8vmq\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 06:53:18.719551 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:18.719558    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4-console-config\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 06:53:18.719716 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:18.719567    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4-service-ca\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 06:53:18.719716 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:18.719576    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4-oauth-serving-cert\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 06:53:18.719716 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:18.719584    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4-console-serving-cert\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 06:53:19.285634 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:19.285605    2575 generic.go:356] "Generic (PLEG): container finished" podID="4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4" containerID="2f7417c20eea7486940240272f15ecb01cb6dce6a54dbd44dd041bf353667954" exitCode=0
Sep 09 06:53:19.285910 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:19.285648    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74d75b469-9mr4z" event={"ID":"4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4","Type":"ContainerDied","Data":"2f7417c20eea7486940240272f15ecb01cb6dce6a54dbd44dd041bf353667954"}
Sep 09 06:53:19.285910 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:19.285682    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74d75b469-9mr4z" event={"ID":"4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4","Type":"ContainerDied","Data":"1e495cdcd93fb883462307d0a243e3d4b9439d6b9e1d9df8eb96d5afe8814efc"}
Sep 09 06:53:19.285910 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:19.285701    2575 scope.go:117] "RemoveContainer" containerID="2f7417c20eea7486940240272f15ecb01cb6dce6a54dbd44dd041bf353667954"
Sep 09 06:53:19.285910 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:19.285649    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74d75b469-9mr4z"
Sep 09 06:53:19.296031 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:19.296011    2575 scope.go:117] "RemoveContainer" containerID="2f7417c20eea7486940240272f15ecb01cb6dce6a54dbd44dd041bf353667954"
Sep 09 06:53:19.296570 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:53:19.296549    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f7417c20eea7486940240272f15ecb01cb6dce6a54dbd44dd041bf353667954\": container with ID starting with 2f7417c20eea7486940240272f15ecb01cb6dce6a54dbd44dd041bf353667954 not found: ID does not exist" containerID="2f7417c20eea7486940240272f15ecb01cb6dce6a54dbd44dd041bf353667954"
Sep 09 06:53:19.296642 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:19.296579    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f7417c20eea7486940240272f15ecb01cb6dce6a54dbd44dd041bf353667954"} err="failed to get container status \"2f7417c20eea7486940240272f15ecb01cb6dce6a54dbd44dd041bf353667954\": rpc error: code = NotFound desc = could not find container \"2f7417c20eea7486940240272f15ecb01cb6dce6a54dbd44dd041bf353667954\": container with ID starting with 2f7417c20eea7486940240272f15ecb01cb6dce6a54dbd44dd041bf353667954 not found: ID does not exist"
Sep 09 06:53:19.311357 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:19.311316    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74d75b469-9mr4z"]
Sep 09 06:53:19.314677 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:19.314652    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-74d75b469-9mr4z"]
Sep 09 06:53:19.710549 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:19.710517    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4" path="/var/lib/kubelet/pods/4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4/volumes"
Sep 09 06:53:22.546061 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:22.546033    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7b575d98bf-fhppb"
Sep 09 06:53:22.549670 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:22.549649    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7b575d98bf-fhppb"
Sep 09 06:53:44.561063 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:44.561032    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:53:44.581462 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:44.581439    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:53:45.409816 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:53:45.409795    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 06:54:16.042523 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:54:16.042487    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d9756b77f-8j828"]
Sep 09 06:54:41.065781 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:54:41.065726    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7d9756b77f-8j828" podUID="b4ccd799-2317-48c7-bbbf-1174b44b48d3" containerName="console" containerID="cri-o://5bca672fd34ed3667a3944da1c3bffd718620c7fd465ccf008f3c2a587b812a7" gracePeriod=15
Sep 09 06:54:41.311278 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:54:41.311248    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d9756b77f-8j828"
Sep 09 06:54:41.493328 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:54:41.493298    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-flscq\" (UniqueName: \"kubernetes.io/projected/b4ccd799-2317-48c7-bbbf-1174b44b48d3-kube-api-access-flscq\") pod \"b4ccd799-2317-48c7-bbbf-1174b44b48d3\" (UID: \"b4ccd799-2317-48c7-bbbf-1174b44b48d3\") "
Sep 09 06:54:41.493510 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:54:41.493343    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4ccd799-2317-48c7-bbbf-1174b44b48d3-console-config\") pod \"b4ccd799-2317-48c7-bbbf-1174b44b48d3\" (UID: \"b4ccd799-2317-48c7-bbbf-1174b44b48d3\") "
Sep 09 06:54:41.493510 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:54:41.493368    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4ccd799-2317-48c7-bbbf-1174b44b48d3-console-oauth-config\") pod \"b4ccd799-2317-48c7-bbbf-1174b44b48d3\" (UID: \"b4ccd799-2317-48c7-bbbf-1174b44b48d3\") "
Sep 09 06:54:41.493510 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:54:41.493401    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4ccd799-2317-48c7-bbbf-1174b44b48d3-console-serving-cert\") pod \"b4ccd799-2317-48c7-bbbf-1174b44b48d3\" (UID: \"b4ccd799-2317-48c7-bbbf-1174b44b48d3\") "
Sep 09 06:54:41.493510 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:54:41.493451    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4ccd799-2317-48c7-bbbf-1174b44b48d3-trusted-ca-bundle\") pod \"b4ccd799-2317-48c7-bbbf-1174b44b48d3\" (UID: \"b4ccd799-2317-48c7-bbbf-1174b44b48d3\") "
Sep 09 06:54:41.493510 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:54:41.493478    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4ccd799-2317-48c7-bbbf-1174b44b48d3-oauth-serving-cert\") pod \"b4ccd799-2317-48c7-bbbf-1174b44b48d3\" (UID: \"b4ccd799-2317-48c7-bbbf-1174b44b48d3\") "
Sep 09 06:54:41.493510 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:54:41.493506    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4ccd799-2317-48c7-bbbf-1174b44b48d3-service-ca\") pod \"b4ccd799-2317-48c7-bbbf-1174b44b48d3\" (UID: \"b4ccd799-2317-48c7-bbbf-1174b44b48d3\") "
Sep 09 06:54:41.493903 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:54:41.493872    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4ccd799-2317-48c7-bbbf-1174b44b48d3-console-config" (OuterVolumeSpecName: "console-config") pod "b4ccd799-2317-48c7-bbbf-1174b44b48d3" (UID: "b4ccd799-2317-48c7-bbbf-1174b44b48d3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 06:54:41.493990 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:54:41.493963    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4ccd799-2317-48c7-bbbf-1174b44b48d3-service-ca" (OuterVolumeSpecName: "service-ca") pod "b4ccd799-2317-48c7-bbbf-1174b44b48d3" (UID: "b4ccd799-2317-48c7-bbbf-1174b44b48d3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 06:54:41.494045 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:54:41.494019    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4ccd799-2317-48c7-bbbf-1174b44b48d3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b4ccd799-2317-48c7-bbbf-1174b44b48d3" (UID: "b4ccd799-2317-48c7-bbbf-1174b44b48d3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 06:54:41.494089 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:54:41.494030    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4ccd799-2317-48c7-bbbf-1174b44b48d3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b4ccd799-2317-48c7-bbbf-1174b44b48d3" (UID: "b4ccd799-2317-48c7-bbbf-1174b44b48d3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 06:54:41.495810 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:54:41.495784    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4ccd799-2317-48c7-bbbf-1174b44b48d3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b4ccd799-2317-48c7-bbbf-1174b44b48d3" (UID: "b4ccd799-2317-48c7-bbbf-1174b44b48d3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 06:54:41.496210 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:54:41.496189    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4ccd799-2317-48c7-bbbf-1174b44b48d3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b4ccd799-2317-48c7-bbbf-1174b44b48d3" (UID: "b4ccd799-2317-48c7-bbbf-1174b44b48d3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 06:54:41.496283 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:54:41.496254    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4ccd799-2317-48c7-bbbf-1174b44b48d3-kube-api-access-flscq" (OuterVolumeSpecName: "kube-api-access-flscq") pod "b4ccd799-2317-48c7-bbbf-1174b44b48d3" (UID: "b4ccd799-2317-48c7-bbbf-1174b44b48d3"). InnerVolumeSpecName "kube-api-access-flscq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:54:41.594709 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:54:41.594676    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flscq\" (UniqueName: \"kubernetes.io/projected/b4ccd799-2317-48c7-bbbf-1174b44b48d3-kube-api-access-flscq\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 06:54:41.594709 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:54:41.594700    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4ccd799-2317-48c7-bbbf-1174b44b48d3-console-config\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 06:54:41.594709 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:54:41.594709    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4ccd799-2317-48c7-bbbf-1174b44b48d3-console-oauth-config\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 06:54:41.594709 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:54:41.594718    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4ccd799-2317-48c7-bbbf-1174b44b48d3-console-serving-cert\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 06:54:41.594940 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:54:41.594727    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4ccd799-2317-48c7-bbbf-1174b44b48d3-trusted-ca-bundle\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 06:54:41.594940 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:54:41.594735    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4ccd799-2317-48c7-bbbf-1174b44b48d3-oauth-serving-cert\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 06:54:41.594940 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:54:41.594760    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4ccd799-2317-48c7-bbbf-1174b44b48d3-service-ca\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 06:54:41.607164 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:54:41.607134    2575 generic.go:356] "Generic (PLEG): container finished" podID="b4ccd799-2317-48c7-bbbf-1174b44b48d3" containerID="5bca672fd34ed3667a3944da1c3bffd718620c7fd465ccf008f3c2a587b812a7" exitCode=0
Sep 09 06:54:41.607287 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:54:41.607185    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d9756b77f-8j828"
Sep 09 06:54:41.607287 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:54:41.607218    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d9756b77f-8j828" event={"ID":"b4ccd799-2317-48c7-bbbf-1174b44b48d3","Type":"ContainerDied","Data":"5bca672fd34ed3667a3944da1c3bffd718620c7fd465ccf008f3c2a587b812a7"}
Sep 09 06:54:41.607287 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:54:41.607274    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d9756b77f-8j828" event={"ID":"b4ccd799-2317-48c7-bbbf-1174b44b48d3","Type":"ContainerDied","Data":"82abac757b0fca418ab53ad5b44cf584eac537757b24ec4d71ec93517ca834a3"}
Sep 09 06:54:41.607430 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:54:41.607296    2575 scope.go:117] "RemoveContainer" containerID="5bca672fd34ed3667a3944da1c3bffd718620c7fd465ccf008f3c2a587b812a7"
Sep 09 06:54:41.615620 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:54:41.615603    2575 scope.go:117] "RemoveContainer" containerID="5bca672fd34ed3667a3944da1c3bffd718620c7fd465ccf008f3c2a587b812a7"
Sep 09 06:54:41.615957 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:54:41.615941    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bca672fd34ed3667a3944da1c3bffd718620c7fd465ccf008f3c2a587b812a7\": container with ID starting with 5bca672fd34ed3667a3944da1c3bffd718620c7fd465ccf008f3c2a587b812a7 not found: ID does not exist" containerID="5bca672fd34ed3667a3944da1c3bffd718620c7fd465ccf008f3c2a587b812a7"
Sep 09 06:54:41.616013 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:54:41.615966    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bca672fd34ed3667a3944da1c3bffd718620c7fd465ccf008f3c2a587b812a7"} err="failed to get container status \"5bca672fd34ed3667a3944da1c3bffd718620c7fd465ccf008f3c2a587b812a7\": rpc error: code = NotFound desc = could not find container \"5bca672fd34ed3667a3944da1c3bffd718620c7fd465ccf008f3c2a587b812a7\": container with ID starting with 5bca672fd34ed3667a3944da1c3bffd718620c7fd465ccf008f3c2a587b812a7 not found: ID does not exist"
Sep 09 06:54:41.628052 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:54:41.628030    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d9756b77f-8j828"]
Sep 09 06:54:41.632399 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:54:41.632378    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d9756b77f-8j828"]
Sep 09 06:54:41.710449 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:54:41.710424    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4ccd799-2317-48c7-bbbf-1174b44b48d3" path="/var/lib/kubelet/pods/b4ccd799-2317-48c7-bbbf-1174b44b48d3/volumes"
Sep 09 06:56:05.601116 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:05.601090    2575 kubelet.go:1648] "Image garbage collection succeeded"
Sep 09 06:56:13.398122 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:13.398084    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cmcrb"]
Sep 09 06:56:13.400550 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:13.398492    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb5cd0d7-4682-4760-8f8a-8a221c4a682b" containerName="registry"
Sep 09 06:56:13.400550 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:13.398512    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb5cd0d7-4682-4760-8f8a-8a221c4a682b" containerName="registry"
Sep 09 06:56:13.400550 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:13.398544    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4" containerName="console"
Sep 09 06:56:13.400550 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:13.398550    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4" containerName="console"
Sep 09 06:56:13.400550 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:13.398560    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4ccd799-2317-48c7-bbbf-1174b44b48d3" containerName="console"
Sep 09 06:56:13.400550 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:13.398565    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4ccd799-2317-48c7-bbbf-1174b44b48d3" containerName="console"
Sep 09 06:56:13.400550 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:13.398614    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f3d58e6-2ef4-4bfe-9ed1-5de6a82bc0b4" containerName="console"
Sep 09 06:56:13.400550 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:13.398621    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4ccd799-2317-48c7-bbbf-1174b44b48d3" containerName="console"
Sep 09 06:56:13.400550 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:13.398630    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb5cd0d7-4682-4760-8f8a-8a221c4a682b" containerName="registry"
Sep 09 06:56:13.401427 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:13.401413    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cmcrb"
Sep 09 06:56:13.403939 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:13.403921    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 09 06:56:13.404698 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:13.404681    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 09 06:56:13.404762 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:13.404681    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-74tsx\""
Sep 09 06:56:13.410138 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:13.410117    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cmcrb"]
Sep 09 06:56:13.486991 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:13.486960    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aefc7797-44b9-4ef5-b45d-0be18623f2b3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cmcrb\" (UID: \"aefc7797-44b9-4ef5-b45d-0be18623f2b3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cmcrb"
Sep 09 06:56:13.487107 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:13.487004    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdt65\" (UniqueName: \"kubernetes.io/projected/aefc7797-44b9-4ef5-b45d-0be18623f2b3-kube-api-access-tdt65\") pod \"openshift-lws-operator-fd8ccff4c-cmcrb\" (UID: \"aefc7797-44b9-4ef5-b45d-0be18623f2b3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cmcrb"
Sep 09 06:56:13.588482 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:13.588452    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aefc7797-44b9-4ef5-b45d-0be18623f2b3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cmcrb\" (UID: \"aefc7797-44b9-4ef5-b45d-0be18623f2b3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cmcrb"
Sep 09 06:56:13.588623 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:13.588493    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdt65\" (UniqueName: \"kubernetes.io/projected/aefc7797-44b9-4ef5-b45d-0be18623f2b3-kube-api-access-tdt65\") pod \"openshift-lws-operator-fd8ccff4c-cmcrb\" (UID: \"aefc7797-44b9-4ef5-b45d-0be18623f2b3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cmcrb"
Sep 09 06:56:13.588827 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:13.588809    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aefc7797-44b9-4ef5-b45d-0be18623f2b3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cmcrb\" (UID: \"aefc7797-44b9-4ef5-b45d-0be18623f2b3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cmcrb"
Sep 09 06:56:13.597869 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:13.597848    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdt65\" (UniqueName: \"kubernetes.io/projected/aefc7797-44b9-4ef5-b45d-0be18623f2b3-kube-api-access-tdt65\") pod \"openshift-lws-operator-fd8ccff4c-cmcrb\" (UID: \"aefc7797-44b9-4ef5-b45d-0be18623f2b3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cmcrb"
Sep 09 06:56:13.719938 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:13.719868    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cmcrb"
Sep 09 06:56:13.987632 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:13.987561    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cmcrb"]
Sep 09 06:56:13.991120 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:56:13.991095    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaefc7797_44b9_4ef5_b45d_0be18623f2b3.slice/crio-2e9afc70d57d36c3eacc4cd2f7d5bd53a5a397ef12ac3e8968d6a6275bc6567c WatchSource:0}: Error finding container 2e9afc70d57d36c3eacc4cd2f7d5bd53a5a397ef12ac3e8968d6a6275bc6567c: Status 404 returned error can't find the container with id 2e9afc70d57d36c3eacc4cd2f7d5bd53a5a397ef12ac3e8968d6a6275bc6567c
Sep 09 06:56:13.992541 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:13.992524    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 06:56:14.948403 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:14.948366    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cmcrb" event={"ID":"aefc7797-44b9-4ef5-b45d-0be18623f2b3","Type":"ContainerStarted","Data":"2e9afc70d57d36c3eacc4cd2f7d5bd53a5a397ef12ac3e8968d6a6275bc6567c"}
Sep 09 06:56:16.959235 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:16.959194    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cmcrb" event={"ID":"aefc7797-44b9-4ef5-b45d-0be18623f2b3","Type":"ContainerStarted","Data":"6fb45ba438c1d7c687408941ac5c44b3244953b8dc98e6541a3b3860cdecb06e"}
Sep 09 06:56:16.981354 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:16.981305    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cmcrb" podStartSLOduration=1.7536216119999999 podStartE2EDuration="3.981290453s" totalImagesPullingTime="2.227668841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:56:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:56:16.981157289 +0000 UTC m=+311.772966630" watchObservedRunningTime="2026-09-09 06:56:16.981290453 +0000 UTC m=+311.773099791"
Sep 09 06:56:33.724936 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:33.724906    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-789c5bdf9c-dtdcs"]
Sep 09 06:56:33.733838 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:33.733816    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-789c5bdf9c-dtdcs"
Sep 09 06:56:33.737994 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:33.737969    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 09 06:56:33.737994 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:33.737988    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 09 06:56:33.738183 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:33.737972    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 09 06:56:33.738183 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:33.738030    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-9blcl\""
Sep 09 06:56:33.740170 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:33.740114    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-789c5bdf9c-dtdcs"]
Sep 09 06:56:33.845154 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:33.845127    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e095b85b-84bc-4e88-90f8-31eae9c1a5f6-cert\") pod \"lws-controller-manager-789c5bdf9c-dtdcs\" (UID: \"e095b85b-84bc-4e88-90f8-31eae9c1a5f6\") " pod="openshift-lws-operator/lws-controller-manager-789c5bdf9c-dtdcs"
Sep 09 06:56:33.845260 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:33.845178    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e095b85b-84bc-4e88-90f8-31eae9c1a5f6-manager-config\") pod \"lws-controller-manager-789c5bdf9c-dtdcs\" (UID: \"e095b85b-84bc-4e88-90f8-31eae9c1a5f6\") " pod="openshift-lws-operator/lws-controller-manager-789c5bdf9c-dtdcs"
Sep 09 06:56:33.845308 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:33.845256    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mslp\" (UniqueName: \"kubernetes.io/projected/e095b85b-84bc-4e88-90f8-31eae9c1a5f6-kube-api-access-5mslp\") pod \"lws-controller-manager-789c5bdf9c-dtdcs\" (UID: \"e095b85b-84bc-4e88-90f8-31eae9c1a5f6\") " pod="openshift-lws-operator/lws-controller-manager-789c5bdf9c-dtdcs"
Sep 09 06:56:33.845308 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:33.845300    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e095b85b-84bc-4e88-90f8-31eae9c1a5f6-metrics-cert\") pod \"lws-controller-manager-789c5bdf9c-dtdcs\" (UID: \"e095b85b-84bc-4e88-90f8-31eae9c1a5f6\") " pod="openshift-lws-operator/lws-controller-manager-789c5bdf9c-dtdcs"
Sep 09 06:56:33.946481 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:33.946444    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e095b85b-84bc-4e88-90f8-31eae9c1a5f6-manager-config\") pod \"lws-controller-manager-789c5bdf9c-dtdcs\" (UID: \"e095b85b-84bc-4e88-90f8-31eae9c1a5f6\") " pod="openshift-lws-operator/lws-controller-manager-789c5bdf9c-dtdcs"
Sep 09 06:56:33.946662 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:33.946523    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mslp\" (UniqueName: \"kubernetes.io/projected/e095b85b-84bc-4e88-90f8-31eae9c1a5f6-kube-api-access-5mslp\") pod \"lws-controller-manager-789c5bdf9c-dtdcs\" (UID: \"e095b85b-84bc-4e88-90f8-31eae9c1a5f6\") " pod="openshift-lws-operator/lws-controller-manager-789c5bdf9c-dtdcs"
Sep 09 06:56:33.946662 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:33.946564    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e095b85b-84bc-4e88-90f8-31eae9c1a5f6-metrics-cert\") pod \"lws-controller-manager-789c5bdf9c-dtdcs\" (UID: \"e095b85b-84bc-4e88-90f8-31eae9c1a5f6\") " pod="openshift-lws-operator/lws-controller-manager-789c5bdf9c-dtdcs"
Sep 09 06:56:33.946662 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:33.946606    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e095b85b-84bc-4e88-90f8-31eae9c1a5f6-cert\") pod \"lws-controller-manager-789c5bdf9c-dtdcs\" (UID: \"e095b85b-84bc-4e88-90f8-31eae9c1a5f6\") " pod="openshift-lws-operator/lws-controller-manager-789c5bdf9c-dtdcs"
Sep 09 06:56:33.947327 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:33.947277    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e095b85b-84bc-4e88-90f8-31eae9c1a5f6-manager-config\") pod \"lws-controller-manager-789c5bdf9c-dtdcs\" (UID: \"e095b85b-84bc-4e88-90f8-31eae9c1a5f6\") " pod="openshift-lws-operator/lws-controller-manager-789c5bdf9c-dtdcs"
Sep 09 06:56:33.949511 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:33.949485    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e095b85b-84bc-4e88-90f8-31eae9c1a5f6-cert\") pod \"lws-controller-manager-789c5bdf9c-dtdcs\" (UID: \"e095b85b-84bc-4e88-90f8-31eae9c1a5f6\") " pod="openshift-lws-operator/lws-controller-manager-789c5bdf9c-dtdcs"
Sep 09 06:56:33.949662 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:33.949638    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e095b85b-84bc-4e88-90f8-31eae9c1a5f6-metrics-cert\") pod \"lws-controller-manager-789c5bdf9c-dtdcs\" (UID: \"e095b85b-84bc-4e88-90f8-31eae9c1a5f6\") " pod="openshift-lws-operator/lws-controller-manager-789c5bdf9c-dtdcs"
Sep 09 06:56:33.965944 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:33.965895    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mslp\" (UniqueName: \"kubernetes.io/projected/e095b85b-84bc-4e88-90f8-31eae9c1a5f6-kube-api-access-5mslp\") pod \"lws-controller-manager-789c5bdf9c-dtdcs\" (UID: \"e095b85b-84bc-4e88-90f8-31eae9c1a5f6\") " pod="openshift-lws-operator/lws-controller-manager-789c5bdf9c-dtdcs"
Sep 09 06:56:34.043951 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:34.043889    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-789c5bdf9c-dtdcs"
Sep 09 06:56:34.324541 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:34.324434    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-789c5bdf9c-dtdcs"]
Sep 09 06:56:34.326946 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:56:34.326923    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode095b85b_84bc_4e88_90f8_31eae9c1a5f6.slice/crio-4160871babb9ea48784dd08246051bc69ed360ee16faeda2e753ae3fb0501fc0 WatchSource:0}: Error finding container 4160871babb9ea48784dd08246051bc69ed360ee16faeda2e753ae3fb0501fc0: Status 404 returned error can't find the container with id 4160871babb9ea48784dd08246051bc69ed360ee16faeda2e753ae3fb0501fc0
Sep 09 06:56:35.026716 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:35.026683    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-789c5bdf9c-dtdcs" event={"ID":"e095b85b-84bc-4e88-90f8-31eae9c1a5f6","Type":"ContainerStarted","Data":"4160871babb9ea48784dd08246051bc69ed360ee16faeda2e753ae3fb0501fc0"}
Sep 09 06:56:36.745924 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:36.745888    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c69cbcb-wgjw9"]
Sep 09 06:56:36.748920 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:36.748904    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c69cbcb-wgjw9"
Sep 09 06:56:36.754867 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:36.754842    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 09 06:56:36.755183 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:36.755037    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 09 06:56:36.755183 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:36.755147    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 09 06:56:36.755183 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:36.755161    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-q96d5\""
Sep 09 06:56:36.755425 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:36.755409    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 09 06:56:36.768139 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:36.768118    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c69cbcb-wgjw9"]
Sep 09 06:56:36.873232 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:36.873201    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ea06747b-bccf-4a47-9ef3-b6e646f2594c-manifests\") pod \"opendatahub-operator-controller-manager-7c69cbcb-wgjw9\" (UID: \"ea06747b-bccf-4a47-9ef3-b6e646f2594c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c69cbcb-wgjw9"
Sep 09 06:56:36.873350 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:36.873243    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ea06747b-bccf-4a47-9ef3-b6e646f2594c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c69cbcb-wgjw9\" (UID: \"ea06747b-bccf-4a47-9ef3-b6e646f2594c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c69cbcb-wgjw9"
Sep 09 06:56:36.873350 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:36.873310    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ea06747b-bccf-4a47-9ef3-b6e646f2594c-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c69cbcb-wgjw9\" (UID: \"ea06747b-bccf-4a47-9ef3-b6e646f2594c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c69cbcb-wgjw9"
Sep 09 06:56:36.873350 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:36.873345    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea06747b-bccf-4a47-9ef3-b6e646f2594c-tmp\") pod \"opendatahub-operator-controller-manager-7c69cbcb-wgjw9\" (UID: \"ea06747b-bccf-4a47-9ef3-b6e646f2594c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c69cbcb-wgjw9"
Sep 09 06:56:36.873490 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:36.873364    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6kdp\" (UniqueName: \"kubernetes.io/projected/ea06747b-bccf-4a47-9ef3-b6e646f2594c-kube-api-access-d6kdp\") pod \"opendatahub-operator-controller-manager-7c69cbcb-wgjw9\" (UID: \"ea06747b-bccf-4a47-9ef3-b6e646f2594c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c69cbcb-wgjw9"
Sep 09 06:56:36.974561 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:36.974526    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea06747b-bccf-4a47-9ef3-b6e646f2594c-tmp\") pod \"opendatahub-operator-controller-manager-7c69cbcb-wgjw9\" (UID: \"ea06747b-bccf-4a47-9ef3-b6e646f2594c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c69cbcb-wgjw9"
Sep 09 06:56:36.974561 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:36.974561    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6kdp\" (UniqueName: \"kubernetes.io/projected/ea06747b-bccf-4a47-9ef3-b6e646f2594c-kube-api-access-d6kdp\") pod \"opendatahub-operator-controller-manager-7c69cbcb-wgjw9\" (UID: \"ea06747b-bccf-4a47-9ef3-b6e646f2594c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c69cbcb-wgjw9"
Sep 09 06:56:36.974785 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:36.974598    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ea06747b-bccf-4a47-9ef3-b6e646f2594c-manifests\") pod \"opendatahub-operator-controller-manager-7c69cbcb-wgjw9\" (UID: \"ea06747b-bccf-4a47-9ef3-b6e646f2594c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c69cbcb-wgjw9"
Sep 09 06:56:36.974785 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:36.974642    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ea06747b-bccf-4a47-9ef3-b6e646f2594c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c69cbcb-wgjw9\" (UID: \"ea06747b-bccf-4a47-9ef3-b6e646f2594c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c69cbcb-wgjw9"
Sep 09 06:56:36.974891 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:36.974811    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ea06747b-bccf-4a47-9ef3-b6e646f2594c-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c69cbcb-wgjw9\" (UID: \"ea06747b-bccf-4a47-9ef3-b6e646f2594c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c69cbcb-wgjw9"
Sep 09 06:56:36.975059 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:36.975032    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ea06747b-bccf-4a47-9ef3-b6e646f2594c-manifests\") pod \"opendatahub-operator-controller-manager-7c69cbcb-wgjw9\" (UID: \"ea06747b-bccf-4a47-9ef3-b6e646f2594c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c69cbcb-wgjw9"
Sep 09 06:56:36.977110 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:36.977089    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea06747b-bccf-4a47-9ef3-b6e646f2594c-tmp\") pod \"opendatahub-operator-controller-manager-7c69cbcb-wgjw9\" (UID: \"ea06747b-bccf-4a47-9ef3-b6e646f2594c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c69cbcb-wgjw9"
Sep 09 06:56:36.977192 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:36.977176    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ea06747b-bccf-4a47-9ef3-b6e646f2594c-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c69cbcb-wgjw9\" (UID: \"ea06747b-bccf-4a47-9ef3-b6e646f2594c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c69cbcb-wgjw9"
Sep 09 06:56:36.977294 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:36.977278    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ea06747b-bccf-4a47-9ef3-b6e646f2594c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c69cbcb-wgjw9\" (UID: \"ea06747b-bccf-4a47-9ef3-b6e646f2594c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c69cbcb-wgjw9"
Sep 09 06:56:36.994549 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:36.994529    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6kdp\" (UniqueName: \"kubernetes.io/projected/ea06747b-bccf-4a47-9ef3-b6e646f2594c-kube-api-access-d6kdp\") pod \"opendatahub-operator-controller-manager-7c69cbcb-wgjw9\" (UID: \"ea06747b-bccf-4a47-9ef3-b6e646f2594c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c69cbcb-wgjw9"
Sep 09 06:56:37.036629 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:37.036561    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-789c5bdf9c-dtdcs" event={"ID":"e095b85b-84bc-4e88-90f8-31eae9c1a5f6","Type":"ContainerStarted","Data":"ee953499e693f250c239b00c2b7cddff3577d37ab27d9e8caec7a3ed927730fb"}
Sep 09 06:56:37.036629 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:37.036617    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-789c5bdf9c-dtdcs"
Sep 09 06:56:37.058730 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:37.058708    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c69cbcb-wgjw9"
Sep 09 06:56:37.068054 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:37.068012    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-789c5bdf9c-dtdcs" podStartSLOduration=2.353343749 podStartE2EDuration="4.067996606s" totalImagesPullingTime="1.714652857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:56:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:56:37.066463941 +0000 UTC m=+331.858273281" watchObservedRunningTime="2026-09-09 06:56:37.067996606 +0000 UTC m=+331.859805945"
Sep 09 06:56:37.345180 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:37.345111    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c69cbcb-wgjw9"]
Sep 09 06:56:37.348981 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:56:37.348955    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea06747b_bccf_4a47_9ef3_b6e646f2594c.slice/crio-2759a0bf74db03c97ffdbfd88e00d140cdddd2220096e7d5a4cb7466b43c6fbb WatchSource:0}: Error finding container 2759a0bf74db03c97ffdbfd88e00d140cdddd2220096e7d5a4cb7466b43c6fbb: Status 404 returned error can't find the container with id 2759a0bf74db03c97ffdbfd88e00d140cdddd2220096e7d5a4cb7466b43c6fbb
Sep 09 06:56:38.043281 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:38.043241    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c69cbcb-wgjw9" event={"ID":"ea06747b-bccf-4a47-9ef3-b6e646f2594c","Type":"ContainerStarted","Data":"2759a0bf74db03c97ffdbfd88e00d140cdddd2220096e7d5a4cb7466b43c6fbb"}
Sep 09 06:56:41.058162 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:41.058126    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c69cbcb-wgjw9" event={"ID":"ea06747b-bccf-4a47-9ef3-b6e646f2594c","Type":"ContainerStarted","Data":"572353f4ec954e27a8048d857bed7a158b93d0bdd862d93665be31341303f72e"}
Sep 09 06:56:42.063452 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:42.063423    2575 generic.go:356] "Generic (PLEG): container finished" podID="ea06747b-bccf-4a47-9ef3-b6e646f2594c" containerID="572353f4ec954e27a8048d857bed7a158b93d0bdd862d93665be31341303f72e" exitCode=0
Sep 09 06:56:42.063818 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:42.063512    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c69cbcb-wgjw9" event={"ID":"ea06747b-bccf-4a47-9ef3-b6e646f2594c","Type":"ContainerDied","Data":"572353f4ec954e27a8048d857bed7a158b93d0bdd862d93665be31341303f72e"}
Sep 09 06:56:44.076098 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:44.076019    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c69cbcb-wgjw9" event={"ID":"ea06747b-bccf-4a47-9ef3-b6e646f2594c","Type":"ContainerStarted","Data":"fe431b62ad5e86bf7297e52e11ebaebaa257604bb07b2374f593438bc3f7a0b1"}
Sep 09 06:56:44.076442 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:44.076155    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7c69cbcb-wgjw9"
Sep 09 06:56:44.099249 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:44.099192    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7c69cbcb-wgjw9" podStartSLOduration=3.033801636 podStartE2EDuration="8.099175993s" totalImagesPullingTime="4.035049966s" totalInitContainerRuntime="1.030324391s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:56:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:56:44.096785025 +0000 UTC m=+338.888594364" watchObservedRunningTime="2026-09-09 06:56:44.099175993 +0000 UTC m=+338.890985331"
Sep 09 06:56:48.045710 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:48.045683    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-789c5bdf9c-dtdcs"
Sep 09 06:56:55.082324 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:55.082294    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7c69cbcb-wgjw9"
Sep 09 06:56:57.144204 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:57.144115    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-56d6c696f5-plgx8"]
Sep 09 06:56:57.146285 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:57.146264    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-56d6c696f5-plgx8"
Sep 09 06:56:57.149832 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:57.149815    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 09 06:56:57.150955 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:57.150935    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-xtsdl\""
Sep 09 06:56:57.150995 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:57.150956    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 09 06:56:57.153859 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:57.153845    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 09 06:56:57.155028 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:57.155012    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 09 06:56:57.167631 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:57.167612    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-56d6c696f5-plgx8"]
Sep 09 06:56:57.240510 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:57.240488    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rt8cc\" (UniqueName: \"kubernetes.io/projected/340258b9-c06a-45e3-9ce6-216fb2128b8e-kube-api-access-rt8cc\") pod \"kube-auth-proxy-56d6c696f5-plgx8\" (UID: \"340258b9-c06a-45e3-9ce6-216fb2128b8e\") " pod="openshift-ingress/kube-auth-proxy-56d6c696f5-plgx8"
Sep 09 06:56:57.240612 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:57.240521    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/340258b9-c06a-45e3-9ce6-216fb2128b8e-tmp\") pod \"kube-auth-proxy-56d6c696f5-plgx8\" (UID: \"340258b9-c06a-45e3-9ce6-216fb2128b8e\") " pod="openshift-ingress/kube-auth-proxy-56d6c696f5-plgx8"
Sep 09 06:56:57.240612 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:57.240565    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/340258b9-c06a-45e3-9ce6-216fb2128b8e-tls-certs\") pod \"kube-auth-proxy-56d6c696f5-plgx8\" (UID: \"340258b9-c06a-45e3-9ce6-216fb2128b8e\") " pod="openshift-ingress/kube-auth-proxy-56d6c696f5-plgx8"
Sep 09 06:56:57.341504 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:57.341472    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rt8cc\" (UniqueName: \"kubernetes.io/projected/340258b9-c06a-45e3-9ce6-216fb2128b8e-kube-api-access-rt8cc\") pod \"kube-auth-proxy-56d6c696f5-plgx8\" (UID: \"340258b9-c06a-45e3-9ce6-216fb2128b8e\") " pod="openshift-ingress/kube-auth-proxy-56d6c696f5-plgx8"
Sep 09 06:56:57.341631 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:57.341518    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/340258b9-c06a-45e3-9ce6-216fb2128b8e-tmp\") pod \"kube-auth-proxy-56d6c696f5-plgx8\" (UID: \"340258b9-c06a-45e3-9ce6-216fb2128b8e\") " pod="openshift-ingress/kube-auth-proxy-56d6c696f5-plgx8"
Sep 09 06:56:57.341631 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:57.341577    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/340258b9-c06a-45e3-9ce6-216fb2128b8e-tls-certs\") pod \"kube-auth-proxy-56d6c696f5-plgx8\" (UID: \"340258b9-c06a-45e3-9ce6-216fb2128b8e\") " pod="openshift-ingress/kube-auth-proxy-56d6c696f5-plgx8"
Sep 09 06:56:57.341721 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:56:57.341676    2575 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Sep 09 06:56:57.341785 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:56:57.341774    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/340258b9-c06a-45e3-9ce6-216fb2128b8e-tls-certs podName:340258b9-c06a-45e3-9ce6-216fb2128b8e nodeName:}" failed. No retries permitted until 2026-09-09 06:56:57.841728238 +0000 UTC m=+352.633537558 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/340258b9-c06a-45e3-9ce6-216fb2128b8e-tls-certs") pod "kube-auth-proxy-56d6c696f5-plgx8" (UID: "340258b9-c06a-45e3-9ce6-216fb2128b8e") : secret "kube-auth-proxy-tls" not found
Sep 09 06:56:57.343983 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:57.343962    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/340258b9-c06a-45e3-9ce6-216fb2128b8e-tmp\") pod \"kube-auth-proxy-56d6c696f5-plgx8\" (UID: \"340258b9-c06a-45e3-9ce6-216fb2128b8e\") " pod="openshift-ingress/kube-auth-proxy-56d6c696f5-plgx8"
Sep 09 06:56:57.356465 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:57.356438    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rt8cc\" (UniqueName: \"kubernetes.io/projected/340258b9-c06a-45e3-9ce6-216fb2128b8e-kube-api-access-rt8cc\") pod \"kube-auth-proxy-56d6c696f5-plgx8\" (UID: \"340258b9-c06a-45e3-9ce6-216fb2128b8e\") " pod="openshift-ingress/kube-auth-proxy-56d6c696f5-plgx8"
Sep 09 06:56:57.843909 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:57.843882    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/340258b9-c06a-45e3-9ce6-216fb2128b8e-tls-certs\") pod \"kube-auth-proxy-56d6c696f5-plgx8\" (UID: \"340258b9-c06a-45e3-9ce6-216fb2128b8e\") " pod="openshift-ingress/kube-auth-proxy-56d6c696f5-plgx8"
Sep 09 06:56:57.846428 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:57.846407    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/340258b9-c06a-45e3-9ce6-216fb2128b8e-tls-certs\") pod \"kube-auth-proxy-56d6c696f5-plgx8\" (UID: \"340258b9-c06a-45e3-9ce6-216fb2128b8e\") " pod="openshift-ingress/kube-auth-proxy-56d6c696f5-plgx8"
Sep 09 06:56:58.055666 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:58.055634    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-56d6c696f5-plgx8"
Sep 09 06:56:58.340655 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:58.340628    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-56d6c696f5-plgx8"]
Sep 09 06:56:58.343129 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:56:58.343104    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod340258b9_c06a_45e3_9ce6_216fb2128b8e.slice/crio-b19477ed9e6b6ad8a5d52b61336984ee56e9db9075fae784873751532ff56a77 WatchSource:0}: Error finding container b19477ed9e6b6ad8a5d52b61336984ee56e9db9075fae784873751532ff56a77: Status 404 returned error can't find the container with id b19477ed9e6b6ad8a5d52b61336984ee56e9db9075fae784873751532ff56a77
Sep 09 06:56:59.142629 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:56:59.142592    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-56d6c696f5-plgx8" event={"ID":"340258b9-c06a-45e3-9ce6-216fb2128b8e","Type":"ContainerStarted","Data":"b19477ed9e6b6ad8a5d52b61336984ee56e9db9075fae784873751532ff56a77"}
Sep 09 06:57:01.152356 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:57:01.152324    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-56d6c696f5-plgx8" event={"ID":"340258b9-c06a-45e3-9ce6-216fb2128b8e","Type":"ContainerStarted","Data":"45046fe18efd8fc38c525b6371ece7f577cc1d5b5b3cd25050f38e6ea9bdbb60"}
Sep 09 06:57:01.172951 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:57:01.172896    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-56d6c696f5-plgx8" podStartSLOduration=1.424668825 podStartE2EDuration="4.172881682s" totalImagesPullingTime="2.748212857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:56:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:57:01.171721267 +0000 UTC m=+355.963530629" watchObservedRunningTime="2026-09-09 06:57:01.172881682 +0000 UTC m=+355.964691020"
Sep 09 06:58:36.590981 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:36.590910    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xmb9f"]
Sep 09 06:58:36.593185 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:36.593168    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xmb9f"
Sep 09 06:58:36.596402 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:36.596385    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 09 06:58:36.596402 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:36.596397    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-gfwrd\""
Sep 09 06:58:36.596552 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:36.596414    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 09 06:58:36.609702 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:36.609679    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xmb9f"]
Sep 09 06:58:36.726737 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:36.726709    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsk8z\" (UniqueName: \"kubernetes.io/projected/5cce1d03-f4c2-4a28-97f3-858dbb541130-kube-api-access-fsk8z\") pod \"kuadrant-operator-controller-manager-76f8f686bf-xmb9f\" (UID: \"5cce1d03-f4c2-4a28-97f3-858dbb541130\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xmb9f"
Sep 09 06:58:36.726908 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:36.726762    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5cce1d03-f4c2-4a28-97f3-858dbb541130-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-xmb9f\" (UID: \"5cce1d03-f4c2-4a28-97f3-858dbb541130\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xmb9f"
Sep 09 06:58:36.827579 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:36.827544    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsk8z\" (UniqueName: \"kubernetes.io/projected/5cce1d03-f4c2-4a28-97f3-858dbb541130-kube-api-access-fsk8z\") pod \"kuadrant-operator-controller-manager-76f8f686bf-xmb9f\" (UID: \"5cce1d03-f4c2-4a28-97f3-858dbb541130\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xmb9f"
Sep 09 06:58:36.827811 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:36.827608    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5cce1d03-f4c2-4a28-97f3-858dbb541130-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-xmb9f\" (UID: \"5cce1d03-f4c2-4a28-97f3-858dbb541130\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xmb9f"
Sep 09 06:58:36.828069 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:36.828046    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5cce1d03-f4c2-4a28-97f3-858dbb541130-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-xmb9f\" (UID: \"5cce1d03-f4c2-4a28-97f3-858dbb541130\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xmb9f"
Sep 09 06:58:36.838150 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:36.838129    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsk8z\" (UniqueName: \"kubernetes.io/projected/5cce1d03-f4c2-4a28-97f3-858dbb541130-kube-api-access-fsk8z\") pod \"kuadrant-operator-controller-manager-76f8f686bf-xmb9f\" (UID: \"5cce1d03-f4c2-4a28-97f3-858dbb541130\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xmb9f"
Sep 09 06:58:36.902983 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:36.902954    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xmb9f"
Sep 09 06:58:37.177648 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:37.177620    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xmb9f"]
Sep 09 06:58:37.179799 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:58:37.179771    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cce1d03_f4c2_4a28_97f3_858dbb541130.slice/crio-5ccea3da7c56a771a600afc33bd3a67c8855b7ef0ca2cbb323f033fa472f5a4e WatchSource:0}: Error finding container 5ccea3da7c56a771a600afc33bd3a67c8855b7ef0ca2cbb323f033fa472f5a4e: Status 404 returned error can't find the container with id 5ccea3da7c56a771a600afc33bd3a67c8855b7ef0ca2cbb323f033fa472f5a4e
Sep 09 06:58:37.560431 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:37.560354    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xmb9f" event={"ID":"5cce1d03-f4c2-4a28-97f3-858dbb541130","Type":"ContainerStarted","Data":"5ccea3da7c56a771a600afc33bd3a67c8855b7ef0ca2cbb323f033fa472f5a4e"}
Sep 09 06:58:41.583088 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:41.583057    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xmb9f" event={"ID":"5cce1d03-f4c2-4a28-97f3-858dbb541130","Type":"ContainerStarted","Data":"1c8640b01605f53b91fe74d538076c8969a4ac7d3b5ec7b9aab4cc23382b9e41"}
Sep 09 06:58:41.583552 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:41.583189    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xmb9f"
Sep 09 06:58:41.605878 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:41.605601    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xmb9f" podStartSLOduration=1.729612168 podStartE2EDuration="5.605583577s" totalImagesPullingTime="3.875971409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:58:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:58:41.603853171 +0000 UTC m=+456.395662520" watchObservedRunningTime="2026-09-09 06:58:41.605583577 +0000 UTC m=+456.397392917"
Sep 09 06:58:52.590362 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:52.590332    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xmb9f"
Sep 09 06:58:54.781499 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:54.781468    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xmb9f"]
Sep 09 06:58:54.781898 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:54.781637    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xmb9f" podUID="5cce1d03-f4c2-4a28-97f3-858dbb541130" containerName="manager" containerID="cri-o://1c8640b01605f53b91fe74d538076c8969a4ac7d3b5ec7b9aab4cc23382b9e41" gracePeriod=2
Sep 09 06:58:54.799420 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:54.799394    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xmb9f"]
Sep 09 06:58:54.812564 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:58:54.812494    2575 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"5cce1d03-f4c2-4a28-97f3-858dbb541130\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-xmb9f\": pods \"kuadrant-operator-controller-manager-76f8f686bf-xmb9f\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xmb9f"
Sep 09 06:58:54.830728 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:54.830707    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fwj6b"]
Sep 09 06:58:54.831071 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:54.831059    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cce1d03-f4c2-4a28-97f3-858dbb541130" containerName="manager"
Sep 09 06:58:54.831118 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:54.831076    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cce1d03-f4c2-4a28-97f3-858dbb541130" containerName="manager"
Sep 09 06:58:54.831175 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:54.831161    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cce1d03-f4c2-4a28-97f3-858dbb541130" containerName="manager"
Sep 09 06:58:54.834865 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:54.834848    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fwj6b"
Sep 09 06:58:54.866773 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:54.862263    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fwj6b"]
Sep 09 06:58:54.894087 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:58:54.894047    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-xmb9f\" is forbidden: User \"system:node:ip-10-0-132-176.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-176.ec2.internal' and this object" podUID="5cce1d03-f4c2-4a28-97f3-858dbb541130" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xmb9f"
Sep 09 06:58:54.979290 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:54.979261    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx8sm\" (UniqueName: \"kubernetes.io/projected/06e4620d-9ed9-44cc-8518-ab59d454674f-kube-api-access-zx8sm\") pod \"kuadrant-operator-controller-manager-76f8f686bf-fwj6b\" (UID: \"06e4620d-9ed9-44cc-8518-ab59d454674f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fwj6b"
Sep 09 06:58:54.979479 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:54.979310    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/06e4620d-9ed9-44cc-8518-ab59d454674f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-fwj6b\" (UID: \"06e4620d-9ed9-44cc-8518-ab59d454674f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fwj6b"
Sep 09 06:58:55.012128 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:55.012110    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xmb9f"
Sep 09 06:58:55.015068 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:58:55.015047    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-xmb9f\" is forbidden: User \"system:node:ip-10-0-132-176.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-176.ec2.internal' and this object" podUID="5cce1d03-f4c2-4a28-97f3-858dbb541130" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xmb9f"
Sep 09 06:58:55.080841 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:55.080735    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zx8sm\" (UniqueName: \"kubernetes.io/projected/06e4620d-9ed9-44cc-8518-ab59d454674f-kube-api-access-zx8sm\") pod \"kuadrant-operator-controller-manager-76f8f686bf-fwj6b\" (UID: \"06e4620d-9ed9-44cc-8518-ab59d454674f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fwj6b"
Sep 09 06:58:55.080841 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:55.080817    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/06e4620d-9ed9-44cc-8518-ab59d454674f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-fwj6b\" (UID: \"06e4620d-9ed9-44cc-8518-ab59d454674f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fwj6b"
Sep 09 06:58:55.081175 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:55.081159    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/06e4620d-9ed9-44cc-8518-ab59d454674f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-fwj6b\" (UID: \"06e4620d-9ed9-44cc-8518-ab59d454674f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fwj6b"
Sep 09 06:58:55.096512 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:55.096480    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx8sm\" (UniqueName: \"kubernetes.io/projected/06e4620d-9ed9-44cc-8518-ab59d454674f-kube-api-access-zx8sm\") pod \"kuadrant-operator-controller-manager-76f8f686bf-fwj6b\" (UID: \"06e4620d-9ed9-44cc-8518-ab59d454674f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fwj6b"
Sep 09 06:58:55.178955 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:55.178931    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fwj6b"
Sep 09 06:58:55.181124 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:55.181108    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fsk8z\" (UniqueName: \"kubernetes.io/projected/5cce1d03-f4c2-4a28-97f3-858dbb541130-kube-api-access-fsk8z\") pod \"5cce1d03-f4c2-4a28-97f3-858dbb541130\" (UID: \"5cce1d03-f4c2-4a28-97f3-858dbb541130\") "
Sep 09 06:58:55.181184 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:55.181149    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5cce1d03-f4c2-4a28-97f3-858dbb541130-extensions-socket-volume\") pod \"5cce1d03-f4c2-4a28-97f3-858dbb541130\" (UID: \"5cce1d03-f4c2-4a28-97f3-858dbb541130\") "
Sep 09 06:58:55.181655 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:55.181633    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cce1d03-f4c2-4a28-97f3-858dbb541130-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5cce1d03-f4c2-4a28-97f3-858dbb541130" (UID: "5cce1d03-f4c2-4a28-97f3-858dbb541130"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:58:55.183333 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:55.183306    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cce1d03-f4c2-4a28-97f3-858dbb541130-kube-api-access-fsk8z" (OuterVolumeSpecName: "kube-api-access-fsk8z") pod "5cce1d03-f4c2-4a28-97f3-858dbb541130" (UID: "5cce1d03-f4c2-4a28-97f3-858dbb541130"). InnerVolumeSpecName "kube-api-access-fsk8z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:58:55.282106 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:55.282080    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fsk8z\" (UniqueName: \"kubernetes.io/projected/5cce1d03-f4c2-4a28-97f3-858dbb541130-kube-api-access-fsk8z\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 06:58:55.282106 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:55.282104    2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5cce1d03-f4c2-4a28-97f3-858dbb541130-extensions-socket-volume\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 06:58:55.459149 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:55.459118    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fwj6b"]
Sep 09 06:58:55.462664 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:58:55.462634    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06e4620d_9ed9_44cc_8518_ab59d454674f.slice/crio-0063e13496e72f1cf8b141e8369a43b4d027a8f59f86cbd212c3d43845ff55bb WatchSource:0}: Error finding container 0063e13496e72f1cf8b141e8369a43b4d027a8f59f86cbd212c3d43845ff55bb: Status 404 returned error can't find the container with id 0063e13496e72f1cf8b141e8369a43b4d027a8f59f86cbd212c3d43845ff55bb
Sep 09 06:58:55.647578 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:55.647543    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fwj6b" event={"ID":"06e4620d-9ed9-44cc-8518-ab59d454674f","Type":"ContainerStarted","Data":"3fc5d953515d30e3fb7ea9ff8187c506c0afe1bfa4c13d37d20870abcdc27ecb"}
Sep 09 06:58:55.647781 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:55.647606    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fwj6b" event={"ID":"06e4620d-9ed9-44cc-8518-ab59d454674f","Type":"ContainerStarted","Data":"0063e13496e72f1cf8b141e8369a43b4d027a8f59f86cbd212c3d43845ff55bb"}
Sep 09 06:58:55.647781 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:55.647634    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fwj6b"
Sep 09 06:58:55.648925 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:55.648902    2575 generic.go:356] "Generic (PLEG): container finished" podID="5cce1d03-f4c2-4a28-97f3-858dbb541130" containerID="1c8640b01605f53b91fe74d538076c8969a4ac7d3b5ec7b9aab4cc23382b9e41" exitCode=0
Sep 09 06:58:55.649028 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:55.648942    2575 scope.go:117] "RemoveContainer" containerID="1c8640b01605f53b91fe74d538076c8969a4ac7d3b5ec7b9aab4cc23382b9e41"
Sep 09 06:58:55.649028 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:55.648942    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xmb9f"
Sep 09 06:58:55.658064 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:55.658048    2575 scope.go:117] "RemoveContainer" containerID="1c8640b01605f53b91fe74d538076c8969a4ac7d3b5ec7b9aab4cc23382b9e41"
Sep 09 06:58:55.658342 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:58:55.658327    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c8640b01605f53b91fe74d538076c8969a4ac7d3b5ec7b9aab4cc23382b9e41\": container with ID starting with 1c8640b01605f53b91fe74d538076c8969a4ac7d3b5ec7b9aab4cc23382b9e41 not found: ID does not exist" containerID="1c8640b01605f53b91fe74d538076c8969a4ac7d3b5ec7b9aab4cc23382b9e41"
Sep 09 06:58:55.658376 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:55.658352    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c8640b01605f53b91fe74d538076c8969a4ac7d3b5ec7b9aab4cc23382b9e41"} err="failed to get container status \"1c8640b01605f53b91fe74d538076c8969a4ac7d3b5ec7b9aab4cc23382b9e41\": rpc error: code = NotFound desc = could not find container \"1c8640b01605f53b91fe74d538076c8969a4ac7d3b5ec7b9aab4cc23382b9e41\": container with ID starting with 1c8640b01605f53b91fe74d538076c8969a4ac7d3b5ec7b9aab4cc23382b9e41 not found: ID does not exist"
Sep 09 06:58:55.673933 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:55.673888    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fwj6b" podStartSLOduration=1.673875867 podStartE2EDuration="1.673875867s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:58:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:58:55.67244045 +0000 UTC m=+470.464249790" watchObservedRunningTime="2026-09-09 06:58:55.673875867 +0000 UTC m=+470.465685202"
Sep 09 06:58:55.675077 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:58:55.675054    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-xmb9f\" is forbidden: User \"system:node:ip-10-0-132-176.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-176.ec2.internal' and this object" podUID="5cce1d03-f4c2-4a28-97f3-858dbb541130" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xmb9f"
Sep 09 06:58:55.677066 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:58:55.677044    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-xmb9f\" is forbidden: User \"system:node:ip-10-0-132-176.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-176.ec2.internal' and this object" podUID="5cce1d03-f4c2-4a28-97f3-858dbb541130" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xmb9f"
Sep 09 06:58:55.709886 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:58:55.709823    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-xmb9f\" is forbidden: User \"system:node:ip-10-0-132-176.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-176.ec2.internal' and this object" podUID="5cce1d03-f4c2-4a28-97f3-858dbb541130" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xmb9f"
Sep 09 06:58:55.711689 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:58:55.711671    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cce1d03-f4c2-4a28-97f3-858dbb541130" path="/var/lib/kubelet/pods/5cce1d03-f4c2-4a28-97f3-858dbb541130/volumes"
Sep 09 06:59:06.656664 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:06.656634    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fwj6b"
Sep 09 06:59:10.337523 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:10.337491    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fwj6b"]
Sep 09 06:59:10.338013 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:10.337724    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fwj6b" podUID="06e4620d-9ed9-44cc-8518-ab59d454674f" containerName="manager" containerID="cri-o://3fc5d953515d30e3fb7ea9ff8187c506c0afe1bfa4c13d37d20870abcdc27ecb" gracePeriod=10
Sep 09 06:59:10.568666 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:10.568645    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fwj6b"
Sep 09 06:59:10.606974 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:10.606922    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zx8sm\" (UniqueName: \"kubernetes.io/projected/06e4620d-9ed9-44cc-8518-ab59d454674f-kube-api-access-zx8sm\") pod \"06e4620d-9ed9-44cc-8518-ab59d454674f\" (UID: \"06e4620d-9ed9-44cc-8518-ab59d454674f\") "
Sep 09 06:59:10.606974 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:10.606965    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/06e4620d-9ed9-44cc-8518-ab59d454674f-extensions-socket-volume\") pod \"06e4620d-9ed9-44cc-8518-ab59d454674f\" (UID: \"06e4620d-9ed9-44cc-8518-ab59d454674f\") "
Sep 09 06:59:10.607498 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:10.607463    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06e4620d-9ed9-44cc-8518-ab59d454674f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "06e4620d-9ed9-44cc-8518-ab59d454674f" (UID: "06e4620d-9ed9-44cc-8518-ab59d454674f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:59:10.609224 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:10.609201    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06e4620d-9ed9-44cc-8518-ab59d454674f-kube-api-access-zx8sm" (OuterVolumeSpecName: "kube-api-access-zx8sm") pod "06e4620d-9ed9-44cc-8518-ab59d454674f" (UID: "06e4620d-9ed9-44cc-8518-ab59d454674f"). InnerVolumeSpecName "kube-api-access-zx8sm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:59:10.655780 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:10.655740    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5k2lr"]
Sep 09 06:59:10.656100 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:10.656088    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06e4620d-9ed9-44cc-8518-ab59d454674f" containerName="manager"
Sep 09 06:59:10.656141 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:10.656102    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="06e4620d-9ed9-44cc-8518-ab59d454674f" containerName="manager"
Sep 09 06:59:10.656174 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:10.656165    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="06e4620d-9ed9-44cc-8518-ab59d454674f" containerName="manager"
Sep 09 06:59:10.659135 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:10.659121    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5k2lr"
Sep 09 06:59:10.673321 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:10.673300    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5k2lr"]
Sep 09 06:59:10.707902 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:10.707877    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e09f7636-8d96-43de-9632-9433bf590c77-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-5k2lr\" (UID: \"e09f7636-8d96-43de-9632-9433bf590c77\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5k2lr"
Sep 09 06:59:10.707985 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:10.707910    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x72lx\" (UniqueName: \"kubernetes.io/projected/e09f7636-8d96-43de-9632-9433bf590c77-kube-api-access-x72lx\") pod \"kuadrant-operator-controller-manager-5769f99d9f-5k2lr\" (UID: \"e09f7636-8d96-43de-9632-9433bf590c77\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5k2lr"
Sep 09 06:59:10.708025 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:10.708009    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zx8sm\" (UniqueName: \"kubernetes.io/projected/06e4620d-9ed9-44cc-8518-ab59d454674f-kube-api-access-zx8sm\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 06:59:10.708059 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:10.708026    2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/06e4620d-9ed9-44cc-8518-ab59d454674f-extensions-socket-volume\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 06:59:10.714567 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:10.714546    2575 generic.go:356] "Generic (PLEG): container finished" podID="06e4620d-9ed9-44cc-8518-ab59d454674f" containerID="3fc5d953515d30e3fb7ea9ff8187c506c0afe1bfa4c13d37d20870abcdc27ecb" exitCode=0
Sep 09 06:59:10.714666 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:10.714573    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fwj6b" event={"ID":"06e4620d-9ed9-44cc-8518-ab59d454674f","Type":"ContainerDied","Data":"3fc5d953515d30e3fb7ea9ff8187c506c0afe1bfa4c13d37d20870abcdc27ecb"}
Sep 09 06:59:10.714666 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:10.714589    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fwj6b"
Sep 09 06:59:10.714666 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:10.714633    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fwj6b" event={"ID":"06e4620d-9ed9-44cc-8518-ab59d454674f","Type":"ContainerDied","Data":"0063e13496e72f1cf8b141e8369a43b4d027a8f59f86cbd212c3d43845ff55bb"}
Sep 09 06:59:10.714666 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:10.714666    2575 scope.go:117] "RemoveContainer" containerID="3fc5d953515d30e3fb7ea9ff8187c506c0afe1bfa4c13d37d20870abcdc27ecb"
Sep 09 06:59:10.723074 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:10.723057    2575 scope.go:117] "RemoveContainer" containerID="3fc5d953515d30e3fb7ea9ff8187c506c0afe1bfa4c13d37d20870abcdc27ecb"
Sep 09 06:59:10.723341 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:59:10.723324    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fc5d953515d30e3fb7ea9ff8187c506c0afe1bfa4c13d37d20870abcdc27ecb\": container with ID starting with 3fc5d953515d30e3fb7ea9ff8187c506c0afe1bfa4c13d37d20870abcdc27ecb not found: ID does not exist" containerID="3fc5d953515d30e3fb7ea9ff8187c506c0afe1bfa4c13d37d20870abcdc27ecb"
Sep 09 06:59:10.723416 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:10.723356    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fc5d953515d30e3fb7ea9ff8187c506c0afe1bfa4c13d37d20870abcdc27ecb"} err="failed to get container status \"3fc5d953515d30e3fb7ea9ff8187c506c0afe1bfa4c13d37d20870abcdc27ecb\": rpc error: code = NotFound desc = could not find container \"3fc5d953515d30e3fb7ea9ff8187c506c0afe1bfa4c13d37d20870abcdc27ecb\": container with ID starting with 3fc5d953515d30e3fb7ea9ff8187c506c0afe1bfa4c13d37d20870abcdc27ecb not found: ID does not exist"
Sep 09 06:59:10.740314 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:10.740294    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fwj6b"]
Sep 09 06:59:10.745820 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:10.745800    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fwj6b"]
Sep 09 06:59:10.808929 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:10.808908    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x72lx\" (UniqueName: \"kubernetes.io/projected/e09f7636-8d96-43de-9632-9433bf590c77-kube-api-access-x72lx\") pod \"kuadrant-operator-controller-manager-5769f99d9f-5k2lr\" (UID: \"e09f7636-8d96-43de-9632-9433bf590c77\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5k2lr"
Sep 09 06:59:10.808999 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:10.808988    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e09f7636-8d96-43de-9632-9433bf590c77-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-5k2lr\" (UID: \"e09f7636-8d96-43de-9632-9433bf590c77\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5k2lr"
Sep 09 06:59:10.809266 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:10.809251    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e09f7636-8d96-43de-9632-9433bf590c77-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-5k2lr\" (UID: \"e09f7636-8d96-43de-9632-9433bf590c77\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5k2lr"
Sep 09 06:59:10.818643 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:10.818620    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x72lx\" (UniqueName: \"kubernetes.io/projected/e09f7636-8d96-43de-9632-9433bf590c77-kube-api-access-x72lx\") pod \"kuadrant-operator-controller-manager-5769f99d9f-5k2lr\" (UID: \"e09f7636-8d96-43de-9632-9433bf590c77\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5k2lr"
Sep 09 06:59:10.967991 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:10.967969    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5k2lr"
Sep 09 06:59:11.245431 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:11.245410    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5k2lr"]
Sep 09 06:59:11.248130 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:59:11.248101    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode09f7636_8d96_43de_9632_9433bf590c77.slice/crio-8faa0fdfb0bc0b418f16d3386b60696324493096d5912d9abdcb17bd3928caac WatchSource:0}: Error finding container 8faa0fdfb0bc0b418f16d3386b60696324493096d5912d9abdcb17bd3928caac: Status 404 returned error can't find the container with id 8faa0fdfb0bc0b418f16d3386b60696324493096d5912d9abdcb17bd3928caac
Sep 09 06:59:11.716301 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:11.715375    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06e4620d-9ed9-44cc-8518-ab59d454674f" path="/var/lib/kubelet/pods/06e4620d-9ed9-44cc-8518-ab59d454674f/volumes"
Sep 09 06:59:11.721326 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:11.721278    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5k2lr" event={"ID":"e09f7636-8d96-43de-9632-9433bf590c77","Type":"ContainerStarted","Data":"4e5fc00c1b6041422167cd8d8548b50f2d0e84cba6f55716cade1ab641bec98b"}
Sep 09 06:59:11.721475 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:11.721342    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5k2lr"
Sep 09 06:59:11.721475 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:11.721359    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5k2lr" event={"ID":"e09f7636-8d96-43de-9632-9433bf590c77","Type":"ContainerStarted","Data":"8faa0fdfb0bc0b418f16d3386b60696324493096d5912d9abdcb17bd3928caac"}
Sep 09 06:59:11.746811 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:11.746770    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5k2lr" podStartSLOduration=1.7467403209999999 podStartE2EDuration="1.746740321s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:59:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:59:11.744165799 +0000 UTC m=+486.535975164" watchObservedRunningTime="2026-09-09 06:59:11.746740321 +0000 UTC m=+486.538549659"
Sep 09 06:59:22.729016 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:22.728984    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5k2lr"
Sep 09 06:59:42.050411 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:42.050375    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-sqzlr"]
Sep 09 06:59:42.053673 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:42.053651    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-sqzlr"
Sep 09 06:59:42.056284 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:42.056260    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-qlpbv\""
Sep 09 06:59:42.062701 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:42.062681    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-sqzlr"]
Sep 09 06:59:42.153212 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:42.153179    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9997d\" (UniqueName: \"kubernetes.io/projected/b7b67603-10de-4df3-b8ff-2a25c5f4e456-kube-api-access-9997d\") pod \"authorino-7bcfd8f9cd-sqzlr\" (UID: \"b7b67603-10de-4df3-b8ff-2a25c5f4e456\") " pod="kuadrant-system/authorino-7bcfd8f9cd-sqzlr"
Sep 09 06:59:42.168679 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:42.168654    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-npdmf"]
Sep 09 06:59:42.172073 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:42.172056    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-npdmf"
Sep 09 06:59:42.179724 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:42.179699    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-npdmf"]
Sep 09 06:59:42.253910 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:42.253889    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9997d\" (UniqueName: \"kubernetes.io/projected/b7b67603-10de-4df3-b8ff-2a25c5f4e456-kube-api-access-9997d\") pod \"authorino-7bcfd8f9cd-sqzlr\" (UID: \"b7b67603-10de-4df3-b8ff-2a25c5f4e456\") " pod="kuadrant-system/authorino-7bcfd8f9cd-sqzlr"
Sep 09 06:59:42.254011 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:42.253949    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl9sl\" (UniqueName: \"kubernetes.io/projected/6cb7b083-f693-4a2d-9cb4-58dc4b158f8b-kube-api-access-zl9sl\") pod \"authorino-59c974bd48-npdmf\" (UID: \"6cb7b083-f693-4a2d-9cb4-58dc4b158f8b\") " pod="kuadrant-system/authorino-59c974bd48-npdmf"
Sep 09 06:59:42.262480 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:42.262458    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9997d\" (UniqueName: \"kubernetes.io/projected/b7b67603-10de-4df3-b8ff-2a25c5f4e456-kube-api-access-9997d\") pod \"authorino-7bcfd8f9cd-sqzlr\" (UID: \"b7b67603-10de-4df3-b8ff-2a25c5f4e456\") " pod="kuadrant-system/authorino-7bcfd8f9cd-sqzlr"
Sep 09 06:59:42.354628 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:42.354571    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl9sl\" (UniqueName: \"kubernetes.io/projected/6cb7b083-f693-4a2d-9cb4-58dc4b158f8b-kube-api-access-zl9sl\") pod \"authorino-59c974bd48-npdmf\" (UID: \"6cb7b083-f693-4a2d-9cb4-58dc4b158f8b\") " pod="kuadrant-system/authorino-59c974bd48-npdmf"
Sep 09 06:59:42.363072 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:42.363055    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-sqzlr"
Sep 09 06:59:42.364225 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:42.364208    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl9sl\" (UniqueName: \"kubernetes.io/projected/6cb7b083-f693-4a2d-9cb4-58dc4b158f8b-kube-api-access-zl9sl\") pod \"authorino-59c974bd48-npdmf\" (UID: \"6cb7b083-f693-4a2d-9cb4-58dc4b158f8b\") " pod="kuadrant-system/authorino-59c974bd48-npdmf"
Sep 09 06:59:42.481210 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:42.481184    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-npdmf"
Sep 09 06:59:42.629209 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:42.629185    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-sqzlr"]
Sep 09 06:59:42.631054 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:59:42.631032    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb7b67603_10de_4df3_b8ff_2a25c5f4e456.slice/crio-7b48e2143b2a02bbbb88c0171ef64f2c528c1ef286bee31a3c23d3406988c2c7 WatchSource:0}: Error finding container 7b48e2143b2a02bbbb88c0171ef64f2c528c1ef286bee31a3c23d3406988c2c7: Status 404 returned error can't find the container with id 7b48e2143b2a02bbbb88c0171ef64f2c528c1ef286bee31a3c23d3406988c2c7
Sep 09 06:59:42.747186 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:42.747165    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-npdmf"]
Sep 09 06:59:42.749409 ip-10-0-132-176 kubenswrapper[2575]: W0909 06:59:42.749386    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6cb7b083_f693_4a2d_9cb4_58dc4b158f8b.slice/crio-c97ce512370fae44f4c0d17290632820a953de963c878c8fe34954869a366105 WatchSource:0}: Error finding container c97ce512370fae44f4c0d17290632820a953de963c878c8fe34954869a366105: Status 404 returned error can't find the container with id c97ce512370fae44f4c0d17290632820a953de963c878c8fe34954869a366105
Sep 09 06:59:42.855497 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:42.855472    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-sqzlr" event={"ID":"b7b67603-10de-4df3-b8ff-2a25c5f4e456","Type":"ContainerStarted","Data":"7b48e2143b2a02bbbb88c0171ef64f2c528c1ef286bee31a3c23d3406988c2c7"}
Sep 09 06:59:42.856638 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:42.856615    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-npdmf" event={"ID":"6cb7b083-f693-4a2d-9cb4-58dc4b158f8b","Type":"ContainerStarted","Data":"c97ce512370fae44f4c0d17290632820a953de963c878c8fe34954869a366105"}
Sep 09 06:59:44.868938 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:44.868843    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-sqzlr" event={"ID":"b7b67603-10de-4df3-b8ff-2a25c5f4e456","Type":"ContainerStarted","Data":"f08dc7124784844d761b31a9868ae2e911212e470327f1fce3d9ee6ca37148eb"}
Sep 09 06:59:44.870487 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:44.870462    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-npdmf" event={"ID":"6cb7b083-f693-4a2d-9cb4-58dc4b158f8b","Type":"ContainerStarted","Data":"b2ceed9d865e6773291b8a09f0f940f502f7a683a17855892c758dc447d8c300"}
Sep 09 06:59:44.884387 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:44.884344    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-sqzlr" podStartSLOduration=0.906692369 podStartE2EDuration="2.884330154s" totalImagesPullingTime="1.977637785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:59:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:59:44.883158528 +0000 UTC m=+519.674967867" watchObservedRunningTime="2026-09-09 06:59:44.884330154 +0000 UTC m=+519.676139497"
Sep 09 06:59:44.898144 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:44.898099    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-npdmf" podStartSLOduration=1.02674799 podStartE2EDuration="2.898086574s" totalImagesPullingTime="1.871338584s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:59:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:59:44.897645114 +0000 UTC m=+519.689454480" watchObservedRunningTime="2026-09-09 06:59:44.898086574 +0000 UTC m=+519.689895918"
Sep 09 06:59:44.926498 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:44.926469    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-sqzlr"]
Sep 09 06:59:46.879394 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:46.879361    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-sqzlr" podUID="b7b67603-10de-4df3-b8ff-2a25c5f4e456" containerName="authorino" containerID="cri-o://f08dc7124784844d761b31a9868ae2e911212e470327f1fce3d9ee6ca37148eb" gracePeriod=30
Sep 09 06:59:47.123444 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:47.123416    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-sqzlr"
Sep 09 06:59:47.196808 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:47.196705    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9997d\" (UniqueName: \"kubernetes.io/projected/b7b67603-10de-4df3-b8ff-2a25c5f4e456-kube-api-access-9997d\") pod \"b7b67603-10de-4df3-b8ff-2a25c5f4e456\" (UID: \"b7b67603-10de-4df3-b8ff-2a25c5f4e456\") "
Sep 09 06:59:47.198850 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:47.198823    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7b67603-10de-4df3-b8ff-2a25c5f4e456-kube-api-access-9997d" (OuterVolumeSpecName: "kube-api-access-9997d") pod "b7b67603-10de-4df3-b8ff-2a25c5f4e456" (UID: "b7b67603-10de-4df3-b8ff-2a25c5f4e456"). InnerVolumeSpecName "kube-api-access-9997d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:59:47.297625 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:47.297592    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9997d\" (UniqueName: \"kubernetes.io/projected/b7b67603-10de-4df3-b8ff-2a25c5f4e456-kube-api-access-9997d\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 06:59:47.885120 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:47.885084    2575 generic.go:356] "Generic (PLEG): container finished" podID="b7b67603-10de-4df3-b8ff-2a25c5f4e456" containerID="f08dc7124784844d761b31a9868ae2e911212e470327f1fce3d9ee6ca37148eb" exitCode=0
Sep 09 06:59:47.885489 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:47.885124    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-sqzlr"
Sep 09 06:59:47.885489 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:47.885124    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-sqzlr" event={"ID":"b7b67603-10de-4df3-b8ff-2a25c5f4e456","Type":"ContainerDied","Data":"f08dc7124784844d761b31a9868ae2e911212e470327f1fce3d9ee6ca37148eb"}
Sep 09 06:59:47.885489 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:47.885245    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-sqzlr" event={"ID":"b7b67603-10de-4df3-b8ff-2a25c5f4e456","Type":"ContainerDied","Data":"7b48e2143b2a02bbbb88c0171ef64f2c528c1ef286bee31a3c23d3406988c2c7"}
Sep 09 06:59:47.885489 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:47.885266    2575 scope.go:117] "RemoveContainer" containerID="f08dc7124784844d761b31a9868ae2e911212e470327f1fce3d9ee6ca37148eb"
Sep 09 06:59:47.893346 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:47.893331    2575 scope.go:117] "RemoveContainer" containerID="f08dc7124784844d761b31a9868ae2e911212e470327f1fce3d9ee6ca37148eb"
Sep 09 06:59:47.893617 ip-10-0-132-176 kubenswrapper[2575]: E0909 06:59:47.893593    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f08dc7124784844d761b31a9868ae2e911212e470327f1fce3d9ee6ca37148eb\": container with ID starting with f08dc7124784844d761b31a9868ae2e911212e470327f1fce3d9ee6ca37148eb not found: ID does not exist" containerID="f08dc7124784844d761b31a9868ae2e911212e470327f1fce3d9ee6ca37148eb"
Sep 09 06:59:47.893706 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:47.893629    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f08dc7124784844d761b31a9868ae2e911212e470327f1fce3d9ee6ca37148eb"} err="failed to get container status \"f08dc7124784844d761b31a9868ae2e911212e470327f1fce3d9ee6ca37148eb\": rpc error: code = NotFound desc = could not find container \"f08dc7124784844d761b31a9868ae2e911212e470327f1fce3d9ee6ca37148eb\": container with ID starting with f08dc7124784844d761b31a9868ae2e911212e470327f1fce3d9ee6ca37148eb not found: ID does not exist"
Sep 09 06:59:47.900270 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:47.900233    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-sqzlr"]
Sep 09 06:59:47.901644 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:47.901625    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-sqzlr"]
Sep 09 06:59:49.710730 ip-10-0-132-176 kubenswrapper[2575]: I0909 06:59:49.710698    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7b67603-10de-4df3-b8ff-2a25c5f4e456" path="/var/lib/kubelet/pods/b7b67603-10de-4df3-b8ff-2a25c5f4e456/volumes"
Sep 09 07:00:09.158167 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:09.158132    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-xzcl4"]
Sep 09 07:00:09.158507 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:09.158432    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7b67603-10de-4df3-b8ff-2a25c5f4e456" containerName="authorino"
Sep 09 07:00:09.158507 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:09.158445    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7b67603-10de-4df3-b8ff-2a25c5f4e456" containerName="authorino"
Sep 09 07:00:09.158507 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:09.158502    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7b67603-10de-4df3-b8ff-2a25c5f4e456" containerName="authorino"
Sep 09 07:00:09.162790 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:09.162769    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-xzcl4"
Sep 09 07:00:09.168493 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:09.168468    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-xzcl4"]
Sep 09 07:00:09.261693 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:09.261661    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjw2w\" (UniqueName: \"kubernetes.io/projected/1770955e-bbb5-47e6-8436-200bf1f4192c-kube-api-access-zjw2w\") pod \"authorino-557f876f69-xzcl4\" (UID: \"1770955e-bbb5-47e6-8436-200bf1f4192c\") " pod="kuadrant-system/authorino-557f876f69-xzcl4"
Sep 09 07:00:09.343376 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:09.343342    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-xzcl4"]
Sep 09 07:00:09.343623 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:00:09.343603    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-zjw2w], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-557f876f69-xzcl4" podUID="1770955e-bbb5-47e6-8436-200bf1f4192c"
Sep 09 07:00:09.363005 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:09.362962    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjw2w\" (UniqueName: \"kubernetes.io/projected/1770955e-bbb5-47e6-8436-200bf1f4192c-kube-api-access-zjw2w\") pod \"authorino-557f876f69-xzcl4\" (UID: \"1770955e-bbb5-47e6-8436-200bf1f4192c\") " pod="kuadrant-system/authorino-557f876f69-xzcl4"
Sep 09 07:00:09.373486 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:09.373454    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-np4nf"]
Sep 09 07:00:09.378996 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:09.378974    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-np4nf"
Sep 09 07:00:09.381151 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:09.381129    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjw2w\" (UniqueName: \"kubernetes.io/projected/1770955e-bbb5-47e6-8436-200bf1f4192c-kube-api-access-zjw2w\") pod \"authorino-557f876f69-xzcl4\" (UID: \"1770955e-bbb5-47e6-8436-200bf1f4192c\") " pod="kuadrant-system/authorino-557f876f69-xzcl4"
Sep 09 07:00:09.381545 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:09.381527    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 09 07:00:09.382979 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:09.382957    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-np4nf"]
Sep 09 07:00:09.423067 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:09.423009    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-np4nf"]
Sep 09 07:00:09.423243 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:00:09.423227    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-vmf94 tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-vmf94 tls-cert]: context canceled" pod="kuadrant-system/authorino-6d4dfc649f-np4nf" podUID="d8e31172-4afe-4001-a7df-701a0af2529e"
Sep 09 07:00:09.451893 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:09.451868    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-575c469bb-f7b6v"]
Sep 09 07:00:09.455131 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:09.455115    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-575c469bb-f7b6v"
Sep 09 07:00:09.464174 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:09.464154    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmf94\" (UniqueName: \"kubernetes.io/projected/d8e31172-4afe-4001-a7df-701a0af2529e-kube-api-access-vmf94\") pod \"authorino-6d4dfc649f-np4nf\" (UID: \"d8e31172-4afe-4001-a7df-701a0af2529e\") " pod="kuadrant-system/authorino-6d4dfc649f-np4nf"
Sep 09 07:00:09.464258 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:09.464217    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmv5k\" (UniqueName: \"kubernetes.io/projected/beff59cc-b2a4-42f3-b907-47bb9f87d2a9-kube-api-access-cmv5k\") pod \"authorino-575c469bb-f7b6v\" (UID: \"beff59cc-b2a4-42f3-b907-47bb9f87d2a9\") " pod="kuadrant-system/authorino-575c469bb-f7b6v"
Sep 09 07:00:09.464258 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:09.464248    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d8e31172-4afe-4001-a7df-701a0af2529e-tls-cert\") pod \"authorino-6d4dfc649f-np4nf\" (UID: \"d8e31172-4afe-4001-a7df-701a0af2529e\") " pod="kuadrant-system/authorino-6d4dfc649f-np4nf"
Sep 09 07:00:09.464342 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:09.464264    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/beff59cc-b2a4-42f3-b907-47bb9f87d2a9-tls-cert\") pod \"authorino-575c469bb-f7b6v\" (UID: \"beff59cc-b2a4-42f3-b907-47bb9f87d2a9\") " pod="kuadrant-system/authorino-575c469bb-f7b6v"
Sep 09 07:00:09.469386 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:09.469365    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-575c469bb-f7b6v"]
Sep 09 07:00:09.565506 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:09.565480    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmv5k\" (UniqueName: \"kubernetes.io/projected/beff59cc-b2a4-42f3-b907-47bb9f87d2a9-kube-api-access-cmv5k\") pod \"authorino-575c469bb-f7b6v\" (UID: \"beff59cc-b2a4-42f3-b907-47bb9f87d2a9\") " pod="kuadrant-system/authorino-575c469bb-f7b6v"
Sep 09 07:00:09.565674 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:09.565517    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d8e31172-4afe-4001-a7df-701a0af2529e-tls-cert\") pod \"authorino-6d4dfc649f-np4nf\" (UID: \"d8e31172-4afe-4001-a7df-701a0af2529e\") " pod="kuadrant-system/authorino-6d4dfc649f-np4nf"
Sep 09 07:00:09.565674 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:09.565535    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/beff59cc-b2a4-42f3-b907-47bb9f87d2a9-tls-cert\") pod \"authorino-575c469bb-f7b6v\" (UID: \"beff59cc-b2a4-42f3-b907-47bb9f87d2a9\") " pod="kuadrant-system/authorino-575c469bb-f7b6v"
Sep 09 07:00:09.565674 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:09.565566    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmf94\" (UniqueName: \"kubernetes.io/projected/d8e31172-4afe-4001-a7df-701a0af2529e-kube-api-access-vmf94\") pod \"authorino-6d4dfc649f-np4nf\" (UID: \"d8e31172-4afe-4001-a7df-701a0af2529e\") " pod="kuadrant-system/authorino-6d4dfc649f-np4nf"
Sep 09 07:00:09.568164 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:09.568141    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d8e31172-4afe-4001-a7df-701a0af2529e-tls-cert\") pod \"authorino-6d4dfc649f-np4nf\" (UID: \"d8e31172-4afe-4001-a7df-701a0af2529e\") " pod="kuadrant-system/authorino-6d4dfc649f-np4nf"
Sep 09 07:00:09.568273 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:09.568218    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/beff59cc-b2a4-42f3-b907-47bb9f87d2a9-tls-cert\") pod \"authorino-575c469bb-f7b6v\" (UID: \"beff59cc-b2a4-42f3-b907-47bb9f87d2a9\") " pod="kuadrant-system/authorino-575c469bb-f7b6v"
Sep 09 07:00:09.573655 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:09.573631    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmf94\" (UniqueName: \"kubernetes.io/projected/d8e31172-4afe-4001-a7df-701a0af2529e-kube-api-access-vmf94\") pod \"authorino-6d4dfc649f-np4nf\" (UID: \"d8e31172-4afe-4001-a7df-701a0af2529e\") " pod="kuadrant-system/authorino-6d4dfc649f-np4nf"
Sep 09 07:00:09.573875 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:09.573859    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmv5k\" (UniqueName: \"kubernetes.io/projected/beff59cc-b2a4-42f3-b907-47bb9f87d2a9-kube-api-access-cmv5k\") pod \"authorino-575c469bb-f7b6v\" (UID: \"beff59cc-b2a4-42f3-b907-47bb9f87d2a9\") " pod="kuadrant-system/authorino-575c469bb-f7b6v"
Sep 09 07:00:09.763733 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:09.763661    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-575c469bb-f7b6v"
Sep 09 07:00:09.979148 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:09.979122    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-np4nf"
Sep 09 07:00:09.979148 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:09.979137    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-xzcl4"
Sep 09 07:00:09.986222 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:09.986205    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-np4nf"
Sep 09 07:00:09.988914 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:09.988898    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-xzcl4"
Sep 09 07:00:10.035939 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:10.035882    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-575c469bb-f7b6v"]
Sep 09 07:00:10.038412 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:00:10.038391    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbeff59cc_b2a4_42f3_b907_47bb9f87d2a9.slice/crio-4913ddfce99aafd7ad17c59b49135ddf561f06c0434839a1e6755c2185696e49 WatchSource:0}: Error finding container 4913ddfce99aafd7ad17c59b49135ddf561f06c0434839a1e6755c2185696e49: Status 404 returned error can't find the container with id 4913ddfce99aafd7ad17c59b49135ddf561f06c0434839a1e6755c2185696e49
Sep 09 07:00:10.068659 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:10.068628    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zjw2w\" (UniqueName: \"kubernetes.io/projected/1770955e-bbb5-47e6-8436-200bf1f4192c-kube-api-access-zjw2w\") pod \"1770955e-bbb5-47e6-8436-200bf1f4192c\" (UID: \"1770955e-bbb5-47e6-8436-200bf1f4192c\") "
Sep 09 07:00:10.068739 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:10.068684    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vmf94\" (UniqueName: \"kubernetes.io/projected/d8e31172-4afe-4001-a7df-701a0af2529e-kube-api-access-vmf94\") pod \"d8e31172-4afe-4001-a7df-701a0af2529e\" (UID: \"d8e31172-4afe-4001-a7df-701a0af2529e\") "
Sep 09 07:00:10.068739 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:10.068707    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d8e31172-4afe-4001-a7df-701a0af2529e-tls-cert\") pod \"d8e31172-4afe-4001-a7df-701a0af2529e\" (UID: \"d8e31172-4afe-4001-a7df-701a0af2529e\") "
Sep 09 07:00:10.070852 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:10.070829    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1770955e-bbb5-47e6-8436-200bf1f4192c-kube-api-access-zjw2w" (OuterVolumeSpecName: "kube-api-access-zjw2w") pod "1770955e-bbb5-47e6-8436-200bf1f4192c" (UID: "1770955e-bbb5-47e6-8436-200bf1f4192c"). InnerVolumeSpecName "kube-api-access-zjw2w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 07:00:10.070852 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:10.070837    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8e31172-4afe-4001-a7df-701a0af2529e-kube-api-access-vmf94" (OuterVolumeSpecName: "kube-api-access-vmf94") pod "d8e31172-4afe-4001-a7df-701a0af2529e" (UID: "d8e31172-4afe-4001-a7df-701a0af2529e"). InnerVolumeSpecName "kube-api-access-vmf94". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 07:00:10.070962 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:10.070834    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8e31172-4afe-4001-a7df-701a0af2529e-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "d8e31172-4afe-4001-a7df-701a0af2529e" (UID: "d8e31172-4afe-4001-a7df-701a0af2529e"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 07:00:10.169295 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:10.169266    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zjw2w\" (UniqueName: \"kubernetes.io/projected/1770955e-bbb5-47e6-8436-200bf1f4192c-kube-api-access-zjw2w\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:00:10.169295 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:10.169293    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmf94\" (UniqueName: \"kubernetes.io/projected/d8e31172-4afe-4001-a7df-701a0af2529e-kube-api-access-vmf94\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:00:10.169634 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:10.169302    2575 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d8e31172-4afe-4001-a7df-701a0af2529e-tls-cert\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:00:10.985569 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:10.985538    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-xzcl4"
Sep 09 07:00:10.985569 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:10.985543    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-575c469bb-f7b6v" event={"ID":"beff59cc-b2a4-42f3-b907-47bb9f87d2a9","Type":"ContainerStarted","Data":"4913ddfce99aafd7ad17c59b49135ddf561f06c0434839a1e6755c2185696e49"}
Sep 09 07:00:10.985569 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:10.985565    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-np4nf"
Sep 09 07:00:11.015847 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:11.015820    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-xzcl4"]
Sep 09 07:00:11.021697 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:11.021672    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-xzcl4"]
Sep 09 07:00:11.041974 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:11.041954    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-np4nf"]
Sep 09 07:00:11.045780 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:11.045735    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-np4nf"]
Sep 09 07:00:11.710729 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:11.710698    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1770955e-bbb5-47e6-8436-200bf1f4192c" path="/var/lib/kubelet/pods/1770955e-bbb5-47e6-8436-200bf1f4192c/volumes"
Sep 09 07:00:11.711073 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:11.710966    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8e31172-4afe-4001-a7df-701a0af2529e" path="/var/lib/kubelet/pods/d8e31172-4afe-4001-a7df-701a0af2529e/volumes"
Sep 09 07:00:11.991417 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:11.991338    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-575c469bb-f7b6v" event={"ID":"beff59cc-b2a4-42f3-b907-47bb9f87d2a9","Type":"ContainerStarted","Data":"079ce66767b6e2d50dec986bbd09170ba59e5b79e162fcb9ca8a1b5a91182727"}
Sep 09 07:00:12.008102 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:12.008061    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-575c469bb-f7b6v" podStartSLOduration=1.876944594 podStartE2EDuration="3.00804798s" totalImagesPullingTime="1.131103386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 07:00:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 07:00:12.007190882 +0000 UTC m=+546.799000234" watchObservedRunningTime="2026-09-09 07:00:12.00804798 +0000 UTC m=+546.799857318"
Sep 09 07:00:12.032066 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:12.032036    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-npdmf"]
Sep 09 07:00:12.032199 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:12.032182    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-npdmf" podUID="6cb7b083-f693-4a2d-9cb4-58dc4b158f8b" containerName="authorino" containerID="cri-o://b2ceed9d865e6773291b8a09f0f940f502f7a683a17855892c758dc447d8c300" gracePeriod=30
Sep 09 07:00:12.271875 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:12.271849    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-npdmf"
Sep 09 07:00:12.287761 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:12.287712    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zl9sl\" (UniqueName: \"kubernetes.io/projected/6cb7b083-f693-4a2d-9cb4-58dc4b158f8b-kube-api-access-zl9sl\") pod \"6cb7b083-f693-4a2d-9cb4-58dc4b158f8b\" (UID: \"6cb7b083-f693-4a2d-9cb4-58dc4b158f8b\") "
Sep 09 07:00:12.290678 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:12.290622    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cb7b083-f693-4a2d-9cb4-58dc4b158f8b-kube-api-access-zl9sl" (OuterVolumeSpecName: "kube-api-access-zl9sl") pod "6cb7b083-f693-4a2d-9cb4-58dc4b158f8b" (UID: "6cb7b083-f693-4a2d-9cb4-58dc4b158f8b"). InnerVolumeSpecName "kube-api-access-zl9sl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 07:00:12.389016 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:12.388984    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zl9sl\" (UniqueName: \"kubernetes.io/projected/6cb7b083-f693-4a2d-9cb4-58dc4b158f8b-kube-api-access-zl9sl\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:00:12.997815 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:12.997781    2575 generic.go:356] "Generic (PLEG): container finished" podID="6cb7b083-f693-4a2d-9cb4-58dc4b158f8b" containerID="b2ceed9d865e6773291b8a09f0f940f502f7a683a17855892c758dc447d8c300" exitCode=0
Sep 09 07:00:12.998319 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:12.997855    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-npdmf" event={"ID":"6cb7b083-f693-4a2d-9cb4-58dc4b158f8b","Type":"ContainerDied","Data":"b2ceed9d865e6773291b8a09f0f940f502f7a683a17855892c758dc447d8c300"}
Sep 09 07:00:12.998319 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:12.997905    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-npdmf"
Sep 09 07:00:12.998319 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:12.997906    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-npdmf" event={"ID":"6cb7b083-f693-4a2d-9cb4-58dc4b158f8b","Type":"ContainerDied","Data":"c97ce512370fae44f4c0d17290632820a953de963c878c8fe34954869a366105"}
Sep 09 07:00:12.998319 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:12.997921    2575 scope.go:117] "RemoveContainer" containerID="b2ceed9d865e6773291b8a09f0f940f502f7a683a17855892c758dc447d8c300"
Sep 09 07:00:13.006978 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:13.006959    2575 scope.go:117] "RemoveContainer" containerID="b2ceed9d865e6773291b8a09f0f940f502f7a683a17855892c758dc447d8c300"
Sep 09 07:00:13.007281 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:00:13.007252    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2ceed9d865e6773291b8a09f0f940f502f7a683a17855892c758dc447d8c300\": container with ID starting with b2ceed9d865e6773291b8a09f0f940f502f7a683a17855892c758dc447d8c300 not found: ID does not exist" containerID="b2ceed9d865e6773291b8a09f0f940f502f7a683a17855892c758dc447d8c300"
Sep 09 07:00:13.007395 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:13.007297    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2ceed9d865e6773291b8a09f0f940f502f7a683a17855892c758dc447d8c300"} err="failed to get container status \"b2ceed9d865e6773291b8a09f0f940f502f7a683a17855892c758dc447d8c300\": rpc error: code = NotFound desc = could not find container \"b2ceed9d865e6773291b8a09f0f940f502f7a683a17855892c758dc447d8c300\": container with ID starting with b2ceed9d865e6773291b8a09f0f940f502f7a683a17855892c758dc447d8c300 not found: ID does not exist"
Sep 09 07:00:13.025099 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:13.025077    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-npdmf"]
Sep 09 07:00:13.030951 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:13.030931    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-npdmf"]
Sep 09 07:00:13.711020 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:13.710989    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cb7b083-f693-4a2d-9cb4-58dc4b158f8b" path="/var/lib/kubelet/pods/6cb7b083-f693-4a2d-9cb4-58dc4b158f8b/volumes"
Sep 09 07:00:54.381333 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:54.381296    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-nwl5f"]
Sep 09 07:00:54.381768 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:54.381617    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cb7b083-f693-4a2d-9cb4-58dc4b158f8b" containerName="authorino"
Sep 09 07:00:54.381768 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:54.381628    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cb7b083-f693-4a2d-9cb4-58dc4b158f8b" containerName="authorino"
Sep 09 07:00:54.381768 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:54.381680    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cb7b083-f693-4a2d-9cb4-58dc4b158f8b" containerName="authorino"
Sep 09 07:00:54.383683 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:54.383660    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-nwl5f"
Sep 09 07:00:54.386038 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:54.386018    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 09 07:00:54.386160 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:54.386052    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-fcqs8\""
Sep 09 07:00:54.392791 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:54.392711    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-nwl5f"]
Sep 09 07:00:54.456354 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:54.456323    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8trht\" (UniqueName: \"kubernetes.io/projected/8f6df0b4-4f64-41b6-9c1b-bad76413aae3-kube-api-access-8trht\") pod \"payload-processing-5b54b7fbb7-nwl5f\" (UID: \"8f6df0b4-4f64-41b6-9c1b-bad76413aae3\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-nwl5f"
Sep 09 07:00:54.456533 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:54.456382    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f6df0b4-4f64-41b6-9c1b-bad76413aae3-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-nwl5f\" (UID: \"8f6df0b4-4f64-41b6-9c1b-bad76413aae3\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-nwl5f"
Sep 09 07:00:54.557820 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:54.557778    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8trht\" (UniqueName: \"kubernetes.io/projected/8f6df0b4-4f64-41b6-9c1b-bad76413aae3-kube-api-access-8trht\") pod \"payload-processing-5b54b7fbb7-nwl5f\" (UID: \"8f6df0b4-4f64-41b6-9c1b-bad76413aae3\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-nwl5f"
Sep 09 07:00:54.558016 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:54.557842    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f6df0b4-4f64-41b6-9c1b-bad76413aae3-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-nwl5f\" (UID: \"8f6df0b4-4f64-41b6-9c1b-bad76413aae3\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-nwl5f"
Sep 09 07:00:54.558484 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:54.558464    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f6df0b4-4f64-41b6-9c1b-bad76413aae3-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-nwl5f\" (UID: \"8f6df0b4-4f64-41b6-9c1b-bad76413aae3\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-nwl5f"
Sep 09 07:00:54.569154 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:54.569122    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8trht\" (UniqueName: \"kubernetes.io/projected/8f6df0b4-4f64-41b6-9c1b-bad76413aae3-kube-api-access-8trht\") pod \"payload-processing-5b54b7fbb7-nwl5f\" (UID: \"8f6df0b4-4f64-41b6-9c1b-bad76413aae3\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-nwl5f"
Sep 09 07:00:54.696447 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:54.696338    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-nwl5f"
Sep 09 07:00:54.975089 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:54.975062    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-nwl5f"]
Sep 09 07:00:54.977854 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:00:54.977824    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f6df0b4_4f64_41b6_9c1b_bad76413aae3.slice/crio-a77c29dae506e9570cd6afdaa73f616eed396880e396d17f2bc41a543d865bd2 WatchSource:0}: Error finding container a77c29dae506e9570cd6afdaa73f616eed396880e396d17f2bc41a543d865bd2: Status 404 returned error can't find the container with id a77c29dae506e9570cd6afdaa73f616eed396880e396d17f2bc41a543d865bd2
Sep 09 07:00:55.184066 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:55.184037    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-nwl5f" event={"ID":"8f6df0b4-4f64-41b6-9c1b-bad76413aae3","Type":"ContainerStarted","Data":"a77c29dae506e9570cd6afdaa73f616eed396880e396d17f2bc41a543d865bd2"}
Sep 09 07:00:58.202336 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:58.202301    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-nwl5f" event={"ID":"8f6df0b4-4f64-41b6-9c1b-bad76413aae3","Type":"ContainerStarted","Data":"14cc5bce4cf9aff1440b5aeb79f256c1226c1e45aa9e0945ba38c84b3f0a74a1"}
Sep 09 07:00:58.202690 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:58.202428    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-nwl5f"
Sep 09 07:00:58.221741 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:00:58.221696    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-nwl5f" podStartSLOduration=1.9516119459999999 podStartE2EDuration="4.221683681s" totalImagesPullingTime="2.270071735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 07:00:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 07:00:58.220350466 +0000 UTC m=+593.012159805" watchObservedRunningTime="2026-09-09 07:00:58.221683681 +0000 UTC m=+593.013493027"
Sep 09 07:01:09.209199 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:09.209169    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-nwl5f"
Sep 09 07:01:35.410351 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:35.410261    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ckzkb"]
Sep 09 07:01:35.418977 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:35.418950    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ckzkb"
Sep 09 07:01:35.421839 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:35.421814    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 09 07:01:35.422641 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:35.422617    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 09 07:01:35.422734 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:35.422644    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-nnc67\""
Sep 09 07:01:35.422734 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:35.422716    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 09 07:01:35.425955 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:35.425932    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ckzkb"]
Sep 09 07:01:35.591418 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:35.591379    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvbmg\" (UniqueName: \"kubernetes.io/projected/eda93acd-78d2-4a33-8b77-6e032be1f12d-kube-api-access-jvbmg\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ckzkb\" (UID: \"eda93acd-78d2-4a33-8b77-6e032be1f12d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ckzkb"
Sep 09 07:01:35.591418 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:35.591419    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eda93acd-78d2-4a33-8b77-6e032be1f12d-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ckzkb\" (UID: \"eda93acd-78d2-4a33-8b77-6e032be1f12d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ckzkb"
Sep 09 07:01:35.591624 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:35.591441    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eda93acd-78d2-4a33-8b77-6e032be1f12d-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ckzkb\" (UID: \"eda93acd-78d2-4a33-8b77-6e032be1f12d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ckzkb"
Sep 09 07:01:35.591624 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:35.591567    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eda93acd-78d2-4a33-8b77-6e032be1f12d-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ckzkb\" (UID: \"eda93acd-78d2-4a33-8b77-6e032be1f12d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ckzkb"
Sep 09 07:01:35.591624 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:35.591587    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eda93acd-78d2-4a33-8b77-6e032be1f12d-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ckzkb\" (UID: \"eda93acd-78d2-4a33-8b77-6e032be1f12d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ckzkb"
Sep 09 07:01:35.591624 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:35.591606    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eda93acd-78d2-4a33-8b77-6e032be1f12d-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ckzkb\" (UID: \"eda93acd-78d2-4a33-8b77-6e032be1f12d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ckzkb"
Sep 09 07:01:35.692083 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:35.692007    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eda93acd-78d2-4a33-8b77-6e032be1f12d-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ckzkb\" (UID: \"eda93acd-78d2-4a33-8b77-6e032be1f12d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ckzkb"
Sep 09 07:01:35.692083 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:35.692039    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eda93acd-78d2-4a33-8b77-6e032be1f12d-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ckzkb\" (UID: \"eda93acd-78d2-4a33-8b77-6e032be1f12d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ckzkb"
Sep 09 07:01:35.692083 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:35.692059    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eda93acd-78d2-4a33-8b77-6e032be1f12d-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ckzkb\" (UID: \"eda93acd-78d2-4a33-8b77-6e032be1f12d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ckzkb"
Sep 09 07:01:35.692083 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:35.692076    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvbmg\" (UniqueName: \"kubernetes.io/projected/eda93acd-78d2-4a33-8b77-6e032be1f12d-kube-api-access-jvbmg\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ckzkb\" (UID: \"eda93acd-78d2-4a33-8b77-6e032be1f12d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ckzkb"
Sep 09 07:01:35.692409 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:35.692098    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eda93acd-78d2-4a33-8b77-6e032be1f12d-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ckzkb\" (UID: \"eda93acd-78d2-4a33-8b77-6e032be1f12d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ckzkb"
Sep 09 07:01:35.692409 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:35.692119    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eda93acd-78d2-4a33-8b77-6e032be1f12d-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ckzkb\" (UID: \"eda93acd-78d2-4a33-8b77-6e032be1f12d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ckzkb"
Sep 09 07:01:35.692515 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:35.692409    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eda93acd-78d2-4a33-8b77-6e032be1f12d-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ckzkb\" (UID: \"eda93acd-78d2-4a33-8b77-6e032be1f12d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ckzkb"
Sep 09 07:01:35.692515 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:35.692473    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eda93acd-78d2-4a33-8b77-6e032be1f12d-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ckzkb\" (UID: \"eda93acd-78d2-4a33-8b77-6e032be1f12d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ckzkb"
Sep 09 07:01:35.692515 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:35.692497    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eda93acd-78d2-4a33-8b77-6e032be1f12d-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ckzkb\" (UID: \"eda93acd-78d2-4a33-8b77-6e032be1f12d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ckzkb"
Sep 09 07:01:35.694479 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:35.694450    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eda93acd-78d2-4a33-8b77-6e032be1f12d-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ckzkb\" (UID: \"eda93acd-78d2-4a33-8b77-6e032be1f12d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ckzkb"
Sep 09 07:01:35.694710 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:35.694695    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eda93acd-78d2-4a33-8b77-6e032be1f12d-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ckzkb\" (UID: \"eda93acd-78d2-4a33-8b77-6e032be1f12d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ckzkb"
Sep 09 07:01:35.700879 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:35.700859    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvbmg\" (UniqueName: \"kubernetes.io/projected/eda93acd-78d2-4a33-8b77-6e032be1f12d-kube-api-access-jvbmg\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ckzkb\" (UID: \"eda93acd-78d2-4a33-8b77-6e032be1f12d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ckzkb"
Sep 09 07:01:35.731170 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:35.731144    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ckzkb"
Sep 09 07:01:36.007295 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:36.007205    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ckzkb"]
Sep 09 07:01:36.009580 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:01:36.009551    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeda93acd_78d2_4a33_8b77_6e032be1f12d.slice/crio-975ba213b9ad772789bdb62bbafb20b2cb3e9fd4f3dfb711d1834e5f69b2b0e9 WatchSource:0}: Error finding container 975ba213b9ad772789bdb62bbafb20b2cb3e9fd4f3dfb711d1834e5f69b2b0e9: Status 404 returned error can't find the container with id 975ba213b9ad772789bdb62bbafb20b2cb3e9fd4f3dfb711d1834e5f69b2b0e9
Sep 09 07:01:36.010877 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:36.010858    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 07:01:36.372665 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:36.372629    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ckzkb" event={"ID":"eda93acd-78d2-4a33-8b77-6e032be1f12d","Type":"ContainerStarted","Data":"975ba213b9ad772789bdb62bbafb20b2cb3e9fd4f3dfb711d1834e5f69b2b0e9"}
Sep 09 07:01:37.378017 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:37.377986    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ckzkb" event={"ID":"eda93acd-78d2-4a33-8b77-6e032be1f12d","Type":"ContainerStarted","Data":"f8d7cc2df70bfbb873322f2b837fe7a3f079aadd4b92c1701571f80c598bb64d"}
Sep 09 07:01:37.395997 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:37.395947    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ckzkb" podStartSLOduration=1.321107609 podStartE2EDuration="2.395927806s" totalImagesPullingTime="1.074820197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 07:01:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 07:01:37.395433258 +0000 UTC m=+632.187242599" watchObservedRunningTime="2026-09-09 07:01:37.395927806 +0000 UTC m=+632.187737216"
Sep 09 07:01:42.228353 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:42.228321    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rpllj"]
Sep 09 07:01:42.231842 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:42.231822    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rpllj"
Sep 09 07:01:42.235369 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:42.235350    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 09 07:01:42.245017 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:42.244992    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rpllj"]
Sep 09 07:01:42.250155 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:42.250129    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe771cca-d5bd-46ac-abea-7df58d3eb669-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rpllj\" (UID: \"fe771cca-d5bd-46ac-abea-7df58d3eb669\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rpllj"
Sep 09 07:01:42.250239 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:42.250177    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9brx\" (UniqueName: \"kubernetes.io/projected/fe771cca-d5bd-46ac-abea-7df58d3eb669-kube-api-access-j9brx\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rpllj\" (UID: \"fe771cca-d5bd-46ac-abea-7df58d3eb669\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rpllj"
Sep 09 07:01:42.250239 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:42.250228    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe771cca-d5bd-46ac-abea-7df58d3eb669-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rpllj\" (UID: \"fe771cca-d5bd-46ac-abea-7df58d3eb669\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rpllj"
Sep 09 07:01:42.250324 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:42.250279    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe771cca-d5bd-46ac-abea-7df58d3eb669-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rpllj\" (UID: \"fe771cca-d5bd-46ac-abea-7df58d3eb669\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rpllj"
Sep 09 07:01:42.250324 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:42.250301    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe771cca-d5bd-46ac-abea-7df58d3eb669-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rpllj\" (UID: \"fe771cca-d5bd-46ac-abea-7df58d3eb669\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rpllj"
Sep 09 07:01:42.250405 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:42.250368    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe771cca-d5bd-46ac-abea-7df58d3eb669-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rpllj\" (UID: \"fe771cca-d5bd-46ac-abea-7df58d3eb669\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rpllj"
Sep 09 07:01:42.351089 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:42.351057    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe771cca-d5bd-46ac-abea-7df58d3eb669-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rpllj\" (UID: \"fe771cca-d5bd-46ac-abea-7df58d3eb669\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rpllj"
Sep 09 07:01:42.351089 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:42.351092    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe771cca-d5bd-46ac-abea-7df58d3eb669-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rpllj\" (UID: \"fe771cca-d5bd-46ac-abea-7df58d3eb669\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rpllj"
Sep 09 07:01:42.351332 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:42.351122    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe771cca-d5bd-46ac-abea-7df58d3eb669-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rpllj\" (UID: \"fe771cca-d5bd-46ac-abea-7df58d3eb669\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rpllj"
Sep 09 07:01:42.351332 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:42.351170    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe771cca-d5bd-46ac-abea-7df58d3eb669-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rpllj\" (UID: \"fe771cca-d5bd-46ac-abea-7df58d3eb669\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rpllj"
Sep 09 07:01:42.351332 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:42.351189    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9brx\" (UniqueName: \"kubernetes.io/projected/fe771cca-d5bd-46ac-abea-7df58d3eb669-kube-api-access-j9brx\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rpllj\" (UID: \"fe771cca-d5bd-46ac-abea-7df58d3eb669\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rpllj"
Sep 09 07:01:42.351332 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:42.351214    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe771cca-d5bd-46ac-abea-7df58d3eb669-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rpllj\" (UID: \"fe771cca-d5bd-46ac-abea-7df58d3eb669\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rpllj"
Sep 09 07:01:42.351517 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:42.351481    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe771cca-d5bd-46ac-abea-7df58d3eb669-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rpllj\" (UID: \"fe771cca-d5bd-46ac-abea-7df58d3eb669\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rpllj"
Sep 09 07:01:42.351572 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:42.351531    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe771cca-d5bd-46ac-abea-7df58d3eb669-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rpllj\" (UID: \"fe771cca-d5bd-46ac-abea-7df58d3eb669\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rpllj"
Sep 09 07:01:42.351618 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:42.351591    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe771cca-d5bd-46ac-abea-7df58d3eb669-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rpllj\" (UID: \"fe771cca-d5bd-46ac-abea-7df58d3eb669\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rpllj"
Sep 09 07:01:42.353532 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:42.353509    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe771cca-d5bd-46ac-abea-7df58d3eb669-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rpllj\" (UID: \"fe771cca-d5bd-46ac-abea-7df58d3eb669\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rpllj"
Sep 09 07:01:42.353821 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:42.353805    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe771cca-d5bd-46ac-abea-7df58d3eb669-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rpllj\" (UID: \"fe771cca-d5bd-46ac-abea-7df58d3eb669\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rpllj"
Sep 09 07:01:42.363319 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:42.363300    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9brx\" (UniqueName: \"kubernetes.io/projected/fe771cca-d5bd-46ac-abea-7df58d3eb669-kube-api-access-j9brx\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rpllj\" (UID: \"fe771cca-d5bd-46ac-abea-7df58d3eb669\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rpllj"
Sep 09 07:01:42.541616 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:42.541522    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rpllj"
Sep 09 07:01:42.813435 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:42.813410    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rpllj"]
Sep 09 07:01:42.815251 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:01:42.815201    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe771cca_d5bd_46ac_abea_7df58d3eb669.slice/crio-4240961325cb65f10d3db347ba5fffd867caf3d5d749e5176a4fad0a687bde01 WatchSource:0}: Error finding container 4240961325cb65f10d3db347ba5fffd867caf3d5d749e5176a4fad0a687bde01: Status 404 returned error can't find the container with id 4240961325cb65f10d3db347ba5fffd867caf3d5d749e5176a4fad0a687bde01
Sep 09 07:01:43.408588 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:43.408557    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rpllj" event={"ID":"fe771cca-d5bd-46ac-abea-7df58d3eb669","Type":"ContainerStarted","Data":"9c0006463c8e0d4c66c9c455797198d8eeec09ce79e40494b0a91bf75c019fae"}
Sep 09 07:01:43.409032 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:43.408614    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rpllj" event={"ID":"fe771cca-d5bd-46ac-abea-7df58d3eb669","Type":"ContainerStarted","Data":"4240961325cb65f10d3db347ba5fffd867caf3d5d749e5176a4fad0a687bde01"}
Sep 09 07:01:43.428532 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:43.428482    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rpllj" podStartSLOduration=1.2234832820000001 podStartE2EDuration="1.428463568s" totalImagesPullingTime="204.980286ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 07:01:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 07:01:43.426350814 +0000 UTC m=+638.218160157" watchObservedRunningTime="2026-09-09 07:01:43.428463568 +0000 UTC m=+638.220272909"
Sep 09 07:01:45.731769 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:45.731710    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ckzkb"
Sep 09 07:01:45.732210 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:45.731792    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ckzkb"
Sep 09 07:01:45.744173 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:45.744149    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ckzkb"
Sep 09 07:01:46.433360 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:46.433331    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ckzkb"
Sep 09 07:01:52.542126 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:52.542090    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rpllj"
Sep 09 07:01:52.542537 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:52.542158    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rpllj"
Sep 09 07:01:52.555158 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:52.555133    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rpllj"
Sep 09 07:01:53.466423 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:01:53.466393    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rpllj"
Sep 09 07:03:41.893377 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:03:41.893345    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7d897ccb4c-v7km4"]
Sep 09 07:03:41.896701 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:03:41.896685    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d897ccb4c-v7km4"
Sep 09 07:03:41.903610 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:03:41.903531    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d897ccb4c-v7km4"]
Sep 09 07:03:41.942829 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:03:41.942807    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bf200635-f995-4cf6-aeec-ddbd9913a601-tls-cert\") pod \"authorino-7d897ccb4c-v7km4\" (UID: \"bf200635-f995-4cf6-aeec-ddbd9913a601\") " pod="kuadrant-system/authorino-7d897ccb4c-v7km4"
Sep 09 07:03:41.942948 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:03:41.942839    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gt2xc\" (UniqueName: \"kubernetes.io/projected/bf200635-f995-4cf6-aeec-ddbd9913a601-kube-api-access-gt2xc\") pod \"authorino-7d897ccb4c-v7km4\" (UID: \"bf200635-f995-4cf6-aeec-ddbd9913a601\") " pod="kuadrant-system/authorino-7d897ccb4c-v7km4"
Sep 09 07:03:42.043681 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:03:42.043655    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bf200635-f995-4cf6-aeec-ddbd9913a601-tls-cert\") pod \"authorino-7d897ccb4c-v7km4\" (UID: \"bf200635-f995-4cf6-aeec-ddbd9913a601\") " pod="kuadrant-system/authorino-7d897ccb4c-v7km4"
Sep 09 07:03:42.043859 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:03:42.043697    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gt2xc\" (UniqueName: \"kubernetes.io/projected/bf200635-f995-4cf6-aeec-ddbd9913a601-kube-api-access-gt2xc\") pod \"authorino-7d897ccb4c-v7km4\" (UID: \"bf200635-f995-4cf6-aeec-ddbd9913a601\") " pod="kuadrant-system/authorino-7d897ccb4c-v7km4"
Sep 09 07:03:42.046219 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:03:42.046200    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bf200635-f995-4cf6-aeec-ddbd9913a601-tls-cert\") pod \"authorino-7d897ccb4c-v7km4\" (UID: \"bf200635-f995-4cf6-aeec-ddbd9913a601\") " pod="kuadrant-system/authorino-7d897ccb4c-v7km4"
Sep 09 07:03:42.051505 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:03:42.051486    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gt2xc\" (UniqueName: \"kubernetes.io/projected/bf200635-f995-4cf6-aeec-ddbd9913a601-kube-api-access-gt2xc\") pod \"authorino-7d897ccb4c-v7km4\" (UID: \"bf200635-f995-4cf6-aeec-ddbd9913a601\") " pod="kuadrant-system/authorino-7d897ccb4c-v7km4"
Sep 09 07:03:42.206123 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:03:42.206049    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d897ccb4c-v7km4"
Sep 09 07:03:42.474412 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:03:42.474342    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d897ccb4c-v7km4"]
Sep 09 07:03:42.478289 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:03:42.478254    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf200635_f995_4cf6_aeec_ddbd9913a601.slice/crio-b2085e78239ba6d20cc0b5aecd493a74d2cf85f375fd74d44fec8744aabd3981 WatchSource:0}: Error finding container b2085e78239ba6d20cc0b5aecd493a74d2cf85f375fd74d44fec8744aabd3981: Status 404 returned error can't find the container with id b2085e78239ba6d20cc0b5aecd493a74d2cf85f375fd74d44fec8744aabd3981
Sep 09 07:03:42.954802 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:03:42.954765    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d897ccb4c-v7km4" event={"ID":"bf200635-f995-4cf6-aeec-ddbd9913a601","Type":"ContainerStarted","Data":"b2085e78239ba6d20cc0b5aecd493a74d2cf85f375fd74d44fec8744aabd3981"}
Sep 09 07:03:43.961995 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:03:43.961957    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d897ccb4c-v7km4" event={"ID":"bf200635-f995-4cf6-aeec-ddbd9913a601","Type":"ContainerStarted","Data":"c2d57551307b1e576ffbb29e9c67f605856550497d0e956537924bfe6592a0dd"}
Sep 09 07:03:43.981148 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:03:43.981093    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7d897ccb4c-v7km4" podStartSLOduration=2.289443825 podStartE2EDuration="2.981076425s" totalImagesPullingTime="691.6326ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 07:03:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 07:03:43.979329959 +0000 UTC m=+758.771139298" watchObservedRunningTime="2026-09-09 07:03:43.981076425 +0000 UTC m=+758.772885794"
Sep 09 07:03:44.009917 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:03:44.009881    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-575c469bb-f7b6v"]
Sep 09 07:03:44.010349 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:03:44.010320    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-575c469bb-f7b6v" podUID="beff59cc-b2a4-42f3-b907-47bb9f87d2a9" containerName="authorino" containerID="cri-o://079ce66767b6e2d50dec986bbd09170ba59e5b79e162fcb9ca8a1b5a91182727" gracePeriod=30
Sep 09 07:03:44.274854 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:03:44.274829    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-575c469bb-f7b6v"
Sep 09 07:03:44.371802 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:03:44.371765    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmv5k\" (UniqueName: \"kubernetes.io/projected/beff59cc-b2a4-42f3-b907-47bb9f87d2a9-kube-api-access-cmv5k\") pod \"beff59cc-b2a4-42f3-b907-47bb9f87d2a9\" (UID: \"beff59cc-b2a4-42f3-b907-47bb9f87d2a9\") "
Sep 09 07:03:44.371962 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:03:44.371861    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/beff59cc-b2a4-42f3-b907-47bb9f87d2a9-tls-cert\") pod \"beff59cc-b2a4-42f3-b907-47bb9f87d2a9\" (UID: \"beff59cc-b2a4-42f3-b907-47bb9f87d2a9\") "
Sep 09 07:03:44.373969 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:03:44.373942    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/beff59cc-b2a4-42f3-b907-47bb9f87d2a9-kube-api-access-cmv5k" (OuterVolumeSpecName: "kube-api-access-cmv5k") pod "beff59cc-b2a4-42f3-b907-47bb9f87d2a9" (UID: "beff59cc-b2a4-42f3-b907-47bb9f87d2a9"). InnerVolumeSpecName "kube-api-access-cmv5k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 07:03:44.384204 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:03:44.384142    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/beff59cc-b2a4-42f3-b907-47bb9f87d2a9-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "beff59cc-b2a4-42f3-b907-47bb9f87d2a9" (UID: "beff59cc-b2a4-42f3-b907-47bb9f87d2a9"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 07:03:44.473476 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:03:44.473441    2575 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/beff59cc-b2a4-42f3-b907-47bb9f87d2a9-tls-cert\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:03:44.473476 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:03:44.473472    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmv5k\" (UniqueName: \"kubernetes.io/projected/beff59cc-b2a4-42f3-b907-47bb9f87d2a9-kube-api-access-cmv5k\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:03:44.968145 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:03:44.968114    2575 generic.go:356] "Generic (PLEG): container finished" podID="beff59cc-b2a4-42f3-b907-47bb9f87d2a9" containerID="079ce66767b6e2d50dec986bbd09170ba59e5b79e162fcb9ca8a1b5a91182727" exitCode=0
Sep 09 07:03:44.968547 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:03:44.968157    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-575c469bb-f7b6v"
Sep 09 07:03:44.968547 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:03:44.968206    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-575c469bb-f7b6v" event={"ID":"beff59cc-b2a4-42f3-b907-47bb9f87d2a9","Type":"ContainerDied","Data":"079ce66767b6e2d50dec986bbd09170ba59e5b79e162fcb9ca8a1b5a91182727"}
Sep 09 07:03:44.968547 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:03:44.968249    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-575c469bb-f7b6v" event={"ID":"beff59cc-b2a4-42f3-b907-47bb9f87d2a9","Type":"ContainerDied","Data":"4913ddfce99aafd7ad17c59b49135ddf561f06c0434839a1e6755c2185696e49"}
Sep 09 07:03:44.968547 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:03:44.968270    2575 scope.go:117] "RemoveContainer" containerID="079ce66767b6e2d50dec986bbd09170ba59e5b79e162fcb9ca8a1b5a91182727"
Sep 09 07:03:44.978255 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:03:44.978207    2575 scope.go:117] "RemoveContainer" containerID="079ce66767b6e2d50dec986bbd09170ba59e5b79e162fcb9ca8a1b5a91182727"
Sep 09 07:03:44.978667 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:03:44.978645    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"079ce66767b6e2d50dec986bbd09170ba59e5b79e162fcb9ca8a1b5a91182727\": container with ID starting with 079ce66767b6e2d50dec986bbd09170ba59e5b79e162fcb9ca8a1b5a91182727 not found: ID does not exist" containerID="079ce66767b6e2d50dec986bbd09170ba59e5b79e162fcb9ca8a1b5a91182727"
Sep 09 07:03:44.978789 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:03:44.978673    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"079ce66767b6e2d50dec986bbd09170ba59e5b79e162fcb9ca8a1b5a91182727"} err="failed to get container status \"079ce66767b6e2d50dec986bbd09170ba59e5b79e162fcb9ca8a1b5a91182727\": rpc error: code = NotFound desc = could not find container \"079ce66767b6e2d50dec986bbd09170ba59e5b79e162fcb9ca8a1b5a91182727\": container with ID starting with 079ce66767b6e2d50dec986bbd09170ba59e5b79e162fcb9ca8a1b5a91182727 not found: ID does not exist"
Sep 09 07:03:44.989847 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:03:44.989826    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-575c469bb-f7b6v"]
Sep 09 07:03:44.995102 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:03:44.995077    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-575c469bb-f7b6v"]
Sep 09 07:03:45.712739 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:03:45.712703    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="beff59cc-b2a4-42f3-b907-47bb9f87d2a9" path="/var/lib/kubelet/pods/beff59cc-b2a4-42f3-b907-47bb9f87d2a9/volumes"
Sep 09 07:04:09.251593 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:09.251563    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7955-140037892555952"]
Sep 09 07:04:09.252004 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:09.251936    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="beff59cc-b2a4-42f3-b907-47bb9f87d2a9" containerName="authorino"
Sep 09 07:04:09.252004 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:09.251949    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="beff59cc-b2a4-42f3-b907-47bb9f87d2a9" containerName="authorino"
Sep 09 07:04:09.252076 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:09.252011    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="beff59cc-b2a4-42f3-b907-47bb9f87d2a9" containerName="authorino"
Sep 09 07:04:09.254682 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:09.254666    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7955-140037892555952"
Sep 09 07:04:09.258171 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:09.258155    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-dw24h\""
Sep 09 07:04:09.266734 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:09.266704    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7955-140037892555952"]
Sep 09 07:04:09.287079 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:09.287059    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6d4p\" (UniqueName: \"kubernetes.io/projected/9d80b202-bd74-4dd8-8ccd-5727b8effd40-kube-api-access-t6d4p\") pod \"test-curl-7955-140037892555952\" (UID: \"9d80b202-bd74-4dd8-8ccd-5727b8effd40\") " pod="opendatahub/test-curl-7955-140037892555952"
Sep 09 07:04:09.387904 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:09.387874    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6d4p\" (UniqueName: \"kubernetes.io/projected/9d80b202-bd74-4dd8-8ccd-5727b8effd40-kube-api-access-t6d4p\") pod \"test-curl-7955-140037892555952\" (UID: \"9d80b202-bd74-4dd8-8ccd-5727b8effd40\") " pod="opendatahub/test-curl-7955-140037892555952"
Sep 09 07:04:09.396631 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:09.396611    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6d4p\" (UniqueName: \"kubernetes.io/projected/9d80b202-bd74-4dd8-8ccd-5727b8effd40-kube-api-access-t6d4p\") pod \"test-curl-7955-140037892555952\" (UID: \"9d80b202-bd74-4dd8-8ccd-5727b8effd40\") " pod="opendatahub/test-curl-7955-140037892555952"
Sep 09 07:04:09.562983 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:09.562914    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7955-140037892555952"
Sep 09 07:04:09.832010 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:09.831979    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7955-140037892555952"]
Sep 09 07:04:09.833608 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:04:09.833585    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9d80b202_bd74_4dd8_8ccd_5727b8effd40.slice/crio-ab89c2e84ae41dd0f6ea91217584e62de9222d3f508ac255d25ebe954c0612f0 WatchSource:0}: Error finding container ab89c2e84ae41dd0f6ea91217584e62de9222d3f508ac255d25ebe954c0612f0: Status 404 returned error can't find the container with id ab89c2e84ae41dd0f6ea91217584e62de9222d3f508ac255d25ebe954c0612f0
Sep 09 07:04:10.080527 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:10.080483    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7955-140037892555952" event={"ID":"9d80b202-bd74-4dd8-8ccd-5727b8effd40","Type":"ContainerStarted","Data":"ab89c2e84ae41dd0f6ea91217584e62de9222d3f508ac255d25ebe954c0612f0"}
Sep 09 07:04:12.832684 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:12.832656    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-b212cb-76d45f97f8-nt4c6"]
Sep 09 07:04:12.836450 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:12.836125    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b212cb-76d45f97f8-nt4c6"
Sep 09 07:04:12.838982 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:12.838960    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-b212cb-dockercfg-r9xhx\""
Sep 09 07:04:12.839086 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:12.838965    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-b212cb\""
Sep 09 07:04:12.848918 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:12.847215    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-b212cb-6c8b5c4477-j2xx8"]
Sep 09 07:04:12.851360 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:12.850986    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-b212cb-76d45f97f8-nt4c6"]
Sep 09 07:04:12.851360 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:12.851090    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-b212cb-6c8b5c4477-j2xx8"
Sep 09 07:04:12.861325 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:12.861306    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-b212cb-6c8b5c4477-j2xx8"]
Sep 09 07:04:12.916003 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:12.915980    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efc7282f-4ca6-4179-8a97-5cabd924a046-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-b212cb-76d45f97f8-nt4c6\" (UID: \"efc7282f-4ca6-4179-8a97-5cabd924a046\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b212cb-76d45f97f8-nt4c6"
Sep 09 07:04:12.916097 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:12.916021    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrkbb\" (UniqueName: \"kubernetes.io/projected/efc7282f-4ca6-4179-8a97-5cabd924a046-kube-api-access-qrkbb\") pod \"payload-pre-processing-e2e-inf-a-b212cb-76d45f97f8-nt4c6\" (UID: \"efc7282f-4ca6-4179-8a97-5cabd924a046\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b212cb-76d45f97f8-nt4c6"
Sep 09 07:04:12.916097 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:12.916061    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba2bd48c-7185-429a-af9c-90086df5b327-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-b212cb-6c8b5c4477-j2xx8\" (UID: \"ba2bd48c-7185-429a-af9c-90086df5b327\") " pod="openshift-ingress/payload-processing-e2e-inf-a-b212cb-6c8b5c4477-j2xx8"
Sep 09 07:04:12.916179 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:12.916096    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glzkf\" (UniqueName: \"kubernetes.io/projected/ba2bd48c-7185-429a-af9c-90086df5b327-kube-api-access-glzkf\") pod \"payload-processing-e2e-inf-a-b212cb-6c8b5c4477-j2xx8\" (UID: \"ba2bd48c-7185-429a-af9c-90086df5b327\") " pod="openshift-ingress/payload-processing-e2e-inf-a-b212cb-6c8b5c4477-j2xx8"
Sep 09 07:04:13.017252 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:13.017180    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efc7282f-4ca6-4179-8a97-5cabd924a046-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-b212cb-76d45f97f8-nt4c6\" (UID: \"efc7282f-4ca6-4179-8a97-5cabd924a046\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b212cb-76d45f97f8-nt4c6"
Sep 09 07:04:13.017252 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:13.017233    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrkbb\" (UniqueName: \"kubernetes.io/projected/efc7282f-4ca6-4179-8a97-5cabd924a046-kube-api-access-qrkbb\") pod \"payload-pre-processing-e2e-inf-a-b212cb-76d45f97f8-nt4c6\" (UID: \"efc7282f-4ca6-4179-8a97-5cabd924a046\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b212cb-76d45f97f8-nt4c6"
Sep 09 07:04:13.017430 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:13.017265    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba2bd48c-7185-429a-af9c-90086df5b327-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-b212cb-6c8b5c4477-j2xx8\" (UID: \"ba2bd48c-7185-429a-af9c-90086df5b327\") " pod="openshift-ingress/payload-processing-e2e-inf-a-b212cb-6c8b5c4477-j2xx8"
Sep 09 07:04:13.017430 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:13.017294    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glzkf\" (UniqueName: \"kubernetes.io/projected/ba2bd48c-7185-429a-af9c-90086df5b327-kube-api-access-glzkf\") pod \"payload-processing-e2e-inf-a-b212cb-6c8b5c4477-j2xx8\" (UID: \"ba2bd48c-7185-429a-af9c-90086df5b327\") " pod="openshift-ingress/payload-processing-e2e-inf-a-b212cb-6c8b5c4477-j2xx8"
Sep 09 07:04:13.018095 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:13.018073    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efc7282f-4ca6-4179-8a97-5cabd924a046-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-b212cb-76d45f97f8-nt4c6\" (UID: \"efc7282f-4ca6-4179-8a97-5cabd924a046\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b212cb-76d45f97f8-nt4c6"
Sep 09 07:04:13.018158 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:13.018073    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba2bd48c-7185-429a-af9c-90086df5b327-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-b212cb-6c8b5c4477-j2xx8\" (UID: \"ba2bd48c-7185-429a-af9c-90086df5b327\") " pod="openshift-ingress/payload-processing-e2e-inf-a-b212cb-6c8b5c4477-j2xx8"
Sep 09 07:04:13.026088 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:13.026068    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrkbb\" (UniqueName: \"kubernetes.io/projected/efc7282f-4ca6-4179-8a97-5cabd924a046-kube-api-access-qrkbb\") pod \"payload-pre-processing-e2e-inf-a-b212cb-76d45f97f8-nt4c6\" (UID: \"efc7282f-4ca6-4179-8a97-5cabd924a046\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b212cb-76d45f97f8-nt4c6"
Sep 09 07:04:13.026189 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:13.026134    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glzkf\" (UniqueName: \"kubernetes.io/projected/ba2bd48c-7185-429a-af9c-90086df5b327-kube-api-access-glzkf\") pod \"payload-processing-e2e-inf-a-b212cb-6c8b5c4477-j2xx8\" (UID: \"ba2bd48c-7185-429a-af9c-90086df5b327\") " pod="openshift-ingress/payload-processing-e2e-inf-a-b212cb-6c8b5c4477-j2xx8"
Sep 09 07:04:13.100105 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:13.100073    2575 generic.go:356] "Generic (PLEG): container finished" podID="9d80b202-bd74-4dd8-8ccd-5727b8effd40" containerID="1617ce815398b784d2e34e186ed4586c182075fb7c0f950d2c21e1d870d1ee55" exitCode=0
Sep 09 07:04:13.100240 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:13.100142    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7955-140037892555952" event={"ID":"9d80b202-bd74-4dd8-8ccd-5727b8effd40","Type":"ContainerDied","Data":"1617ce815398b784d2e34e186ed4586c182075fb7c0f950d2c21e1d870d1ee55"}
Sep 09 07:04:13.199075 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:13.199048    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b212cb-76d45f97f8-nt4c6"
Sep 09 07:04:13.204023 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:13.204008    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-b212cb-6c8b5c4477-j2xx8"
Sep 09 07:04:13.480293 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:13.480271    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-b212cb-6c8b5c4477-j2xx8"]
Sep 09 07:04:13.482647 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:04:13.482619    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba2bd48c_7185_429a_af9c_90086df5b327.slice/crio-9923bbc3ef1910b56f6ffe63c703d87748f7148a19ae6251cb38c35781e368f7 WatchSource:0}: Error finding container 9923bbc3ef1910b56f6ffe63c703d87748f7148a19ae6251cb38c35781e368f7: Status 404 returned error can't find the container with id 9923bbc3ef1910b56f6ffe63c703d87748f7148a19ae6251cb38c35781e368f7
Sep 09 07:04:13.483623 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:13.483603    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-b212cb-76d45f97f8-nt4c6"]
Sep 09 07:04:13.484989 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:04:13.484969    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefc7282f_4ca6_4179_8a97_5cabd924a046.slice/crio-460301b78d49e9d0a2ed78f1f3e201c6a561308280fa47fda3365102847cd285 WatchSource:0}: Error finding container 460301b78d49e9d0a2ed78f1f3e201c6a561308280fa47fda3365102847cd285: Status 404 returned error can't find the container with id 460301b78d49e9d0a2ed78f1f3e201c6a561308280fa47fda3365102847cd285
Sep 09 07:04:14.107204 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:14.107165    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b212cb-76d45f97f8-nt4c6" event={"ID":"efc7282f-4ca6-4179-8a97-5cabd924a046","Type":"ContainerStarted","Data":"c9ed64edd7ea1f61c635bcca388c535f3e5b7879877ca880f6ec431953029447"}
Sep 09 07:04:14.107662 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:14.107232    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b212cb-76d45f97f8-nt4c6" event={"ID":"efc7282f-4ca6-4179-8a97-5cabd924a046","Type":"ContainerStarted","Data":"460301b78d49e9d0a2ed78f1f3e201c6a561308280fa47fda3365102847cd285"}
Sep 09 07:04:14.107662 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:14.107433    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b212cb-76d45f97f8-nt4c6"
Sep 09 07:04:14.109276 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:14.109253    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-b212cb-6c8b5c4477-j2xx8" event={"ID":"ba2bd48c-7185-429a-af9c-90086df5b327","Type":"ContainerStarted","Data":"2c839dadfa228cfc0e71cf388963b6af09eaf1c75b20d3a3d131e9de4445ce61"}
Sep 09 07:04:14.109392 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:14.109298    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-b212cb-6c8b5c4477-j2xx8" event={"ID":"ba2bd48c-7185-429a-af9c-90086df5b327","Type":"ContainerStarted","Data":"9923bbc3ef1910b56f6ffe63c703d87748f7148a19ae6251cb38c35781e368f7"}
Sep 09 07:04:14.128080 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:14.128022    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b212cb-76d45f97f8-nt4c6" podStartSLOduration=2.128007815 podStartE2EDuration="2.128007815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 07:04:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 07:04:14.126869665 +0000 UTC m=+788.918679029" watchObservedRunningTime="2026-09-09 07:04:14.128007815 +0000 UTC m=+788.919817153"
Sep 09 07:04:14.145906 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:14.145853    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-b212cb-6c8b5c4477-j2xx8" podStartSLOduration=2.145832145 podStartE2EDuration="2.145832145s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 07:04:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 07:04:14.143824618 +0000 UTC m=+788.935633959" watchObservedRunningTime="2026-09-09 07:04:14.145832145 +0000 UTC m=+788.937641486"
Sep 09 07:04:14.247569 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:14.247549    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7955-140037892555952"
Sep 09 07:04:14.281017 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:14.280991    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7955-140037892555952_9d80b202-bd74-4dd8-8ccd-5727b8effd40/test-curl-7955-140037892555952/0.log"
Sep 09 07:04:14.301530 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:14.301507    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7955-140037892555952"]
Sep 09 07:04:14.305175 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:14.305157    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7955-140037892555952"]
Sep 09 07:04:14.328529 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:14.328511    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t6d4p\" (UniqueName: \"kubernetes.io/projected/9d80b202-bd74-4dd8-8ccd-5727b8effd40-kube-api-access-t6d4p\") pod \"9d80b202-bd74-4dd8-8ccd-5727b8effd40\" (UID: \"9d80b202-bd74-4dd8-8ccd-5727b8effd40\") "
Sep 09 07:04:14.330775 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:14.330721    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d80b202-bd74-4dd8-8ccd-5727b8effd40-kube-api-access-t6d4p" (OuterVolumeSpecName: "kube-api-access-t6d4p") pod "9d80b202-bd74-4dd8-8ccd-5727b8effd40" (UID: "9d80b202-bd74-4dd8-8ccd-5727b8effd40"). InnerVolumeSpecName "kube-api-access-t6d4p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 07:04:14.429912 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:14.429880    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6d4p\" (UniqueName: \"kubernetes.io/projected/9d80b202-bd74-4dd8-8ccd-5727b8effd40-kube-api-access-t6d4p\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:04:15.116309 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:15.116285    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7955-140037892555952"
Sep 09 07:04:15.116795 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:15.116313    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ab89c2e84ae41dd0f6ea91217584e62de9222d3f508ac255d25ebe954c0612f0"
Sep 09 07:04:15.116795 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:15.116575    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-b212cb-6c8b5c4477-j2xx8"
Sep 09 07:04:15.126428 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:04:15.126401    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7955-140037892555952\" is forbidden: User \"system:node:ip-10-0-132-176.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-176.ec2.internal' and this object" podUID="9d80b202-bd74-4dd8-8ccd-5727b8effd40" pod="opendatahub/test-curl-7955-140037892555952"
Sep 09 07:04:15.710811 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:04:15.710768    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7955-140037892555952\" is forbidden: User \"system:node:ip-10-0-132-176.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-176.ec2.internal' and this object" podUID="9d80b202-bd74-4dd8-8ccd-5727b8effd40" pod="opendatahub/test-curl-7955-140037892555952"
Sep 09 07:04:15.712738 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:15.712711    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d80b202-bd74-4dd8-8ccd-5727b8effd40" path="/var/lib/kubelet/pods/9d80b202-bd74-4dd8-8ccd-5727b8effd40/volumes"
Sep 09 07:04:20.388791 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:20.388757    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ef07c382-75458d4ccf-d5rsf"]
Sep 09 07:04:20.389162 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:20.389148    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d80b202-bd74-4dd8-8ccd-5727b8effd40" containerName="test-curl-7955-140037892555952"
Sep 09 07:04:20.389214 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:20.389164    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d80b202-bd74-4dd8-8ccd-5727b8effd40" containerName="test-curl-7955-140037892555952"
Sep 09 07:04:20.389248 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:20.389220    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d80b202-bd74-4dd8-8ccd-5727b8effd40" containerName="test-curl-7955-140037892555952"
Sep 09 07:04:20.392486 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:20.392469    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ef07c382-75458d4ccf-d5rsf"
Sep 09 07:04:20.395030 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:20.395007    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-ef07c382-dockercfg-9vzvm\""
Sep 09 07:04:20.395149 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:20.395062    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-ef07c382\""
Sep 09 07:04:20.403377 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:20.403353    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ef07c382-75458d4ccf-d5rsf"]
Sep 09 07:04:20.428789 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:20.428767    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ef07c382-6f46c69954-zxp2z"]
Sep 09 07:04:20.432023 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:20.432006    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ef07c382-6f46c69954-zxp2z"
Sep 09 07:04:20.442959 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:20.442940    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ef07c382-6f46c69954-zxp2z"]
Sep 09 07:04:20.485841 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:20.485816    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83261618-da99-48ff-840d-f92378a3f5ec-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-ef07c382-6f46c69954-zxp2z\" (UID: \"83261618-da99-48ff-840d-f92378a3f5ec\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ef07c382-6f46c69954-zxp2z"
Sep 09 07:04:20.485957 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:20.485858    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4pbv\" (UniqueName: \"kubernetes.io/projected/83261618-da99-48ff-840d-f92378a3f5ec-kube-api-access-z4pbv\") pod \"payload-pre-processing-e2e-ait-ef07c382-6f46c69954-zxp2z\" (UID: \"83261618-da99-48ff-840d-f92378a3f5ec\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ef07c382-6f46c69954-zxp2z"
Sep 09 07:04:20.485957 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:20.485941    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/32d1c263-dcb1-4856-b9bd-a4b4197c0e93-plugins-config-volume\") pod \"payload-processing-e2e-ait-ef07c382-75458d4ccf-d5rsf\" (UID: \"32d1c263-dcb1-4856-b9bd-a4b4197c0e93\") " pod="openshift-ingress/payload-processing-e2e-ait-ef07c382-75458d4ccf-d5rsf"
Sep 09 07:04:20.486026 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:20.485974    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkthm\" (UniqueName: \"kubernetes.io/projected/32d1c263-dcb1-4856-b9bd-a4b4197c0e93-kube-api-access-hkthm\") pod \"payload-processing-e2e-ait-ef07c382-75458d4ccf-d5rsf\" (UID: \"32d1c263-dcb1-4856-b9bd-a4b4197c0e93\") " pod="openshift-ingress/payload-processing-e2e-ait-ef07c382-75458d4ccf-d5rsf"
Sep 09 07:04:20.586955 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:20.586925    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83261618-da99-48ff-840d-f92378a3f5ec-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-ef07c382-6f46c69954-zxp2z\" (UID: \"83261618-da99-48ff-840d-f92378a3f5ec\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ef07c382-6f46c69954-zxp2z"
Sep 09 07:04:20.587091 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:20.586961    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4pbv\" (UniqueName: \"kubernetes.io/projected/83261618-da99-48ff-840d-f92378a3f5ec-kube-api-access-z4pbv\") pod \"payload-pre-processing-e2e-ait-ef07c382-6f46c69954-zxp2z\" (UID: \"83261618-da99-48ff-840d-f92378a3f5ec\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ef07c382-6f46c69954-zxp2z"
Sep 09 07:04:20.587091 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:20.587009    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/32d1c263-dcb1-4856-b9bd-a4b4197c0e93-plugins-config-volume\") pod \"payload-processing-e2e-ait-ef07c382-75458d4ccf-d5rsf\" (UID: \"32d1c263-dcb1-4856-b9bd-a4b4197c0e93\") " pod="openshift-ingress/payload-processing-e2e-ait-ef07c382-75458d4ccf-d5rsf"
Sep 09 07:04:20.587091 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:20.587030    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkthm\" (UniqueName: \"kubernetes.io/projected/32d1c263-dcb1-4856-b9bd-a4b4197c0e93-kube-api-access-hkthm\") pod \"payload-processing-e2e-ait-ef07c382-75458d4ccf-d5rsf\" (UID: \"32d1c263-dcb1-4856-b9bd-a4b4197c0e93\") " pod="openshift-ingress/payload-processing-e2e-ait-ef07c382-75458d4ccf-d5rsf"
Sep 09 07:04:20.587692 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:20.587668    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83261618-da99-48ff-840d-f92378a3f5ec-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-ef07c382-6f46c69954-zxp2z\" (UID: \"83261618-da99-48ff-840d-f92378a3f5ec\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ef07c382-6f46c69954-zxp2z"
Sep 09 07:04:20.587807 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:20.587736    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/32d1c263-dcb1-4856-b9bd-a4b4197c0e93-plugins-config-volume\") pod \"payload-processing-e2e-ait-ef07c382-75458d4ccf-d5rsf\" (UID: \"32d1c263-dcb1-4856-b9bd-a4b4197c0e93\") " pod="openshift-ingress/payload-processing-e2e-ait-ef07c382-75458d4ccf-d5rsf"
Sep 09 07:04:20.597320 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:20.597298    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4pbv\" (UniqueName: \"kubernetes.io/projected/83261618-da99-48ff-840d-f92378a3f5ec-kube-api-access-z4pbv\") pod \"payload-pre-processing-e2e-ait-ef07c382-6f46c69954-zxp2z\" (UID: \"83261618-da99-48ff-840d-f92378a3f5ec\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ef07c382-6f46c69954-zxp2z"
Sep 09 07:04:20.597598 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:20.597582    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkthm\" (UniqueName: \"kubernetes.io/projected/32d1c263-dcb1-4856-b9bd-a4b4197c0e93-kube-api-access-hkthm\") pod \"payload-processing-e2e-ait-ef07c382-75458d4ccf-d5rsf\" (UID: \"32d1c263-dcb1-4856-b9bd-a4b4197c0e93\") " pod="openshift-ingress/payload-processing-e2e-ait-ef07c382-75458d4ccf-d5rsf"
Sep 09 07:04:20.705559 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:20.705472    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ef07c382-75458d4ccf-d5rsf"
Sep 09 07:04:20.741835 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:20.741797    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ef07c382-6f46c69954-zxp2z"
Sep 09 07:04:20.986202 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:20.986131    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ef07c382-75458d4ccf-d5rsf"]
Sep 09 07:04:20.989876 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:04:20.989838    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32d1c263_dcb1_4856_b9bd_a4b4197c0e93.slice/crio-94fa993454ed45a219dffffbfaba7dfe6841e44cfd619a38bd7a955fa853028d WatchSource:0}: Error finding container 94fa993454ed45a219dffffbfaba7dfe6841e44cfd619a38bd7a955fa853028d: Status 404 returned error can't find the container with id 94fa993454ed45a219dffffbfaba7dfe6841e44cfd619a38bd7a955fa853028d
Sep 09 07:04:21.029418 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:21.029393    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ef07c382-6f46c69954-zxp2z"]
Sep 09 07:04:21.031972 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:04:21.031937    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83261618_da99_48ff_840d_f92378a3f5ec.slice/crio-04ca67c84f2c64b1a0a9c07e9778bc71b1f8e31c9ea3be6e5e5361b6b929d8f3 WatchSource:0}: Error finding container 04ca67c84f2c64b1a0a9c07e9778bc71b1f8e31c9ea3be6e5e5361b6b929d8f3: Status 404 returned error can't find the container with id 04ca67c84f2c64b1a0a9c07e9778bc71b1f8e31c9ea3be6e5e5361b6b929d8f3
Sep 09 07:04:21.157387 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:21.157349    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ef07c382-75458d4ccf-d5rsf" event={"ID":"32d1c263-dcb1-4856-b9bd-a4b4197c0e93","Type":"ContainerStarted","Data":"5a3a06174d8e44e96b090bb84d69e3190f795917e2ca8965ed03cc28553fa45e"}
Sep 09 07:04:21.157615 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:21.157450    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ef07c382-75458d4ccf-d5rsf" event={"ID":"32d1c263-dcb1-4856-b9bd-a4b4197c0e93","Type":"ContainerStarted","Data":"94fa993454ed45a219dffffbfaba7dfe6841e44cfd619a38bd7a955fa853028d"}
Sep 09 07:04:21.157615 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:21.157481    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-ef07c382-75458d4ccf-d5rsf"
Sep 09 07:04:21.159238 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:21.159208    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ef07c382-6f46c69954-zxp2z" event={"ID":"83261618-da99-48ff-840d-f92378a3f5ec","Type":"ContainerStarted","Data":"843b3bd42ee98abb5bb2d2750449d913d3e2dd326c8091e99c709e0f63195929"}
Sep 09 07:04:21.159370 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:21.159255    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ef07c382-6f46c69954-zxp2z" event={"ID":"83261618-da99-48ff-840d-f92378a3f5ec","Type":"ContainerStarted","Data":"04ca67c84f2c64b1a0a9c07e9778bc71b1f8e31c9ea3be6e5e5361b6b929d8f3"}
Sep 09 07:04:21.159370 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:21.159321    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-ef07c382-6f46c69954-zxp2z"
Sep 09 07:04:21.175432 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:21.175383    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-ef07c382-75458d4ccf-d5rsf" podStartSLOduration=1.175367562 podStartE2EDuration="1.175367562s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 07:04:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 07:04:21.173971742 +0000 UTC m=+795.965781092" watchObservedRunningTime="2026-09-09 07:04:21.175367562 +0000 UTC m=+795.967176903"
Sep 09 07:04:21.190384 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:21.190343    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-ef07c382-6f46c69954-zxp2z" podStartSLOduration=1.190331661 podStartE2EDuration="1.190331661s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 07:04:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 07:04:21.18926496 +0000 UTC m=+795.981074301" watchObservedRunningTime="2026-09-09 07:04:21.190331661 +0000 UTC m=+795.982141004"
Sep 09 07:04:24.946121 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:24.946086    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-40c98b-579d5754c7-lnlgb"]
Sep 09 07:04:24.949825 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:24.949734    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-40c98b-579d5754c7-lnlgb"
Sep 09 07:04:24.952831 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:24.952814    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-40c98b\""
Sep 09 07:04:24.959962 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:24.959937    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-40c98b-579d5754c7-lnlgb"]
Sep 09 07:04:25.014456 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:25.014421    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-40c98b-7874688f8-brkr4"]
Sep 09 07:04:25.017888 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:25.017867    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-40c98b-7874688f8-brkr4"
Sep 09 07:04:25.021303 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:25.021277    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-40c98b-dockercfg-dt7z5\""
Sep 09 07:04:25.029501 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:25.029477    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc7xn\" (UniqueName: \"kubernetes.io/projected/095643f2-fdf6-42bb-9709-dd5628f129fd-kube-api-access-vc7xn\") pod \"payload-processing-e2e-autores-40c98b-579d5754c7-lnlgb\" (UID: \"095643f2-fdf6-42bb-9709-dd5628f129fd\") " pod="openshift-ingress/payload-processing-e2e-autores-40c98b-579d5754c7-lnlgb"
Sep 09 07:04:25.029598 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:25.029530    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/095643f2-fdf6-42bb-9709-dd5628f129fd-plugins-config-volume\") pod \"payload-processing-e2e-autores-40c98b-579d5754c7-lnlgb\" (UID: \"095643f2-fdf6-42bb-9709-dd5628f129fd\") " pod="openshift-ingress/payload-processing-e2e-autores-40c98b-579d5754c7-lnlgb"
Sep 09 07:04:25.032609 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:25.032587    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-40c98b-7874688f8-brkr4"]
Sep 09 07:04:25.118072 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:25.118047    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b212cb-76d45f97f8-nt4c6"
Sep 09 07:04:25.130730 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:25.130692    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhr74\" (UniqueName: \"kubernetes.io/projected/1054978f-4b57-4e60-9bab-597ba4b94bce-kube-api-access-lhr74\") pod \"payload-pre-processing-e2e-autores-40c98b-7874688f8-brkr4\" (UID: \"1054978f-4b57-4e60-9bab-597ba4b94bce\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-40c98b-7874688f8-brkr4"
Sep 09 07:04:25.130903 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:25.130739    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/095643f2-fdf6-42bb-9709-dd5628f129fd-plugins-config-volume\") pod \"payload-processing-e2e-autores-40c98b-579d5754c7-lnlgb\" (UID: \"095643f2-fdf6-42bb-9709-dd5628f129fd\") " pod="openshift-ingress/payload-processing-e2e-autores-40c98b-579d5754c7-lnlgb"
Sep 09 07:04:25.130903 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:25.130876    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1054978f-4b57-4e60-9bab-597ba4b94bce-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-40c98b-7874688f8-brkr4\" (UID: \"1054978f-4b57-4e60-9bab-597ba4b94bce\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-40c98b-7874688f8-brkr4"
Sep 09 07:04:25.131027 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:25.130960    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc7xn\" (UniqueName: \"kubernetes.io/projected/095643f2-fdf6-42bb-9709-dd5628f129fd-kube-api-access-vc7xn\") pod \"payload-processing-e2e-autores-40c98b-579d5754c7-lnlgb\" (UID: \"095643f2-fdf6-42bb-9709-dd5628f129fd\") " pod="openshift-ingress/payload-processing-e2e-autores-40c98b-579d5754c7-lnlgb"
Sep 09 07:04:25.131505 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:25.131483    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/095643f2-fdf6-42bb-9709-dd5628f129fd-plugins-config-volume\") pod \"payload-processing-e2e-autores-40c98b-579d5754c7-lnlgb\" (UID: \"095643f2-fdf6-42bb-9709-dd5628f129fd\") " pod="openshift-ingress/payload-processing-e2e-autores-40c98b-579d5754c7-lnlgb"
Sep 09 07:04:25.139761 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:25.139733    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc7xn\" (UniqueName: \"kubernetes.io/projected/095643f2-fdf6-42bb-9709-dd5628f129fd-kube-api-access-vc7xn\") pod \"payload-processing-e2e-autores-40c98b-579d5754c7-lnlgb\" (UID: \"095643f2-fdf6-42bb-9709-dd5628f129fd\") " pod="openshift-ingress/payload-processing-e2e-autores-40c98b-579d5754c7-lnlgb"
Sep 09 07:04:25.231527 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:25.231451    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhr74\" (UniqueName: \"kubernetes.io/projected/1054978f-4b57-4e60-9bab-597ba4b94bce-kube-api-access-lhr74\") pod \"payload-pre-processing-e2e-autores-40c98b-7874688f8-brkr4\" (UID: \"1054978f-4b57-4e60-9bab-597ba4b94bce\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-40c98b-7874688f8-brkr4"
Sep 09 07:04:25.231685 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:25.231542    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1054978f-4b57-4e60-9bab-597ba4b94bce-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-40c98b-7874688f8-brkr4\" (UID: \"1054978f-4b57-4e60-9bab-597ba4b94bce\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-40c98b-7874688f8-brkr4"
Sep 09 07:04:25.232231 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:25.232210    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1054978f-4b57-4e60-9bab-597ba4b94bce-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-40c98b-7874688f8-brkr4\" (UID: \"1054978f-4b57-4e60-9bab-597ba4b94bce\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-40c98b-7874688f8-brkr4"
Sep 09 07:04:25.245314 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:25.245287    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhr74\" (UniqueName: \"kubernetes.io/projected/1054978f-4b57-4e60-9bab-597ba4b94bce-kube-api-access-lhr74\") pod \"payload-pre-processing-e2e-autores-40c98b-7874688f8-brkr4\" (UID: \"1054978f-4b57-4e60-9bab-597ba4b94bce\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-40c98b-7874688f8-brkr4"
Sep 09 07:04:25.262170 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:25.262151    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-40c98b-579d5754c7-lnlgb"
Sep 09 07:04:25.328212 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:25.328079    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-40c98b-7874688f8-brkr4"
Sep 09 07:04:25.540098 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:25.540014    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-40c98b-579d5754c7-lnlgb"]
Sep 09 07:04:25.543067 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:04:25.543041    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod095643f2_fdf6_42bb_9709_dd5628f129fd.slice/crio-43314d3f0f57138576d45d05ef30f56a53c7eb2fd5721c8e7f17f96a4c56810a WatchSource:0}: Error finding container 43314d3f0f57138576d45d05ef30f56a53c7eb2fd5721c8e7f17f96a4c56810a: Status 404 returned error can't find the container with id 43314d3f0f57138576d45d05ef30f56a53c7eb2fd5721c8e7f17f96a4c56810a
Sep 09 07:04:25.620559 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:25.615830    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-40c98b-7874688f8-brkr4"]
Sep 09 07:04:26.123235 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:26.123202    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-b212cb-6c8b5c4477-j2xx8"
Sep 09 07:04:26.190561 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:26.190530    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-40c98b-579d5754c7-lnlgb" event={"ID":"095643f2-fdf6-42bb-9709-dd5628f129fd","Type":"ContainerStarted","Data":"167940e9ba37e66a19f553855c56a80456d0d3f00a82b35ce36e4ad2fb8f0059"}
Sep 09 07:04:26.190732 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:26.190600    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-40c98b-579d5754c7-lnlgb" event={"ID":"095643f2-fdf6-42bb-9709-dd5628f129fd","Type":"ContainerStarted","Data":"43314d3f0f57138576d45d05ef30f56a53c7eb2fd5721c8e7f17f96a4c56810a"}
Sep 09 07:04:26.190732 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:26.190674    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-40c98b-579d5754c7-lnlgb"
Sep 09 07:04:26.192821 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:26.192793    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-40c98b-7874688f8-brkr4" event={"ID":"1054978f-4b57-4e60-9bab-597ba4b94bce","Type":"ContainerStarted","Data":"30456cee46b1f03461182ee554e3f908cd39ae10d92db488eeefcba2911cf4ba"}
Sep 09 07:04:26.192921 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:26.192859    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-40c98b-7874688f8-brkr4" event={"ID":"1054978f-4b57-4e60-9bab-597ba4b94bce","Type":"ContainerStarted","Data":"1d5e6171168948fd70de058a40658ae4386bfbbf8ee5b249415616d6b6428624"}
Sep 09 07:04:26.192921 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:26.192887    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-40c98b-7874688f8-brkr4"
Sep 09 07:04:26.214974 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:26.214926    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-40c98b-579d5754c7-lnlgb" podStartSLOduration=2.214911608 podStartE2EDuration="2.214911608s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 07:04:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 07:04:26.210172123 +0000 UTC m=+801.001981489" watchObservedRunningTime="2026-09-09 07:04:26.214911608 +0000 UTC m=+801.006720997"
Sep 09 07:04:26.240432 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:26.240378    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-autores-40c98b-7874688f8-brkr4" podStartSLOduration=2.240363607 podStartE2EDuration="2.240363607s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 07:04:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 07:04:26.239673763 +0000 UTC m=+801.031483171" watchObservedRunningTime="2026-09-09 07:04:26.240363607 +0000 UTC m=+801.032172947"
Sep 09 07:04:32.167380 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:32.167299    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-ef07c382-75458d4ccf-d5rsf"
Sep 09 07:04:32.167704 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:32.167475    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-ef07c382-6f46c69954-zxp2z"
Sep 09 07:04:37.199239 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:37.199210    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-40c98b-7874688f8-brkr4"
Sep 09 07:04:37.199689 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:37.199286    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-40c98b-579d5754c7-lnlgb"
Sep 09 07:04:42.176239 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:42.176209    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-fc9900-74c4648c8b-q6tdq"]
Sep 09 07:04:42.182113 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:42.182094    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fc9900-74c4648c8b-q6tdq"
Sep 09 07:04:42.188848 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:42.188829    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-fc9900\""
Sep 09 07:04:42.215118 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:42.215091    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-fc9900-74c4648c8b-q6tdq"]
Sep 09 07:04:42.216847 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:42.216825    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-fc9900-7df568df6f-6z2r4"]
Sep 09 07:04:42.220890 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:42.220875    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-fc9900-7df568df6f-6z2r4"
Sep 09 07:04:42.242542 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:42.242523    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-fc9900-dockercfg-rvdlv\""
Sep 09 07:04:42.273664 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:42.273641    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9995f2b4-217e-46b3-891d-2273f99bdd7d-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-fc9900-7df568df6f-6z2r4\" (UID: \"9995f2b4-217e-46b3-891d-2273f99bdd7d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-fc9900-7df568df6f-6z2r4"
Sep 09 07:04:42.273796 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:42.273684    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4af2ca9c-554a-4cfa-bd6a-cdbbf7f56188-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-fc9900-74c4648c8b-q6tdq\" (UID: \"4af2ca9c-554a-4cfa-bd6a-cdbbf7f56188\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fc9900-74c4648c8b-q6tdq"
Sep 09 07:04:42.273796 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:42.273704    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqts2\" (UniqueName: \"kubernetes.io/projected/4af2ca9c-554a-4cfa-bd6a-cdbbf7f56188-kube-api-access-jqts2\") pod \"payload-pre-processing-e2e-inf-b-fc9900-74c4648c8b-q6tdq\" (UID: \"4af2ca9c-554a-4cfa-bd6a-cdbbf7f56188\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fc9900-74c4648c8b-q6tdq"
Sep 09 07:04:42.273890 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:42.273816    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmpst\" (UniqueName: \"kubernetes.io/projected/9995f2b4-217e-46b3-891d-2273f99bdd7d-kube-api-access-jmpst\") pod \"payload-processing-e2e-inf-b-fc9900-7df568df6f-6z2r4\" (UID: \"9995f2b4-217e-46b3-891d-2273f99bdd7d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-fc9900-7df568df6f-6z2r4"
Sep 09 07:04:42.278382 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:42.278360    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-fc9900-7df568df6f-6z2r4"]
Sep 09 07:04:42.374850 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:42.374821    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9995f2b4-217e-46b3-891d-2273f99bdd7d-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-fc9900-7df568df6f-6z2r4\" (UID: \"9995f2b4-217e-46b3-891d-2273f99bdd7d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-fc9900-7df568df6f-6z2r4"
Sep 09 07:04:42.375005 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:42.374874    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4af2ca9c-554a-4cfa-bd6a-cdbbf7f56188-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-fc9900-74c4648c8b-q6tdq\" (UID: \"4af2ca9c-554a-4cfa-bd6a-cdbbf7f56188\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fc9900-74c4648c8b-q6tdq"
Sep 09 07:04:42.375005 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:42.374897    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqts2\" (UniqueName: \"kubernetes.io/projected/4af2ca9c-554a-4cfa-bd6a-cdbbf7f56188-kube-api-access-jqts2\") pod \"payload-pre-processing-e2e-inf-b-fc9900-74c4648c8b-q6tdq\" (UID: \"4af2ca9c-554a-4cfa-bd6a-cdbbf7f56188\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fc9900-74c4648c8b-q6tdq"
Sep 09 07:04:42.375005 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:42.374950    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmpst\" (UniqueName: \"kubernetes.io/projected/9995f2b4-217e-46b3-891d-2273f99bdd7d-kube-api-access-jmpst\") pod \"payload-processing-e2e-inf-b-fc9900-7df568df6f-6z2r4\" (UID: \"9995f2b4-217e-46b3-891d-2273f99bdd7d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-fc9900-7df568df6f-6z2r4"
Sep 09 07:04:42.375676 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:42.375650    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9995f2b4-217e-46b3-891d-2273f99bdd7d-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-fc9900-7df568df6f-6z2r4\" (UID: \"9995f2b4-217e-46b3-891d-2273f99bdd7d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-fc9900-7df568df6f-6z2r4"
Sep 09 07:04:42.375827 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:42.375734    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4af2ca9c-554a-4cfa-bd6a-cdbbf7f56188-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-fc9900-74c4648c8b-q6tdq\" (UID: \"4af2ca9c-554a-4cfa-bd6a-cdbbf7f56188\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fc9900-74c4648c8b-q6tdq"
Sep 09 07:04:42.412029 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:42.412008    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmpst\" (UniqueName: \"kubernetes.io/projected/9995f2b4-217e-46b3-891d-2273f99bdd7d-kube-api-access-jmpst\") pod \"payload-processing-e2e-inf-b-fc9900-7df568df6f-6z2r4\" (UID: \"9995f2b4-217e-46b3-891d-2273f99bdd7d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-fc9900-7df568df6f-6z2r4"
Sep 09 07:04:42.412121 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:42.412085    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqts2\" (UniqueName: \"kubernetes.io/projected/4af2ca9c-554a-4cfa-bd6a-cdbbf7f56188-kube-api-access-jqts2\") pod \"payload-pre-processing-e2e-inf-b-fc9900-74c4648c8b-q6tdq\" (UID: \"4af2ca9c-554a-4cfa-bd6a-cdbbf7f56188\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fc9900-74c4648c8b-q6tdq"
Sep 09 07:04:42.493049 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:42.492997    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fc9900-74c4648c8b-q6tdq"
Sep 09 07:04:42.533723 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:42.533681    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-fc9900-7df568df6f-6z2r4"
Sep 09 07:04:42.784389 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:42.784366    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-fc9900-74c4648c8b-q6tdq"]
Sep 09 07:04:42.785716 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:04:42.785685    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4af2ca9c_554a_4cfa_bd6a_cdbbf7f56188.slice/crio-c476e4b7b1302bde4fbb0206ec70cebe6cdcaffbfb293afadc3fd59c424fc919 WatchSource:0}: Error finding container c476e4b7b1302bde4fbb0206ec70cebe6cdcaffbfb293afadc3fd59c424fc919: Status 404 returned error can't find the container with id c476e4b7b1302bde4fbb0206ec70cebe6cdcaffbfb293afadc3fd59c424fc919
Sep 09 07:04:42.829257 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:42.829227    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-fc9900-7df568df6f-6z2r4"]
Sep 09 07:04:42.831631 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:04:42.831608    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9995f2b4_217e_46b3_891d_2273f99bdd7d.slice/crio-3f6da3a95067d44056194e84add575c16bd7313169eaafd9d8369fe5b754f972 WatchSource:0}: Error finding container 3f6da3a95067d44056194e84add575c16bd7313169eaafd9d8369fe5b754f972: Status 404 returned error can't find the container with id 3f6da3a95067d44056194e84add575c16bd7313169eaafd9d8369fe5b754f972
Sep 09 07:04:43.274716 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:43.274680    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fc9900-74c4648c8b-q6tdq" event={"ID":"4af2ca9c-554a-4cfa-bd6a-cdbbf7f56188","Type":"ContainerStarted","Data":"4b16aa9b1f5b85211cb6b2bec1a6a5b9789f3778867cba27644080285f0e127c"}
Sep 09 07:04:43.275171 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:43.274796    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fc9900-74c4648c8b-q6tdq"
Sep 09 07:04:43.275171 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:43.274822    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fc9900-74c4648c8b-q6tdq" event={"ID":"4af2ca9c-554a-4cfa-bd6a-cdbbf7f56188","Type":"ContainerStarted","Data":"c476e4b7b1302bde4fbb0206ec70cebe6cdcaffbfb293afadc3fd59c424fc919"}
Sep 09 07:04:43.276327 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:43.276301    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-fc9900-7df568df6f-6z2r4" event={"ID":"9995f2b4-217e-46b3-891d-2273f99bdd7d","Type":"ContainerStarted","Data":"7c47661d22c6a6fe534d682b19a180735a44f2a8d3bbc6d4b4b65c31c618599d"}
Sep 09 07:04:43.276391 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:43.276351    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-fc9900-7df568df6f-6z2r4" event={"ID":"9995f2b4-217e-46b3-891d-2273f99bdd7d","Type":"ContainerStarted","Data":"3f6da3a95067d44056194e84add575c16bd7313169eaafd9d8369fe5b754f972"}
Sep 09 07:04:43.276442 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:43.276388    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-fc9900-7df568df6f-6z2r4"
Sep 09 07:04:43.301614 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:43.301566    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fc9900-74c4648c8b-q6tdq" podStartSLOduration=1.3015542 podStartE2EDuration="1.3015542s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 07:04:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 07:04:43.299258957 +0000 UTC m=+818.091068276" watchObservedRunningTime="2026-09-09 07:04:43.3015542 +0000 UTC m=+818.093363538"
Sep 09 07:04:43.329867 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:43.329816    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-fc9900-7df568df6f-6z2r4" podStartSLOduration=1.329804719 podStartE2EDuration="1.329804719s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 07:04:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 07:04:43.326506298 +0000 UTC m=+818.118315637" watchObservedRunningTime="2026-09-09 07:04:43.329804719 +0000 UTC m=+818.121614058"
Sep 09 07:04:54.283343 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:54.283315    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-fc9900-7df568df6f-6z2r4"
Sep 09 07:04:54.283709 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:04:54.283390    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fc9900-74c4648c8b-q6tdq"
Sep 09 07:05:00.516209 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:00.516173    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ef07c382-75458d4ccf-d5rsf"]
Sep 09 07:05:00.516617 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:00.516435    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-ef07c382-75458d4ccf-d5rsf" podUID="32d1c263-dcb1-4856-b9bd-a4b4197c0e93" containerName="payload-processing" containerID="cri-o://5a3a06174d8e44e96b090bb84d69e3190f795917e2ca8965ed03cc28553fa45e" gracePeriod=30
Sep 09 07:05:00.524397 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:00.524370    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ef07c382-6f46c69954-zxp2z"]
Sep 09 07:05:00.524622 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:00.524596    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-ef07c382-6f46c69954-zxp2z" podUID="83261618-da99-48ff-840d-f92378a3f5ec" containerName="payload-pre-processing" containerID="cri-o://843b3bd42ee98abb5bb2d2750449d913d3e2dd326c8091e99c709e0f63195929" gracePeriod=30
Sep 09 07:05:00.804558 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:00.804478    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ef07c382-75458d4ccf-d5rsf"
Sep 09 07:05:00.807549 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:00.807528    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ef07c382-6f46c69954-zxp2z"
Sep 09 07:05:00.949638 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:00.949599    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkthm\" (UniqueName: \"kubernetes.io/projected/32d1c263-dcb1-4856-b9bd-a4b4197c0e93-kube-api-access-hkthm\") pod \"32d1c263-dcb1-4856-b9bd-a4b4197c0e93\" (UID: \"32d1c263-dcb1-4856-b9bd-a4b4197c0e93\") "
Sep 09 07:05:00.949835 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:00.949648    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/32d1c263-dcb1-4856-b9bd-a4b4197c0e93-plugins-config-volume\") pod \"32d1c263-dcb1-4856-b9bd-a4b4197c0e93\" (UID: \"32d1c263-dcb1-4856-b9bd-a4b4197c0e93\") "
Sep 09 07:05:00.949835 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:00.949670    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4pbv\" (UniqueName: \"kubernetes.io/projected/83261618-da99-48ff-840d-f92378a3f5ec-kube-api-access-z4pbv\") pod \"83261618-da99-48ff-840d-f92378a3f5ec\" (UID: \"83261618-da99-48ff-840d-f92378a3f5ec\") "
Sep 09 07:05:00.949835 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:00.949795    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83261618-da99-48ff-840d-f92378a3f5ec-plugins-config-volume\") pod \"83261618-da99-48ff-840d-f92378a3f5ec\" (UID: \"83261618-da99-48ff-840d-f92378a3f5ec\") "
Sep 09 07:05:00.950091 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:00.950070    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32d1c263-dcb1-4856-b9bd-a4b4197c0e93-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "32d1c263-dcb1-4856-b9bd-a4b4197c0e93" (UID: "32d1c263-dcb1-4856-b9bd-a4b4197c0e93"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 07:05:00.950156 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:00.950135    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83261618-da99-48ff-840d-f92378a3f5ec-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "83261618-da99-48ff-840d-f92378a3f5ec" (UID: "83261618-da99-48ff-840d-f92378a3f5ec"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 07:05:00.952103 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:00.952074    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32d1c263-dcb1-4856-b9bd-a4b4197c0e93-kube-api-access-hkthm" (OuterVolumeSpecName: "kube-api-access-hkthm") pod "32d1c263-dcb1-4856-b9bd-a4b4197c0e93" (UID: "32d1c263-dcb1-4856-b9bd-a4b4197c0e93"). InnerVolumeSpecName "kube-api-access-hkthm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 07:05:00.952103 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:00.952090    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83261618-da99-48ff-840d-f92378a3f5ec-kube-api-access-z4pbv" (OuterVolumeSpecName: "kube-api-access-z4pbv") pod "83261618-da99-48ff-840d-f92378a3f5ec" (UID: "83261618-da99-48ff-840d-f92378a3f5ec"). InnerVolumeSpecName "kube-api-access-z4pbv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 07:05:01.051531 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:01.051470    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83261618-da99-48ff-840d-f92378a3f5ec-plugins-config-volume\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:05:01.051531 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:01.051490    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkthm\" (UniqueName: \"kubernetes.io/projected/32d1c263-dcb1-4856-b9bd-a4b4197c0e93-kube-api-access-hkthm\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:05:01.051531 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:01.051499    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/32d1c263-dcb1-4856-b9bd-a4b4197c0e93-plugins-config-volume\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:05:01.051531 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:01.051510    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4pbv\" (UniqueName: \"kubernetes.io/projected/83261618-da99-48ff-840d-f92378a3f5ec-kube-api-access-z4pbv\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:05:01.372158 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:01.372082    2575 generic.go:356] "Generic (PLEG): container finished" podID="32d1c263-dcb1-4856-b9bd-a4b4197c0e93" containerID="5a3a06174d8e44e96b090bb84d69e3190f795917e2ca8965ed03cc28553fa45e" exitCode=0
Sep 09 07:05:01.372158 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:01.372124    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ef07c382-75458d4ccf-d5rsf"
Sep 09 07:05:01.372342 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:01.372160    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ef07c382-75458d4ccf-d5rsf" event={"ID":"32d1c263-dcb1-4856-b9bd-a4b4197c0e93","Type":"ContainerDied","Data":"5a3a06174d8e44e96b090bb84d69e3190f795917e2ca8965ed03cc28553fa45e"}
Sep 09 07:05:01.372342 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:01.372211    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ef07c382-75458d4ccf-d5rsf" event={"ID":"32d1c263-dcb1-4856-b9bd-a4b4197c0e93","Type":"ContainerDied","Data":"94fa993454ed45a219dffffbfaba7dfe6841e44cfd619a38bd7a955fa853028d"}
Sep 09 07:05:01.372342 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:01.372240    2575 scope.go:117] "RemoveContainer" containerID="5a3a06174d8e44e96b090bb84d69e3190f795917e2ca8965ed03cc28553fa45e"
Sep 09 07:05:01.373492 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:01.373471    2575 generic.go:356] "Generic (PLEG): container finished" podID="83261618-da99-48ff-840d-f92378a3f5ec" containerID="843b3bd42ee98abb5bb2d2750449d913d3e2dd326c8091e99c709e0f63195929" exitCode=0
Sep 09 07:05:01.373601 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:01.373511    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ef07c382-6f46c69954-zxp2z"
Sep 09 07:05:01.373601 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:01.373522    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ef07c382-6f46c69954-zxp2z" event={"ID":"83261618-da99-48ff-840d-f92378a3f5ec","Type":"ContainerDied","Data":"843b3bd42ee98abb5bb2d2750449d913d3e2dd326c8091e99c709e0f63195929"}
Sep 09 07:05:01.373601 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:01.373561    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ef07c382-6f46c69954-zxp2z" event={"ID":"83261618-da99-48ff-840d-f92378a3f5ec","Type":"ContainerDied","Data":"04ca67c84f2c64b1a0a9c07e9778bc71b1f8e31c9ea3be6e5e5361b6b929d8f3"}
Sep 09 07:05:01.382663 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:01.382644    2575 scope.go:117] "RemoveContainer" containerID="5a3a06174d8e44e96b090bb84d69e3190f795917e2ca8965ed03cc28553fa45e"
Sep 09 07:05:01.382920 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:05:01.382902    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a3a06174d8e44e96b090bb84d69e3190f795917e2ca8965ed03cc28553fa45e\": container with ID starting with 5a3a06174d8e44e96b090bb84d69e3190f795917e2ca8965ed03cc28553fa45e not found: ID does not exist" containerID="5a3a06174d8e44e96b090bb84d69e3190f795917e2ca8965ed03cc28553fa45e"
Sep 09 07:05:01.383007 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:01.382927    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a3a06174d8e44e96b090bb84d69e3190f795917e2ca8965ed03cc28553fa45e"} err="failed to get container status \"5a3a06174d8e44e96b090bb84d69e3190f795917e2ca8965ed03cc28553fa45e\": rpc error: code = NotFound desc = could not find container \"5a3a06174d8e44e96b090bb84d69e3190f795917e2ca8965ed03cc28553fa45e\": container with ID starting with 5a3a06174d8e44e96b090bb84d69e3190f795917e2ca8965ed03cc28553fa45e not found: ID does not exist"
Sep 09 07:05:01.383007 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:01.382944    2575 scope.go:117] "RemoveContainer" containerID="843b3bd42ee98abb5bb2d2750449d913d3e2dd326c8091e99c709e0f63195929"
Sep 09 07:05:01.391145 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:01.391129    2575 scope.go:117] "RemoveContainer" containerID="843b3bd42ee98abb5bb2d2750449d913d3e2dd326c8091e99c709e0f63195929"
Sep 09 07:05:01.391401 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:05:01.391385    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"843b3bd42ee98abb5bb2d2750449d913d3e2dd326c8091e99c709e0f63195929\": container with ID starting with 843b3bd42ee98abb5bb2d2750449d913d3e2dd326c8091e99c709e0f63195929 not found: ID does not exist" containerID="843b3bd42ee98abb5bb2d2750449d913d3e2dd326c8091e99c709e0f63195929"
Sep 09 07:05:01.391441 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:01.391409    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"843b3bd42ee98abb5bb2d2750449d913d3e2dd326c8091e99c709e0f63195929"} err="failed to get container status \"843b3bd42ee98abb5bb2d2750449d913d3e2dd326c8091e99c709e0f63195929\": rpc error: code = NotFound desc = could not find container \"843b3bd42ee98abb5bb2d2750449d913d3e2dd326c8091e99c709e0f63195929\": container with ID starting with 843b3bd42ee98abb5bb2d2750449d913d3e2dd326c8091e99c709e0f63195929 not found: ID does not exist"
Sep 09 07:05:01.398327 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:01.398307    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ef07c382-75458d4ccf-d5rsf"]
Sep 09 07:05:01.400940 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:01.400920    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ef07c382-75458d4ccf-d5rsf"]
Sep 09 07:05:01.415330 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:01.415311    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ef07c382-6f46c69954-zxp2z"]
Sep 09 07:05:01.419940 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:01.419920    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ef07c382-6f46c69954-zxp2z"]
Sep 09 07:05:01.711522 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:01.711489    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32d1c263-dcb1-4856-b9bd-a4b4197c0e93" path="/var/lib/kubelet/pods/32d1c263-dcb1-4856-b9bd-a4b4197c0e93/volumes"
Sep 09 07:05:01.711914 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:01.711898    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83261618-da99-48ff-840d-f92378a3f5ec" path="/var/lib/kubelet/pods/83261618-da99-48ff-840d-f92378a3f5ec/volumes"
Sep 09 07:05:05.691351 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:05.691323    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-83162d4f-c59f8884b-mmczv"]
Sep 09 07:05:05.691894 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:05.691876    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83261618-da99-48ff-840d-f92378a3f5ec" containerName="payload-pre-processing"
Sep 09 07:05:05.691894 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:05.691894    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="83261618-da99-48ff-840d-f92378a3f5ec" containerName="payload-pre-processing"
Sep 09 07:05:05.692018 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:05.691908    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32d1c263-dcb1-4856-b9bd-a4b4197c0e93" containerName="payload-processing"
Sep 09 07:05:05.692018 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:05.691919    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="32d1c263-dcb1-4856-b9bd-a4b4197c0e93" containerName="payload-processing"
Sep 09 07:05:05.692018 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:05.692000    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="32d1c263-dcb1-4856-b9bd-a4b4197c0e93" containerName="payload-processing"
Sep 09 07:05:05.692018 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:05.692010    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="83261618-da99-48ff-840d-f92378a3f5ec" containerName="payload-pre-processing"
Sep 09 07:05:05.696996 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:05.696978    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-83162d4f-c59f8884b-mmczv"
Sep 09 07:05:05.699694 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:05.699674    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-83162d4f-dockercfg-nbb9f\""
Sep 09 07:05:05.699694 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:05.699676    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-83162d4f\""
Sep 09 07:05:05.704796 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:05.704731    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-83162d4f-c59f8884b-mmczv"]
Sep 09 07:05:05.732292 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:05.732266    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-83162d4f-949449878-t6xnh"]
Sep 09 07:05:05.737547 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:05.737530    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-83162d4f-949449878-t6xnh"
Sep 09 07:05:05.747060 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:05.747036    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-83162d4f-949449878-t6xnh"]
Sep 09 07:05:05.790247 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:05.790219    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/279bf7a2-cf87-463f-8de8-f8458307006e-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-83162d4f-949449878-t6xnh\" (UID: \"279bf7a2-cf87-463f-8de8-f8458307006e\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-83162d4f-949449878-t6xnh"
Sep 09 07:05:05.790362 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:05.790253    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8ldx\" (UniqueName: \"kubernetes.io/projected/279bf7a2-cf87-463f-8de8-f8458307006e-kube-api-access-l8ldx\") pod \"payload-pre-processing-e2e-migrate-83162d4f-949449878-t6xnh\" (UID: \"279bf7a2-cf87-463f-8de8-f8458307006e\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-83162d4f-949449878-t6xnh"
Sep 09 07:05:05.790362 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:05.790281    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2189bed-ec41-4838-9123-451b6f1d9e90-plugins-config-volume\") pod \"payload-processing-e2e-migrate-83162d4f-c59f8884b-mmczv\" (UID: \"b2189bed-ec41-4838-9123-451b6f1d9e90\") " pod="openshift-ingress/payload-processing-e2e-migrate-83162d4f-c59f8884b-mmczv"
Sep 09 07:05:05.790362 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:05.790351    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8gc4\" (UniqueName: \"kubernetes.io/projected/b2189bed-ec41-4838-9123-451b6f1d9e90-kube-api-access-k8gc4\") pod \"payload-processing-e2e-migrate-83162d4f-c59f8884b-mmczv\" (UID: \"b2189bed-ec41-4838-9123-451b6f1d9e90\") " pod="openshift-ingress/payload-processing-e2e-migrate-83162d4f-c59f8884b-mmczv"
Sep 09 07:05:05.891226 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:05.891200    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/279bf7a2-cf87-463f-8de8-f8458307006e-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-83162d4f-949449878-t6xnh\" (UID: \"279bf7a2-cf87-463f-8de8-f8458307006e\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-83162d4f-949449878-t6xnh"
Sep 09 07:05:05.891377 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:05.891232    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8ldx\" (UniqueName: \"kubernetes.io/projected/279bf7a2-cf87-463f-8de8-f8458307006e-kube-api-access-l8ldx\") pod \"payload-pre-processing-e2e-migrate-83162d4f-949449878-t6xnh\" (UID: \"279bf7a2-cf87-463f-8de8-f8458307006e\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-83162d4f-949449878-t6xnh"
Sep 09 07:05:05.891377 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:05.891259    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2189bed-ec41-4838-9123-451b6f1d9e90-plugins-config-volume\") pod \"payload-processing-e2e-migrate-83162d4f-c59f8884b-mmczv\" (UID: \"b2189bed-ec41-4838-9123-451b6f1d9e90\") " pod="openshift-ingress/payload-processing-e2e-migrate-83162d4f-c59f8884b-mmczv"
Sep 09 07:05:05.891377 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:05.891297    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8gc4\" (UniqueName: \"kubernetes.io/projected/b2189bed-ec41-4838-9123-451b6f1d9e90-kube-api-access-k8gc4\") pod \"payload-processing-e2e-migrate-83162d4f-c59f8884b-mmczv\" (UID: \"b2189bed-ec41-4838-9123-451b6f1d9e90\") " pod="openshift-ingress/payload-processing-e2e-migrate-83162d4f-c59f8884b-mmczv"
Sep 09 07:05:05.891989 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:05.891967    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/279bf7a2-cf87-463f-8de8-f8458307006e-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-83162d4f-949449878-t6xnh\" (UID: \"279bf7a2-cf87-463f-8de8-f8458307006e\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-83162d4f-949449878-t6xnh"
Sep 09 07:05:05.892078 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:05.891986    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2189bed-ec41-4838-9123-451b6f1d9e90-plugins-config-volume\") pod \"payload-processing-e2e-migrate-83162d4f-c59f8884b-mmczv\" (UID: \"b2189bed-ec41-4838-9123-451b6f1d9e90\") " pod="openshift-ingress/payload-processing-e2e-migrate-83162d4f-c59f8884b-mmczv"
Sep 09 07:05:05.903339 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:05.903316    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8ldx\" (UniqueName: \"kubernetes.io/projected/279bf7a2-cf87-463f-8de8-f8458307006e-kube-api-access-l8ldx\") pod \"payload-pre-processing-e2e-migrate-83162d4f-949449878-t6xnh\" (UID: \"279bf7a2-cf87-463f-8de8-f8458307006e\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-83162d4f-949449878-t6xnh"
Sep 09 07:05:05.903814 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:05.903795    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8gc4\" (UniqueName: \"kubernetes.io/projected/b2189bed-ec41-4838-9123-451b6f1d9e90-kube-api-access-k8gc4\") pod \"payload-processing-e2e-migrate-83162d4f-c59f8884b-mmczv\" (UID: \"b2189bed-ec41-4838-9123-451b6f1d9e90\") " pod="openshift-ingress/payload-processing-e2e-migrate-83162d4f-c59f8884b-mmczv"
Sep 09 07:05:06.007716 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:06.007651    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-83162d4f-c59f8884b-mmczv"
Sep 09 07:05:06.047854 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:06.047816    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-83162d4f-949449878-t6xnh"
Sep 09 07:05:06.284628 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:06.284470    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-83162d4f-c59f8884b-mmczv"]
Sep 09 07:05:06.287154 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:05:06.287127    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2189bed_ec41_4838_9123_451b6f1d9e90.slice/crio-0fef2bb7c555de604095729bf23ddb45f906359b499b650e53d32e89466b80a4 WatchSource:0}: Error finding container 0fef2bb7c555de604095729bf23ddb45f906359b499b650e53d32e89466b80a4: Status 404 returned error can't find the container with id 0fef2bb7c555de604095729bf23ddb45f906359b499b650e53d32e89466b80a4
Sep 09 07:05:06.333119 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:06.333095    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-83162d4f-949449878-t6xnh"]
Sep 09 07:05:06.334411 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:05:06.334388    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod279bf7a2_cf87_463f_8de8_f8458307006e.slice/crio-dc900b299815492d542b25bafe7c90fbaef334e13e808532ffa4fa2211c99712 WatchSource:0}: Error finding container dc900b299815492d542b25bafe7c90fbaef334e13e808532ffa4fa2211c99712: Status 404 returned error can't find the container with id dc900b299815492d542b25bafe7c90fbaef334e13e808532ffa4fa2211c99712
Sep 09 07:05:06.402601 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:06.402570    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-83162d4f-949449878-t6xnh" event={"ID":"279bf7a2-cf87-463f-8de8-f8458307006e","Type":"ContainerStarted","Data":"dc900b299815492d542b25bafe7c90fbaef334e13e808532ffa4fa2211c99712"}
Sep 09 07:05:06.404397 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:06.404373    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-83162d4f-c59f8884b-mmczv" event={"ID":"b2189bed-ec41-4838-9123-451b6f1d9e90","Type":"ContainerStarted","Data":"c932d4f74cb2dc67d0c57fb28428bf5b738b1e52d76c290fba95e7079e853dd6"}
Sep 09 07:05:06.404531 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:06.404423    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-83162d4f-c59f8884b-mmczv" event={"ID":"b2189bed-ec41-4838-9123-451b6f1d9e90","Type":"ContainerStarted","Data":"0fef2bb7c555de604095729bf23ddb45f906359b499b650e53d32e89466b80a4"}
Sep 09 07:05:06.404531 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:06.404518    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-83162d4f-c59f8884b-mmczv"
Sep 09 07:05:06.425429 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:06.425376    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-83162d4f-c59f8884b-mmczv" podStartSLOduration=1.425355436 podStartE2EDuration="1.425355436s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 07:05:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 07:05:06.423721944 +0000 UTC m=+841.215531296" watchObservedRunningTime="2026-09-09 07:05:06.425355436 +0000 UTC m=+841.217164777"
Sep 09 07:05:07.411475 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:07.411440    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-83162d4f-949449878-t6xnh" event={"ID":"279bf7a2-cf87-463f-8de8-f8458307006e","Type":"ContainerStarted","Data":"1132df04dc73c1f38903140f226437044f25575ef78077abbe581adc736334a9"}
Sep 09 07:05:07.411999 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:07.411525    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-83162d4f-949449878-t6xnh"
Sep 09 07:05:07.436533 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:07.436478    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-83162d4f-949449878-t6xnh" podStartSLOduration=2.436459824 podStartE2EDuration="2.436459824s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 07:05:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 07:05:07.435092932 +0000 UTC m=+842.226902272" watchObservedRunningTime="2026-09-09 07:05:07.436459824 +0000 UTC m=+842.228269165"
Sep 09 07:05:17.414180 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:17.414151    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-83162d4f-c59f8884b-mmczv"
Sep 09 07:05:18.419125 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:18.419098    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-83162d4f-949449878-t6xnh"
Sep 09 07:05:36.464817 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:36.464787    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-83162d4f-c59f8884b-mmczv"]
Sep 09 07:05:36.465264 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:36.464998    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-83162d4f-c59f8884b-mmczv" podUID="b2189bed-ec41-4838-9123-451b6f1d9e90" containerName="payload-processing" containerID="cri-o://c932d4f74cb2dc67d0c57fb28428bf5b738b1e52d76c290fba95e7079e853dd6" gracePeriod=30
Sep 09 07:05:36.480171 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:36.480144    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-83162d4f-949449878-t6xnh"]
Sep 09 07:05:36.480482 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:36.480341    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-83162d4f-949449878-t6xnh" podUID="279bf7a2-cf87-463f-8de8-f8458307006e" containerName="payload-pre-processing" containerID="cri-o://1132df04dc73c1f38903140f226437044f25575ef78077abbe581adc736334a9" gracePeriod=30
Sep 09 07:05:36.744852 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:36.744826    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-83162d4f-c59f8884b-mmczv"
Sep 09 07:05:36.758712 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:36.758695    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-83162d4f-949449878-t6xnh"
Sep 09 07:05:36.873173 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:36.873128    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l8ldx\" (UniqueName: \"kubernetes.io/projected/279bf7a2-cf87-463f-8de8-f8458307006e-kube-api-access-l8ldx\") pod \"279bf7a2-cf87-463f-8de8-f8458307006e\" (UID: \"279bf7a2-cf87-463f-8de8-f8458307006e\") "
Sep 09 07:05:36.873347 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:36.873269    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/279bf7a2-cf87-463f-8de8-f8458307006e-plugins-config-volume\") pod \"279bf7a2-cf87-463f-8de8-f8458307006e\" (UID: \"279bf7a2-cf87-463f-8de8-f8458307006e\") "
Sep 09 07:05:36.873347 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:36.873297    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2189bed-ec41-4838-9123-451b6f1d9e90-plugins-config-volume\") pod \"b2189bed-ec41-4838-9123-451b6f1d9e90\" (UID: \"b2189bed-ec41-4838-9123-451b6f1d9e90\") "
Sep 09 07:05:36.873347 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:36.873330    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8gc4\" (UniqueName: \"kubernetes.io/projected/b2189bed-ec41-4838-9123-451b6f1d9e90-kube-api-access-k8gc4\") pod \"b2189bed-ec41-4838-9123-451b6f1d9e90\" (UID: \"b2189bed-ec41-4838-9123-451b6f1d9e90\") "
Sep 09 07:05:36.873861 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:36.873817    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/279bf7a2-cf87-463f-8de8-f8458307006e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "279bf7a2-cf87-463f-8de8-f8458307006e" (UID: "279bf7a2-cf87-463f-8de8-f8458307006e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 07:05:36.875787 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:36.874864    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2189bed-ec41-4838-9123-451b6f1d9e90-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b2189bed-ec41-4838-9123-451b6f1d9e90" (UID: "b2189bed-ec41-4838-9123-451b6f1d9e90"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 07:05:36.886988 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:36.886934    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/279bf7a2-cf87-463f-8de8-f8458307006e-kube-api-access-l8ldx" (OuterVolumeSpecName: "kube-api-access-l8ldx") pod "279bf7a2-cf87-463f-8de8-f8458307006e" (UID: "279bf7a2-cf87-463f-8de8-f8458307006e"). InnerVolumeSpecName "kube-api-access-l8ldx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 07:05:36.887722 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:36.887687    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2189bed-ec41-4838-9123-451b6f1d9e90-kube-api-access-k8gc4" (OuterVolumeSpecName: "kube-api-access-k8gc4") pod "b2189bed-ec41-4838-9123-451b6f1d9e90" (UID: "b2189bed-ec41-4838-9123-451b6f1d9e90"). InnerVolumeSpecName "kube-api-access-k8gc4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 07:05:36.974859 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:36.974827    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/279bf7a2-cf87-463f-8de8-f8458307006e-plugins-config-volume\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:05:36.974859 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:36.974853    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2189bed-ec41-4838-9123-451b6f1d9e90-plugins-config-volume\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:05:36.974859 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:36.974862    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8gc4\" (UniqueName: \"kubernetes.io/projected/b2189bed-ec41-4838-9123-451b6f1d9e90-kube-api-access-k8gc4\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:05:36.975046 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:36.974870    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8ldx\" (UniqueName: \"kubernetes.io/projected/279bf7a2-cf87-463f-8de8-f8458307006e-kube-api-access-l8ldx\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:05:37.564621 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:37.564586    2575 generic.go:356] "Generic (PLEG): container finished" podID="279bf7a2-cf87-463f-8de8-f8458307006e" containerID="1132df04dc73c1f38903140f226437044f25575ef78077abbe581adc736334a9" exitCode=0
Sep 09 07:05:37.565102 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:37.564659    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-83162d4f-949449878-t6xnh" event={"ID":"279bf7a2-cf87-463f-8de8-f8458307006e","Type":"ContainerDied","Data":"1132df04dc73c1f38903140f226437044f25575ef78077abbe581adc736334a9"}
Sep 09 07:05:37.565102 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:37.564661    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-83162d4f-949449878-t6xnh"
Sep 09 07:05:37.565102 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:37.564727    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-83162d4f-949449878-t6xnh" event={"ID":"279bf7a2-cf87-463f-8de8-f8458307006e","Type":"ContainerDied","Data":"dc900b299815492d542b25bafe7c90fbaef334e13e808532ffa4fa2211c99712"}
Sep 09 07:05:37.565102 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:37.564784    2575 scope.go:117] "RemoveContainer" containerID="1132df04dc73c1f38903140f226437044f25575ef78077abbe581adc736334a9"
Sep 09 07:05:37.566155 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:37.566096    2575 generic.go:356] "Generic (PLEG): container finished" podID="b2189bed-ec41-4838-9123-451b6f1d9e90" containerID="c932d4f74cb2dc67d0c57fb28428bf5b738b1e52d76c290fba95e7079e853dd6" exitCode=0
Sep 09 07:05:37.566155 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:37.566142    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-83162d4f-c59f8884b-mmczv" event={"ID":"b2189bed-ec41-4838-9123-451b6f1d9e90","Type":"ContainerDied","Data":"c932d4f74cb2dc67d0c57fb28428bf5b738b1e52d76c290fba95e7079e853dd6"}
Sep 09 07:05:37.566260 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:37.566157    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-83162d4f-c59f8884b-mmczv"
Sep 09 07:05:37.566260 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:37.566177    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-83162d4f-c59f8884b-mmczv" event={"ID":"b2189bed-ec41-4838-9123-451b6f1d9e90","Type":"ContainerDied","Data":"0fef2bb7c555de604095729bf23ddb45f906359b499b650e53d32e89466b80a4"}
Sep 09 07:05:37.576191 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:37.576173    2575 scope.go:117] "RemoveContainer" containerID="1132df04dc73c1f38903140f226437044f25575ef78077abbe581adc736334a9"
Sep 09 07:05:37.576489 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:05:37.576465    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1132df04dc73c1f38903140f226437044f25575ef78077abbe581adc736334a9\": container with ID starting with 1132df04dc73c1f38903140f226437044f25575ef78077abbe581adc736334a9 not found: ID does not exist" containerID="1132df04dc73c1f38903140f226437044f25575ef78077abbe581adc736334a9"
Sep 09 07:05:37.576567 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:37.576500    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1132df04dc73c1f38903140f226437044f25575ef78077abbe581adc736334a9"} err="failed to get container status \"1132df04dc73c1f38903140f226437044f25575ef78077abbe581adc736334a9\": rpc error: code = NotFound desc = could not find container \"1132df04dc73c1f38903140f226437044f25575ef78077abbe581adc736334a9\": container with ID starting with 1132df04dc73c1f38903140f226437044f25575ef78077abbe581adc736334a9 not found: ID does not exist"
Sep 09 07:05:37.576567 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:37.576524    2575 scope.go:117] "RemoveContainer" containerID="c932d4f74cb2dc67d0c57fb28428bf5b738b1e52d76c290fba95e7079e853dd6"
Sep 09 07:05:37.584564 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:37.584547    2575 scope.go:117] "RemoveContainer" containerID="c932d4f74cb2dc67d0c57fb28428bf5b738b1e52d76c290fba95e7079e853dd6"
Sep 09 07:05:37.584857 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:05:37.584840    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c932d4f74cb2dc67d0c57fb28428bf5b738b1e52d76c290fba95e7079e853dd6\": container with ID starting with c932d4f74cb2dc67d0c57fb28428bf5b738b1e52d76c290fba95e7079e853dd6 not found: ID does not exist" containerID="c932d4f74cb2dc67d0c57fb28428bf5b738b1e52d76c290fba95e7079e853dd6"
Sep 09 07:05:37.584915 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:37.584865    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c932d4f74cb2dc67d0c57fb28428bf5b738b1e52d76c290fba95e7079e853dd6"} err="failed to get container status \"c932d4f74cb2dc67d0c57fb28428bf5b738b1e52d76c290fba95e7079e853dd6\": rpc error: code = NotFound desc = could not find container \"c932d4f74cb2dc67d0c57fb28428bf5b738b1e52d76c290fba95e7079e853dd6\": container with ID starting with c932d4f74cb2dc67d0c57fb28428bf5b738b1e52d76c290fba95e7079e853dd6 not found: ID does not exist"
Sep 09 07:05:37.608057 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:37.608033    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-83162d4f-c59f8884b-mmczv"]
Sep 09 07:05:37.613284 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:37.613262    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-83162d4f-c59f8884b-mmczv"]
Sep 09 07:05:37.642652 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:37.642629    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-83162d4f-949449878-t6xnh"]
Sep 09 07:05:37.650732 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:37.650713    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-83162d4f-949449878-t6xnh"]
Sep 09 07:05:37.711677 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:37.711650    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="279bf7a2-cf87-463f-8de8-f8458307006e" path="/var/lib/kubelet/pods/279bf7a2-cf87-463f-8de8-f8458307006e/volumes"
Sep 09 07:05:37.712039 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:37.712022    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2189bed-ec41-4838-9123-451b6f1d9e90" path="/var/lib/kubelet/pods/b2189bed-ec41-4838-9123-451b6f1d9e90/volumes"
Sep 09 07:05:44.950481 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:44.950444    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-7eec132b-5f4667cb95-hbhsv"]
Sep 09 07:05:44.951034 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:44.951015    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2189bed-ec41-4838-9123-451b6f1d9e90" containerName="payload-processing"
Sep 09 07:05:44.951129 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:44.951038    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2189bed-ec41-4838-9123-451b6f1d9e90" containerName="payload-processing"
Sep 09 07:05:44.951129 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:44.951049    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="279bf7a2-cf87-463f-8de8-f8458307006e" containerName="payload-pre-processing"
Sep 09 07:05:44.951129 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:44.951058    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="279bf7a2-cf87-463f-8de8-f8458307006e" containerName="payload-pre-processing"
Sep 09 07:05:44.951283 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:44.951165    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2189bed-ec41-4838-9123-451b6f1d9e90" containerName="payload-processing"
Sep 09 07:05:44.951283 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:44.951180    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="279bf7a2-cf87-463f-8de8-f8458307006e" containerName="payload-pre-processing"
Sep 09 07:05:44.955902 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:44.955883    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-7eec132b-5f4667cb95-hbhsv"
Sep 09 07:05:44.960220 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:44.960201    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-7eec132b-dockercfg-ffgjd\""
Sep 09 07:05:44.960490 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:44.960473    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-7eec132b\""
Sep 09 07:05:44.972917 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:44.972886    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-7eec132b-5f4667cb95-hbhsv"]
Sep 09 07:05:45.049027 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:45.048996    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7x98\" (UniqueName: \"kubernetes.io/projected/a24d0a5d-a836-404c-a393-a9ff0b86daf9-kube-api-access-j7x98\") pod \"payload-processing-e2e-ait-7eec132b-5f4667cb95-hbhsv\" (UID: \"a24d0a5d-a836-404c-a393-a9ff0b86daf9\") " pod="openshift-ingress/payload-processing-e2e-ait-7eec132b-5f4667cb95-hbhsv"
Sep 09 07:05:45.049157 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:45.049038    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a24d0a5d-a836-404c-a393-a9ff0b86daf9-plugins-config-volume\") pod \"payload-processing-e2e-ait-7eec132b-5f4667cb95-hbhsv\" (UID: \"a24d0a5d-a836-404c-a393-a9ff0b86daf9\") " pod="openshift-ingress/payload-processing-e2e-ait-7eec132b-5f4667cb95-hbhsv"
Sep 09 07:05:45.055497 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:45.055466    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-7eec132b-85489d769d-km8rn"]
Sep 09 07:05:45.058683 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:45.058664    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-7eec132b-85489d769d-km8rn"
Sep 09 07:05:45.091207 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:45.091184    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-7eec132b-85489d769d-km8rn"]
Sep 09 07:05:45.149834 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:45.149809    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-np6mq\" (UniqueName: \"kubernetes.io/projected/f8b6ff41-d818-4b6d-b99d-c1495d4d261d-kube-api-access-np6mq\") pod \"payload-pre-processing-e2e-ait-7eec132b-85489d769d-km8rn\" (UID: \"f8b6ff41-d818-4b6d-b99d-c1495d4d261d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-7eec132b-85489d769d-km8rn"
Sep 09 07:05:45.149951 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:45.149913    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7x98\" (UniqueName: \"kubernetes.io/projected/a24d0a5d-a836-404c-a393-a9ff0b86daf9-kube-api-access-j7x98\") pod \"payload-processing-e2e-ait-7eec132b-5f4667cb95-hbhsv\" (UID: \"a24d0a5d-a836-404c-a393-a9ff0b86daf9\") " pod="openshift-ingress/payload-processing-e2e-ait-7eec132b-5f4667cb95-hbhsv"
Sep 09 07:05:45.150000 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:45.149952    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8b6ff41-d818-4b6d-b99d-c1495d4d261d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-7eec132b-85489d769d-km8rn\" (UID: \"f8b6ff41-d818-4b6d-b99d-c1495d4d261d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-7eec132b-85489d769d-km8rn"
Sep 09 07:05:45.150000 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:45.149973    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a24d0a5d-a836-404c-a393-a9ff0b86daf9-plugins-config-volume\") pod \"payload-processing-e2e-ait-7eec132b-5f4667cb95-hbhsv\" (UID: \"a24d0a5d-a836-404c-a393-a9ff0b86daf9\") " pod="openshift-ingress/payload-processing-e2e-ait-7eec132b-5f4667cb95-hbhsv"
Sep 09 07:05:45.150561 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:45.150545    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a24d0a5d-a836-404c-a393-a9ff0b86daf9-plugins-config-volume\") pod \"payload-processing-e2e-ait-7eec132b-5f4667cb95-hbhsv\" (UID: \"a24d0a5d-a836-404c-a393-a9ff0b86daf9\") " pod="openshift-ingress/payload-processing-e2e-ait-7eec132b-5f4667cb95-hbhsv"
Sep 09 07:05:45.164739 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:45.164719    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7x98\" (UniqueName: \"kubernetes.io/projected/a24d0a5d-a836-404c-a393-a9ff0b86daf9-kube-api-access-j7x98\") pod \"payload-processing-e2e-ait-7eec132b-5f4667cb95-hbhsv\" (UID: \"a24d0a5d-a836-404c-a393-a9ff0b86daf9\") " pod="openshift-ingress/payload-processing-e2e-ait-7eec132b-5f4667cb95-hbhsv"
Sep 09 07:05:45.250877 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:45.250826    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8b6ff41-d818-4b6d-b99d-c1495d4d261d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-7eec132b-85489d769d-km8rn\" (UID: \"f8b6ff41-d818-4b6d-b99d-c1495d4d261d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-7eec132b-85489d769d-km8rn"
Sep 09 07:05:45.250969 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:45.250879    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-np6mq\" (UniqueName: \"kubernetes.io/projected/f8b6ff41-d818-4b6d-b99d-c1495d4d261d-kube-api-access-np6mq\") pod \"payload-pre-processing-e2e-ait-7eec132b-85489d769d-km8rn\" (UID: \"f8b6ff41-d818-4b6d-b99d-c1495d4d261d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-7eec132b-85489d769d-km8rn"
Sep 09 07:05:45.251433 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:45.251416    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8b6ff41-d818-4b6d-b99d-c1495d4d261d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-7eec132b-85489d769d-km8rn\" (UID: \"f8b6ff41-d818-4b6d-b99d-c1495d4d261d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-7eec132b-85489d769d-km8rn"
Sep 09 07:05:45.263441 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:45.263421    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-np6mq\" (UniqueName: \"kubernetes.io/projected/f8b6ff41-d818-4b6d-b99d-c1495d4d261d-kube-api-access-np6mq\") pod \"payload-pre-processing-e2e-ait-7eec132b-85489d769d-km8rn\" (UID: \"f8b6ff41-d818-4b6d-b99d-c1495d4d261d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-7eec132b-85489d769d-km8rn"
Sep 09 07:05:45.266236 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:45.266221    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-7eec132b-5f4667cb95-hbhsv"
Sep 09 07:05:45.368482 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:45.368451    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-7eec132b-85489d769d-km8rn"
Sep 09 07:05:45.541246 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:45.541224    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-7eec132b-5f4667cb95-hbhsv"]
Sep 09 07:05:45.542724 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:05:45.542700    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda24d0a5d_a836_404c_a393_a9ff0b86daf9.slice/crio-667c4546f63a2dca6aa418a11027dd4e45e59c5ee09977a2bb011b738813a021 WatchSource:0}: Error finding container 667c4546f63a2dca6aa418a11027dd4e45e59c5ee09977a2bb011b738813a021: Status 404 returned error can't find the container with id 667c4546f63a2dca6aa418a11027dd4e45e59c5ee09977a2bb011b738813a021
Sep 09 07:05:45.616259 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:45.616233    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-7eec132b-5f4667cb95-hbhsv" event={"ID":"a24d0a5d-a836-404c-a393-a9ff0b86daf9","Type":"ContainerStarted","Data":"667c4546f63a2dca6aa418a11027dd4e45e59c5ee09977a2bb011b738813a021"}
Sep 09 07:05:45.660098 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:45.660068    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-7eec132b-85489d769d-km8rn"]
Sep 09 07:05:45.661821 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:05:45.661796    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8b6ff41_d818_4b6d_b99d_c1495d4d261d.slice/crio-23b0fbca7af409d0799548a7fbe296c398c863ec3c41733282c46e39eee10fa5 WatchSource:0}: Error finding container 23b0fbca7af409d0799548a7fbe296c398c863ec3c41733282c46e39eee10fa5: Status 404 returned error can't find the container with id 23b0fbca7af409d0799548a7fbe296c398c863ec3c41733282c46e39eee10fa5
Sep 09 07:05:46.623988 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:46.623949    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-7eec132b-5f4667cb95-hbhsv" event={"ID":"a24d0a5d-a836-404c-a393-a9ff0b86daf9","Type":"ContainerStarted","Data":"ad283ff8a7bf00a5d2e01c8e1d201b1cdd59e53bb7ee7d434022fdee41b0b862"}
Sep 09 07:05:46.624420 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:46.624058    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-7eec132b-5f4667cb95-hbhsv"
Sep 09 07:05:46.625579 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:46.625558    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-7eec132b-85489d769d-km8rn" event={"ID":"f8b6ff41-d818-4b6d-b99d-c1495d4d261d","Type":"ContainerStarted","Data":"1fe388c73a1ed319b8b06803ef18c96db3dcfb646c9bc464f308aecf61e8e8d5"}
Sep 09 07:05:46.625667 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:46.625591    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-7eec132b-85489d769d-km8rn" event={"ID":"f8b6ff41-d818-4b6d-b99d-c1495d4d261d","Type":"ContainerStarted","Data":"23b0fbca7af409d0799548a7fbe296c398c863ec3c41733282c46e39eee10fa5"}
Sep 09 07:05:46.625667 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:46.625626    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-7eec132b-85489d769d-km8rn"
Sep 09 07:05:46.653512 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:46.653467    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-7eec132b-5f4667cb95-hbhsv" podStartSLOduration=2.653454241 podStartE2EDuration="2.653454241s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 07:05:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 07:05:46.650381719 +0000 UTC m=+881.442191073" watchObservedRunningTime="2026-09-09 07:05:46.653454241 +0000 UTC m=+881.445263624"
Sep 09 07:05:46.674650 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:46.674607    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-7eec132b-85489d769d-km8rn" podStartSLOduration=1.6745918309999999 podStartE2EDuration="1.674591831s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 07:05:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 07:05:46.673579769 +0000 UTC m=+881.465389106" watchObservedRunningTime="2026-09-09 07:05:46.674591831 +0000 UTC m=+881.466401150"
Sep 09 07:05:57.634312 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:57.634237    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-7eec132b-5f4667cb95-hbhsv"
Sep 09 07:05:57.634312 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:05:57.634299    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-7eec132b-85489d769d-km8rn"
Sep 09 07:06:16.819306 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:16.819265    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-40c98b-579d5754c7-lnlgb"]
Sep 09 07:06:16.819813 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:16.819483    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-40c98b-579d5754c7-lnlgb" podUID="095643f2-fdf6-42bb-9709-dd5628f129fd" containerName="payload-processing" containerID="cri-o://167940e9ba37e66a19f553855c56a80456d0d3f00a82b35ce36e4ad2fb8f0059" gracePeriod=30
Sep 09 07:06:16.826779 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:16.826733    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-40c98b-7874688f8-brkr4"]
Sep 09 07:06:16.827036 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:16.826980    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-autores-40c98b-7874688f8-brkr4" podUID="1054978f-4b57-4e60-9bab-597ba4b94bce" containerName="payload-pre-processing" containerID="cri-o://30456cee46b1f03461182ee554e3f908cd39ae10d92db488eeefcba2911cf4ba" gracePeriod=30
Sep 09 07:06:17.103840 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.103817    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-40c98b-579d5754c7-lnlgb"
Sep 09 07:06:17.107468 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.107446    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-40c98b-7874688f8-brkr4"
Sep 09 07:06:17.223263 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.223237    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1054978f-4b57-4e60-9bab-597ba4b94bce-plugins-config-volume\") pod \"1054978f-4b57-4e60-9bab-597ba4b94bce\" (UID: \"1054978f-4b57-4e60-9bab-597ba4b94bce\") "
Sep 09 07:06:17.223449 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.223279    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vc7xn\" (UniqueName: \"kubernetes.io/projected/095643f2-fdf6-42bb-9709-dd5628f129fd-kube-api-access-vc7xn\") pod \"095643f2-fdf6-42bb-9709-dd5628f129fd\" (UID: \"095643f2-fdf6-42bb-9709-dd5628f129fd\") "
Sep 09 07:06:17.223449 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.223335    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhr74\" (UniqueName: \"kubernetes.io/projected/1054978f-4b57-4e60-9bab-597ba4b94bce-kube-api-access-lhr74\") pod \"1054978f-4b57-4e60-9bab-597ba4b94bce\" (UID: \"1054978f-4b57-4e60-9bab-597ba4b94bce\") "
Sep 09 07:06:17.223449 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.223407    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/095643f2-fdf6-42bb-9709-dd5628f129fd-plugins-config-volume\") pod \"095643f2-fdf6-42bb-9709-dd5628f129fd\" (UID: \"095643f2-fdf6-42bb-9709-dd5628f129fd\") "
Sep 09 07:06:17.223812 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.223674    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1054978f-4b57-4e60-9bab-597ba4b94bce-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1054978f-4b57-4e60-9bab-597ba4b94bce" (UID: "1054978f-4b57-4e60-9bab-597ba4b94bce"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 07:06:17.223890 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.223841    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/095643f2-fdf6-42bb-9709-dd5628f129fd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "095643f2-fdf6-42bb-9709-dd5628f129fd" (UID: "095643f2-fdf6-42bb-9709-dd5628f129fd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 07:06:17.225588 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.225565    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1054978f-4b57-4e60-9bab-597ba4b94bce-kube-api-access-lhr74" (OuterVolumeSpecName: "kube-api-access-lhr74") pod "1054978f-4b57-4e60-9bab-597ba4b94bce" (UID: "1054978f-4b57-4e60-9bab-597ba4b94bce"). InnerVolumeSpecName "kube-api-access-lhr74". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 07:06:17.225661 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.225584    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/095643f2-fdf6-42bb-9709-dd5628f129fd-kube-api-access-vc7xn" (OuterVolumeSpecName: "kube-api-access-vc7xn") pod "095643f2-fdf6-42bb-9709-dd5628f129fd" (UID: "095643f2-fdf6-42bb-9709-dd5628f129fd"). InnerVolumeSpecName "kube-api-access-vc7xn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 07:06:17.324706 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.324675    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/095643f2-fdf6-42bb-9709-dd5628f129fd-plugins-config-volume\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:06:17.324706 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.324700    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1054978f-4b57-4e60-9bab-597ba4b94bce-plugins-config-volume\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:06:17.324706 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.324709    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vc7xn\" (UniqueName: \"kubernetes.io/projected/095643f2-fdf6-42bb-9709-dd5628f129fd-kube-api-access-vc7xn\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:06:17.324942 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.324719    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhr74\" (UniqueName: \"kubernetes.io/projected/1054978f-4b57-4e60-9bab-597ba4b94bce-kube-api-access-lhr74\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:06:17.751236 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.751208    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-b212cb/test-model-b212cb-kserve-79c6b74997-vm48z"]
Sep 09 07:06:17.751608 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.751595    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1054978f-4b57-4e60-9bab-597ba4b94bce" containerName="payload-pre-processing"
Sep 09 07:06:17.751692 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.751610    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1054978f-4b57-4e60-9bab-597ba4b94bce" containerName="payload-pre-processing"
Sep 09 07:06:17.751692 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.751627    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="095643f2-fdf6-42bb-9709-dd5628f129fd" containerName="payload-processing"
Sep 09 07:06:17.751692 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.751632    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="095643f2-fdf6-42bb-9709-dd5628f129fd" containerName="payload-processing"
Sep 09 07:06:17.751885 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.751695    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1054978f-4b57-4e60-9bab-597ba4b94bce" containerName="payload-pre-processing"
Sep 09 07:06:17.751885 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.751705    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="095643f2-fdf6-42bb-9709-dd5628f129fd" containerName="payload-processing"
Sep 09 07:06:17.754878 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.754864    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-b212cb/test-model-b212cb-kserve-79c6b74997-vm48z"
Sep 09 07:06:17.758046 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.758020    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-b212cb\"/\"default-dockercfg-bc4jn\""
Sep 09 07:06:17.759126 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.759102    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-b212cb\"/\"kube-root-ca.crt\""
Sep 09 07:06:17.759385 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.759368    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-b212cb\"/\"test-model-b212cb-kserve-self-signed-certs\""
Sep 09 07:06:17.759652 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.759637    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-b212cb\"/\"openshift-service-ca.crt\""
Sep 09 07:06:17.779246 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.779211    2575 generic.go:356] "Generic (PLEG): container finished" podID="1054978f-4b57-4e60-9bab-597ba4b94bce" containerID="30456cee46b1f03461182ee554e3f908cd39ae10d92db488eeefcba2911cf4ba" exitCode=0
Sep 09 07:06:17.779371 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.779331    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-40c98b-7874688f8-brkr4"
Sep 09 07:06:17.779429 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.779396    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-40c98b-7874688f8-brkr4" event={"ID":"1054978f-4b57-4e60-9bab-597ba4b94bce","Type":"ContainerDied","Data":"30456cee46b1f03461182ee554e3f908cd39ae10d92db488eeefcba2911cf4ba"}
Sep 09 07:06:17.779488 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.779472    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-40c98b-7874688f8-brkr4" event={"ID":"1054978f-4b57-4e60-9bab-597ba4b94bce","Type":"ContainerDied","Data":"1d5e6171168948fd70de058a40658ae4386bfbbf8ee5b249415616d6b6428624"}
Sep 09 07:06:17.779528 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.779507    2575 scope.go:117] "RemoveContainer" containerID="30456cee46b1f03461182ee554e3f908cd39ae10d92db488eeefcba2911cf4ba"
Sep 09 07:06:17.781178 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.781159    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-b212cb/test-model-b212cb-kserve-79c6b74997-vm48z"]
Sep 09 07:06:17.781312 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.781288    2575 generic.go:356] "Generic (PLEG): container finished" podID="095643f2-fdf6-42bb-9709-dd5628f129fd" containerID="167940e9ba37e66a19f553855c56a80456d0d3f00a82b35ce36e4ad2fb8f0059" exitCode=0
Sep 09 07:06:17.781415 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.781362    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-40c98b-579d5754c7-lnlgb"
Sep 09 07:06:17.781415 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.781303    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-40c98b-579d5754c7-lnlgb" event={"ID":"095643f2-fdf6-42bb-9709-dd5628f129fd","Type":"ContainerDied","Data":"167940e9ba37e66a19f553855c56a80456d0d3f00a82b35ce36e4ad2fb8f0059"}
Sep 09 07:06:17.781532 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.781449    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-40c98b-579d5754c7-lnlgb" event={"ID":"095643f2-fdf6-42bb-9709-dd5628f129fd","Type":"ContainerDied","Data":"43314d3f0f57138576d45d05ef30f56a53c7eb2fd5721c8e7f17f96a4c56810a"}
Sep 09 07:06:17.790866 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.790847    2575 scope.go:117] "RemoveContainer" containerID="30456cee46b1f03461182ee554e3f908cd39ae10d92db488eeefcba2911cf4ba"
Sep 09 07:06:17.791161 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:06:17.791144    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30456cee46b1f03461182ee554e3f908cd39ae10d92db488eeefcba2911cf4ba\": container with ID starting with 30456cee46b1f03461182ee554e3f908cd39ae10d92db488eeefcba2911cf4ba not found: ID does not exist" containerID="30456cee46b1f03461182ee554e3f908cd39ae10d92db488eeefcba2911cf4ba"
Sep 09 07:06:17.791206 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.791169    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30456cee46b1f03461182ee554e3f908cd39ae10d92db488eeefcba2911cf4ba"} err="failed to get container status \"30456cee46b1f03461182ee554e3f908cd39ae10d92db488eeefcba2911cf4ba\": rpc error: code = NotFound desc = could not find container \"30456cee46b1f03461182ee554e3f908cd39ae10d92db488eeefcba2911cf4ba\": container with ID starting with 30456cee46b1f03461182ee554e3f908cd39ae10d92db488eeefcba2911cf4ba not found: ID does not exist"
Sep 09 07:06:17.791206 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.791186    2575 scope.go:117] "RemoveContainer" containerID="167940e9ba37e66a19f553855c56a80456d0d3f00a82b35ce36e4ad2fb8f0059"
Sep 09 07:06:17.799605 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.799585    2575 scope.go:117] "RemoveContainer" containerID="167940e9ba37e66a19f553855c56a80456d0d3f00a82b35ce36e4ad2fb8f0059"
Sep 09 07:06:17.799885 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:06:17.799866    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"167940e9ba37e66a19f553855c56a80456d0d3f00a82b35ce36e4ad2fb8f0059\": container with ID starting with 167940e9ba37e66a19f553855c56a80456d0d3f00a82b35ce36e4ad2fb8f0059 not found: ID does not exist" containerID="167940e9ba37e66a19f553855c56a80456d0d3f00a82b35ce36e4ad2fb8f0059"
Sep 09 07:06:17.799949 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.799891    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"167940e9ba37e66a19f553855c56a80456d0d3f00a82b35ce36e4ad2fb8f0059"} err="failed to get container status \"167940e9ba37e66a19f553855c56a80456d0d3f00a82b35ce36e4ad2fb8f0059\": rpc error: code = NotFound desc = could not find container \"167940e9ba37e66a19f553855c56a80456d0d3f00a82b35ce36e4ad2fb8f0059\": container with ID starting with 167940e9ba37e66a19f553855c56a80456d0d3f00a82b35ce36e4ad2fb8f0059 not found: ID does not exist"
Sep 09 07:06:17.809329 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.809305    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-40c98b-579d5754c7-lnlgb"]
Sep 09 07:06:17.813937 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.813918    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-40c98b-579d5754c7-lnlgb"]
Sep 09 07:06:17.827453 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.827433    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-40c98b-7874688f8-brkr4"]
Sep 09 07:06:17.828701 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.828682    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb68753c-cdb6-48e7-86bf-8c183f6c603e-dshm\") pod \"test-model-b212cb-kserve-79c6b74997-vm48z\" (UID: \"cb68753c-cdb6-48e7-86bf-8c183f6c603e\") " pod="ai-tenant-e2e-inf-a-b212cb/test-model-b212cb-kserve-79c6b74997-vm48z"
Sep 09 07:06:17.828813 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.828715    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb68753c-cdb6-48e7-86bf-8c183f6c603e-home\") pod \"test-model-b212cb-kserve-79c6b74997-vm48z\" (UID: \"cb68753c-cdb6-48e7-86bf-8c183f6c603e\") " pod="ai-tenant-e2e-inf-a-b212cb/test-model-b212cb-kserve-79c6b74997-vm48z"
Sep 09 07:06:17.828813 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.828733    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb68753c-cdb6-48e7-86bf-8c183f6c603e-tmp-dir\") pod \"test-model-b212cb-kserve-79c6b74997-vm48z\" (UID: \"cb68753c-cdb6-48e7-86bf-8c183f6c603e\") " pod="ai-tenant-e2e-inf-a-b212cb/test-model-b212cb-kserve-79c6b74997-vm48z"
Sep 09 07:06:17.828927 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.828883    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scl9x\" (UniqueName: \"kubernetes.io/projected/cb68753c-cdb6-48e7-86bf-8c183f6c603e-kube-api-access-scl9x\") pod \"test-model-b212cb-kserve-79c6b74997-vm48z\" (UID: \"cb68753c-cdb6-48e7-86bf-8c183f6c603e\") " pod="ai-tenant-e2e-inf-a-b212cb/test-model-b212cb-kserve-79c6b74997-vm48z"
Sep 09 07:06:17.828979 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.828931    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb68753c-cdb6-48e7-86bf-8c183f6c603e-model-cache\") pod \"test-model-b212cb-kserve-79c6b74997-vm48z\" (UID: \"cb68753c-cdb6-48e7-86bf-8c183f6c603e\") " pod="ai-tenant-e2e-inf-a-b212cb/test-model-b212cb-kserve-79c6b74997-vm48z"
Sep 09 07:06:17.828979 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.828960    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb68753c-cdb6-48e7-86bf-8c183f6c603e-tls-certs\") pod \"test-model-b212cb-kserve-79c6b74997-vm48z\" (UID: \"cb68753c-cdb6-48e7-86bf-8c183f6c603e\") " pod="ai-tenant-e2e-inf-a-b212cb/test-model-b212cb-kserve-79c6b74997-vm48z"
Sep 09 07:06:17.830943 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.830922    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-40c98b-7874688f8-brkr4"]
Sep 09 07:06:17.930343 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.930318    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb68753c-cdb6-48e7-86bf-8c183f6c603e-model-cache\") pod \"test-model-b212cb-kserve-79c6b74997-vm48z\" (UID: \"cb68753c-cdb6-48e7-86bf-8c183f6c603e\") " pod="ai-tenant-e2e-inf-a-b212cb/test-model-b212cb-kserve-79c6b74997-vm48z"
Sep 09 07:06:17.930440 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.930347    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb68753c-cdb6-48e7-86bf-8c183f6c603e-tls-certs\") pod \"test-model-b212cb-kserve-79c6b74997-vm48z\" (UID: \"cb68753c-cdb6-48e7-86bf-8c183f6c603e\") " pod="ai-tenant-e2e-inf-a-b212cb/test-model-b212cb-kserve-79c6b74997-vm48z"
Sep 09 07:06:17.930440 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.930385    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb68753c-cdb6-48e7-86bf-8c183f6c603e-dshm\") pod \"test-model-b212cb-kserve-79c6b74997-vm48z\" (UID: \"cb68753c-cdb6-48e7-86bf-8c183f6c603e\") " pod="ai-tenant-e2e-inf-a-b212cb/test-model-b212cb-kserve-79c6b74997-vm48z"
Sep 09 07:06:17.930440 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.930401    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb68753c-cdb6-48e7-86bf-8c183f6c603e-home\") pod \"test-model-b212cb-kserve-79c6b74997-vm48z\" (UID: \"cb68753c-cdb6-48e7-86bf-8c183f6c603e\") " pod="ai-tenant-e2e-inf-a-b212cb/test-model-b212cb-kserve-79c6b74997-vm48z"
Sep 09 07:06:17.930440 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.930416    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb68753c-cdb6-48e7-86bf-8c183f6c603e-tmp-dir\") pod \"test-model-b212cb-kserve-79c6b74997-vm48z\" (UID: \"cb68753c-cdb6-48e7-86bf-8c183f6c603e\") " pod="ai-tenant-e2e-inf-a-b212cb/test-model-b212cb-kserve-79c6b74997-vm48z"
Sep 09 07:06:17.930632 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.930460    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scl9x\" (UniqueName: \"kubernetes.io/projected/cb68753c-cdb6-48e7-86bf-8c183f6c603e-kube-api-access-scl9x\") pod \"test-model-b212cb-kserve-79c6b74997-vm48z\" (UID: \"cb68753c-cdb6-48e7-86bf-8c183f6c603e\") " pod="ai-tenant-e2e-inf-a-b212cb/test-model-b212cb-kserve-79c6b74997-vm48z"
Sep 09 07:06:17.930773 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.930727    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb68753c-cdb6-48e7-86bf-8c183f6c603e-model-cache\") pod \"test-model-b212cb-kserve-79c6b74997-vm48z\" (UID: \"cb68753c-cdb6-48e7-86bf-8c183f6c603e\") " pod="ai-tenant-e2e-inf-a-b212cb/test-model-b212cb-kserve-79c6b74997-vm48z"
Sep 09 07:06:17.930842 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.930810    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb68753c-cdb6-48e7-86bf-8c183f6c603e-home\") pod \"test-model-b212cb-kserve-79c6b74997-vm48z\" (UID: \"cb68753c-cdb6-48e7-86bf-8c183f6c603e\") " pod="ai-tenant-e2e-inf-a-b212cb/test-model-b212cb-kserve-79c6b74997-vm48z"
Sep 09 07:06:17.930891 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.930867    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb68753c-cdb6-48e7-86bf-8c183f6c603e-tmp-dir\") pod \"test-model-b212cb-kserve-79c6b74997-vm48z\" (UID: \"cb68753c-cdb6-48e7-86bf-8c183f6c603e\") " pod="ai-tenant-e2e-inf-a-b212cb/test-model-b212cb-kserve-79c6b74997-vm48z"
Sep 09 07:06:17.932816 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.932798    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb68753c-cdb6-48e7-86bf-8c183f6c603e-dshm\") pod \"test-model-b212cb-kserve-79c6b74997-vm48z\" (UID: \"cb68753c-cdb6-48e7-86bf-8c183f6c603e\") " pod="ai-tenant-e2e-inf-a-b212cb/test-model-b212cb-kserve-79c6b74997-vm48z"
Sep 09 07:06:17.932975 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.932960    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb68753c-cdb6-48e7-86bf-8c183f6c603e-tls-certs\") pod \"test-model-b212cb-kserve-79c6b74997-vm48z\" (UID: \"cb68753c-cdb6-48e7-86bf-8c183f6c603e\") " pod="ai-tenant-e2e-inf-a-b212cb/test-model-b212cb-kserve-79c6b74997-vm48z"
Sep 09 07:06:17.940215 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:17.940196    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scl9x\" (UniqueName: \"kubernetes.io/projected/cb68753c-cdb6-48e7-86bf-8c183f6c603e-kube-api-access-scl9x\") pod \"test-model-b212cb-kserve-79c6b74997-vm48z\" (UID: \"cb68753c-cdb6-48e7-86bf-8c183f6c603e\") " pod="ai-tenant-e2e-inf-a-b212cb/test-model-b212cb-kserve-79c6b74997-vm48z"
Sep 09 07:06:18.068860 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:18.068796    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-b212cb/test-model-b212cb-kserve-79c6b74997-vm48z"
Sep 09 07:06:18.352272 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:18.352238    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-b212cb/test-model-b212cb-kserve-79c6b74997-vm48z"]
Sep 09 07:06:18.353718 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:06:18.353697    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb68753c_cdb6_48e7_86bf_8c183f6c603e.slice/crio-83dc5be03725a31e4c1ee448179bf16966226c78faedc541472f21e949c8999b WatchSource:0}: Error finding container 83dc5be03725a31e4c1ee448179bf16966226c78faedc541472f21e949c8999b: Status 404 returned error can't find the container with id 83dc5be03725a31e4c1ee448179bf16966226c78faedc541472f21e949c8999b
Sep 09 07:06:18.790285 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:18.790248    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-b212cb/test-model-b212cb-kserve-79c6b74997-vm48z" event={"ID":"cb68753c-cdb6-48e7-86bf-8c183f6c603e","Type":"ContainerStarted","Data":"505e9309fcb893e61c67a18af15d0f8d4c267c0658d6d32e8a06844f17a93ca4"}
Sep 09 07:06:18.790285 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:18.790289    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-b212cb/test-model-b212cb-kserve-79c6b74997-vm48z" event={"ID":"cb68753c-cdb6-48e7-86bf-8c183f6c603e","Type":"ContainerStarted","Data":"83dc5be03725a31e4c1ee448179bf16966226c78faedc541472f21e949c8999b"}
Sep 09 07:06:18.810555 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:18.810505    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-b212cb/test-model-b212cb-kserve-79c6b74997-vm48z" podStartSLOduration=1.81049025 podStartE2EDuration="1.81049025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 07:06:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 07:06:18.808657351 +0000 UTC m=+913.600466754" watchObservedRunningTime="2026-09-09 07:06:18.81049025 +0000 UTC m=+913.602299589"
Sep 09 07:06:19.712000 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:19.711967    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="095643f2-fdf6-42bb-9709-dd5628f129fd" path="/var/lib/kubelet/pods/095643f2-fdf6-42bb-9709-dd5628f129fd/volumes"
Sep 09 07:06:19.712482 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:19.712469    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1054978f-4b57-4e60-9bab-597ba4b94bce" path="/var/lib/kubelet/pods/1054978f-4b57-4e60-9bab-597ba4b94bce/volumes"
Sep 09 07:06:25.208139 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:25.208104    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-7eec132b-5f4667cb95-hbhsv"]
Sep 09 07:06:25.208782 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:25.208413    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-7eec132b-5f4667cb95-hbhsv" podUID="a24d0a5d-a836-404c-a393-a9ff0b86daf9" containerName="payload-processing" containerID="cri-o://ad283ff8a7bf00a5d2e01c8e1d201b1cdd59e53bb7ee7d434022fdee41b0b862" gracePeriod=30
Sep 09 07:06:25.253103 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:25.252973    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-7eec132b-85489d769d-km8rn"]
Sep 09 07:06:25.253318 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:25.253251    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-7eec132b-85489d769d-km8rn" podUID="f8b6ff41-d818-4b6d-b99d-c1495d4d261d" containerName="payload-pre-processing" containerID="cri-o://1fe388c73a1ed319b8b06803ef18c96db3dcfb646c9bc464f308aecf61e8e8d5" gracePeriod=30
Sep 09 07:06:25.571878 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:25.571855    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-7eec132b-5f4667cb95-hbhsv"
Sep 09 07:06:25.601930 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:25.601905    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-7eec132b-85489d769d-km8rn"
Sep 09 07:06:25.702027 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:25.701995    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8b6ff41-d818-4b6d-b99d-c1495d4d261d-plugins-config-volume\") pod \"f8b6ff41-d818-4b6d-b99d-c1495d4d261d\" (UID: \"f8b6ff41-d818-4b6d-b99d-c1495d4d261d\") "
Sep 09 07:06:25.702027 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:25.702031    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-np6mq\" (UniqueName: \"kubernetes.io/projected/f8b6ff41-d818-4b6d-b99d-c1495d4d261d-kube-api-access-np6mq\") pod \"f8b6ff41-d818-4b6d-b99d-c1495d4d261d\" (UID: \"f8b6ff41-d818-4b6d-b99d-c1495d4d261d\") "
Sep 09 07:06:25.702234 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:25.702128    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a24d0a5d-a836-404c-a393-a9ff0b86daf9-plugins-config-volume\") pod \"a24d0a5d-a836-404c-a393-a9ff0b86daf9\" (UID: \"a24d0a5d-a836-404c-a393-a9ff0b86daf9\") "
Sep 09 07:06:25.702234 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:25.702148    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7x98\" (UniqueName: \"kubernetes.io/projected/a24d0a5d-a836-404c-a393-a9ff0b86daf9-kube-api-access-j7x98\") pod \"a24d0a5d-a836-404c-a393-a9ff0b86daf9\" (UID: \"a24d0a5d-a836-404c-a393-a9ff0b86daf9\") "
Sep 09 07:06:25.702515 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:25.702486    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8b6ff41-d818-4b6d-b99d-c1495d4d261d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f8b6ff41-d818-4b6d-b99d-c1495d4d261d" (UID: "f8b6ff41-d818-4b6d-b99d-c1495d4d261d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 07:06:25.702588 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:25.702566    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a24d0a5d-a836-404c-a393-a9ff0b86daf9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a24d0a5d-a836-404c-a393-a9ff0b86daf9" (UID: "a24d0a5d-a836-404c-a393-a9ff0b86daf9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 07:06:25.704381 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:25.704329    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a24d0a5d-a836-404c-a393-a9ff0b86daf9-kube-api-access-j7x98" (OuterVolumeSpecName: "kube-api-access-j7x98") pod "a24d0a5d-a836-404c-a393-a9ff0b86daf9" (UID: "a24d0a5d-a836-404c-a393-a9ff0b86daf9"). InnerVolumeSpecName "kube-api-access-j7x98". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 07:06:25.704483 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:25.704391    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8b6ff41-d818-4b6d-b99d-c1495d4d261d-kube-api-access-np6mq" (OuterVolumeSpecName: "kube-api-access-np6mq") pod "f8b6ff41-d818-4b6d-b99d-c1495d4d261d" (UID: "f8b6ff41-d818-4b6d-b99d-c1495d4d261d"). InnerVolumeSpecName "kube-api-access-np6mq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 07:06:25.803215 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:25.803146    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a24d0a5d-a836-404c-a393-a9ff0b86daf9-plugins-config-volume\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:06:25.803215 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:25.803168    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7x98\" (UniqueName: \"kubernetes.io/projected/a24d0a5d-a836-404c-a393-a9ff0b86daf9-kube-api-access-j7x98\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:06:25.803215 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:25.803177    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8b6ff41-d818-4b6d-b99d-c1495d4d261d-plugins-config-volume\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:06:25.803215 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:25.803187    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-np6mq\" (UniqueName: \"kubernetes.io/projected/f8b6ff41-d818-4b6d-b99d-c1495d4d261d-kube-api-access-np6mq\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:06:25.833480 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:25.833440    2575 generic.go:356] "Generic (PLEG): container finished" podID="a24d0a5d-a836-404c-a393-a9ff0b86daf9" containerID="ad283ff8a7bf00a5d2e01c8e1d201b1cdd59e53bb7ee7d434022fdee41b0b862" exitCode=0
Sep 09 07:06:25.833638 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:25.833507    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-7eec132b-5f4667cb95-hbhsv"
Sep 09 07:06:25.833638 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:25.833529    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-7eec132b-5f4667cb95-hbhsv" event={"ID":"a24d0a5d-a836-404c-a393-a9ff0b86daf9","Type":"ContainerDied","Data":"ad283ff8a7bf00a5d2e01c8e1d201b1cdd59e53bb7ee7d434022fdee41b0b862"}
Sep 09 07:06:25.833796 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:25.833642    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-7eec132b-5f4667cb95-hbhsv" event={"ID":"a24d0a5d-a836-404c-a393-a9ff0b86daf9","Type":"ContainerDied","Data":"667c4546f63a2dca6aa418a11027dd4e45e59c5ee09977a2bb011b738813a021"}
Sep 09 07:06:25.833796 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:25.833673    2575 scope.go:117] "RemoveContainer" containerID="ad283ff8a7bf00a5d2e01c8e1d201b1cdd59e53bb7ee7d434022fdee41b0b862"
Sep 09 07:06:25.835166 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:25.835129    2575 generic.go:356] "Generic (PLEG): container finished" podID="f8b6ff41-d818-4b6d-b99d-c1495d4d261d" containerID="1fe388c73a1ed319b8b06803ef18c96db3dcfb646c9bc464f308aecf61e8e8d5" exitCode=0
Sep 09 07:06:25.835248 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:25.835160    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-7eec132b-85489d769d-km8rn" event={"ID":"f8b6ff41-d818-4b6d-b99d-c1495d4d261d","Type":"ContainerDied","Data":"1fe388c73a1ed319b8b06803ef18c96db3dcfb646c9bc464f308aecf61e8e8d5"}
Sep 09 07:06:25.835248 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:25.835190    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-7eec132b-85489d769d-km8rn"
Sep 09 07:06:25.835248 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:25.835206    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-7eec132b-85489d769d-km8rn" event={"ID":"f8b6ff41-d818-4b6d-b99d-c1495d4d261d","Type":"ContainerDied","Data":"23b0fbca7af409d0799548a7fbe296c398c863ec3c41733282c46e39eee10fa5"}
Sep 09 07:06:25.842807 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:25.842781    2575 scope.go:117] "RemoveContainer" containerID="ad283ff8a7bf00a5d2e01c8e1d201b1cdd59e53bb7ee7d434022fdee41b0b862"
Sep 09 07:06:25.844874 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:06:25.844852    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad283ff8a7bf00a5d2e01c8e1d201b1cdd59e53bb7ee7d434022fdee41b0b862\": container with ID starting with ad283ff8a7bf00a5d2e01c8e1d201b1cdd59e53bb7ee7d434022fdee41b0b862 not found: ID does not exist" containerID="ad283ff8a7bf00a5d2e01c8e1d201b1cdd59e53bb7ee7d434022fdee41b0b862"
Sep 09 07:06:25.844971 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:25.844882    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad283ff8a7bf00a5d2e01c8e1d201b1cdd59e53bb7ee7d434022fdee41b0b862"} err="failed to get container status \"ad283ff8a7bf00a5d2e01c8e1d201b1cdd59e53bb7ee7d434022fdee41b0b862\": rpc error: code = NotFound desc = could not find container \"ad283ff8a7bf00a5d2e01c8e1d201b1cdd59e53bb7ee7d434022fdee41b0b862\": container with ID starting with ad283ff8a7bf00a5d2e01c8e1d201b1cdd59e53bb7ee7d434022fdee41b0b862 not found: ID does not exist"
Sep 09 07:06:25.844971 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:25.844898    2575 scope.go:117] "RemoveContainer" containerID="1fe388c73a1ed319b8b06803ef18c96db3dcfb646c9bc464f308aecf61e8e8d5"
Sep 09 07:06:25.853896 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:25.853882    2575 scope.go:117] "RemoveContainer" containerID="1fe388c73a1ed319b8b06803ef18c96db3dcfb646c9bc464f308aecf61e8e8d5"
Sep 09 07:06:25.854166 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:06:25.854141    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fe388c73a1ed319b8b06803ef18c96db3dcfb646c9bc464f308aecf61e8e8d5\": container with ID starting with 1fe388c73a1ed319b8b06803ef18c96db3dcfb646c9bc464f308aecf61e8e8d5 not found: ID does not exist" containerID="1fe388c73a1ed319b8b06803ef18c96db3dcfb646c9bc464f308aecf61e8e8d5"
Sep 09 07:06:25.854259 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:25.854174    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fe388c73a1ed319b8b06803ef18c96db3dcfb646c9bc464f308aecf61e8e8d5"} err="failed to get container status \"1fe388c73a1ed319b8b06803ef18c96db3dcfb646c9bc464f308aecf61e8e8d5\": rpc error: code = NotFound desc = could not find container \"1fe388c73a1ed319b8b06803ef18c96db3dcfb646c9bc464f308aecf61e8e8d5\": container with ID starting with 1fe388c73a1ed319b8b06803ef18c96db3dcfb646c9bc464f308aecf61e8e8d5 not found: ID does not exist"
Sep 09 07:06:25.863550 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:25.863513    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-7eec132b-5f4667cb95-hbhsv"]
Sep 09 07:06:25.868889 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:25.868870    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-7eec132b-5f4667cb95-hbhsv"]
Sep 09 07:06:25.886899 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:25.886868    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-7eec132b-85489d769d-km8rn"]
Sep 09 07:06:25.895967 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:25.895944    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-7eec132b-85489d769d-km8rn"]
Sep 09 07:06:27.711280 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:27.711237    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a24d0a5d-a836-404c-a393-a9ff0b86daf9" path="/var/lib/kubelet/pods/a24d0a5d-a836-404c-a393-a9ff0b86daf9/volumes"
Sep 09 07:06:27.711738 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:27.711591    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8b6ff41-d818-4b6d-b99d-c1495d4d261d" path="/var/lib/kubelet/pods/f8b6ff41-d818-4b6d-b99d-c1495d4d261d/volumes"
Sep 09 07:06:28.069316 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:28.069242    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-b212cb/test-model-b212cb-kserve-79c6b74997-vm48z"
Sep 09 07:06:28.069316 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:28.069279    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-b212cb/test-model-b212cb-kserve-79c6b74997-vm48z"
Sep 09 07:06:28.081758 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:28.081724    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-b212cb/test-model-b212cb-kserve-79c6b74997-vm48z"
Sep 09 07:06:28.864357 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:28.864331    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-b212cb/test-model-b212cb-kserve-79c6b74997-vm48z"
Sep 09 07:06:32.159924 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:32.159893    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-29013a28-85bcc858db-bnzpl"]
Sep 09 07:06:32.160269 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:32.160250    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8b6ff41-d818-4b6d-b99d-c1495d4d261d" containerName="payload-pre-processing"
Sep 09 07:06:32.160269 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:32.160261    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8b6ff41-d818-4b6d-b99d-c1495d4d261d" containerName="payload-pre-processing"
Sep 09 07:06:32.160340 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:32.160280    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a24d0a5d-a836-404c-a393-a9ff0b86daf9" containerName="payload-processing"
Sep 09 07:06:32.160340 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:32.160286    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a24d0a5d-a836-404c-a393-a9ff0b86daf9" containerName="payload-processing"
Sep 09 07:06:32.160407 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:32.160347    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a24d0a5d-a836-404c-a393-a9ff0b86daf9" containerName="payload-processing"
Sep 09 07:06:32.160407 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:32.160357    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8b6ff41-d818-4b6d-b99d-c1495d4d261d" containerName="payload-pre-processing"
Sep 09 07:06:32.163482 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:32.163464    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-29013a28-85bcc858db-bnzpl"
Sep 09 07:06:32.169457 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:32.169438    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-29013a28\""
Sep 09 07:06:32.169945 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:32.169709    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-29013a28-dockercfg-jhlnj\""
Sep 09 07:06:32.203185 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:32.203164    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-29013a28-85bcc858db-bnzpl"]
Sep 09 07:06:32.259340 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:32.259314    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee7ab23e-4177-4f2f-b757-6a7bdc39c0b6-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-29013a28-85bcc858db-bnzpl\" (UID: \"ee7ab23e-4177-4f2f-b757-6a7bdc39c0b6\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-29013a28-85bcc858db-bnzpl"
Sep 09 07:06:32.259457 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:32.259351    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls8ms\" (UniqueName: \"kubernetes.io/projected/ee7ab23e-4177-4f2f-b757-6a7bdc39c0b6-kube-api-access-ls8ms\") pod \"payload-pre-processing-e2e-derive-29013a28-85bcc858db-bnzpl\" (UID: \"ee7ab23e-4177-4f2f-b757-6a7bdc39c0b6\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-29013a28-85bcc858db-bnzpl"
Sep 09 07:06:32.268343 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:32.268322    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-29013a28-599f9b695c-t67nx"]
Sep 09 07:06:32.271831 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:32.271813    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-29013a28-599f9b695c-t67nx"
Sep 09 07:06:32.287474 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:32.287452    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-29013a28-599f9b695c-t67nx"]
Sep 09 07:06:32.360182 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:32.360156    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggnlm\" (UniqueName: \"kubernetes.io/projected/e3572b42-8114-4135-86e6-07e9acaa06d6-kube-api-access-ggnlm\") pod \"payload-processing-e2e-derive-29013a28-599f9b695c-t67nx\" (UID: \"e3572b42-8114-4135-86e6-07e9acaa06d6\") " pod="openshift-ingress/payload-processing-e2e-derive-29013a28-599f9b695c-t67nx"
Sep 09 07:06:32.360314 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:32.360199    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3572b42-8114-4135-86e6-07e9acaa06d6-plugins-config-volume\") pod \"payload-processing-e2e-derive-29013a28-599f9b695c-t67nx\" (UID: \"e3572b42-8114-4135-86e6-07e9acaa06d6\") " pod="openshift-ingress/payload-processing-e2e-derive-29013a28-599f9b695c-t67nx"
Sep 09 07:06:32.360314 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:32.360268    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee7ab23e-4177-4f2f-b757-6a7bdc39c0b6-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-29013a28-85bcc858db-bnzpl\" (UID: \"ee7ab23e-4177-4f2f-b757-6a7bdc39c0b6\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-29013a28-85bcc858db-bnzpl"
Sep 09 07:06:32.360314 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:32.360287    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls8ms\" (UniqueName: \"kubernetes.io/projected/ee7ab23e-4177-4f2f-b757-6a7bdc39c0b6-kube-api-access-ls8ms\") pod \"payload-pre-processing-e2e-derive-29013a28-85bcc858db-bnzpl\" (UID: \"ee7ab23e-4177-4f2f-b757-6a7bdc39c0b6\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-29013a28-85bcc858db-bnzpl"
Sep 09 07:06:32.360887 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:32.360868    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee7ab23e-4177-4f2f-b757-6a7bdc39c0b6-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-29013a28-85bcc858db-bnzpl\" (UID: \"ee7ab23e-4177-4f2f-b757-6a7bdc39c0b6\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-29013a28-85bcc858db-bnzpl"
Sep 09 07:06:32.388117 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:32.388096    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls8ms\" (UniqueName: \"kubernetes.io/projected/ee7ab23e-4177-4f2f-b757-6a7bdc39c0b6-kube-api-access-ls8ms\") pod \"payload-pre-processing-e2e-derive-29013a28-85bcc858db-bnzpl\" (UID: \"ee7ab23e-4177-4f2f-b757-6a7bdc39c0b6\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-29013a28-85bcc858db-bnzpl"
Sep 09 07:06:32.461327 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:32.461271    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3572b42-8114-4135-86e6-07e9acaa06d6-plugins-config-volume\") pod \"payload-processing-e2e-derive-29013a28-599f9b695c-t67nx\" (UID: \"e3572b42-8114-4135-86e6-07e9acaa06d6\") " pod="openshift-ingress/payload-processing-e2e-derive-29013a28-599f9b695c-t67nx"
Sep 09 07:06:32.461422 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:32.461370    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggnlm\" (UniqueName: \"kubernetes.io/projected/e3572b42-8114-4135-86e6-07e9acaa06d6-kube-api-access-ggnlm\") pod \"payload-processing-e2e-derive-29013a28-599f9b695c-t67nx\" (UID: \"e3572b42-8114-4135-86e6-07e9acaa06d6\") " pod="openshift-ingress/payload-processing-e2e-derive-29013a28-599f9b695c-t67nx"
Sep 09 07:06:32.461933 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:32.461909    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3572b42-8114-4135-86e6-07e9acaa06d6-plugins-config-volume\") pod \"payload-processing-e2e-derive-29013a28-599f9b695c-t67nx\" (UID: \"e3572b42-8114-4135-86e6-07e9acaa06d6\") " pod="openshift-ingress/payload-processing-e2e-derive-29013a28-599f9b695c-t67nx"
Sep 09 07:06:32.473213 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:32.473192    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-29013a28-85bcc858db-bnzpl"
Sep 09 07:06:32.501932 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:32.501907    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggnlm\" (UniqueName: \"kubernetes.io/projected/e3572b42-8114-4135-86e6-07e9acaa06d6-kube-api-access-ggnlm\") pod \"payload-processing-e2e-derive-29013a28-599f9b695c-t67nx\" (UID: \"e3572b42-8114-4135-86e6-07e9acaa06d6\") " pod="openshift-ingress/payload-processing-e2e-derive-29013a28-599f9b695c-t67nx"
Sep 09 07:06:32.581727 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:32.581698    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-29013a28-599f9b695c-t67nx"
Sep 09 07:06:32.761668 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:32.761602    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-29013a28-85bcc858db-bnzpl"]
Sep 09 07:06:32.765263 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:06:32.765241    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee7ab23e_4177_4f2f_b757_6a7bdc39c0b6.slice/crio-030523d0c7f52a5ed11abad776b5328197edf9918b50ac15028817b4a3f23b7d WatchSource:0}: Error finding container 030523d0c7f52a5ed11abad776b5328197edf9918b50ac15028817b4a3f23b7d: Status 404 returned error can't find the container with id 030523d0c7f52a5ed11abad776b5328197edf9918b50ac15028817b4a3f23b7d
Sep 09 07:06:32.874035 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:06:32.874005    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3572b42_8114_4135_86e6_07e9acaa06d6.slice/crio-dd4d19e238f11228e2c36e2493eb269b82947dfbcca68df51ed8a5f70c1bb3af WatchSource:0}: Error finding container dd4d19e238f11228e2c36e2493eb269b82947dfbcca68df51ed8a5f70c1bb3af: Status 404 returned error can't find the container with id dd4d19e238f11228e2c36e2493eb269b82947dfbcca68df51ed8a5f70c1bb3af
Sep 09 07:06:32.875783 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:32.875731    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-29013a28-85bcc858db-bnzpl" event={"ID":"ee7ab23e-4177-4f2f-b757-6a7bdc39c0b6","Type":"ContainerStarted","Data":"d6eb0d2090e74109e33f2992baf3fb18acf06c0a77c9cfdc81f73c1b82967ad8"}
Sep 09 07:06:32.875903 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:32.875810    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-29013a28-85bcc858db-bnzpl" event={"ID":"ee7ab23e-4177-4f2f-b757-6a7bdc39c0b6","Type":"ContainerStarted","Data":"030523d0c7f52a5ed11abad776b5328197edf9918b50ac15028817b4a3f23b7d"}
Sep 09 07:06:32.875970 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:32.875915    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-29013a28-85bcc858db-bnzpl"
Sep 09 07:06:32.877147 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:32.877129    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-29013a28-599f9b695c-t67nx"]
Sep 09 07:06:32.914217 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:32.914160    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-29013a28-85bcc858db-bnzpl" podStartSLOduration=0.91414191 podStartE2EDuration="914.14191ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 07:06:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 07:06:32.913031131 +0000 UTC m=+927.704840471" watchObservedRunningTime="2026-09-09 07:06:32.91414191 +0000 UTC m=+927.705951251"
Sep 09 07:06:33.882278 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:33.882245    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-29013a28-599f9b695c-t67nx" event={"ID":"e3572b42-8114-4135-86e6-07e9acaa06d6","Type":"ContainerStarted","Data":"b8bb63564fdbc4e4c935cd0a6bb39ca6a6fa4934be19ddfcf1472342e2c297c4"}
Sep 09 07:06:33.882634 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:33.882322    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-29013a28-599f9b695c-t67nx"
Sep 09 07:06:33.882634 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:33.882366    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-29013a28-599f9b695c-t67nx" event={"ID":"e3572b42-8114-4135-86e6-07e9acaa06d6","Type":"ContainerStarted","Data":"dd4d19e238f11228e2c36e2493eb269b82947dfbcca68df51ed8a5f70c1bb3af"}
Sep 09 07:06:33.909511 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:33.909459    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-29013a28-599f9b695c-t67nx" podStartSLOduration=1.909441364 podStartE2EDuration="1.909441364s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 07:06:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 07:06:33.905882467 +0000 UTC m=+928.697691818" watchObservedRunningTime="2026-09-09 07:06:33.909441364 +0000 UTC m=+928.701250704"
Sep 09 07:06:43.884739 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:43.884713    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-29013a28-85bcc858db-bnzpl"
Sep 09 07:06:44.890189 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:06:44.890161    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-29013a28-599f9b695c-t67nx"
Sep 09 07:07:02.223145 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:02.223105    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-29013a28-599f9b695c-t67nx"]
Sep 09 07:07:02.223721 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:02.223371    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-29013a28-599f9b695c-t67nx" podUID="e3572b42-8114-4135-86e6-07e9acaa06d6" containerName="payload-processing" containerID="cri-o://b8bb63564fdbc4e4c935cd0a6bb39ca6a6fa4934be19ddfcf1472342e2c297c4" gracePeriod=30
Sep 09 07:07:02.230565 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:02.230540    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-29013a28-85bcc858db-bnzpl"]
Sep 09 07:07:02.230769 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:02.230725    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-29013a28-85bcc858db-bnzpl" podUID="ee7ab23e-4177-4f2f-b757-6a7bdc39c0b6" containerName="payload-pre-processing" containerID="cri-o://d6eb0d2090e74109e33f2992baf3fb18acf06c0a77c9cfdc81f73c1b82967ad8" gracePeriod=30
Sep 09 07:07:02.491318 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:02.491280    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-29013a28-599f9b695c-t67nx"
Sep 09 07:07:02.493925 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:02.493908    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-29013a28-85bcc858db-bnzpl"
Sep 09 07:07:02.619436 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:02.619402    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ls8ms\" (UniqueName: \"kubernetes.io/projected/ee7ab23e-4177-4f2f-b757-6a7bdc39c0b6-kube-api-access-ls8ms\") pod \"ee7ab23e-4177-4f2f-b757-6a7bdc39c0b6\" (UID: \"ee7ab23e-4177-4f2f-b757-6a7bdc39c0b6\") "
Sep 09 07:07:02.619628 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:02.619492    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3572b42-8114-4135-86e6-07e9acaa06d6-plugins-config-volume\") pod \"e3572b42-8114-4135-86e6-07e9acaa06d6\" (UID: \"e3572b42-8114-4135-86e6-07e9acaa06d6\") "
Sep 09 07:07:02.619628 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:02.619572    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggnlm\" (UniqueName: \"kubernetes.io/projected/e3572b42-8114-4135-86e6-07e9acaa06d6-kube-api-access-ggnlm\") pod \"e3572b42-8114-4135-86e6-07e9acaa06d6\" (UID: \"e3572b42-8114-4135-86e6-07e9acaa06d6\") "
Sep 09 07:07:02.619777 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:02.619694    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee7ab23e-4177-4f2f-b757-6a7bdc39c0b6-plugins-config-volume\") pod \"ee7ab23e-4177-4f2f-b757-6a7bdc39c0b6\" (UID: \"ee7ab23e-4177-4f2f-b757-6a7bdc39c0b6\") "
Sep 09 07:07:02.619941 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:02.619905    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3572b42-8114-4135-86e6-07e9acaa06d6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e3572b42-8114-4135-86e6-07e9acaa06d6" (UID: "e3572b42-8114-4135-86e6-07e9acaa06d6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 07:07:02.620085 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:02.620057    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee7ab23e-4177-4f2f-b757-6a7bdc39c0b6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ee7ab23e-4177-4f2f-b757-6a7bdc39c0b6" (UID: "ee7ab23e-4177-4f2f-b757-6a7bdc39c0b6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 07:07:02.620085 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:02.620068    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3572b42-8114-4135-86e6-07e9acaa06d6-plugins-config-volume\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:07:02.621767 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:02.621730    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3572b42-8114-4135-86e6-07e9acaa06d6-kube-api-access-ggnlm" (OuterVolumeSpecName: "kube-api-access-ggnlm") pod "e3572b42-8114-4135-86e6-07e9acaa06d6" (UID: "e3572b42-8114-4135-86e6-07e9acaa06d6"). InnerVolumeSpecName "kube-api-access-ggnlm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 07:07:02.621863 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:02.621782    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee7ab23e-4177-4f2f-b757-6a7bdc39c0b6-kube-api-access-ls8ms" (OuterVolumeSpecName: "kube-api-access-ls8ms") pod "ee7ab23e-4177-4f2f-b757-6a7bdc39c0b6" (UID: "ee7ab23e-4177-4f2f-b757-6a7bdc39c0b6"). InnerVolumeSpecName "kube-api-access-ls8ms". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 07:07:02.725954 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:02.721136    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee7ab23e-4177-4f2f-b757-6a7bdc39c0b6-plugins-config-volume\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:07:02.725954 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:02.721175    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ls8ms\" (UniqueName: \"kubernetes.io/projected/ee7ab23e-4177-4f2f-b757-6a7bdc39c0b6-kube-api-access-ls8ms\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:07:02.725954 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:02.721191    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggnlm\" (UniqueName: \"kubernetes.io/projected/e3572b42-8114-4135-86e6-07e9acaa06d6-kube-api-access-ggnlm\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:07:03.030030 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:03.029947    2575 generic.go:356] "Generic (PLEG): container finished" podID="e3572b42-8114-4135-86e6-07e9acaa06d6" containerID="b8bb63564fdbc4e4c935cd0a6bb39ca6a6fa4934be19ddfcf1472342e2c297c4" exitCode=0
Sep 09 07:07:03.030030 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:03.030000    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-29013a28-599f9b695c-t67nx"
Sep 09 07:07:03.030228 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:03.030038    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-29013a28-599f9b695c-t67nx" event={"ID":"e3572b42-8114-4135-86e6-07e9acaa06d6","Type":"ContainerDied","Data":"b8bb63564fdbc4e4c935cd0a6bb39ca6a6fa4934be19ddfcf1472342e2c297c4"}
Sep 09 07:07:03.030228 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:03.030121    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-29013a28-599f9b695c-t67nx" event={"ID":"e3572b42-8114-4135-86e6-07e9acaa06d6","Type":"ContainerDied","Data":"dd4d19e238f11228e2c36e2493eb269b82947dfbcca68df51ed8a5f70c1bb3af"}
Sep 09 07:07:03.030228 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:03.030144    2575 scope.go:117] "RemoveContainer" containerID="b8bb63564fdbc4e4c935cd0a6bb39ca6a6fa4934be19ddfcf1472342e2c297c4"
Sep 09 07:07:03.031618 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:03.031595    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-29013a28-85bcc858db-bnzpl"
Sep 09 07:07:03.031767 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:03.031619    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-29013a28-85bcc858db-bnzpl" event={"ID":"ee7ab23e-4177-4f2f-b757-6a7bdc39c0b6","Type":"ContainerDied","Data":"d6eb0d2090e74109e33f2992baf3fb18acf06c0a77c9cfdc81f73c1b82967ad8"}
Sep 09 07:07:03.031767 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:03.031580    2575 generic.go:356] "Generic (PLEG): container finished" podID="ee7ab23e-4177-4f2f-b757-6a7bdc39c0b6" containerID="d6eb0d2090e74109e33f2992baf3fb18acf06c0a77c9cfdc81f73c1b82967ad8" exitCode=0
Sep 09 07:07:03.031911 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:03.031779    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-29013a28-85bcc858db-bnzpl" event={"ID":"ee7ab23e-4177-4f2f-b757-6a7bdc39c0b6","Type":"ContainerDied","Data":"030523d0c7f52a5ed11abad776b5328197edf9918b50ac15028817b4a3f23b7d"}
Sep 09 07:07:03.039195 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:03.039176    2575 scope.go:117] "RemoveContainer" containerID="b8bb63564fdbc4e4c935cd0a6bb39ca6a6fa4934be19ddfcf1472342e2c297c4"
Sep 09 07:07:03.039490 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:07:03.039472    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8bb63564fdbc4e4c935cd0a6bb39ca6a6fa4934be19ddfcf1472342e2c297c4\": container with ID starting with b8bb63564fdbc4e4c935cd0a6bb39ca6a6fa4934be19ddfcf1472342e2c297c4 not found: ID does not exist" containerID="b8bb63564fdbc4e4c935cd0a6bb39ca6a6fa4934be19ddfcf1472342e2c297c4"
Sep 09 07:07:03.039544 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:03.039499    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8bb63564fdbc4e4c935cd0a6bb39ca6a6fa4934be19ddfcf1472342e2c297c4"} err="failed to get container status \"b8bb63564fdbc4e4c935cd0a6bb39ca6a6fa4934be19ddfcf1472342e2c297c4\": rpc error: code = NotFound desc = could not find container \"b8bb63564fdbc4e4c935cd0a6bb39ca6a6fa4934be19ddfcf1472342e2c297c4\": container with ID starting with b8bb63564fdbc4e4c935cd0a6bb39ca6a6fa4934be19ddfcf1472342e2c297c4 not found: ID does not exist"
Sep 09 07:07:03.039544 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:03.039516    2575 scope.go:117] "RemoveContainer" containerID="d6eb0d2090e74109e33f2992baf3fb18acf06c0a77c9cfdc81f73c1b82967ad8"
Sep 09 07:07:03.047411 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:03.047396    2575 scope.go:117] "RemoveContainer" containerID="d6eb0d2090e74109e33f2992baf3fb18acf06c0a77c9cfdc81f73c1b82967ad8"
Sep 09 07:07:03.047667 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:07:03.047652    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6eb0d2090e74109e33f2992baf3fb18acf06c0a77c9cfdc81f73c1b82967ad8\": container with ID starting with d6eb0d2090e74109e33f2992baf3fb18acf06c0a77c9cfdc81f73c1b82967ad8 not found: ID does not exist" containerID="d6eb0d2090e74109e33f2992baf3fb18acf06c0a77c9cfdc81f73c1b82967ad8"
Sep 09 07:07:03.047724 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:03.047673    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6eb0d2090e74109e33f2992baf3fb18acf06c0a77c9cfdc81f73c1b82967ad8"} err="failed to get container status \"d6eb0d2090e74109e33f2992baf3fb18acf06c0a77c9cfdc81f73c1b82967ad8\": rpc error: code = NotFound desc = could not find container \"d6eb0d2090e74109e33f2992baf3fb18acf06c0a77c9cfdc81f73c1b82967ad8\": container with ID starting with d6eb0d2090e74109e33f2992baf3fb18acf06c0a77c9cfdc81f73c1b82967ad8 not found: ID does not exist"
Sep 09 07:07:03.054675 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:03.054652    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-29013a28-85bcc858db-bnzpl"]
Sep 09 07:07:03.061481 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:03.061461    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-29013a28-85bcc858db-bnzpl"]
Sep 09 07:07:03.073011 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:03.072991    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-29013a28-599f9b695c-t67nx"]
Sep 09 07:07:03.077178 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:03.077159    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-29013a28-599f9b695c-t67nx"]
Sep 09 07:07:03.712257 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:03.712227    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3572b42-8114-4135-86e6-07e9acaa06d6" path="/var/lib/kubelet/pods/e3572b42-8114-4135-86e6-07e9acaa06d6/volumes"
Sep 09 07:07:03.712628 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:03.712574    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee7ab23e-4177-4f2f-b757-6a7bdc39c0b6" path="/var/lib/kubelet/pods/ee7ab23e-4177-4f2f-b757-6a7bdc39c0b6/volumes"
Sep 09 07:07:05.614508 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:05.614474    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-a1a33e-77d845fc5d-s5bnt"]
Sep 09 07:07:05.614904 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:05.614848    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3572b42-8114-4135-86e6-07e9acaa06d6" containerName="payload-processing"
Sep 09 07:07:05.614904 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:05.614862    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3572b42-8114-4135-86e6-07e9acaa06d6" containerName="payload-processing"
Sep 09 07:07:05.614904 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:05.614888    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee7ab23e-4177-4f2f-b757-6a7bdc39c0b6" containerName="payload-pre-processing"
Sep 09 07:07:05.614904 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:05.614898    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee7ab23e-4177-4f2f-b757-6a7bdc39c0b6" containerName="payload-pre-processing"
Sep 09 07:07:05.615135 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:05.614998    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee7ab23e-4177-4f2f-b757-6a7bdc39c0b6" containerName="payload-pre-processing"
Sep 09 07:07:05.615135 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:05.615012    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3572b42-8114-4135-86e6-07e9acaa06d6" containerName="payload-processing"
Sep 09 07:07:05.619422 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:05.619405    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a1a33e-77d845fc5d-s5bnt"
Sep 09 07:07:05.622124 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:05.622105    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-a1a33e\""
Sep 09 07:07:05.631217 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:05.631198    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-a1a33e-77d845fc5d-s5bnt"]
Sep 09 07:07:05.640105 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:05.640084    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-a1a33e-5d47cf7849-5mrfn"]
Sep 09 07:07:05.643629 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:05.643613    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-a1a33e-5d47cf7849-5mrfn"
Sep 09 07:07:05.646391 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:05.646374    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-a1a33e-dockercfg-9xxwt\""
Sep 09 07:07:05.664008 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:05.663986    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-a1a33e-5d47cf7849-5mrfn"]
Sep 09 07:07:05.749262 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:05.749239    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bqd5\" (UniqueName: \"kubernetes.io/projected/2ece7420-9b61-4ae0-a42b-89009b114386-kube-api-access-8bqd5\") pod \"payload-pre-processing-e2e-explicit-a1a33e-77d845fc5d-s5bnt\" (UID: \"2ece7420-9b61-4ae0-a42b-89009b114386\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-a1a33e-77d845fc5d-s5bnt"
Sep 09 07:07:05.749382 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:05.749273    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb9w6\" (UniqueName: \"kubernetes.io/projected/06a00b03-937b-4591-835e-492cef1d73eb-kube-api-access-gb9w6\") pod \"payload-processing-e2e-explicit-a1a33e-5d47cf7849-5mrfn\" (UID: \"06a00b03-937b-4591-835e-492cef1d73eb\") " pod="openshift-ingress/payload-processing-e2e-explicit-a1a33e-5d47cf7849-5mrfn"
Sep 09 07:07:05.749453 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:05.749394    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06a00b03-937b-4591-835e-492cef1d73eb-plugins-config-volume\") pod \"payload-processing-e2e-explicit-a1a33e-5d47cf7849-5mrfn\" (UID: \"06a00b03-937b-4591-835e-492cef1d73eb\") " pod="openshift-ingress/payload-processing-e2e-explicit-a1a33e-5d47cf7849-5mrfn"
Sep 09 07:07:05.749453 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:05.749439    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ece7420-9b61-4ae0-a42b-89009b114386-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-a1a33e-77d845fc5d-s5bnt\" (UID: \"2ece7420-9b61-4ae0-a42b-89009b114386\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-a1a33e-77d845fc5d-s5bnt"
Sep 09 07:07:05.850108 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:05.850082    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bqd5\" (UniqueName: \"kubernetes.io/projected/2ece7420-9b61-4ae0-a42b-89009b114386-kube-api-access-8bqd5\") pod \"payload-pre-processing-e2e-explicit-a1a33e-77d845fc5d-s5bnt\" (UID: \"2ece7420-9b61-4ae0-a42b-89009b114386\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-a1a33e-77d845fc5d-s5bnt"
Sep 09 07:07:05.850261 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:05.850120    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gb9w6\" (UniqueName: \"kubernetes.io/projected/06a00b03-937b-4591-835e-492cef1d73eb-kube-api-access-gb9w6\") pod \"payload-processing-e2e-explicit-a1a33e-5d47cf7849-5mrfn\" (UID: \"06a00b03-937b-4591-835e-492cef1d73eb\") " pod="openshift-ingress/payload-processing-e2e-explicit-a1a33e-5d47cf7849-5mrfn"
Sep 09 07:07:05.850261 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:05.850197    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06a00b03-937b-4591-835e-492cef1d73eb-plugins-config-volume\") pod \"payload-processing-e2e-explicit-a1a33e-5d47cf7849-5mrfn\" (UID: \"06a00b03-937b-4591-835e-492cef1d73eb\") " pod="openshift-ingress/payload-processing-e2e-explicit-a1a33e-5d47cf7849-5mrfn"
Sep 09 07:07:05.850378 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:05.850333    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ece7420-9b61-4ae0-a42b-89009b114386-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-a1a33e-77d845fc5d-s5bnt\" (UID: \"2ece7420-9b61-4ae0-a42b-89009b114386\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-a1a33e-77d845fc5d-s5bnt"
Sep 09 07:07:05.850928 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:05.850902    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06a00b03-937b-4591-835e-492cef1d73eb-plugins-config-volume\") pod \"payload-processing-e2e-explicit-a1a33e-5d47cf7849-5mrfn\" (UID: \"06a00b03-937b-4591-835e-492cef1d73eb\") " pod="openshift-ingress/payload-processing-e2e-explicit-a1a33e-5d47cf7849-5mrfn"
Sep 09 07:07:05.851199 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:05.851178    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ece7420-9b61-4ae0-a42b-89009b114386-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-a1a33e-77d845fc5d-s5bnt\" (UID: \"2ece7420-9b61-4ae0-a42b-89009b114386\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-a1a33e-77d845fc5d-s5bnt"
Sep 09 07:07:05.861644 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:05.861619    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bqd5\" (UniqueName: \"kubernetes.io/projected/2ece7420-9b61-4ae0-a42b-89009b114386-kube-api-access-8bqd5\") pod \"payload-pre-processing-e2e-explicit-a1a33e-77d845fc5d-s5bnt\" (UID: \"2ece7420-9b61-4ae0-a42b-89009b114386\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-a1a33e-77d845fc5d-s5bnt"
Sep 09 07:07:05.863180 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:05.863161    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb9w6\" (UniqueName: \"kubernetes.io/projected/06a00b03-937b-4591-835e-492cef1d73eb-kube-api-access-gb9w6\") pod \"payload-processing-e2e-explicit-a1a33e-5d47cf7849-5mrfn\" (UID: \"06a00b03-937b-4591-835e-492cef1d73eb\") " pod="openshift-ingress/payload-processing-e2e-explicit-a1a33e-5d47cf7849-5mrfn"
Sep 09 07:07:05.929656 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:05.929628    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a1a33e-77d845fc5d-s5bnt"
Sep 09 07:07:05.954203 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:05.954173    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-a1a33e-5d47cf7849-5mrfn"
Sep 09 07:07:06.206059 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:06.206030    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-a1a33e-77d845fc5d-s5bnt"]
Sep 09 07:07:06.207611 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:07:06.207586    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ece7420_9b61_4ae0_a42b_89009b114386.slice/crio-59f6fdae0f04b2d00e22c38002709dc8bc05eb12364454b48289901262e83227 WatchSource:0}: Error finding container 59f6fdae0f04b2d00e22c38002709dc8bc05eb12364454b48289901262e83227: Status 404 returned error can't find the container with id 59f6fdae0f04b2d00e22c38002709dc8bc05eb12364454b48289901262e83227
Sep 09 07:07:06.249015 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:06.248993    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-a1a33e-5d47cf7849-5mrfn"]
Sep 09 07:07:06.251197 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:07:06.251170    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06a00b03_937b_4591_835e_492cef1d73eb.slice/crio-1edca844e50675058dccdf38ef4f759fcddc640ca510b02b5c478508a99ef031 WatchSource:0}: Error finding container 1edca844e50675058dccdf38ef4f759fcddc640ca510b02b5c478508a99ef031: Status 404 returned error can't find the container with id 1edca844e50675058dccdf38ef4f759fcddc640ca510b02b5c478508a99ef031
Sep 09 07:07:07.057094 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:07.057056    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-a1a33e-5d47cf7849-5mrfn" event={"ID":"06a00b03-937b-4591-835e-492cef1d73eb","Type":"ContainerStarted","Data":"b87f8095457af9221a7a8ff92f7c5aaf7ae17bd1ad5eaaea2edbe25e494b4bf9"}
Sep 09 07:07:07.057495 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:07.057117    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-a1a33e-5d47cf7849-5mrfn" event={"ID":"06a00b03-937b-4591-835e-492cef1d73eb","Type":"ContainerStarted","Data":"1edca844e50675058dccdf38ef4f759fcddc640ca510b02b5c478508a99ef031"}
Sep 09 07:07:07.057495 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:07.057149    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-a1a33e-5d47cf7849-5mrfn"
Sep 09 07:07:07.058785 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:07.058731    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a1a33e-77d845fc5d-s5bnt" event={"ID":"2ece7420-9b61-4ae0-a42b-89009b114386","Type":"ContainerStarted","Data":"205d105068f1d9a24c96a29e898cdde4f349cf2e23b906eca826c6bb7696421b"}
Sep 09 07:07:07.058928 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:07.058803    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a1a33e-77d845fc5d-s5bnt" event={"ID":"2ece7420-9b61-4ae0-a42b-89009b114386","Type":"ContainerStarted","Data":"59f6fdae0f04b2d00e22c38002709dc8bc05eb12364454b48289901262e83227"}
Sep 09 07:07:07.058928 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:07.058871    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a1a33e-77d845fc5d-s5bnt"
Sep 09 07:07:07.075559 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:07.075509    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-a1a33e-5d47cf7849-5mrfn" podStartSLOduration=2.075492096 podStartE2EDuration="2.075492096s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 07:07:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 07:07:07.074396223 +0000 UTC m=+961.866205562" watchObservedRunningTime="2026-09-09 07:07:07.075492096 +0000 UTC m=+961.867301437"
Sep 09 07:07:07.094701 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:07.094661    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a1a33e-77d845fc5d-s5bnt" podStartSLOduration=2.094647436 podStartE2EDuration="2.094647436s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 07:07:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 07:07:07.092222311 +0000 UTC m=+961.884031650" watchObservedRunningTime="2026-09-09 07:07:07.094647436 +0000 UTC m=+961.886456791"
Sep 09 07:07:18.066652 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:18.066621    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-a1a33e-5d47cf7849-5mrfn"
Sep 09 07:07:18.067018 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:18.066788    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a1a33e-77d845fc5d-s5bnt"
Sep 09 07:07:56.117543 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:07:56.117506    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-b212cb/test-model-b212cb-kserve-79c6b74997-vm48z"]
Sep 09 07:08:03.185658 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:03.185622    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-a1a33e-5d47cf7849-5mrfn"]
Sep 09 07:08:03.186097 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:03.185910    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-a1a33e-5d47cf7849-5mrfn" podUID="06a00b03-937b-4591-835e-492cef1d73eb" containerName="payload-processing" containerID="cri-o://b87f8095457af9221a7a8ff92f7c5aaf7ae17bd1ad5eaaea2edbe25e494b4bf9" gracePeriod=30
Sep 09 07:08:03.193488 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:03.193465    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-a1a33e-77d845fc5d-s5bnt"]
Sep 09 07:08:03.194136 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:03.193989    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a1a33e-77d845fc5d-s5bnt" podUID="2ece7420-9b61-4ae0-a42b-89009b114386" containerName="payload-pre-processing" containerID="cri-o://205d105068f1d9a24c96a29e898cdde4f349cf2e23b906eca826c6bb7696421b" gracePeriod=30
Sep 09 07:08:03.341802 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:03.341770    2575 generic.go:356] "Generic (PLEG): container finished" podID="2ece7420-9b61-4ae0-a42b-89009b114386" containerID="205d105068f1d9a24c96a29e898cdde4f349cf2e23b906eca826c6bb7696421b" exitCode=0
Sep 09 07:08:03.341982 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:03.341799    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a1a33e-77d845fc5d-s5bnt" event={"ID":"2ece7420-9b61-4ae0-a42b-89009b114386","Type":"ContainerDied","Data":"205d105068f1d9a24c96a29e898cdde4f349cf2e23b906eca826c6bb7696421b"}
Sep 09 07:08:03.344015 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:03.343987    2575 generic.go:356] "Generic (PLEG): container finished" podID="06a00b03-937b-4591-835e-492cef1d73eb" containerID="b87f8095457af9221a7a8ff92f7c5aaf7ae17bd1ad5eaaea2edbe25e494b4bf9" exitCode=0
Sep 09 07:08:03.344147 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:03.344061    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-a1a33e-5d47cf7849-5mrfn" event={"ID":"06a00b03-937b-4591-835e-492cef1d73eb","Type":"ContainerDied","Data":"b87f8095457af9221a7a8ff92f7c5aaf7ae17bd1ad5eaaea2edbe25e494b4bf9"}
Sep 09 07:08:03.440625 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:03.440573    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-a1a33e-5d47cf7849-5mrfn"
Sep 09 07:08:03.475176 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:03.475151    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a1a33e-77d845fc5d-s5bnt"
Sep 09 07:08:03.524944 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:03.524913    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8bqd5\" (UniqueName: \"kubernetes.io/projected/2ece7420-9b61-4ae0-a42b-89009b114386-kube-api-access-8bqd5\") pod \"2ece7420-9b61-4ae0-a42b-89009b114386\" (UID: \"2ece7420-9b61-4ae0-a42b-89009b114386\") "
Sep 09 07:08:03.525071 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:03.524966    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06a00b03-937b-4591-835e-492cef1d73eb-plugins-config-volume\") pod \"06a00b03-937b-4591-835e-492cef1d73eb\" (UID: \"06a00b03-937b-4591-835e-492cef1d73eb\") "
Sep 09 07:08:03.525071 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:03.525024    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ece7420-9b61-4ae0-a42b-89009b114386-plugins-config-volume\") pod \"2ece7420-9b61-4ae0-a42b-89009b114386\" (UID: \"2ece7420-9b61-4ae0-a42b-89009b114386\") "
Sep 09 07:08:03.525071 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:03.525068    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gb9w6\" (UniqueName: \"kubernetes.io/projected/06a00b03-937b-4591-835e-492cef1d73eb-kube-api-access-gb9w6\") pod \"06a00b03-937b-4591-835e-492cef1d73eb\" (UID: \"06a00b03-937b-4591-835e-492cef1d73eb\") "
Sep 09 07:08:03.525348 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:03.525325    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06a00b03-937b-4591-835e-492cef1d73eb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "06a00b03-937b-4591-835e-492cef1d73eb" (UID: "06a00b03-937b-4591-835e-492cef1d73eb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 07:08:03.525442 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:03.525419    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ece7420-9b61-4ae0-a42b-89009b114386-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2ece7420-9b61-4ae0-a42b-89009b114386" (UID: "2ece7420-9b61-4ae0-a42b-89009b114386"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 07:08:03.527668 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:03.527642    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ece7420-9b61-4ae0-a42b-89009b114386-kube-api-access-8bqd5" (OuterVolumeSpecName: "kube-api-access-8bqd5") pod "2ece7420-9b61-4ae0-a42b-89009b114386" (UID: "2ece7420-9b61-4ae0-a42b-89009b114386"). InnerVolumeSpecName "kube-api-access-8bqd5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 07:08:03.527668 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:03.527665    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06a00b03-937b-4591-835e-492cef1d73eb-kube-api-access-gb9w6" (OuterVolumeSpecName: "kube-api-access-gb9w6") pod "06a00b03-937b-4591-835e-492cef1d73eb" (UID: "06a00b03-937b-4591-835e-492cef1d73eb"). InnerVolumeSpecName "kube-api-access-gb9w6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 07:08:03.626411 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:03.626380    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8bqd5\" (UniqueName: \"kubernetes.io/projected/2ece7420-9b61-4ae0-a42b-89009b114386-kube-api-access-8bqd5\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:08:03.626411 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:03.626408    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06a00b03-937b-4591-835e-492cef1d73eb-plugins-config-volume\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:08:03.626549 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:03.626421    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ece7420-9b61-4ae0-a42b-89009b114386-plugins-config-volume\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:08:03.626549 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:03.626433    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gb9w6\" (UniqueName: \"kubernetes.io/projected/06a00b03-937b-4591-835e-492cef1d73eb-kube-api-access-gb9w6\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:08:04.351403 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:04.351373    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a1a33e-77d845fc5d-s5bnt"
Sep 09 07:08:04.351880 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:04.351408    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a1a33e-77d845fc5d-s5bnt" event={"ID":"2ece7420-9b61-4ae0-a42b-89009b114386","Type":"ContainerDied","Data":"59f6fdae0f04b2d00e22c38002709dc8bc05eb12364454b48289901262e83227"}
Sep 09 07:08:04.351880 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:04.351467    2575 scope.go:117] "RemoveContainer" containerID="205d105068f1d9a24c96a29e898cdde4f349cf2e23b906eca826c6bb7696421b"
Sep 09 07:08:04.352823 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:04.352800    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-a1a33e-5d47cf7849-5mrfn" event={"ID":"06a00b03-937b-4591-835e-492cef1d73eb","Type":"ContainerDied","Data":"1edca844e50675058dccdf38ef4f759fcddc640ca510b02b5c478508a99ef031"}
Sep 09 07:08:04.352823 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:04.352817    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-a1a33e-5d47cf7849-5mrfn"
Sep 09 07:08:04.360397 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:04.360382    2575 scope.go:117] "RemoveContainer" containerID="b87f8095457af9221a7a8ff92f7c5aaf7ae17bd1ad5eaaea2edbe25e494b4bf9"
Sep 09 07:08:04.373085 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:04.373059    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-a1a33e-77d845fc5d-s5bnt"]
Sep 09 07:08:04.379126 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:04.379106    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-a1a33e-77d845fc5d-s5bnt"]
Sep 09 07:08:04.388576 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:04.388557    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-a1a33e-5d47cf7849-5mrfn"]
Sep 09 07:08:04.393119 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:04.393098    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-a1a33e-5d47cf7849-5mrfn"]
Sep 09 07:08:05.712769 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:05.712727    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06a00b03-937b-4591-835e-492cef1d73eb" path="/var/lib/kubelet/pods/06a00b03-937b-4591-835e-492cef1d73eb/volumes"
Sep 09 07:08:05.713108 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:05.713093    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ece7420-9b61-4ae0-a42b-89009b114386" path="/var/lib/kubelet/pods/2ece7420-9b61-4ae0-a42b-89009b114386/volumes"
Sep 09 07:08:08.293241 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:08.293197    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-b212cb-6c8b5c4477-j2xx8"]
Sep 09 07:08:08.293716 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:08.293446    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-b212cb-6c8b5c4477-j2xx8" podUID="ba2bd48c-7185-429a-af9c-90086df5b327" containerName="payload-processing" containerID="cri-o://2c839dadfa228cfc0e71cf388963b6af09eaf1c75b20d3a3d131e9de4445ce61" gracePeriod=30
Sep 09 07:08:08.300600 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:08.300217    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-b212cb-76d45f97f8-nt4c6"]
Sep 09 07:08:08.300600 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:08.300430    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b212cb-76d45f97f8-nt4c6" podUID="efc7282f-4ca6-4179-8a97-5cabd924a046" containerName="payload-pre-processing" containerID="cri-o://c9ed64edd7ea1f61c635bcca388c535f3e5b7879877ca880f6ec431953029447" gracePeriod=30
Sep 09 07:08:08.576229 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:08.576206    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-b212cb-6c8b5c4477-j2xx8"
Sep 09 07:08:08.578934 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:08.578913    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b212cb-76d45f97f8-nt4c6"
Sep 09 07:08:08.664038 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:08.664003    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-glzkf\" (UniqueName: \"kubernetes.io/projected/ba2bd48c-7185-429a-af9c-90086df5b327-kube-api-access-glzkf\") pod \"ba2bd48c-7185-429a-af9c-90086df5b327\" (UID: \"ba2bd48c-7185-429a-af9c-90086df5b327\") "
Sep 09 07:08:08.664215 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:08.664084    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba2bd48c-7185-429a-af9c-90086df5b327-plugins-config-volume\") pod \"ba2bd48c-7185-429a-af9c-90086df5b327\" (UID: \"ba2bd48c-7185-429a-af9c-90086df5b327\") "
Sep 09 07:08:08.664215 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:08.664118    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrkbb\" (UniqueName: \"kubernetes.io/projected/efc7282f-4ca6-4179-8a97-5cabd924a046-kube-api-access-qrkbb\") pod \"efc7282f-4ca6-4179-8a97-5cabd924a046\" (UID: \"efc7282f-4ca6-4179-8a97-5cabd924a046\") "
Sep 09 07:08:08.664470 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:08.664442    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba2bd48c-7185-429a-af9c-90086df5b327-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ba2bd48c-7185-429a-af9c-90086df5b327" (UID: "ba2bd48c-7185-429a-af9c-90086df5b327"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 07:08:08.664596 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:08.664575    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efc7282f-4ca6-4179-8a97-5cabd924a046-plugins-config-volume\") pod \"efc7282f-4ca6-4179-8a97-5cabd924a046\" (UID: \"efc7282f-4ca6-4179-8a97-5cabd924a046\") "
Sep 09 07:08:08.664924 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:08.664906    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba2bd48c-7185-429a-af9c-90086df5b327-plugins-config-volume\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:08:08.665222 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:08.665182    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efc7282f-4ca6-4179-8a97-5cabd924a046-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "efc7282f-4ca6-4179-8a97-5cabd924a046" (UID: "efc7282f-4ca6-4179-8a97-5cabd924a046"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 07:08:08.666325 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:08.666297    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efc7282f-4ca6-4179-8a97-5cabd924a046-kube-api-access-qrkbb" (OuterVolumeSpecName: "kube-api-access-qrkbb") pod "efc7282f-4ca6-4179-8a97-5cabd924a046" (UID: "efc7282f-4ca6-4179-8a97-5cabd924a046"). InnerVolumeSpecName "kube-api-access-qrkbb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 07:08:08.666419 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:08.666399    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba2bd48c-7185-429a-af9c-90086df5b327-kube-api-access-glzkf" (OuterVolumeSpecName: "kube-api-access-glzkf") pod "ba2bd48c-7185-429a-af9c-90086df5b327" (UID: "ba2bd48c-7185-429a-af9c-90086df5b327"). InnerVolumeSpecName "kube-api-access-glzkf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 07:08:08.766160 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:08.766135    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efc7282f-4ca6-4179-8a97-5cabd924a046-plugins-config-volume\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:08:08.766160 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:08.766161    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-glzkf\" (UniqueName: \"kubernetes.io/projected/ba2bd48c-7185-429a-af9c-90086df5b327-kube-api-access-glzkf\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:08:08.766296 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:08.766174    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrkbb\" (UniqueName: \"kubernetes.io/projected/efc7282f-4ca6-4179-8a97-5cabd924a046-kube-api-access-qrkbb\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:08:09.381026 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:09.380981    2575 generic.go:356] "Generic (PLEG): container finished" podID="ba2bd48c-7185-429a-af9c-90086df5b327" containerID="2c839dadfa228cfc0e71cf388963b6af09eaf1c75b20d3a3d131e9de4445ce61" exitCode=0
Sep 09 07:08:09.381026 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:09.381027    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-b212cb-6c8b5c4477-j2xx8"
Sep 09 07:08:09.381504 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:09.381061    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-b212cb-6c8b5c4477-j2xx8" event={"ID":"ba2bd48c-7185-429a-af9c-90086df5b327","Type":"ContainerDied","Data":"2c839dadfa228cfc0e71cf388963b6af09eaf1c75b20d3a3d131e9de4445ce61"}
Sep 09 07:08:09.381504 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:09.381121    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-b212cb-6c8b5c4477-j2xx8" event={"ID":"ba2bd48c-7185-429a-af9c-90086df5b327","Type":"ContainerDied","Data":"9923bbc3ef1910b56f6ffe63c703d87748f7148a19ae6251cb38c35781e368f7"}
Sep 09 07:08:09.381504 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:09.381153    2575 scope.go:117] "RemoveContainer" containerID="2c839dadfa228cfc0e71cf388963b6af09eaf1c75b20d3a3d131e9de4445ce61"
Sep 09 07:08:09.382537 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:09.382418    2575 generic.go:356] "Generic (PLEG): container finished" podID="efc7282f-4ca6-4179-8a97-5cabd924a046" containerID="c9ed64edd7ea1f61c635bcca388c535f3e5b7879877ca880f6ec431953029447" exitCode=0
Sep 09 07:08:09.382537 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:09.382460    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b212cb-76d45f97f8-nt4c6"
Sep 09 07:08:09.382537 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:09.382482    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b212cb-76d45f97f8-nt4c6" event={"ID":"efc7282f-4ca6-4179-8a97-5cabd924a046","Type":"ContainerDied","Data":"c9ed64edd7ea1f61c635bcca388c535f3e5b7879877ca880f6ec431953029447"}
Sep 09 07:08:09.382537 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:09.382522    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b212cb-76d45f97f8-nt4c6" event={"ID":"efc7282f-4ca6-4179-8a97-5cabd924a046","Type":"ContainerDied","Data":"460301b78d49e9d0a2ed78f1f3e201c6a561308280fa47fda3365102847cd285"}
Sep 09 07:08:09.389789 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:09.389774    2575 scope.go:117] "RemoveContainer" containerID="2c839dadfa228cfc0e71cf388963b6af09eaf1c75b20d3a3d131e9de4445ce61"
Sep 09 07:08:09.390081 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:08:09.390056    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c839dadfa228cfc0e71cf388963b6af09eaf1c75b20d3a3d131e9de4445ce61\": container with ID starting with 2c839dadfa228cfc0e71cf388963b6af09eaf1c75b20d3a3d131e9de4445ce61 not found: ID does not exist" containerID="2c839dadfa228cfc0e71cf388963b6af09eaf1c75b20d3a3d131e9de4445ce61"
Sep 09 07:08:09.390201 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:09.390089    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c839dadfa228cfc0e71cf388963b6af09eaf1c75b20d3a3d131e9de4445ce61"} err="failed to get container status \"2c839dadfa228cfc0e71cf388963b6af09eaf1c75b20d3a3d131e9de4445ce61\": rpc error: code = NotFound desc = could not find container \"2c839dadfa228cfc0e71cf388963b6af09eaf1c75b20d3a3d131e9de4445ce61\": container with ID starting with 2c839dadfa228cfc0e71cf388963b6af09eaf1c75b20d3a3d131e9de4445ce61 not found: ID does not exist"
Sep 09 07:08:09.390201 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:09.390113    2575 scope.go:117] "RemoveContainer" containerID="c9ed64edd7ea1f61c635bcca388c535f3e5b7879877ca880f6ec431953029447"
Sep 09 07:08:09.398448 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:09.398434    2575 scope.go:117] "RemoveContainer" containerID="c9ed64edd7ea1f61c635bcca388c535f3e5b7879877ca880f6ec431953029447"
Sep 09 07:08:09.398692 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:08:09.398676    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9ed64edd7ea1f61c635bcca388c535f3e5b7879877ca880f6ec431953029447\": container with ID starting with c9ed64edd7ea1f61c635bcca388c535f3e5b7879877ca880f6ec431953029447 not found: ID does not exist" containerID="c9ed64edd7ea1f61c635bcca388c535f3e5b7879877ca880f6ec431953029447"
Sep 09 07:08:09.398786 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:09.398697    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9ed64edd7ea1f61c635bcca388c535f3e5b7879877ca880f6ec431953029447"} err="failed to get container status \"c9ed64edd7ea1f61c635bcca388c535f3e5b7879877ca880f6ec431953029447\": rpc error: code = NotFound desc = could not find container \"c9ed64edd7ea1f61c635bcca388c535f3e5b7879877ca880f6ec431953029447\": container with ID starting with c9ed64edd7ea1f61c635bcca388c535f3e5b7879877ca880f6ec431953029447 not found: ID does not exist"
Sep 09 07:08:09.410078 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:09.410059    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-b212cb-76d45f97f8-nt4c6"]
Sep 09 07:08:09.416480 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:09.416462    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-b212cb-76d45f97f8-nt4c6"]
Sep 09 07:08:09.431498 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:09.431477    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-b212cb-6c8b5c4477-j2xx8"]
Sep 09 07:08:09.436633 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:09.436614    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-b212cb-6c8b5c4477-j2xx8"]
Sep 09 07:08:09.712309 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:09.712239    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba2bd48c-7185-429a-af9c-90086df5b327" path="/var/lib/kubelet/pods/ba2bd48c-7185-429a-af9c-90086df5b327/volumes"
Sep 09 07:08:09.712564 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:09.712552    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efc7282f-4ca6-4179-8a97-5cabd924a046" path="/var/lib/kubelet/pods/efc7282f-4ca6-4179-8a97-5cabd924a046/volumes"
Sep 09 07:08:11.138624 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:11.138583    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-b212cb/test-model-b212cb-kserve-79c6b74997-vm48z" podUID="cb68753c-cdb6-48e7-86bf-8c183f6c603e" containerName="main" containerID="cri-o://505e9309fcb893e61c67a18af15d0f8d4c267c0658d6d32e8a06844f17a93ca4" gracePeriod=45
Sep 09 07:08:11.386400 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:11.386374    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-b212cb/test-model-b212cb-kserve-79c6b74997-vm48z"
Sep 09 07:08:11.402550 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:11.402467    2575 generic.go:356] "Generic (PLEG): container finished" podID="cb68753c-cdb6-48e7-86bf-8c183f6c603e" containerID="505e9309fcb893e61c67a18af15d0f8d4c267c0658d6d32e8a06844f17a93ca4" exitCode=0
Sep 09 07:08:11.402550 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:11.402523    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-b212cb/test-model-b212cb-kserve-79c6b74997-vm48z"
Sep 09 07:08:11.402734 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:11.402540    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-b212cb/test-model-b212cb-kserve-79c6b74997-vm48z" event={"ID":"cb68753c-cdb6-48e7-86bf-8c183f6c603e","Type":"ContainerDied","Data":"505e9309fcb893e61c67a18af15d0f8d4c267c0658d6d32e8a06844f17a93ca4"}
Sep 09 07:08:11.402734 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:11.402586    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-b212cb/test-model-b212cb-kserve-79c6b74997-vm48z" event={"ID":"cb68753c-cdb6-48e7-86bf-8c183f6c603e","Type":"ContainerDied","Data":"83dc5be03725a31e4c1ee448179bf16966226c78faedc541472f21e949c8999b"}
Sep 09 07:08:11.402734 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:11.402603    2575 scope.go:117] "RemoveContainer" containerID="505e9309fcb893e61c67a18af15d0f8d4c267c0658d6d32e8a06844f17a93ca4"
Sep 09 07:08:11.412005 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:11.411663    2575 scope.go:117] "RemoveContainer" containerID="505e9309fcb893e61c67a18af15d0f8d4c267c0658d6d32e8a06844f17a93ca4"
Sep 09 07:08:11.412337 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:08:11.412314    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"505e9309fcb893e61c67a18af15d0f8d4c267c0658d6d32e8a06844f17a93ca4\": container with ID starting with 505e9309fcb893e61c67a18af15d0f8d4c267c0658d6d32e8a06844f17a93ca4 not found: ID does not exist" containerID="505e9309fcb893e61c67a18af15d0f8d4c267c0658d6d32e8a06844f17a93ca4"
Sep 09 07:08:11.412446 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:11.412345    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"505e9309fcb893e61c67a18af15d0f8d4c267c0658d6d32e8a06844f17a93ca4"} err="failed to get container status \"505e9309fcb893e61c67a18af15d0f8d4c267c0658d6d32e8a06844f17a93ca4\": rpc error: code = NotFound desc = could not find container \"505e9309fcb893e61c67a18af15d0f8d4c267c0658d6d32e8a06844f17a93ca4\": container with ID starting with 505e9309fcb893e61c67a18af15d0f8d4c267c0658d6d32e8a06844f17a93ca4 not found: ID does not exist"
Sep 09 07:08:11.492113 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:11.492088    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb68753c-cdb6-48e7-86bf-8c183f6c603e-model-cache\") pod \"cb68753c-cdb6-48e7-86bf-8c183f6c603e\" (UID: \"cb68753c-cdb6-48e7-86bf-8c183f6c603e\") "
Sep 09 07:08:11.492251 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:11.492127    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-scl9x\" (UniqueName: \"kubernetes.io/projected/cb68753c-cdb6-48e7-86bf-8c183f6c603e-kube-api-access-scl9x\") pod \"cb68753c-cdb6-48e7-86bf-8c183f6c603e\" (UID: \"cb68753c-cdb6-48e7-86bf-8c183f6c603e\") "
Sep 09 07:08:11.492251 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:11.492169    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb68753c-cdb6-48e7-86bf-8c183f6c603e-tls-certs\") pod \"cb68753c-cdb6-48e7-86bf-8c183f6c603e\" (UID: \"cb68753c-cdb6-48e7-86bf-8c183f6c603e\") "
Sep 09 07:08:11.492251 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:11.492192    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb68753c-cdb6-48e7-86bf-8c183f6c603e-tmp-dir\") pod \"cb68753c-cdb6-48e7-86bf-8c183f6c603e\" (UID: \"cb68753c-cdb6-48e7-86bf-8c183f6c603e\") "
Sep 09 07:08:11.492251 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:11.492243    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb68753c-cdb6-48e7-86bf-8c183f6c603e-home\") pod \"cb68753c-cdb6-48e7-86bf-8c183f6c603e\" (UID: \"cb68753c-cdb6-48e7-86bf-8c183f6c603e\") "
Sep 09 07:08:11.492475 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:11.492270    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb68753c-cdb6-48e7-86bf-8c183f6c603e-dshm\") pod \"cb68753c-cdb6-48e7-86bf-8c183f6c603e\" (UID: \"cb68753c-cdb6-48e7-86bf-8c183f6c603e\") "
Sep 09 07:08:11.492475 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:11.492406    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb68753c-cdb6-48e7-86bf-8c183f6c603e-model-cache" (OuterVolumeSpecName: "model-cache") pod "cb68753c-cdb6-48e7-86bf-8c183f6c603e" (UID: "cb68753c-cdb6-48e7-86bf-8c183f6c603e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 07:08:11.492568 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:11.492484    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb68753c-cdb6-48e7-86bf-8c183f6c603e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cb68753c-cdb6-48e7-86bf-8c183f6c603e" (UID: "cb68753c-cdb6-48e7-86bf-8c183f6c603e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 07:08:11.492568 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:11.492495    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb68753c-cdb6-48e7-86bf-8c183f6c603e-home" (OuterVolumeSpecName: "home") pod "cb68753c-cdb6-48e7-86bf-8c183f6c603e" (UID: "cb68753c-cdb6-48e7-86bf-8c183f6c603e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 07:08:11.492681 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:11.492591    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb68753c-cdb6-48e7-86bf-8c183f6c603e-tmp-dir\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:08:11.492681 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:11.492605    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb68753c-cdb6-48e7-86bf-8c183f6c603e-home\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:08:11.492681 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:11.492615    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb68753c-cdb6-48e7-86bf-8c183f6c603e-model-cache\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:08:11.494523 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:11.494501    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb68753c-cdb6-48e7-86bf-8c183f6c603e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cb68753c-cdb6-48e7-86bf-8c183f6c603e" (UID: "cb68753c-cdb6-48e7-86bf-8c183f6c603e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 07:08:11.494604 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:11.494519    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb68753c-cdb6-48e7-86bf-8c183f6c603e-dshm" (OuterVolumeSpecName: "dshm") pod "cb68753c-cdb6-48e7-86bf-8c183f6c603e" (UID: "cb68753c-cdb6-48e7-86bf-8c183f6c603e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 07:08:11.494641 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:11.494607    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb68753c-cdb6-48e7-86bf-8c183f6c603e-kube-api-access-scl9x" (OuterVolumeSpecName: "kube-api-access-scl9x") pod "cb68753c-cdb6-48e7-86bf-8c183f6c603e" (UID: "cb68753c-cdb6-48e7-86bf-8c183f6c603e"). InnerVolumeSpecName "kube-api-access-scl9x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 07:08:11.593724 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:11.593701    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb68753c-cdb6-48e7-86bf-8c183f6c603e-dshm\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:08:11.593724 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:11.593723    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-scl9x\" (UniqueName: \"kubernetes.io/projected/cb68753c-cdb6-48e7-86bf-8c183f6c603e-kube-api-access-scl9x\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:08:11.593909 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:11.593733    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb68753c-cdb6-48e7-86bf-8c183f6c603e-tls-certs\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:08:11.725913 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:11.725884    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-b212cb/test-model-b212cb-kserve-79c6b74997-vm48z"]
Sep 09 07:08:11.728492 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:11.728470    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-b212cb/test-model-b212cb-kserve-79c6b74997-vm48z"]
Sep 09 07:08:13.711695 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:13.711662    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb68753c-cdb6-48e7-86bf-8c183f6c603e" path="/var/lib/kubelet/pods/cb68753c-cdb6-48e7-86bf-8c183f6c603e/volumes"
Sep 09 07:08:15.752603 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:15.752569    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fc9900-mmxjg"]
Sep 09 07:08:15.753099 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:15.753083    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba2bd48c-7185-429a-af9c-90086df5b327" containerName="payload-processing"
Sep 09 07:08:15.753143 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:15.753102    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba2bd48c-7185-429a-af9c-90086df5b327" containerName="payload-processing"
Sep 09 07:08:15.753143 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:15.753114    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ece7420-9b61-4ae0-a42b-89009b114386" containerName="payload-pre-processing"
Sep 09 07:08:15.753143 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:15.753123    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ece7420-9b61-4ae0-a42b-89009b114386" containerName="payload-pre-processing"
Sep 09 07:08:15.753143 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:15.753141    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efc7282f-4ca6-4179-8a97-5cabd924a046" containerName="payload-pre-processing"
Sep 09 07:08:15.753267 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:15.753149    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="efc7282f-4ca6-4179-8a97-5cabd924a046" containerName="payload-pre-processing"
Sep 09 07:08:15.753267 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:15.753167    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb68753c-cdb6-48e7-86bf-8c183f6c603e" containerName="main"
Sep 09 07:08:15.753267 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:15.753175    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb68753c-cdb6-48e7-86bf-8c183f6c603e" containerName="main"
Sep 09 07:08:15.753267 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:15.753184    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06a00b03-937b-4591-835e-492cef1d73eb" containerName="payload-processing"
Sep 09 07:08:15.753267 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:15.753192    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="06a00b03-937b-4591-835e-492cef1d73eb" containerName="payload-processing"
Sep 09 07:08:15.753410 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:15.753280    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb68753c-cdb6-48e7-86bf-8c183f6c603e" containerName="main"
Sep 09 07:08:15.753410 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:15.753293    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ece7420-9b61-4ae0-a42b-89009b114386" containerName="payload-pre-processing"
Sep 09 07:08:15.753410 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:15.753304    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="06a00b03-937b-4591-835e-492cef1d73eb" containerName="payload-processing"
Sep 09 07:08:15.753410 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:15.753314    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="efc7282f-4ca6-4179-8a97-5cabd924a046" containerName="payload-pre-processing"
Sep 09 07:08:15.753410 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:15.753322    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba2bd48c-7185-429a-af9c-90086df5b327" containerName="payload-processing"
Sep 09 07:08:15.757258 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:15.757242    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fc9900-mmxjg"
Sep 09 07:08:15.760274 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:15.760255    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bbglc\""
Sep 09 07:08:15.761251 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:15.761233    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 07:08:15.777827 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:15.777802    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fc9900-mmxjg"]
Sep 09 07:08:15.832703 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:15.832678    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f7c4c24-81b3-4e2e-a857-d706230c4741-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-fc9900-mmxjg\" (UID: \"3f7c4c24-81b3-4e2e-a857-d706230c4741\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fc9900-mmxjg"
Sep 09 07:08:15.933879 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:15.933845    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f7c4c24-81b3-4e2e-a857-d706230c4741-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-fc9900-mmxjg\" (UID: \"3f7c4c24-81b3-4e2e-a857-d706230c4741\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fc9900-mmxjg"
Sep 09 07:08:15.934417 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:15.934400    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f7c4c24-81b3-4e2e-a857-d706230c4741-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-fc9900-mmxjg\" (UID: \"3f7c4c24-81b3-4e2e-a857-d706230c4741\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fc9900-mmxjg"
Sep 09 07:08:16.066884 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:16.066811    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fc9900-mmxjg"
Sep 09 07:08:16.344235 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:16.344157    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fc9900-mmxjg"]
Sep 09 07:08:16.348428 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:08:16.348402    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f7c4c24_81b3_4e2e_a857_d706230c4741.slice/crio-175f43d2b5fd42ed989398f0acb478b7b679e0a97b019c2f69adac90502a52f3 WatchSource:0}: Error finding container 175f43d2b5fd42ed989398f0acb478b7b679e0a97b019c2f69adac90502a52f3: Status 404 returned error can't find the container with id 175f43d2b5fd42ed989398f0acb478b7b679e0a97b019c2f69adac90502a52f3
Sep 09 07:08:16.350297 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:16.350279    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 07:08:16.429500 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:16.429465    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fc9900-mmxjg" event={"ID":"3f7c4c24-81b3-4e2e-a857-d706230c4741","Type":"ContainerStarted","Data":"175f43d2b5fd42ed989398f0acb478b7b679e0a97b019c2f69adac90502a52f3"}
Sep 09 07:08:20.451336 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:20.451302    2575 generic.go:356] "Generic (PLEG): container finished" podID="3f7c4c24-81b3-4e2e-a857-d706230c4741" containerID="1198db878b952b164216d0b4987e1e490905a2e004325799178dec3a5db5bc81" exitCode=0
Sep 09 07:08:20.451698 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:20.451394    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fc9900-mmxjg" event={"ID":"3f7c4c24-81b3-4e2e-a857-d706230c4741","Type":"ContainerDied","Data":"1198db878b952b164216d0b4987e1e490905a2e004325799178dec3a5db5bc81"}
Sep 09 07:08:21.591179 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:21.591154    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fc9900-mmxjg"
Sep 09 07:08:21.681116 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:21.681086    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f7c4c24-81b3-4e2e-a857-d706230c4741-maas-api-service-ca\") pod \"3f7c4c24-81b3-4e2e-a857-d706230c4741\" (UID: \"3f7c4c24-81b3-4e2e-a857-d706230c4741\") "
Sep 09 07:08:21.681448 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:21.681420    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f7c4c24-81b3-4e2e-a857-d706230c4741-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3f7c4c24-81b3-4e2e-a857-d706230c4741" (UID: "3f7c4c24-81b3-4e2e-a857-d706230c4741"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 07:08:21.782352 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:21.782324    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f7c4c24-81b3-4e2e-a857-d706230c4741-maas-api-service-ca\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:08:22.463482 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:22.463452    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fc9900-mmxjg"
Sep 09 07:08:22.463660 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:22.463456    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fc9900-mmxjg" event={"ID":"3f7c4c24-81b3-4e2e-a857-d706230c4741","Type":"ContainerDied","Data":"175f43d2b5fd42ed989398f0acb478b7b679e0a97b019c2f69adac90502a52f3"}
Sep 09 07:08:22.463660 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:22.463571    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="175f43d2b5fd42ed989398f0acb478b7b679e0a97b019c2f69adac90502a52f3"
Sep 09 07:08:26.305008 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:26.304969    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-fc9900-7df568df6f-6z2r4"]
Sep 09 07:08:26.305820 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:26.305735    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-fc9900-7df568df6f-6z2r4" podUID="9995f2b4-217e-46b3-891d-2273f99bdd7d" containerName="payload-processing" containerID="cri-o://7c47661d22c6a6fe534d682b19a180735a44f2a8d3bbc6d4b4b65c31c618599d" gracePeriod=30
Sep 09 07:08:26.319590 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:26.319558    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-fc9900-74c4648c8b-q6tdq"]
Sep 09 07:08:26.319841 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:26.319815    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fc9900-74c4648c8b-q6tdq" podUID="4af2ca9c-554a-4cfa-bd6a-cdbbf7f56188" containerName="payload-pre-processing" containerID="cri-o://4b16aa9b1f5b85211cb6b2bec1a6a5b9789f3778867cba27644080285f0e127c" gracePeriod=30
Sep 09 07:08:26.488365 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:26.488151    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fc9900-mmxjg"]
Sep 09 07:08:26.491393 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:26.491354    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fc9900-mmxjg"]
Sep 09 07:08:26.497809 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:26.497781    2575 generic.go:356] "Generic (PLEG): container finished" podID="9995f2b4-217e-46b3-891d-2273f99bdd7d" containerID="7c47661d22c6a6fe534d682b19a180735a44f2a8d3bbc6d4b4b65c31c618599d" exitCode=0
Sep 09 07:08:26.497917 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:26.497896    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-fc9900-7df568df6f-6z2r4" event={"ID":"9995f2b4-217e-46b3-891d-2273f99bdd7d","Type":"ContainerDied","Data":"7c47661d22c6a6fe534d682b19a180735a44f2a8d3bbc6d4b4b65c31c618599d"}
Sep 09 07:08:26.499564 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:26.499493    2575 generic.go:356] "Generic (PLEG): container finished" podID="4af2ca9c-554a-4cfa-bd6a-cdbbf7f56188" containerID="4b16aa9b1f5b85211cb6b2bec1a6a5b9789f3778867cba27644080285f0e127c" exitCode=0
Sep 09 07:08:26.499708 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:26.499605    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fc9900-74c4648c8b-q6tdq" event={"ID":"4af2ca9c-554a-4cfa-bd6a-cdbbf7f56188","Type":"ContainerDied","Data":"4b16aa9b1f5b85211cb6b2bec1a6a5b9789f3778867cba27644080285f0e127c"}
Sep 09 07:08:26.596208 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:26.596183    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-fc9900-7df568df6f-6z2r4"
Sep 09 07:08:26.599052 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:26.599037    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fc9900-74c4648c8b-q6tdq"
Sep 09 07:08:26.727455 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:26.727427    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmpst\" (UniqueName: \"kubernetes.io/projected/9995f2b4-217e-46b3-891d-2273f99bdd7d-kube-api-access-jmpst\") pod \"9995f2b4-217e-46b3-891d-2273f99bdd7d\" (UID: \"9995f2b4-217e-46b3-891d-2273f99bdd7d\") "
Sep 09 07:08:26.727628 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:26.727490    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9995f2b4-217e-46b3-891d-2273f99bdd7d-plugins-config-volume\") pod \"9995f2b4-217e-46b3-891d-2273f99bdd7d\" (UID: \"9995f2b4-217e-46b3-891d-2273f99bdd7d\") "
Sep 09 07:08:26.727628 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:26.727524    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqts2\" (UniqueName: \"kubernetes.io/projected/4af2ca9c-554a-4cfa-bd6a-cdbbf7f56188-kube-api-access-jqts2\") pod \"4af2ca9c-554a-4cfa-bd6a-cdbbf7f56188\" (UID: \"4af2ca9c-554a-4cfa-bd6a-cdbbf7f56188\") "
Sep 09 07:08:26.727716 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:26.727620    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4af2ca9c-554a-4cfa-bd6a-cdbbf7f56188-plugins-config-volume\") pod \"4af2ca9c-554a-4cfa-bd6a-cdbbf7f56188\" (UID: \"4af2ca9c-554a-4cfa-bd6a-cdbbf7f56188\") "
Sep 09 07:08:26.728003 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:26.727976    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9995f2b4-217e-46b3-891d-2273f99bdd7d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9995f2b4-217e-46b3-891d-2273f99bdd7d" (UID: "9995f2b4-217e-46b3-891d-2273f99bdd7d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 07:08:26.728095 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:26.728003    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4af2ca9c-554a-4cfa-bd6a-cdbbf7f56188-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4af2ca9c-554a-4cfa-bd6a-cdbbf7f56188" (UID: "4af2ca9c-554a-4cfa-bd6a-cdbbf7f56188"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 07:08:26.729799 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:26.729778    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9995f2b4-217e-46b3-891d-2273f99bdd7d-kube-api-access-jmpst" (OuterVolumeSpecName: "kube-api-access-jmpst") pod "9995f2b4-217e-46b3-891d-2273f99bdd7d" (UID: "9995f2b4-217e-46b3-891d-2273f99bdd7d"). InnerVolumeSpecName "kube-api-access-jmpst". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 07:08:26.729998 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:26.729983    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4af2ca9c-554a-4cfa-bd6a-cdbbf7f56188-kube-api-access-jqts2" (OuterVolumeSpecName: "kube-api-access-jqts2") pod "4af2ca9c-554a-4cfa-bd6a-cdbbf7f56188" (UID: "4af2ca9c-554a-4cfa-bd6a-cdbbf7f56188"). InnerVolumeSpecName "kube-api-access-jqts2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 07:08:26.828765 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:26.828669    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9995f2b4-217e-46b3-891d-2273f99bdd7d-plugins-config-volume\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:08:26.828765 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:26.828700    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqts2\" (UniqueName: \"kubernetes.io/projected/4af2ca9c-554a-4cfa-bd6a-cdbbf7f56188-kube-api-access-jqts2\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:08:26.828765 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:26.828714    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4af2ca9c-554a-4cfa-bd6a-cdbbf7f56188-plugins-config-volume\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:08:26.828765 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:26.828726    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmpst\" (UniqueName: \"kubernetes.io/projected/9995f2b4-217e-46b3-891d-2273f99bdd7d-kube-api-access-jmpst\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:08:27.506102 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:27.506073    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fc9900-74c4648c8b-q6tdq"
Sep 09 07:08:27.506557 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:27.506167    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fc9900-74c4648c8b-q6tdq" event={"ID":"4af2ca9c-554a-4cfa-bd6a-cdbbf7f56188","Type":"ContainerDied","Data":"c476e4b7b1302bde4fbb0206ec70cebe6cdcaffbfb293afadc3fd59c424fc919"}
Sep 09 07:08:27.506557 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:27.506236    2575 scope.go:117] "RemoveContainer" containerID="4b16aa9b1f5b85211cb6b2bec1a6a5b9789f3778867cba27644080285f0e127c"
Sep 09 07:08:27.507730 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:27.507680    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-fc9900-7df568df6f-6z2r4" event={"ID":"9995f2b4-217e-46b3-891d-2273f99bdd7d","Type":"ContainerDied","Data":"3f6da3a95067d44056194e84add575c16bd7313169eaafd9d8369fe5b754f972"}
Sep 09 07:08:27.507833 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:27.507794    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-fc9900-7df568df6f-6z2r4"
Sep 09 07:08:27.515442 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:27.515417    2575 scope.go:117] "RemoveContainer" containerID="7c47661d22c6a6fe534d682b19a180735a44f2a8d3bbc6d4b4b65c31c618599d"
Sep 09 07:08:27.533726 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:27.533706    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-fc9900-7df568df6f-6z2r4"]
Sep 09 07:08:27.537336 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:27.537317    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-fc9900-7df568df6f-6z2r4"]
Sep 09 07:08:27.549134 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:27.549109    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-fc9900-74c4648c8b-q6tdq"]
Sep 09 07:08:27.553164 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:27.553142    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-fc9900-74c4648c8b-q6tdq"]
Sep 09 07:08:27.711583 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:27.711546    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f7c4c24-81b3-4e2e-a857-d706230c4741" path="/var/lib/kubelet/pods/3f7c4c24-81b3-4e2e-a857-d706230c4741/volumes"
Sep 09 07:08:27.711934 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:27.711919    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4af2ca9c-554a-4cfa-bd6a-cdbbf7f56188" path="/var/lib/kubelet/pods/4af2ca9c-554a-4cfa-bd6a-cdbbf7f56188/volumes"
Sep 09 07:08:27.712228 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:27.712215    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9995f2b4-217e-46b3-891d-2273f99bdd7d" path="/var/lib/kubelet/pods/9995f2b4-217e-46b3-891d-2273f99bdd7d/volumes"
Sep 09 07:08:39.312668 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:39.312635    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-ea0f1c-bd755c56c-9qpt4"]
Sep 09 07:08:39.313109 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:39.313068    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f7c4c24-81b3-4e2e-a857-d706230c4741" containerName="revoke-keys"
Sep 09 07:08:39.313109 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:39.313082    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f7c4c24-81b3-4e2e-a857-d706230c4741" containerName="revoke-keys"
Sep 09 07:08:39.313109 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:39.313098    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4af2ca9c-554a-4cfa-bd6a-cdbbf7f56188" containerName="payload-pre-processing"
Sep 09 07:08:39.313109 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:39.313103    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4af2ca9c-554a-4cfa-bd6a-cdbbf7f56188" containerName="payload-pre-processing"
Sep 09 07:08:39.313109 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:39.313111    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9995f2b4-217e-46b3-891d-2273f99bdd7d" containerName="payload-processing"
Sep 09 07:08:39.313262 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:39.313116    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9995f2b4-217e-46b3-891d-2273f99bdd7d" containerName="payload-processing"
Sep 09 07:08:39.313262 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:39.313172    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4af2ca9c-554a-4cfa-bd6a-cdbbf7f56188" containerName="payload-pre-processing"
Sep 09 07:08:39.313262 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:39.313179    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9995f2b4-217e-46b3-891d-2273f99bdd7d" containerName="payload-processing"
Sep 09 07:08:39.313262 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:39.313187    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f7c4c24-81b3-4e2e-a857-d706230c4741" containerName="revoke-keys"
Sep 09 07:08:39.316044 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:39.316024    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ea0f1c-bd755c56c-9qpt4"
Sep 09 07:08:39.319693 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:39.319673    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-ea0f1c\""
Sep 09 07:08:39.319832 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:39.319675    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-ea0f1c-dockercfg-5vpxp\""
Sep 09 07:08:39.335182 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:39.335149    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-ea0f1c-bd755c56c-9qpt4"]
Sep 09 07:08:39.336401 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:39.336369    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8n9l\" (UniqueName: \"kubernetes.io/projected/9c5e60db-c474-4691-9d05-214734d67834-kube-api-access-h8n9l\") pod \"payload-processing-e2e-shared-a-w3-ea0f1c-bd755c56c-9qpt4\" (UID: \"9c5e60db-c474-4691-9d05-214734d67834\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ea0f1c-bd755c56c-9qpt4"
Sep 09 07:08:39.336501 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:39.336447    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c5e60db-c474-4691-9d05-214734d67834-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-ea0f1c-bd755c56c-9qpt4\" (UID: \"9c5e60db-c474-4691-9d05-214734d67834\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ea0f1c-bd755c56c-9qpt4"
Sep 09 07:08:39.369208 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:39.369179    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ea0f1c-6d4fdfff5d-jtzpq"]
Sep 09 07:08:39.372474 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:39.372457    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ea0f1c-6d4fdfff5d-jtzpq"
Sep 09 07:08:39.383879 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:39.383857    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ea0f1c-6d4fdfff5d-jtzpq"]
Sep 09 07:08:39.437480 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:39.437451    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2b88f27-ae58-407d-9ca3-230e5bde6740-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-ea0f1c-6d4fdfff5d-jtzpq\" (UID: \"f2b88f27-ae58-407d-9ca3-230e5bde6740\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ea0f1c-6d4fdfff5d-jtzpq"
Sep 09 07:08:39.437591 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:39.437495    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8n9l\" (UniqueName: \"kubernetes.io/projected/9c5e60db-c474-4691-9d05-214734d67834-kube-api-access-h8n9l\") pod \"payload-processing-e2e-shared-a-w3-ea0f1c-bd755c56c-9qpt4\" (UID: \"9c5e60db-c474-4691-9d05-214734d67834\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ea0f1c-bd755c56c-9qpt4"
Sep 09 07:08:39.437591 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:39.437542    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx2x8\" (UniqueName: \"kubernetes.io/projected/f2b88f27-ae58-407d-9ca3-230e5bde6740-kube-api-access-nx2x8\") pod \"payload-pre-processing-e2e-shared-a-w3-ea0f1c-6d4fdfff5d-jtzpq\" (UID: \"f2b88f27-ae58-407d-9ca3-230e5bde6740\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ea0f1c-6d4fdfff5d-jtzpq"
Sep 09 07:08:39.437591 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:39.437562    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c5e60db-c474-4691-9d05-214734d67834-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-ea0f1c-bd755c56c-9qpt4\" (UID: \"9c5e60db-c474-4691-9d05-214734d67834\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ea0f1c-bd755c56c-9qpt4"
Sep 09 07:08:39.438274 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:39.438258    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c5e60db-c474-4691-9d05-214734d67834-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-ea0f1c-bd755c56c-9qpt4\" (UID: \"9c5e60db-c474-4691-9d05-214734d67834\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ea0f1c-bd755c56c-9qpt4"
Sep 09 07:08:39.447198 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:39.447177    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8n9l\" (UniqueName: \"kubernetes.io/projected/9c5e60db-c474-4691-9d05-214734d67834-kube-api-access-h8n9l\") pod \"payload-processing-e2e-shared-a-w3-ea0f1c-bd755c56c-9qpt4\" (UID: \"9c5e60db-c474-4691-9d05-214734d67834\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ea0f1c-bd755c56c-9qpt4"
Sep 09 07:08:39.538006 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:39.537980    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nx2x8\" (UniqueName: \"kubernetes.io/projected/f2b88f27-ae58-407d-9ca3-230e5bde6740-kube-api-access-nx2x8\") pod \"payload-pre-processing-e2e-shared-a-w3-ea0f1c-6d4fdfff5d-jtzpq\" (UID: \"f2b88f27-ae58-407d-9ca3-230e5bde6740\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ea0f1c-6d4fdfff5d-jtzpq"
Sep 09 07:08:39.538119 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:39.538042    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2b88f27-ae58-407d-9ca3-230e5bde6740-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-ea0f1c-6d4fdfff5d-jtzpq\" (UID: \"f2b88f27-ae58-407d-9ca3-230e5bde6740\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ea0f1c-6d4fdfff5d-jtzpq"
Sep 09 07:08:39.538640 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:39.538620    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2b88f27-ae58-407d-9ca3-230e5bde6740-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-ea0f1c-6d4fdfff5d-jtzpq\" (UID: \"f2b88f27-ae58-407d-9ca3-230e5bde6740\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ea0f1c-6d4fdfff5d-jtzpq"
Sep 09 07:08:39.546632 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:39.546610    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx2x8\" (UniqueName: \"kubernetes.io/projected/f2b88f27-ae58-407d-9ca3-230e5bde6740-kube-api-access-nx2x8\") pod \"payload-pre-processing-e2e-shared-a-w3-ea0f1c-6d4fdfff5d-jtzpq\" (UID: \"f2b88f27-ae58-407d-9ca3-230e5bde6740\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ea0f1c-6d4fdfff5d-jtzpq"
Sep 09 07:08:39.625534 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:39.625497    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ea0f1c-bd755c56c-9qpt4"
Sep 09 07:08:39.682345 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:39.682080    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ea0f1c-6d4fdfff5d-jtzpq"
Sep 09 07:08:39.898602 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:39.898574    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-ea0f1c-bd755c56c-9qpt4"]
Sep 09 07:08:39.900386 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:08:39.900362    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c5e60db_c474_4691_9d05_214734d67834.slice/crio-464ab00d716989be80a1a952e41a220d306549c5b08de786284452effc8e2453 WatchSource:0}: Error finding container 464ab00d716989be80a1a952e41a220d306549c5b08de786284452effc8e2453: Status 404 returned error can't find the container with id 464ab00d716989be80a1a952e41a220d306549c5b08de786284452effc8e2453
Sep 09 07:08:39.962839 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:39.961634    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ea0f1c-6d4fdfff5d-jtzpq"]
Sep 09 07:08:39.964783 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:08:39.964567    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2b88f27_ae58_407d_9ca3_230e5bde6740.slice/crio-e4d885c629abc591acacd500ed6a406697d2dee3469e91750ac71c0553fce7ca WatchSource:0}: Error finding container e4d885c629abc591acacd500ed6a406697d2dee3469e91750ac71c0553fce7ca: Status 404 returned error can't find the container with id e4d885c629abc591acacd500ed6a406697d2dee3469e91750ac71c0553fce7ca
Sep 09 07:08:40.574312 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:40.574283    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ea0f1c-bd755c56c-9qpt4" event={"ID":"9c5e60db-c474-4691-9d05-214734d67834","Type":"ContainerStarted","Data":"36fea2e78c39a4699d20a2bceb0a10de5afec62a53f374f1be846c484c4870b0"}
Sep 09 07:08:40.574707 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:40.574334    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ea0f1c-bd755c56c-9qpt4" event={"ID":"9c5e60db-c474-4691-9d05-214734d67834","Type":"ContainerStarted","Data":"464ab00d716989be80a1a952e41a220d306549c5b08de786284452effc8e2453"}
Sep 09 07:08:40.574707 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:40.574397    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ea0f1c-bd755c56c-9qpt4"
Sep 09 07:08:40.575944 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:40.575921    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ea0f1c-6d4fdfff5d-jtzpq" event={"ID":"f2b88f27-ae58-407d-9ca3-230e5bde6740","Type":"ContainerStarted","Data":"3e60a7c75c83fac21338a175fc5b8f0f098d7fbf06c5b8323a0595522be2e4c7"}
Sep 09 07:08:40.576011 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:40.575954    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ea0f1c-6d4fdfff5d-jtzpq" event={"ID":"f2b88f27-ae58-407d-9ca3-230e5bde6740","Type":"ContainerStarted","Data":"e4d885c629abc591acacd500ed6a406697d2dee3469e91750ac71c0553fce7ca"}
Sep 09 07:08:40.576011 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:40.575975    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ea0f1c-6d4fdfff5d-jtzpq"
Sep 09 07:08:40.594720 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:40.594678    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ea0f1c-bd755c56c-9qpt4" podStartSLOduration=1.594667179 podStartE2EDuration="1.594667179s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 07:08:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 07:08:40.593053122 +0000 UTC m=+1055.384862463" watchObservedRunningTime="2026-09-09 07:08:40.594667179 +0000 UTC m=+1055.386476515"
Sep 09 07:08:40.612059 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:40.612017    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ea0f1c-6d4fdfff5d-jtzpq" podStartSLOduration=1.612004524 podStartE2EDuration="1.612004524s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 07:08:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 07:08:40.610652974 +0000 UTC m=+1055.402462312" watchObservedRunningTime="2026-09-09 07:08:40.612004524 +0000 UTC m=+1055.403813863"
Sep 09 07:08:44.781088 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:44.781056    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c20824ba-6c4568484b-w67hn"]
Sep 09 07:08:44.784552 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:44.784534    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c20824ba-6c4568484b-w67hn"
Sep 09 07:08:44.788342 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:44.788319    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-c20824ba-serving-cert\""
Sep 09 07:08:44.788741 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:44.788722    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 09 07:08:44.789089 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:44.789073    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 07:08:44.789466 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:44.789450    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 09 07:08:44.789610 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:44.789586    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-lbttc\""
Sep 09 07:08:44.805915 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:44.805854    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c20824ba-6c4568484b-w67hn"]
Sep 09 07:08:44.885202 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:44.885170    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8efddc42-69e2-4216-aced-9b82344355b4-openshift-service-ca\") pod \"maas-api-e2e-mt-c20824ba-6c4568484b-w67hn\" (UID: \"8efddc42-69e2-4216-aced-9b82344355b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c20824ba-6c4568484b-w67hn"
Sep 09 07:08:44.885345 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:44.885240    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8efddc42-69e2-4216-aced-9b82344355b4-metrics-certs\") pod \"maas-api-e2e-mt-c20824ba-6c4568484b-w67hn\" (UID: \"8efddc42-69e2-4216-aced-9b82344355b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c20824ba-6c4568484b-w67hn"
Sep 09 07:08:44.885345 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:44.885307    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8efddc42-69e2-4216-aced-9b82344355b4-maas-api-tls\") pod \"maas-api-e2e-mt-c20824ba-6c4568484b-w67hn\" (UID: \"8efddc42-69e2-4216-aced-9b82344355b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c20824ba-6c4568484b-w67hn"
Sep 09 07:08:44.885434 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:44.885351    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzjb9\" (UniqueName: \"kubernetes.io/projected/8efddc42-69e2-4216-aced-9b82344355b4-kube-api-access-xzjb9\") pod \"maas-api-e2e-mt-c20824ba-6c4568484b-w67hn\" (UID: \"8efddc42-69e2-4216-aced-9b82344355b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c20824ba-6c4568484b-w67hn"
Sep 09 07:08:44.986509 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:44.986480    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8efddc42-69e2-4216-aced-9b82344355b4-maas-api-tls\") pod \"maas-api-e2e-mt-c20824ba-6c4568484b-w67hn\" (UID: \"8efddc42-69e2-4216-aced-9b82344355b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c20824ba-6c4568484b-w67hn"
Sep 09 07:08:44.986671 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:44.986512    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzjb9\" (UniqueName: \"kubernetes.io/projected/8efddc42-69e2-4216-aced-9b82344355b4-kube-api-access-xzjb9\") pod \"maas-api-e2e-mt-c20824ba-6c4568484b-w67hn\" (UID: \"8efddc42-69e2-4216-aced-9b82344355b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c20824ba-6c4568484b-w67hn"
Sep 09 07:08:44.986671 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:44.986543    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8efddc42-69e2-4216-aced-9b82344355b4-openshift-service-ca\") pod \"maas-api-e2e-mt-c20824ba-6c4568484b-w67hn\" (UID: \"8efddc42-69e2-4216-aced-9b82344355b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c20824ba-6c4568484b-w67hn"
Sep 09 07:08:44.986671 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:44.986579    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8efddc42-69e2-4216-aced-9b82344355b4-metrics-certs\") pod \"maas-api-e2e-mt-c20824ba-6c4568484b-w67hn\" (UID: \"8efddc42-69e2-4216-aced-9b82344355b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c20824ba-6c4568484b-w67hn"
Sep 09 07:08:44.986671 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:08:44.986640    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-c20824ba-serving-cert: secret "maas-api-e2e-mt-c20824ba-serving-cert" not found
Sep 09 07:08:44.986934 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:08:44.986711    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8efddc42-69e2-4216-aced-9b82344355b4-maas-api-tls podName:8efddc42-69e2-4216-aced-9b82344355b4 nodeName:}" failed. No retries permitted until 2026-09-09 07:08:45.4866925 +0000 UTC m=+1060.278501820 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8efddc42-69e2-4216-aced-9b82344355b4-maas-api-tls") pod "maas-api-e2e-mt-c20824ba-6c4568484b-w67hn" (UID: "8efddc42-69e2-4216-aced-9b82344355b4") : secret "maas-api-e2e-mt-c20824ba-serving-cert" not found
Sep 09 07:08:44.987311 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:44.987293    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8efddc42-69e2-4216-aced-9b82344355b4-openshift-service-ca\") pod \"maas-api-e2e-mt-c20824ba-6c4568484b-w67hn\" (UID: \"8efddc42-69e2-4216-aced-9b82344355b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c20824ba-6c4568484b-w67hn"
Sep 09 07:08:44.989144 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:44.989127    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8efddc42-69e2-4216-aced-9b82344355b4-metrics-certs\") pod \"maas-api-e2e-mt-c20824ba-6c4568484b-w67hn\" (UID: \"8efddc42-69e2-4216-aced-9b82344355b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c20824ba-6c4568484b-w67hn"
Sep 09 07:08:44.996662 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:44.996642    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzjb9\" (UniqueName: \"kubernetes.io/projected/8efddc42-69e2-4216-aced-9b82344355b4-kube-api-access-xzjb9\") pod \"maas-api-e2e-mt-c20824ba-6c4568484b-w67hn\" (UID: \"8efddc42-69e2-4216-aced-9b82344355b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c20824ba-6c4568484b-w67hn"
Sep 09 07:08:45.490818 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:45.490787    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8efddc42-69e2-4216-aced-9b82344355b4-maas-api-tls\") pod \"maas-api-e2e-mt-c20824ba-6c4568484b-w67hn\" (UID: \"8efddc42-69e2-4216-aced-9b82344355b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c20824ba-6c4568484b-w67hn"
Sep 09 07:08:45.493260 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:45.493235    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8efddc42-69e2-4216-aced-9b82344355b4-maas-api-tls\") pod \"maas-api-e2e-mt-c20824ba-6c4568484b-w67hn\" (UID: \"8efddc42-69e2-4216-aced-9b82344355b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c20824ba-6c4568484b-w67hn"
Sep 09 07:08:45.615020 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:45.614991    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c20824ba-85b69487f4-sslvx"]
Sep 09 07:08:45.618575 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:45.618554    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-c20824ba-85b69487f4-sslvx"
Sep 09 07:08:45.621615 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:45.621593    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-c20824ba-dockercfg-n6d8q\""
Sep 09 07:08:45.621730 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:45.621647    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-c20824ba\""
Sep 09 07:08:45.628831 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:45.628810    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c20824ba-85b69487f4-sslvx"]
Sep 09 07:08:45.644015 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:45.643984    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c20824ba-75d5cc54cc-jtx47"]
Sep 09 07:08:45.647924 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:45.647904    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-c20824ba-75d5cc54cc-jtx47"
Sep 09 07:08:45.658108 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:45.658082    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c20824ba-75d5cc54cc-jtx47"]
Sep 09 07:08:45.692457 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:45.692430    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grqv2\" (UniqueName: \"kubernetes.io/projected/fce57d35-f56e-44be-814d-a3e2a55a2890-kube-api-access-grqv2\") pod \"payload-processing-e2e-mt-c20824ba-75d5cc54cc-jtx47\" (UID: \"fce57d35-f56e-44be-814d-a3e2a55a2890\") " pod="openshift-ingress/payload-processing-e2e-mt-c20824ba-75d5cc54cc-jtx47"
Sep 09 07:08:45.692605 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:45.692482    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2462223-6559-4a1a-a91b-94c99ba7c60e-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-c20824ba-85b69487f4-sslvx\" (UID: \"e2462223-6559-4a1a-a91b-94c99ba7c60e\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c20824ba-85b69487f4-sslvx"
Sep 09 07:08:45.692605 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:45.692528    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fce57d35-f56e-44be-814d-a3e2a55a2890-plugins-config-volume\") pod \"payload-processing-e2e-mt-c20824ba-75d5cc54cc-jtx47\" (UID: \"fce57d35-f56e-44be-814d-a3e2a55a2890\") " pod="openshift-ingress/payload-processing-e2e-mt-c20824ba-75d5cc54cc-jtx47"
Sep 09 07:08:45.692605 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:45.692586    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smxjn\" (UniqueName: \"kubernetes.io/projected/e2462223-6559-4a1a-a91b-94c99ba7c60e-kube-api-access-smxjn\") pod \"payload-pre-processing-e2e-mt-c20824ba-85b69487f4-sslvx\" (UID: \"e2462223-6559-4a1a-a91b-94c99ba7c60e\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c20824ba-85b69487f4-sslvx"
Sep 09 07:08:45.696393 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:45.696375    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c20824ba-6c4568484b-w67hn"
Sep 09 07:08:45.793836 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:45.793801    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2462223-6559-4a1a-a91b-94c99ba7c60e-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-c20824ba-85b69487f4-sslvx\" (UID: \"e2462223-6559-4a1a-a91b-94c99ba7c60e\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c20824ba-85b69487f4-sslvx"
Sep 09 07:08:45.794253 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:45.793888    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fce57d35-f56e-44be-814d-a3e2a55a2890-plugins-config-volume\") pod \"payload-processing-e2e-mt-c20824ba-75d5cc54cc-jtx47\" (UID: \"fce57d35-f56e-44be-814d-a3e2a55a2890\") " pod="openshift-ingress/payload-processing-e2e-mt-c20824ba-75d5cc54cc-jtx47"
Sep 09 07:08:45.794253 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:45.793921    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smxjn\" (UniqueName: \"kubernetes.io/projected/e2462223-6559-4a1a-a91b-94c99ba7c60e-kube-api-access-smxjn\") pod \"payload-pre-processing-e2e-mt-c20824ba-85b69487f4-sslvx\" (UID: \"e2462223-6559-4a1a-a91b-94c99ba7c60e\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c20824ba-85b69487f4-sslvx"
Sep 09 07:08:45.794253 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:45.793989    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grqv2\" (UniqueName: \"kubernetes.io/projected/fce57d35-f56e-44be-814d-a3e2a55a2890-kube-api-access-grqv2\") pod \"payload-processing-e2e-mt-c20824ba-75d5cc54cc-jtx47\" (UID: \"fce57d35-f56e-44be-814d-a3e2a55a2890\") " pod="openshift-ingress/payload-processing-e2e-mt-c20824ba-75d5cc54cc-jtx47"
Sep 09 07:08:45.794790 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:45.794733    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2462223-6559-4a1a-a91b-94c99ba7c60e-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-c20824ba-85b69487f4-sslvx\" (UID: \"e2462223-6559-4a1a-a91b-94c99ba7c60e\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c20824ba-85b69487f4-sslvx"
Sep 09 07:08:45.794871 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:45.794846    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fce57d35-f56e-44be-814d-a3e2a55a2890-plugins-config-volume\") pod \"payload-processing-e2e-mt-c20824ba-75d5cc54cc-jtx47\" (UID: \"fce57d35-f56e-44be-814d-a3e2a55a2890\") " pod="openshift-ingress/payload-processing-e2e-mt-c20824ba-75d5cc54cc-jtx47"
Sep 09 07:08:45.803351 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:45.803326    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grqv2\" (UniqueName: \"kubernetes.io/projected/fce57d35-f56e-44be-814d-a3e2a55a2890-kube-api-access-grqv2\") pod \"payload-processing-e2e-mt-c20824ba-75d5cc54cc-jtx47\" (UID: \"fce57d35-f56e-44be-814d-a3e2a55a2890\") " pod="openshift-ingress/payload-processing-e2e-mt-c20824ba-75d5cc54cc-jtx47"
Sep 09 07:08:45.804181 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:45.804125    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smxjn\" (UniqueName: \"kubernetes.io/projected/e2462223-6559-4a1a-a91b-94c99ba7c60e-kube-api-access-smxjn\") pod \"payload-pre-processing-e2e-mt-c20824ba-85b69487f4-sslvx\" (UID: \"e2462223-6559-4a1a-a91b-94c99ba7c60e\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c20824ba-85b69487f4-sslvx"
Sep 09 07:08:45.930203 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:45.930173    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-c20824ba-85b69487f4-sslvx"
Sep 09 07:08:45.959278 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:45.959250    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-c20824ba-75d5cc54cc-jtx47"
Sep 09 07:08:45.974434 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:45.974414    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c20824ba-6c4568484b-w67hn"]
Sep 09 07:08:45.976643 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:08:45.976620    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8efddc42_69e2_4216_aced_9b82344355b4.slice/crio-444c64e3ec57265b42f1fadc6e8e0b8d5d564feeee51539ae43e0ef019e0209d WatchSource:0}: Error finding container 444c64e3ec57265b42f1fadc6e8e0b8d5d564feeee51539ae43e0ef019e0209d: Status 404 returned error can't find the container with id 444c64e3ec57265b42f1fadc6e8e0b8d5d564feeee51539ae43e0ef019e0209d
Sep 09 07:08:46.207806 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:46.207778    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c20824ba-85b69487f4-sslvx"]
Sep 09 07:08:46.208436 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:08:46.208413    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2462223_6559_4a1a_a91b_94c99ba7c60e.slice/crio-cdac063e4c7cefd30f2a441f8fb36237be1e3be5da1844f7d2a284cfd38b6297 WatchSource:0}: Error finding container cdac063e4c7cefd30f2a441f8fb36237be1e3be5da1844f7d2a284cfd38b6297: Status 404 returned error can't find the container with id cdac063e4c7cefd30f2a441f8fb36237be1e3be5da1844f7d2a284cfd38b6297
Sep 09 07:08:46.249505 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:46.249482    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c20824ba-75d5cc54cc-jtx47"]
Sep 09 07:08:46.251257 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:08:46.251231    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfce57d35_f56e_44be_814d_a3e2a55a2890.slice/crio-cde68404e3a152aff25ec21a84554fc83d037c1b6c3a99ea7679433ccef99b48 WatchSource:0}: Error finding container cde68404e3a152aff25ec21a84554fc83d037c1b6c3a99ea7679433ccef99b48: Status 404 returned error can't find the container with id cde68404e3a152aff25ec21a84554fc83d037c1b6c3a99ea7679433ccef99b48
Sep 09 07:08:46.604712 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:46.604629    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c20824ba-6c4568484b-w67hn" event={"ID":"8efddc42-69e2-4216-aced-9b82344355b4","Type":"ContainerStarted","Data":"444c64e3ec57265b42f1fadc6e8e0b8d5d564feeee51539ae43e0ef019e0209d"}
Sep 09 07:08:46.606347 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:46.606317    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-c20824ba-85b69487f4-sslvx" event={"ID":"e2462223-6559-4a1a-a91b-94c99ba7c60e","Type":"ContainerStarted","Data":"a3fbf82e8a28e18c3b9021d23db65112f6641b48dd0680404ca66fdcfb5f96fa"}
Sep 09 07:08:46.606467 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:46.606370    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-c20824ba-85b69487f4-sslvx" event={"ID":"e2462223-6559-4a1a-a91b-94c99ba7c60e","Type":"ContainerStarted","Data":"cdac063e4c7cefd30f2a441f8fb36237be1e3be5da1844f7d2a284cfd38b6297"}
Sep 09 07:08:46.606467 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:46.606400    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-c20824ba-85b69487f4-sslvx"
Sep 09 07:08:46.609105 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:46.609082    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-c20824ba-75d5cc54cc-jtx47" event={"ID":"fce57d35-f56e-44be-814d-a3e2a55a2890","Type":"ContainerStarted","Data":"034970d70ad7fd68f8e247973c8e23175ca75d5a505eef5f307ac6c7f7fed08f"}
Sep 09 07:08:46.609679 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:46.609658    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-c20824ba-75d5cc54cc-jtx47" event={"ID":"fce57d35-f56e-44be-814d-a3e2a55a2890","Type":"ContainerStarted","Data":"cde68404e3a152aff25ec21a84554fc83d037c1b6c3a99ea7679433ccef99b48"}
Sep 09 07:08:46.609869 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:46.609853    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-c20824ba-75d5cc54cc-jtx47"
Sep 09 07:08:46.626681 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:46.626624    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-c20824ba-85b69487f4-sslvx" podStartSLOduration=1.626606433 podStartE2EDuration="1.626606433s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 07:08:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 07:08:46.625518262 +0000 UTC m=+1061.417327604" watchObservedRunningTime="2026-09-09 07:08:46.626606433 +0000 UTC m=+1061.418415770"
Sep 09 07:08:46.644283 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:46.644237    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-c20824ba-75d5cc54cc-jtx47" podStartSLOduration=1.644223555 podStartE2EDuration="1.644223555s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 07:08:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 07:08:46.643978603 +0000 UTC m=+1061.435787941" watchObservedRunningTime="2026-09-09 07:08:46.644223555 +0000 UTC m=+1061.436032897"
Sep 09 07:08:48.629356 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:48.629311    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c20824ba-6c4568484b-w67hn" event={"ID":"8efddc42-69e2-4216-aced-9b82344355b4","Type":"ContainerStarted","Data":"03a8d9c7dbffdb6c7cadfe938836999064eac26bf2aa8d539bd23e833ade8fb6"}
Sep 09 07:08:48.629849 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:48.629398    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c20824ba-6c4568484b-w67hn"
Sep 09 07:08:48.653586 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:48.653539    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c20824ba-6c4568484b-w67hn" podStartSLOduration=2.860667349 podStartE2EDuration="4.653521137s" totalImagesPullingTime="1.792853788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 07:08:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 07:08:48.65201963 +0000 UTC m=+1063.443828969" watchObservedRunningTime="2026-09-09 07:08:48.653521137 +0000 UTC m=+1063.445330475"
Sep 09 07:08:51.582318 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:51.582288    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ea0f1c-6d4fdfff5d-jtzpq"
Sep 09 07:08:51.582710 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:51.582451    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ea0f1c-bd755c56c-9qpt4"
Sep 09 07:08:54.641530 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:54.641505    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c20824ba-6c4568484b-w67hn"
Sep 09 07:08:57.624179 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:57.624090    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-c20824ba-75d5cc54cc-jtx47"
Sep 09 07:08:57.624561 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:08:57.624338    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-c20824ba-85b69487f4-sslvx"
Sep 09 07:09:07.937434 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:07.937398    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-988b24-7cbcc787c8-kqzth"]
Sep 09 07:09:07.942229 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:07.942212    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-988b24-7cbcc787c8-kqzth"
Sep 09 07:09:07.946855 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:07.946835    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-988b24-dockercfg-mgqhj\""
Sep 09 07:09:07.947128 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:07.947114    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-988b24\""
Sep 09 07:09:07.986355 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:07.986316    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-988b24-7cbcc787c8-kqzth"]
Sep 09 07:09:07.988104 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:07.988079    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-988b24-6d44b9dcc5-s577j"]
Sep 09 07:09:07.991457 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:07.991438    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-988b24-6d44b9dcc5-s577j"
Sep 09 07:09:08.017173 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:08.017150    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-988b24-6d44b9dcc5-s577j"]
Sep 09 07:09:08.092052 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:08.092020    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4vmk\" (UniqueName: \"kubernetes.io/projected/b0009a37-110e-4422-af75-b5ea06ff64da-kube-api-access-q4vmk\") pod \"payload-processing-e2e-shared-b-w3-988b24-6d44b9dcc5-s577j\" (UID: \"b0009a37-110e-4422-af75-b5ea06ff64da\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-988b24-6d44b9dcc5-s577j"
Sep 09 07:09:08.092211 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:08.092061    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sktf7\" (UniqueName: \"kubernetes.io/projected/ccbfc2e6-2cea-4eb3-a0e0-e2c4af53bf9e-kube-api-access-sktf7\") pod \"payload-pre-processing-e2e-shared-b-w3-988b24-7cbcc787c8-kqzth\" (UID: \"ccbfc2e6-2cea-4eb3-a0e0-e2c4af53bf9e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-988b24-7cbcc787c8-kqzth"
Sep 09 07:09:08.092211 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:08.092132    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b0009a37-110e-4422-af75-b5ea06ff64da-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-988b24-6d44b9dcc5-s577j\" (UID: \"b0009a37-110e-4422-af75-b5ea06ff64da\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-988b24-6d44b9dcc5-s577j"
Sep 09 07:09:08.092306 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:08.092209    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ccbfc2e6-2cea-4eb3-a0e0-e2c4af53bf9e-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-988b24-7cbcc787c8-kqzth\" (UID: \"ccbfc2e6-2cea-4eb3-a0e0-e2c4af53bf9e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-988b24-7cbcc787c8-kqzth"
Sep 09 07:09:08.192896 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:08.192811    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b0009a37-110e-4422-af75-b5ea06ff64da-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-988b24-6d44b9dcc5-s577j\" (UID: \"b0009a37-110e-4422-af75-b5ea06ff64da\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-988b24-6d44b9dcc5-s577j"
Sep 09 07:09:08.192896 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:08.192867    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ccbfc2e6-2cea-4eb3-a0e0-e2c4af53bf9e-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-988b24-7cbcc787c8-kqzth\" (UID: \"ccbfc2e6-2cea-4eb3-a0e0-e2c4af53bf9e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-988b24-7cbcc787c8-kqzth"
Sep 09 07:09:08.193077 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:08.192925    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4vmk\" (UniqueName: \"kubernetes.io/projected/b0009a37-110e-4422-af75-b5ea06ff64da-kube-api-access-q4vmk\") pod \"payload-processing-e2e-shared-b-w3-988b24-6d44b9dcc5-s577j\" (UID: \"b0009a37-110e-4422-af75-b5ea06ff64da\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-988b24-6d44b9dcc5-s577j"
Sep 09 07:09:08.193077 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:08.192946    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sktf7\" (UniqueName: \"kubernetes.io/projected/ccbfc2e6-2cea-4eb3-a0e0-e2c4af53bf9e-kube-api-access-sktf7\") pod \"payload-pre-processing-e2e-shared-b-w3-988b24-7cbcc787c8-kqzth\" (UID: \"ccbfc2e6-2cea-4eb3-a0e0-e2c4af53bf9e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-988b24-7cbcc787c8-kqzth"
Sep 09 07:09:08.193555 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:08.193535    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b0009a37-110e-4422-af75-b5ea06ff64da-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-988b24-6d44b9dcc5-s577j\" (UID: \"b0009a37-110e-4422-af75-b5ea06ff64da\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-988b24-6d44b9dcc5-s577j"
Sep 09 07:09:08.193607 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:08.193589    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ccbfc2e6-2cea-4eb3-a0e0-e2c4af53bf9e-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-988b24-7cbcc787c8-kqzth\" (UID: \"ccbfc2e6-2cea-4eb3-a0e0-e2c4af53bf9e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-988b24-7cbcc787c8-kqzth"
Sep 09 07:09:08.201699 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:08.201670    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4vmk\" (UniqueName: \"kubernetes.io/projected/b0009a37-110e-4422-af75-b5ea06ff64da-kube-api-access-q4vmk\") pod \"payload-processing-e2e-shared-b-w3-988b24-6d44b9dcc5-s577j\" (UID: \"b0009a37-110e-4422-af75-b5ea06ff64da\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-988b24-6d44b9dcc5-s577j"
Sep 09 07:09:08.201843 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:08.201823    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sktf7\" (UniqueName: \"kubernetes.io/projected/ccbfc2e6-2cea-4eb3-a0e0-e2c4af53bf9e-kube-api-access-sktf7\") pod \"payload-pre-processing-e2e-shared-b-w3-988b24-7cbcc787c8-kqzth\" (UID: \"ccbfc2e6-2cea-4eb3-a0e0-e2c4af53bf9e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-988b24-7cbcc787c8-kqzth"
Sep 09 07:09:08.251922 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:08.251894    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-988b24-7cbcc787c8-kqzth"
Sep 09 07:09:08.301572 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:08.301531    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-988b24-6d44b9dcc5-s577j"
Sep 09 07:09:08.522243 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:08.522161    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-988b24-7cbcc787c8-kqzth"]
Sep 09 07:09:08.525572 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:09:08.525543    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccbfc2e6_2cea_4eb3_a0e0_e2c4af53bf9e.slice/crio-f4ecd987ac021dd27e6480417ed2b8140521da0e6ae1533873e662349b4e7962 WatchSource:0}: Error finding container f4ecd987ac021dd27e6480417ed2b8140521da0e6ae1533873e662349b4e7962: Status 404 returned error can't find the container with id f4ecd987ac021dd27e6480417ed2b8140521da0e6ae1533873e662349b4e7962
Sep 09 07:09:08.585716 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:08.585695    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-988b24-6d44b9dcc5-s577j"]
Sep 09 07:09:08.587933 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:09:08.587906    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0009a37_110e_4422_af75_b5ea06ff64da.slice/crio-26ae9d1073c633b23accce31e5f67c626f6c48a1f84f690a631c6b53a58a3aae WatchSource:0}: Error finding container 26ae9d1073c633b23accce31e5f67c626f6c48a1f84f690a631c6b53a58a3aae: Status 404 returned error can't find the container with id 26ae9d1073c633b23accce31e5f67c626f6c48a1f84f690a631c6b53a58a3aae
Sep 09 07:09:08.741674 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:08.741626    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-988b24-6d44b9dcc5-s577j" event={"ID":"b0009a37-110e-4422-af75-b5ea06ff64da","Type":"ContainerStarted","Data":"20903f7b3a3f302ef0e585c65a2d6e2da487c24a9302cdf718b5618e198079e9"}
Sep 09 07:09:08.741885 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:08.741690    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-988b24-6d44b9dcc5-s577j" event={"ID":"b0009a37-110e-4422-af75-b5ea06ff64da","Type":"ContainerStarted","Data":"26ae9d1073c633b23accce31e5f67c626f6c48a1f84f690a631c6b53a58a3aae"}
Sep 09 07:09:08.741885 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:08.741717    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-988b24-6d44b9dcc5-s577j"
Sep 09 07:09:08.743355 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:08.743328    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-988b24-7cbcc787c8-kqzth" event={"ID":"ccbfc2e6-2cea-4eb3-a0e0-e2c4af53bf9e","Type":"ContainerStarted","Data":"e7248408f72f4a8571d81a20f22e260a77afcf00273c0abbfde31cc3fec30c3a"}
Sep 09 07:09:08.743447 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:08.743383    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-988b24-7cbcc787c8-kqzth"
Sep 09 07:09:08.743447 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:08.743406    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-988b24-7cbcc787c8-kqzth" event={"ID":"ccbfc2e6-2cea-4eb3-a0e0-e2c4af53bf9e","Type":"ContainerStarted","Data":"f4ecd987ac021dd27e6480417ed2b8140521da0e6ae1533873e662349b4e7962"}
Sep 09 07:09:08.760956 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:08.760905    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-988b24-6d44b9dcc5-s577j" podStartSLOduration=1.760889598 podStartE2EDuration="1.760889598s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 07:09:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 07:09:08.759336379 +0000 UTC m=+1083.551145731" watchObservedRunningTime="2026-09-09 07:09:08.760889598 +0000 UTC m=+1083.552698936"
Sep 09 07:09:08.778141 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:08.778061    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-988b24-7cbcc787c8-kqzth" podStartSLOduration=1.778047172 podStartE2EDuration="1.778047172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 07:09:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 07:09:08.776323018 +0000 UTC m=+1083.568132359" watchObservedRunningTime="2026-09-09 07:09:08.778047172 +0000 UTC m=+1083.569856510"
Sep 09 07:09:19.751242 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:19.751204    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-988b24-6d44b9dcc5-s577j"
Sep 09 07:09:19.751767 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:19.751294    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-988b24-7cbcc787c8-kqzth"
Sep 09 07:09:26.308466 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.308437    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c20824ba-6c4568484b-w67hn"]
Sep 09 07:09:26.308889 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.308621    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c20824ba-6c4568484b-w67hn" podUID="8efddc42-69e2-4216-aced-9b82344355b4" containerName="maas-api" containerID="cri-o://03a8d9c7dbffdb6c7cadfe938836999064eac26bf2aa8d539bd23e833ade8fb6" gracePeriod=30
Sep 09 07:09:26.348980 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.348954    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c20824ba-75d5cc54cc-jtx47"]
Sep 09 07:09:26.349213 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.349186    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-c20824ba-75d5cc54cc-jtx47" podUID="fce57d35-f56e-44be-814d-a3e2a55a2890" containerName="payload-processing" containerID="cri-o://034970d70ad7fd68f8e247973c8e23175ca75d5a505eef5f307ac6c7f7fed08f" gracePeriod=30
Sep 09 07:09:26.356015 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.355992    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c20824ba-85b69487f4-sslvx"]
Sep 09 07:09:26.356202 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.356181    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-c20824ba-85b69487f4-sslvx" podUID="e2462223-6559-4a1a-a91b-94c99ba7c60e" containerName="payload-pre-processing" containerID="cri-o://a3fbf82e8a28e18c3b9021d23db65112f6641b48dd0680404ca66fdcfb5f96fa" gracePeriod=30
Sep 09 07:09:26.618309 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.618286    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c20824ba-6c4568484b-w67hn"
Sep 09 07:09:26.646441 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.646416    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-c20824ba-75d5cc54cc-jtx47"
Sep 09 07:09:26.649891 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.649870    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-c20824ba-85b69487f4-sslvx"
Sep 09 07:09:26.661587 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.661566    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8efddc42-69e2-4216-aced-9b82344355b4-metrics-certs\") pod \"8efddc42-69e2-4216-aced-9b82344355b4\" (UID: \"8efddc42-69e2-4216-aced-9b82344355b4\") "
Sep 09 07:09:26.661697 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.661595    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2462223-6559-4a1a-a91b-94c99ba7c60e-plugins-config-volume\") pod \"e2462223-6559-4a1a-a91b-94c99ba7c60e\" (UID: \"e2462223-6559-4a1a-a91b-94c99ba7c60e\") "
Sep 09 07:09:26.661697 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.661618    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8efddc42-69e2-4216-aced-9b82344355b4-openshift-service-ca\") pod \"8efddc42-69e2-4216-aced-9b82344355b4\" (UID: \"8efddc42-69e2-4216-aced-9b82344355b4\") "
Sep 09 07:09:26.661697 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.661653    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fce57d35-f56e-44be-814d-a3e2a55a2890-plugins-config-volume\") pod \"fce57d35-f56e-44be-814d-a3e2a55a2890\" (UID: \"fce57d35-f56e-44be-814d-a3e2a55a2890\") "
Sep 09 07:09:26.661697 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.661679    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smxjn\" (UniqueName: \"kubernetes.io/projected/e2462223-6559-4a1a-a91b-94c99ba7c60e-kube-api-access-smxjn\") pod \"e2462223-6559-4a1a-a91b-94c99ba7c60e\" (UID: \"e2462223-6559-4a1a-a91b-94c99ba7c60e\") "
Sep 09 07:09:26.661975 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.661726    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grqv2\" (UniqueName: \"kubernetes.io/projected/fce57d35-f56e-44be-814d-a3e2a55a2890-kube-api-access-grqv2\") pod \"fce57d35-f56e-44be-814d-a3e2a55a2890\" (UID: \"fce57d35-f56e-44be-814d-a3e2a55a2890\") "
Sep 09 07:09:26.661975 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.661807    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8efddc42-69e2-4216-aced-9b82344355b4-maas-api-tls\") pod \"8efddc42-69e2-4216-aced-9b82344355b4\" (UID: \"8efddc42-69e2-4216-aced-9b82344355b4\") "
Sep 09 07:09:26.661975 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.661836    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzjb9\" (UniqueName: \"kubernetes.io/projected/8efddc42-69e2-4216-aced-9b82344355b4-kube-api-access-xzjb9\") pod \"8efddc42-69e2-4216-aced-9b82344355b4\" (UID: \"8efddc42-69e2-4216-aced-9b82344355b4\") "
Sep 09 07:09:26.662148 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.661998    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8efddc42-69e2-4216-aced-9b82344355b4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8efddc42-69e2-4216-aced-9b82344355b4" (UID: "8efddc42-69e2-4216-aced-9b82344355b4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 07:09:26.662148 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.662014    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2462223-6559-4a1a-a91b-94c99ba7c60e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e2462223-6559-4a1a-a91b-94c99ba7c60e" (UID: "e2462223-6559-4a1a-a91b-94c99ba7c60e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 07:09:26.662148 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.662039    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fce57d35-f56e-44be-814d-a3e2a55a2890-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fce57d35-f56e-44be-814d-a3e2a55a2890" (UID: "fce57d35-f56e-44be-814d-a3e2a55a2890"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 07:09:26.662312 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.662227    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fce57d35-f56e-44be-814d-a3e2a55a2890-plugins-config-volume\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:09:26.662312 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.662248    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2462223-6559-4a1a-a91b-94c99ba7c60e-plugins-config-volume\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:09:26.662312 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.662262    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8efddc42-69e2-4216-aced-9b82344355b4-openshift-service-ca\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:09:26.664314 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.664281    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2462223-6559-4a1a-a91b-94c99ba7c60e-kube-api-access-smxjn" (OuterVolumeSpecName: "kube-api-access-smxjn") pod "e2462223-6559-4a1a-a91b-94c99ba7c60e" (UID: "e2462223-6559-4a1a-a91b-94c99ba7c60e"). InnerVolumeSpecName "kube-api-access-smxjn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 07:09:26.664981 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.664724    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8efddc42-69e2-4216-aced-9b82344355b4-kube-api-access-xzjb9" (OuterVolumeSpecName: "kube-api-access-xzjb9") pod "8efddc42-69e2-4216-aced-9b82344355b4" (UID: "8efddc42-69e2-4216-aced-9b82344355b4"). InnerVolumeSpecName "kube-api-access-xzjb9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 07:09:26.664981 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.664731    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8efddc42-69e2-4216-aced-9b82344355b4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8efddc42-69e2-4216-aced-9b82344355b4" (UID: "8efddc42-69e2-4216-aced-9b82344355b4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 07:09:26.664981 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.664773    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8efddc42-69e2-4216-aced-9b82344355b4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8efddc42-69e2-4216-aced-9b82344355b4" (UID: "8efddc42-69e2-4216-aced-9b82344355b4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 07:09:26.665449 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.664885    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fce57d35-f56e-44be-814d-a3e2a55a2890-kube-api-access-grqv2" (OuterVolumeSpecName: "kube-api-access-grqv2") pod "fce57d35-f56e-44be-814d-a3e2a55a2890" (UID: "fce57d35-f56e-44be-814d-a3e2a55a2890"). InnerVolumeSpecName "kube-api-access-grqv2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 07:09:26.762910 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.762882    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grqv2\" (UniqueName: \"kubernetes.io/projected/fce57d35-f56e-44be-814d-a3e2a55a2890-kube-api-access-grqv2\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:09:26.762910 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.762906    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8efddc42-69e2-4216-aced-9b82344355b4-maas-api-tls\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:09:26.762910 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.762916    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzjb9\" (UniqueName: \"kubernetes.io/projected/8efddc42-69e2-4216-aced-9b82344355b4-kube-api-access-xzjb9\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:09:26.763120 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.762925    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8efddc42-69e2-4216-aced-9b82344355b4-metrics-certs\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:09:26.763120 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.762933    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smxjn\" (UniqueName: \"kubernetes.io/projected/e2462223-6559-4a1a-a91b-94c99ba7c60e-kube-api-access-smxjn\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:09:26.836974 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.836897    2575 generic.go:356] "Generic (PLEG): container finished" podID="8efddc42-69e2-4216-aced-9b82344355b4" containerID="03a8d9c7dbffdb6c7cadfe938836999064eac26bf2aa8d539bd23e833ade8fb6" exitCode=0
Sep 09 07:09:26.836974 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.836930    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c20824ba-6c4568484b-w67hn"
Sep 09 07:09:26.837147 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.836977    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c20824ba-6c4568484b-w67hn" event={"ID":"8efddc42-69e2-4216-aced-9b82344355b4","Type":"ContainerDied","Data":"03a8d9c7dbffdb6c7cadfe938836999064eac26bf2aa8d539bd23e833ade8fb6"}
Sep 09 07:09:26.837147 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.837021    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c20824ba-6c4568484b-w67hn" event={"ID":"8efddc42-69e2-4216-aced-9b82344355b4","Type":"ContainerDied","Data":"444c64e3ec57265b42f1fadc6e8e0b8d5d564feeee51539ae43e0ef019e0209d"}
Sep 09 07:09:26.837147 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.837047    2575 scope.go:117] "RemoveContainer" containerID="03a8d9c7dbffdb6c7cadfe938836999064eac26bf2aa8d539bd23e833ade8fb6"
Sep 09 07:09:26.838433 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.838408    2575 generic.go:356] "Generic (PLEG): container finished" podID="e2462223-6559-4a1a-a91b-94c99ba7c60e" containerID="a3fbf82e8a28e18c3b9021d23db65112f6641b48dd0680404ca66fdcfb5f96fa" exitCode=0
Sep 09 07:09:26.838556 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.838434    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-c20824ba-85b69487f4-sslvx" event={"ID":"e2462223-6559-4a1a-a91b-94c99ba7c60e","Type":"ContainerDied","Data":"a3fbf82e8a28e18c3b9021d23db65112f6641b48dd0680404ca66fdcfb5f96fa"}
Sep 09 07:09:26.838556 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.838460    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-c20824ba-85b69487f4-sslvx"
Sep 09 07:09:26.838556 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.838482    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-c20824ba-85b69487f4-sslvx" event={"ID":"e2462223-6559-4a1a-a91b-94c99ba7c60e","Type":"ContainerDied","Data":"cdac063e4c7cefd30f2a441f8fb36237be1e3be5da1844f7d2a284cfd38b6297"}
Sep 09 07:09:26.839949 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.839928    2575 generic.go:356] "Generic (PLEG): container finished" podID="fce57d35-f56e-44be-814d-a3e2a55a2890" containerID="034970d70ad7fd68f8e247973c8e23175ca75d5a505eef5f307ac6c7f7fed08f" exitCode=0
Sep 09 07:09:26.840066 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.839955    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-c20824ba-75d5cc54cc-jtx47" event={"ID":"fce57d35-f56e-44be-814d-a3e2a55a2890","Type":"ContainerDied","Data":"034970d70ad7fd68f8e247973c8e23175ca75d5a505eef5f307ac6c7f7fed08f"}
Sep 09 07:09:26.840066 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.839970    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-c20824ba-75d5cc54cc-jtx47"
Sep 09 07:09:26.840066 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.839989    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-c20824ba-75d5cc54cc-jtx47" event={"ID":"fce57d35-f56e-44be-814d-a3e2a55a2890","Type":"ContainerDied","Data":"cde68404e3a152aff25ec21a84554fc83d037c1b6c3a99ea7679433ccef99b48"}
Sep 09 07:09:26.847402 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.847244    2575 scope.go:117] "RemoveContainer" containerID="03a8d9c7dbffdb6c7cadfe938836999064eac26bf2aa8d539bd23e833ade8fb6"
Sep 09 07:09:26.847733 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:09:26.847705    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03a8d9c7dbffdb6c7cadfe938836999064eac26bf2aa8d539bd23e833ade8fb6\": container with ID starting with 03a8d9c7dbffdb6c7cadfe938836999064eac26bf2aa8d539bd23e833ade8fb6 not found: ID does not exist" containerID="03a8d9c7dbffdb6c7cadfe938836999064eac26bf2aa8d539bd23e833ade8fb6"
Sep 09 07:09:26.847893 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.847732    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03a8d9c7dbffdb6c7cadfe938836999064eac26bf2aa8d539bd23e833ade8fb6"} err="failed to get container status \"03a8d9c7dbffdb6c7cadfe938836999064eac26bf2aa8d539bd23e833ade8fb6\": rpc error: code = NotFound desc = could not find container \"03a8d9c7dbffdb6c7cadfe938836999064eac26bf2aa8d539bd23e833ade8fb6\": container with ID starting with 03a8d9c7dbffdb6c7cadfe938836999064eac26bf2aa8d539bd23e833ade8fb6 not found: ID does not exist"
Sep 09 07:09:26.847893 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.847772    2575 scope.go:117] "RemoveContainer" containerID="a3fbf82e8a28e18c3b9021d23db65112f6641b48dd0680404ca66fdcfb5f96fa"
Sep 09 07:09:26.856714 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.856695    2575 scope.go:117] "RemoveContainer" containerID="a3fbf82e8a28e18c3b9021d23db65112f6641b48dd0680404ca66fdcfb5f96fa"
Sep 09 07:09:26.857008 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:09:26.856985    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3fbf82e8a28e18c3b9021d23db65112f6641b48dd0680404ca66fdcfb5f96fa\": container with ID starting with a3fbf82e8a28e18c3b9021d23db65112f6641b48dd0680404ca66fdcfb5f96fa not found: ID does not exist" containerID="a3fbf82e8a28e18c3b9021d23db65112f6641b48dd0680404ca66fdcfb5f96fa"
Sep 09 07:09:26.857079 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.857017    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3fbf82e8a28e18c3b9021d23db65112f6641b48dd0680404ca66fdcfb5f96fa"} err="failed to get container status \"a3fbf82e8a28e18c3b9021d23db65112f6641b48dd0680404ca66fdcfb5f96fa\": rpc error: code = NotFound desc = could not find container \"a3fbf82e8a28e18c3b9021d23db65112f6641b48dd0680404ca66fdcfb5f96fa\": container with ID starting with a3fbf82e8a28e18c3b9021d23db65112f6641b48dd0680404ca66fdcfb5f96fa not found: ID does not exist"
Sep 09 07:09:26.857079 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.857039    2575 scope.go:117] "RemoveContainer" containerID="034970d70ad7fd68f8e247973c8e23175ca75d5a505eef5f307ac6c7f7fed08f"
Sep 09 07:09:26.864502 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.864485    2575 scope.go:117] "RemoveContainer" containerID="034970d70ad7fd68f8e247973c8e23175ca75d5a505eef5f307ac6c7f7fed08f"
Sep 09 07:09:26.864741 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:09:26.864724    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"034970d70ad7fd68f8e247973c8e23175ca75d5a505eef5f307ac6c7f7fed08f\": container with ID starting with 034970d70ad7fd68f8e247973c8e23175ca75d5a505eef5f307ac6c7f7fed08f not found: ID does not exist" containerID="034970d70ad7fd68f8e247973c8e23175ca75d5a505eef5f307ac6c7f7fed08f"
Sep 09 07:09:26.864741 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.864761    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"034970d70ad7fd68f8e247973c8e23175ca75d5a505eef5f307ac6c7f7fed08f"} err="failed to get container status \"034970d70ad7fd68f8e247973c8e23175ca75d5a505eef5f307ac6c7f7fed08f\": rpc error: code = NotFound desc = could not find container \"034970d70ad7fd68f8e247973c8e23175ca75d5a505eef5f307ac6c7f7fed08f\": container with ID starting with 034970d70ad7fd68f8e247973c8e23175ca75d5a505eef5f307ac6c7f7fed08f not found: ID does not exist"
Sep 09 07:09:26.872194 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.872177    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c20824ba-6c4568484b-w67hn"]
Sep 09 07:09:26.877114 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.877091    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c20824ba-6c4568484b-w67hn"]
Sep 09 07:09:26.887911 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.887891    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c20824ba-75d5cc54cc-jtx47"]
Sep 09 07:09:26.894631 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.894612    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c20824ba-75d5cc54cc-jtx47"]
Sep 09 07:09:26.907061 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.907038    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c20824ba-85b69487f4-sslvx"]
Sep 09 07:09:26.913021 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:26.913003    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c20824ba-85b69487f4-sslvx"]
Sep 09 07:09:27.712317 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:27.712288    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8efddc42-69e2-4216-aced-9b82344355b4" path="/var/lib/kubelet/pods/8efddc42-69e2-4216-aced-9b82344355b4/volumes"
Sep 09 07:09:27.712738 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:27.712629    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2462223-6559-4a1a-a91b-94c99ba7c60e" path="/var/lib/kubelet/pods/e2462223-6559-4a1a-a91b-94c99ba7c60e/volumes"
Sep 09 07:09:27.712972 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:27.712958    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fce57d35-f56e-44be-814d-a3e2a55a2890" path="/var/lib/kubelet/pods/fce57d35-f56e-44be-814d-a3e2a55a2890/volumes"
Sep 09 07:09:34.227003 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:34.226959    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-ea0f1c/auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd"]
Sep 09 07:09:34.227576 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:34.227557    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8efddc42-69e2-4216-aced-9b82344355b4" containerName="maas-api"
Sep 09 07:09:34.227630 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:34.227581    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8efddc42-69e2-4216-aced-9b82344355b4" containerName="maas-api"
Sep 09 07:09:34.227630 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:34.227604    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fce57d35-f56e-44be-814d-a3e2a55a2890" containerName="payload-processing"
Sep 09 07:09:34.227630 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:34.227613    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fce57d35-f56e-44be-814d-a3e2a55a2890" containerName="payload-processing"
Sep 09 07:09:34.227725 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:34.227633    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2462223-6559-4a1a-a91b-94c99ba7c60e" containerName="payload-pre-processing"
Sep 09 07:09:34.227725 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:34.227641    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2462223-6559-4a1a-a91b-94c99ba7c60e" containerName="payload-pre-processing"
Sep 09 07:09:34.227821 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:34.227736    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="fce57d35-f56e-44be-814d-a3e2a55a2890" containerName="payload-processing"
Sep 09 07:09:34.227821 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:34.227769    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2462223-6559-4a1a-a91b-94c99ba7c60e" containerName="payload-pre-processing"
Sep 09 07:09:34.227821 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:34.227784    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8efddc42-69e2-4216-aced-9b82344355b4" containerName="maas-api"
Sep 09 07:09:34.231061 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:34.231046    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-ea0f1c/auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd"
Sep 09 07:09:34.235000 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:34.234971    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-ea0f1c\"/\"kube-root-ca.crt\""
Sep 09 07:09:34.235133 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:34.235008    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-ea0f1c\"/\"auth-test-model-ea0f1c-kserve-self-signed-certs\""
Sep 09 07:09:34.235133 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:34.234976    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-ea0f1c\"/\"default-dockercfg-lt889\""
Sep 09 07:09:34.235340 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:34.235317    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-ea0f1c\"/\"openshift-service-ca.crt\""
Sep 09 07:09:34.241617 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:34.241595    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-ea0f1c/auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd"]
Sep 09 07:09:34.324101 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:34.324065    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4461d5e5-dcc2-4456-90c7-10ff2f23ee8b-tls-certs\") pod \"auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd\" (UID: \"4461d5e5-dcc2-4456-90c7-10ff2f23ee8b\") " pod="ai-tenant-e2e-shared-a-w3-ea0f1c/auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd"
Sep 09 07:09:34.324101 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:34.324108    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4461d5e5-dcc2-4456-90c7-10ff2f23ee8b-model-cache\") pod \"auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd\" (UID: \"4461d5e5-dcc2-4456-90c7-10ff2f23ee8b\") " pod="ai-tenant-e2e-shared-a-w3-ea0f1c/auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd"
Sep 09 07:09:34.324347 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:34.324127    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swqn6\" (UniqueName: \"kubernetes.io/projected/4461d5e5-dcc2-4456-90c7-10ff2f23ee8b-kube-api-access-swqn6\") pod \"auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd\" (UID: \"4461d5e5-dcc2-4456-90c7-10ff2f23ee8b\") " pod="ai-tenant-e2e-shared-a-w3-ea0f1c/auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd"
Sep 09 07:09:34.324347 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:34.324207    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4461d5e5-dcc2-4456-90c7-10ff2f23ee8b-dshm\") pod \"auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd\" (UID: \"4461d5e5-dcc2-4456-90c7-10ff2f23ee8b\") " pod="ai-tenant-e2e-shared-a-w3-ea0f1c/auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd"
Sep 09 07:09:34.324347 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:34.324236    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4461d5e5-dcc2-4456-90c7-10ff2f23ee8b-tmp-dir\") pod \"auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd\" (UID: \"4461d5e5-dcc2-4456-90c7-10ff2f23ee8b\") " pod="ai-tenant-e2e-shared-a-w3-ea0f1c/auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd"
Sep 09 07:09:34.324347 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:34.324255    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4461d5e5-dcc2-4456-90c7-10ff2f23ee8b-home\") pod \"auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd\" (UID: \"4461d5e5-dcc2-4456-90c7-10ff2f23ee8b\") " pod="ai-tenant-e2e-shared-a-w3-ea0f1c/auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd"
Sep 09 07:09:34.425443 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:34.425410    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4461d5e5-dcc2-4456-90c7-10ff2f23ee8b-tls-certs\") pod \"auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd\" (UID: \"4461d5e5-dcc2-4456-90c7-10ff2f23ee8b\") " pod="ai-tenant-e2e-shared-a-w3-ea0f1c/auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd"
Sep 09 07:09:34.425601 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:34.425456    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4461d5e5-dcc2-4456-90c7-10ff2f23ee8b-model-cache\") pod \"auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd\" (UID: \"4461d5e5-dcc2-4456-90c7-10ff2f23ee8b\") " pod="ai-tenant-e2e-shared-a-w3-ea0f1c/auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd"
Sep 09 07:09:34.425601 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:34.425476    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swqn6\" (UniqueName: \"kubernetes.io/projected/4461d5e5-dcc2-4456-90c7-10ff2f23ee8b-kube-api-access-swqn6\") pod \"auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd\" (UID: \"4461d5e5-dcc2-4456-90c7-10ff2f23ee8b\") " pod="ai-tenant-e2e-shared-a-w3-ea0f1c/auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd"
Sep 09 07:09:34.425601 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:34.425512    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4461d5e5-dcc2-4456-90c7-10ff2f23ee8b-dshm\") pod \"auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd\" (UID: \"4461d5e5-dcc2-4456-90c7-10ff2f23ee8b\") " pod="ai-tenant-e2e-shared-a-w3-ea0f1c/auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd"
Sep 09 07:09:34.425601 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:34.425539    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4461d5e5-dcc2-4456-90c7-10ff2f23ee8b-tmp-dir\") pod \"auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd\" (UID: \"4461d5e5-dcc2-4456-90c7-10ff2f23ee8b\") " pod="ai-tenant-e2e-shared-a-w3-ea0f1c/auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd"
Sep 09 07:09:34.425601 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:34.425556    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4461d5e5-dcc2-4456-90c7-10ff2f23ee8b-home\") pod \"auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd\" (UID: \"4461d5e5-dcc2-4456-90c7-10ff2f23ee8b\") " pod="ai-tenant-e2e-shared-a-w3-ea0f1c/auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd"
Sep 09 07:09:34.425985 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:34.425961    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4461d5e5-dcc2-4456-90c7-10ff2f23ee8b-model-cache\") pod \"auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd\" (UID: \"4461d5e5-dcc2-4456-90c7-10ff2f23ee8b\") " pod="ai-tenant-e2e-shared-a-w3-ea0f1c/auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd"
Sep 09 07:09:34.426059 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:34.426001    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4461d5e5-dcc2-4456-90c7-10ff2f23ee8b-tmp-dir\") pod \"auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd\" (UID: \"4461d5e5-dcc2-4456-90c7-10ff2f23ee8b\") " pod="ai-tenant-e2e-shared-a-w3-ea0f1c/auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd"
Sep 09 07:09:34.426059 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:34.426036    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4461d5e5-dcc2-4456-90c7-10ff2f23ee8b-home\") pod \"auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd\" (UID: \"4461d5e5-dcc2-4456-90c7-10ff2f23ee8b\") " pod="ai-tenant-e2e-shared-a-w3-ea0f1c/auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd"
Sep 09 07:09:34.428072 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:34.428046    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4461d5e5-dcc2-4456-90c7-10ff2f23ee8b-dshm\") pod \"auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd\" (UID: \"4461d5e5-dcc2-4456-90c7-10ff2f23ee8b\") " pod="ai-tenant-e2e-shared-a-w3-ea0f1c/auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd"
Sep 09 07:09:34.428209 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:34.428192    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4461d5e5-dcc2-4456-90c7-10ff2f23ee8b-tls-certs\") pod \"auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd\" (UID: \"4461d5e5-dcc2-4456-90c7-10ff2f23ee8b\") " pod="ai-tenant-e2e-shared-a-w3-ea0f1c/auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd"
Sep 09 07:09:34.434150 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:34.434132    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swqn6\" (UniqueName: \"kubernetes.io/projected/4461d5e5-dcc2-4456-90c7-10ff2f23ee8b-kube-api-access-swqn6\") pod \"auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd\" (UID: \"4461d5e5-dcc2-4456-90c7-10ff2f23ee8b\") " pod="ai-tenant-e2e-shared-a-w3-ea0f1c/auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd"
Sep 09 07:09:34.543629 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:34.543527    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-ea0f1c/auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd"
Sep 09 07:09:34.816504 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:34.816416    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-ea0f1c/auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd"]
Sep 09 07:09:34.821250 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:09:34.821223    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4461d5e5_dcc2_4456_90c7_10ff2f23ee8b.slice/crio-c8e13bdbb5af388f66c5bb72c29ff796aa8e34a7702b03367a9bb32267b9b8ec WatchSource:0}: Error finding container c8e13bdbb5af388f66c5bb72c29ff796aa8e34a7702b03367a9bb32267b9b8ec: Status 404 returned error can't find the container with id c8e13bdbb5af388f66c5bb72c29ff796aa8e34a7702b03367a9bb32267b9b8ec
Sep 09 07:09:34.883248 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:34.883221    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-ea0f1c/auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd" event={"ID":"4461d5e5-dcc2-4456-90c7-10ff2f23ee8b","Type":"ContainerStarted","Data":"c8e13bdbb5af388f66c5bb72c29ff796aa8e34a7702b03367a9bb32267b9b8ec"}
Sep 09 07:09:35.889429 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:35.889388    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-ea0f1c/auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd" event={"ID":"4461d5e5-dcc2-4456-90c7-10ff2f23ee8b","Type":"ContainerStarted","Data":"81a6f932696c6e46600474a78b098afaa9ac72771c611134ab3f2740873f2370"}
Sep 09 07:09:35.908878 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:35.908784    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-ea0f1c/auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd" podStartSLOduration=1.908765889 podStartE2EDuration="1.908765889s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 07:09:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 07:09:35.906946477 +0000 UTC m=+1110.698755817" watchObservedRunningTime="2026-09-09 07:09:35.908765889 +0000 UTC m=+1110.700575223"
Sep 09 07:09:44.544348 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:44.544294    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-ea0f1c/auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd"
Sep 09 07:09:44.544348 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:44.544364    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-ea0f1c/auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd"
Sep 09 07:09:44.557235 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:44.557210    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-ea0f1c/auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd"
Sep 09 07:09:44.953876 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:44.953850    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-ea0f1c/auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd"
Sep 09 07:09:51.828437 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:51.828407    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-1128ac-75f8dd598f-s7zgg"]
Sep 09 07:09:51.832819 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:51.832799    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-1128ac-75f8dd598f-s7zgg"
Sep 09 07:09:51.837913 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:51.837885    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-1128ac\""
Sep 09 07:09:51.845693 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:51.845670    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-1128ac-75f8dd598f-s7zgg"]
Sep 09 07:09:51.876661 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:51.876632    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1128ac-cd99d78f4-hj2fg"]
Sep 09 07:09:51.880235 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:51.880218    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1128ac-cd99d78f4-hj2fg"
Sep 09 07:09:51.883303 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:51.883284    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-1128ac-dockercfg-qzs9h\""
Sep 09 07:09:51.898006 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:51.897982    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1128ac-cd99d78f4-hj2fg"]
Sep 09 07:09:51.981184 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:51.981151    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2btj9\" (UniqueName: \"kubernetes.io/projected/64a12175-3c1c-4013-9a66-07757d81c3f0-kube-api-access-2btj9\") pod \"payload-processing-e2e-shared-a-w2-1128ac-75f8dd598f-s7zgg\" (UID: \"64a12175-3c1c-4013-9a66-07757d81c3f0\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-1128ac-75f8dd598f-s7zgg"
Sep 09 07:09:51.981341 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:51.981192    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64a12175-3c1c-4013-9a66-07757d81c3f0-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-1128ac-75f8dd598f-s7zgg\" (UID: \"64a12175-3c1c-4013-9a66-07757d81c3f0\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-1128ac-75f8dd598f-s7zgg"
Sep 09 07:09:51.981341 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:51.981266    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw846\" (UniqueName: \"kubernetes.io/projected/f5ded2f4-2cf7-46f0-8e6a-58c5dceaae8c-kube-api-access-mw846\") pod \"payload-pre-processing-e2e-shared-a-w2-1128ac-cd99d78f4-hj2fg\" (UID: \"f5ded2f4-2cf7-46f0-8e6a-58c5dceaae8c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1128ac-cd99d78f4-hj2fg"
Sep 09 07:09:51.981341 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:51.981296    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5ded2f4-2cf7-46f0-8e6a-58c5dceaae8c-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-1128ac-cd99d78f4-hj2fg\" (UID: \"f5ded2f4-2cf7-46f0-8e6a-58c5dceaae8c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1128ac-cd99d78f4-hj2fg"
Sep 09 07:09:52.082242 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:52.082161    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2btj9\" (UniqueName: \"kubernetes.io/projected/64a12175-3c1c-4013-9a66-07757d81c3f0-kube-api-access-2btj9\") pod \"payload-processing-e2e-shared-a-w2-1128ac-75f8dd598f-s7zgg\" (UID: \"64a12175-3c1c-4013-9a66-07757d81c3f0\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-1128ac-75f8dd598f-s7zgg"
Sep 09 07:09:52.082242 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:52.082205    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64a12175-3c1c-4013-9a66-07757d81c3f0-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-1128ac-75f8dd598f-s7zgg\" (UID: \"64a12175-3c1c-4013-9a66-07757d81c3f0\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-1128ac-75f8dd598f-s7zgg"
Sep 09 07:09:52.082242 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:52.082225    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw846\" (UniqueName: \"kubernetes.io/projected/f5ded2f4-2cf7-46f0-8e6a-58c5dceaae8c-kube-api-access-mw846\") pod \"payload-pre-processing-e2e-shared-a-w2-1128ac-cd99d78f4-hj2fg\" (UID: \"f5ded2f4-2cf7-46f0-8e6a-58c5dceaae8c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1128ac-cd99d78f4-hj2fg"
Sep 09 07:09:52.082505 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:52.082334    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5ded2f4-2cf7-46f0-8e6a-58c5dceaae8c-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-1128ac-cd99d78f4-hj2fg\" (UID: \"f5ded2f4-2cf7-46f0-8e6a-58c5dceaae8c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1128ac-cd99d78f4-hj2fg"
Sep 09 07:09:52.082894 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:52.082873    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64a12175-3c1c-4013-9a66-07757d81c3f0-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-1128ac-75f8dd598f-s7zgg\" (UID: \"64a12175-3c1c-4013-9a66-07757d81c3f0\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-1128ac-75f8dd598f-s7zgg"
Sep 09 07:09:52.083099 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:52.083081    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5ded2f4-2cf7-46f0-8e6a-58c5dceaae8c-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-1128ac-cd99d78f4-hj2fg\" (UID: \"f5ded2f4-2cf7-46f0-8e6a-58c5dceaae8c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1128ac-cd99d78f4-hj2fg"
Sep 09 07:09:52.097191 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:52.097161    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw846\" (UniqueName: \"kubernetes.io/projected/f5ded2f4-2cf7-46f0-8e6a-58c5dceaae8c-kube-api-access-mw846\") pod \"payload-pre-processing-e2e-shared-a-w2-1128ac-cd99d78f4-hj2fg\" (UID: \"f5ded2f4-2cf7-46f0-8e6a-58c5dceaae8c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1128ac-cd99d78f4-hj2fg"
Sep 09 07:09:52.099068 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:52.099048    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2btj9\" (UniqueName: \"kubernetes.io/projected/64a12175-3c1c-4013-9a66-07757d81c3f0-kube-api-access-2btj9\") pod \"payload-processing-e2e-shared-a-w2-1128ac-75f8dd598f-s7zgg\" (UID: \"64a12175-3c1c-4013-9a66-07757d81c3f0\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-1128ac-75f8dd598f-s7zgg"
Sep 09 07:09:52.143432 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:52.143405    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-1128ac-75f8dd598f-s7zgg"
Sep 09 07:09:52.189872 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:52.189830    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1128ac-cd99d78f4-hj2fg"
Sep 09 07:09:52.415796 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:52.415773    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-1128ac-75f8dd598f-s7zgg"]
Sep 09 07:09:52.417647 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:09:52.417626    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64a12175_3c1c_4013_9a66_07757d81c3f0.slice/crio-a2740b34936635745df3a20fa58251eecc14e375ec2443545eedc839433bccf0 WatchSource:0}: Error finding container a2740b34936635745df3a20fa58251eecc14e375ec2443545eedc839433bccf0: Status 404 returned error can't find the container with id a2740b34936635745df3a20fa58251eecc14e375ec2443545eedc839433bccf0
Sep 09 07:09:52.479648 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:52.479624    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1128ac-cd99d78f4-hj2fg"]
Sep 09 07:09:52.480965 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:09:52.480943    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5ded2f4_2cf7_46f0_8e6a_58c5dceaae8c.slice/crio-04422fd2b798928fffec827f8997f846b6e9a5aafe384a456f661d2b2234e7d1 WatchSource:0}: Error finding container 04422fd2b798928fffec827f8997f846b6e9a5aafe384a456f661d2b2234e7d1: Status 404 returned error can't find the container with id 04422fd2b798928fffec827f8997f846b6e9a5aafe384a456f661d2b2234e7d1
Sep 09 07:09:52.981215 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:52.981173    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-1128ac-75f8dd598f-s7zgg" event={"ID":"64a12175-3c1c-4013-9a66-07757d81c3f0","Type":"ContainerStarted","Data":"3fe790230656c1f3da1a44307f3a525668a6ea64b3c2735b23fe80d480b6f2a0"}
Sep 09 07:09:52.981654 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:52.981243    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-1128ac-75f8dd598f-s7zgg" event={"ID":"64a12175-3c1c-4013-9a66-07757d81c3f0","Type":"ContainerStarted","Data":"a2740b34936635745df3a20fa58251eecc14e375ec2443545eedc839433bccf0"}
Sep 09 07:09:52.981654 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:52.981274    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-1128ac-75f8dd598f-s7zgg"
Sep 09 07:09:52.982712 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:52.982689    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1128ac-cd99d78f4-hj2fg" event={"ID":"f5ded2f4-2cf7-46f0-8e6a-58c5dceaae8c","Type":"ContainerStarted","Data":"27ee54a7302d35950698c93a98f42c8e07de9fbab140e0748ba8fac4d46093d6"}
Sep 09 07:09:52.982862 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:52.982729    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1128ac-cd99d78f4-hj2fg" event={"ID":"f5ded2f4-2cf7-46f0-8e6a-58c5dceaae8c","Type":"ContainerStarted","Data":"04422fd2b798928fffec827f8997f846b6e9a5aafe384a456f661d2b2234e7d1"}
Sep 09 07:09:52.982862 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:52.982790    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1128ac-cd99d78f4-hj2fg"
Sep 09 07:09:53.001009 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:53.000963    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-1128ac-75f8dd598f-s7zgg" podStartSLOduration=2.000944931 podStartE2EDuration="2.000944931s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 07:09:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 07:09:52.999513342 +0000 UTC m=+1127.791322693" watchObservedRunningTime="2026-09-09 07:09:53.000944931 +0000 UTC m=+1127.792754286"
Sep 09 07:09:53.025002 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:09:53.024962    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1128ac-cd99d78f4-hj2fg" podStartSLOduration=2.024949252 podStartE2EDuration="2.024949252s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 07:09:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 07:09:53.023639805 +0000 UTC m=+1127.815449145" watchObservedRunningTime="2026-09-09 07:09:53.024949252 +0000 UTC m=+1127.816758591"
Sep 09 07:10:03.989643 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:10:03.989615    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-1128ac-75f8dd598f-s7zgg"
Sep 09 07:10:03.990096 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:10:03.989678    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1128ac-cd99d78f4-hj2fg"
Sep 09 07:10:21.004866 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:10:21.004786    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-1d8843-754d4f4595-7qt5p"]
Sep 09 07:10:21.009854 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:10:21.009832    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-1d8843-754d4f4595-7qt5p"
Sep 09 07:10:21.012725 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:10:21.012705    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-1d8843-dockercfg-jbbq2\""
Sep 09 07:10:21.012984 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:10:21.012705    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-1d8843\""
Sep 09 07:10:21.022645 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:10:21.022622    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-1d8843-754d4f4595-7qt5p"]
Sep 09 07:10:21.038575 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:10:21.038555    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7088b1dc-cdb0-4bb8-afc0-11162e65217a-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-1d8843-754d4f4595-7qt5p\" (UID: \"7088b1dc-cdb0-4bb8-afc0-11162e65217a\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-1d8843-754d4f4595-7qt5p"
Sep 09 07:10:21.038691 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:10:21.038602    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkgv6\" (UniqueName: \"kubernetes.io/projected/7088b1dc-cdb0-4bb8-afc0-11162e65217a-kube-api-access-bkgv6\") pod \"payload-processing-e2e-shared-b-w2-1d8843-754d4f4595-7qt5p\" (UID: \"7088b1dc-cdb0-4bb8-afc0-11162e65217a\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-1d8843-754d4f4595-7qt5p"
Sep 09 07:10:21.139635 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:10:21.139606    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkgv6\" (UniqueName: \"kubernetes.io/projected/7088b1dc-cdb0-4bb8-afc0-11162e65217a-kube-api-access-bkgv6\") pod \"payload-processing-e2e-shared-b-w2-1d8843-754d4f4595-7qt5p\" (UID: \"7088b1dc-cdb0-4bb8-afc0-11162e65217a\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-1d8843-754d4f4595-7qt5p"
Sep 09 07:10:21.139811 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:10:21.139681    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7088b1dc-cdb0-4bb8-afc0-11162e65217a-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-1d8843-754d4f4595-7qt5p\" (UID: \"7088b1dc-cdb0-4bb8-afc0-11162e65217a\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-1d8843-754d4f4595-7qt5p"
Sep 09 07:10:21.140299 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:10:21.140280    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7088b1dc-cdb0-4bb8-afc0-11162e65217a-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-1d8843-754d4f4595-7qt5p\" (UID: \"7088b1dc-cdb0-4bb8-afc0-11162e65217a\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-1d8843-754d4f4595-7qt5p"
Sep 09 07:10:21.148321 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:10:21.148291    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkgv6\" (UniqueName: \"kubernetes.io/projected/7088b1dc-cdb0-4bb8-afc0-11162e65217a-kube-api-access-bkgv6\") pod \"payload-processing-e2e-shared-b-w2-1d8843-754d4f4595-7qt5p\" (UID: \"7088b1dc-cdb0-4bb8-afc0-11162e65217a\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-1d8843-754d4f4595-7qt5p"
Sep 09 07:10:21.321810 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:10:21.321724    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-1d8843-754d4f4595-7qt5p"
Sep 09 07:10:21.592326 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:10:21.592303    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-1d8843-754d4f4595-7qt5p"]
Sep 09 07:10:21.594214 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:10:21.594190    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7088b1dc_cdb0_4bb8_afc0_11162e65217a.slice/crio-9996915383b8e53fa491ba2113d7a1362a03f39ec0e73596aca0c13c9a622885 WatchSource:0}: Error finding container 9996915383b8e53fa491ba2113d7a1362a03f39ec0e73596aca0c13c9a622885: Status 404 returned error can't find the container with id 9996915383b8e53fa491ba2113d7a1362a03f39ec0e73596aca0c13c9a622885
Sep 09 07:10:22.136735 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:10:22.136702    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-1d8843-754d4f4595-7qt5p" event={"ID":"7088b1dc-cdb0-4bb8-afc0-11162e65217a","Type":"ContainerStarted","Data":"58c7deb2f627cf99c04b372625d2f2f3706c4aa97660c509c1759dd6a93b0d28"}
Sep 09 07:10:22.137138 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:10:22.136805    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-1d8843-754d4f4595-7qt5p"
Sep 09 07:10:22.137138 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:10:22.136823    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-1d8843-754d4f4595-7qt5p" event={"ID":"7088b1dc-cdb0-4bb8-afc0-11162e65217a","Type":"ContainerStarted","Data":"9996915383b8e53fa491ba2113d7a1362a03f39ec0e73596aca0c13c9a622885"}
Sep 09 07:10:22.157270 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:10:22.157214    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-1d8843-754d4f4595-7qt5p" podStartSLOduration=2.157200454 podStartE2EDuration="2.157200454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 07:10:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 07:10:22.154473446 +0000 UTC m=+1156.946282788" watchObservedRunningTime="2026-09-09 07:10:22.157200454 +0000 UTC m=+1156.949009792"
Sep 09 07:10:33.143700 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:10:33.143630    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-1d8843-754d4f4595-7qt5p"
Sep 09 07:11:05.805045 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:11:05.805013    2575 scope.go:117] "RemoveContainer" containerID="1617ce815398b784d2e34e186ed4586c182075fb7c0f950d2c21e1d870d1ee55"
Sep 09 07:12:00.880322 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:00.880242    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cc2c009-hfx55"]
Sep 09 07:12:00.884017 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:00.884000    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cc2c009-hfx55"
Sep 09 07:12:00.886859 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:00.886834    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bbglc\""
Sep 09 07:12:00.886859 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:00.886868    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 07:12:00.891983 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:00.891959    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cc2c009-hfx55"]
Sep 09 07:12:01.012375 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:01.012343    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cbe146a-e5ce-4747-bae5-d2a8e50bae27-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-0cc2c009-hfx55\" (UID: \"4cbe146a-e5ce-4747-bae5-d2a8e50bae27\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cc2c009-hfx55"
Sep 09 07:12:01.113793 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:01.113765    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cbe146a-e5ce-4747-bae5-d2a8e50bae27-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-0cc2c009-hfx55\" (UID: \"4cbe146a-e5ce-4747-bae5-d2a8e50bae27\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cc2c009-hfx55"
Sep 09 07:12:01.114520 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:01.114496    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cbe146a-e5ce-4747-bae5-d2a8e50bae27-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-0cc2c009-hfx55\" (UID: \"4cbe146a-e5ce-4747-bae5-d2a8e50bae27\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cc2c009-hfx55"
Sep 09 07:12:01.195970 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:01.195901    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cc2c009-hfx55"
Sep 09 07:12:01.472050 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:01.472019    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cc2c009-hfx55"]
Sep 09 07:12:01.472436 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:12:01.472408    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cbe146a_e5ce_4747_bae5_d2a8e50bae27.slice/crio-9ddd2e0c201f67b0b15f8dd3c2367170db4bd0aa51710220ae3178b4fe0dd482 WatchSource:0}: Error finding container 9ddd2e0c201f67b0b15f8dd3c2367170db4bd0aa51710220ae3178b4fe0dd482: Status 404 returned error can't find the container with id 9ddd2e0c201f67b0b15f8dd3c2367170db4bd0aa51710220ae3178b4fe0dd482
Sep 09 07:12:01.634836 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:01.634809    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cc2c009-hfx55" event={"ID":"4cbe146a-e5ce-4747-bae5-d2a8e50bae27","Type":"ContainerStarted","Data":"9ddd2e0c201f67b0b15f8dd3c2367170db4bd0aa51710220ae3178b4fe0dd482"}
Sep 09 07:12:02.641327 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:02.641295    2575 generic.go:356] "Generic (PLEG): container finished" podID="4cbe146a-e5ce-4747-bae5-d2a8e50bae27" containerID="ca9b4faba5e36093d87ba74a395444a5ac3417acc3019616eb86a67d56d88355" exitCode=0
Sep 09 07:12:02.641793 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:02.641377    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cc2c009-hfx55" event={"ID":"4cbe146a-e5ce-4747-bae5-d2a8e50bae27","Type":"ContainerDied","Data":"ca9b4faba5e36093d87ba74a395444a5ac3417acc3019616eb86a67d56d88355"}
Sep 09 07:12:03.775702 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:03.775681    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cc2c009-hfx55"
Sep 09 07:12:03.835817 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:03.835788    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cbe146a-e5ce-4747-bae5-d2a8e50bae27-maas-api-service-ca\") pod \"4cbe146a-e5ce-4747-bae5-d2a8e50bae27\" (UID: \"4cbe146a-e5ce-4747-bae5-d2a8e50bae27\") "
Sep 09 07:12:03.836102 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:03.836082    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4cbe146a-e5ce-4747-bae5-d2a8e50bae27-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4cbe146a-e5ce-4747-bae5-d2a8e50bae27" (UID: "4cbe146a-e5ce-4747-bae5-d2a8e50bae27"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 07:12:03.936915 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:03.936844    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cbe146a-e5ce-4747-bae5-d2a8e50bae27-maas-api-service-ca\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:12:04.652874 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:04.652842    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cc2c009-hfx55"
Sep 09 07:12:04.652874 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:04.652845    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cc2c009-hfx55" event={"ID":"4cbe146a-e5ce-4747-bae5-d2a8e50bae27","Type":"ContainerDied","Data":"9ddd2e0c201f67b0b15f8dd3c2367170db4bd0aa51710220ae3178b4fe0dd482"}
Sep 09 07:12:04.653080 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:04.652889    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9ddd2e0c201f67b0b15f8dd3c2367170db4bd0aa51710220ae3178b4fe0dd482"
Sep 09 07:12:15.896230 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:15.896200    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7946-859200"]
Sep 09 07:12:15.896683 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:15.896620    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cbe146a-e5ce-4747-bae5-d2a8e50bae27" containerName="revoke-keys"
Sep 09 07:12:15.896683 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:15.896633    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cbe146a-e5ce-4747-bae5-d2a8e50bae27" containerName="revoke-keys"
Sep 09 07:12:15.896795 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:15.896703    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cbe146a-e5ce-4747-bae5-d2a8e50bae27" containerName="revoke-keys"
Sep 09 07:12:15.899836 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:15.899822    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7946-859200"
Sep 09 07:12:15.902355 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:15.902336    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-dw24h\""
Sep 09 07:12:15.905895 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:15.905870    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7946-859200"]
Sep 09 07:12:16.042244 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:16.042211    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7r9l\" (UniqueName: \"kubernetes.io/projected/655b2c88-2680-4160-9e14-e17cb13b5a6d-kube-api-access-h7r9l\") pod \"mt-curl-7946-859200\" (UID: \"655b2c88-2680-4160-9e14-e17cb13b5a6d\") " pod="opendatahub/mt-curl-7946-859200"
Sep 09 07:12:16.143248 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:16.143217    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7r9l\" (UniqueName: \"kubernetes.io/projected/655b2c88-2680-4160-9e14-e17cb13b5a6d-kube-api-access-h7r9l\") pod \"mt-curl-7946-859200\" (UID: \"655b2c88-2680-4160-9e14-e17cb13b5a6d\") " pod="opendatahub/mt-curl-7946-859200"
Sep 09 07:12:16.152140 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:16.152076    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7r9l\" (UniqueName: \"kubernetes.io/projected/655b2c88-2680-4160-9e14-e17cb13b5a6d-kube-api-access-h7r9l\") pod \"mt-curl-7946-859200\" (UID: \"655b2c88-2680-4160-9e14-e17cb13b5a6d\") " pod="opendatahub/mt-curl-7946-859200"
Sep 09 07:12:16.211501 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:16.211475    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7946-859200"
Sep 09 07:12:16.482646 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:16.482622    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7946-859200"]
Sep 09 07:12:16.484992 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:12:16.484962    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod655b2c88_2680_4160_9e14_e17cb13b5a6d.slice/crio-ed90eee0a9235460ab3b3241878e9ca9a402c7365350727035d73ea1da74c49f WatchSource:0}: Error finding container ed90eee0a9235460ab3b3241878e9ca9a402c7365350727035d73ea1da74c49f: Status 404 returned error can't find the container with id ed90eee0a9235460ab3b3241878e9ca9a402c7365350727035d73ea1da74c49f
Sep 09 07:12:16.638945 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:16.638909    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cc2c009-hfx55"]
Sep 09 07:12:16.645218 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:16.645190    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cc2c009-hfx55"]
Sep 09 07:12:16.716227 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:16.716194    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7946-859200" event={"ID":"655b2c88-2680-4160-9e14-e17cb13b5a6d","Type":"ContainerStarted","Data":"ed90eee0a9235460ab3b3241878e9ca9a402c7365350727035d73ea1da74c49f"}
Sep 09 07:12:17.712768 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:17.712711    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4cbe146a-e5ce-4747-bae5-d2a8e50bae27" path="/var/lib/kubelet/pods/4cbe146a-e5ce-4747-bae5-d2a8e50bae27/volumes"
Sep 09 07:12:17.722413 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:17.722377    2575 generic.go:356] "Generic (PLEG): container finished" podID="655b2c88-2680-4160-9e14-e17cb13b5a6d" containerID="e60ae1abeec13f76c899630fbc25b020511d0092cfa21c4e30d6826ef085fbc2" exitCode=0
Sep 09 07:12:17.722571 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:17.722418    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7946-859200" event={"ID":"655b2c88-2680-4160-9e14-e17cb13b5a6d","Type":"ContainerDied","Data":"e60ae1abeec13f76c899630fbc25b020511d0092cfa21c4e30d6826ef085fbc2"}
Sep 09 07:12:18.859709 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:18.859688    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7946-859200"
Sep 09 07:12:18.895795 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:18.895733    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7946-859200_655b2c88-2680-4160-9e14-e17cb13b5a6d/mt-curl-7946-859200/0.log"
Sep 09 07:12:18.918721 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:18.918696    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7946-859200"]
Sep 09 07:12:18.923002 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:18.922978    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7946-859200"]
Sep 09 07:12:18.970288 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:18.970267    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7r9l\" (UniqueName: \"kubernetes.io/projected/655b2c88-2680-4160-9e14-e17cb13b5a6d-kube-api-access-h7r9l\") pod \"655b2c88-2680-4160-9e14-e17cb13b5a6d\" (UID: \"655b2c88-2680-4160-9e14-e17cb13b5a6d\") "
Sep 09 07:12:18.972434 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:18.972405    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/655b2c88-2680-4160-9e14-e17cb13b5a6d-kube-api-access-h7r9l" (OuterVolumeSpecName: "kube-api-access-h7r9l") pod "655b2c88-2680-4160-9e14-e17cb13b5a6d" (UID: "655b2c88-2680-4160-9e14-e17cb13b5a6d"). InnerVolumeSpecName "kube-api-access-h7r9l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 07:12:19.071260 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:19.071227    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7r9l\" (UniqueName: \"kubernetes.io/projected/655b2c88-2680-4160-9e14-e17cb13b5a6d-kube-api-access-h7r9l\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:12:19.712576 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:19.712546    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="655b2c88-2680-4160-9e14-e17cb13b5a6d" path="/var/lib/kubelet/pods/655b2c88-2680-4160-9e14-e17cb13b5a6d/volumes"
Sep 09 07:12:19.734016 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:19.733994    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7946-859200"
Sep 09 07:12:19.734016 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:19.734011    2575 scope.go:117] "RemoveContainer" containerID="e60ae1abeec13f76c899630fbc25b020511d0092cfa21c4e30d6826ef085fbc2"
Sep 09 07:12:20.376320 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:20.376287    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-ea0f1c/auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd"]
Sep 09 07:12:35.397618 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:35.397560    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-ea0f1c/auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd" podUID="4461d5e5-dcc2-4456-90c7-10ff2f23ee8b" containerName="main" containerID="cri-o://81a6f932696c6e46600474a78b098afaa9ac72771c611134ab3f2740873f2370" gracePeriod=45
Sep 09 07:12:35.656327 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:35.656273    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-ea0f1c/auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd"
Sep 09 07:12:35.813521 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:35.813481    2575 generic.go:356] "Generic (PLEG): container finished" podID="4461d5e5-dcc2-4456-90c7-10ff2f23ee8b" containerID="81a6f932696c6e46600474a78b098afaa9ac72771c611134ab3f2740873f2370" exitCode=0
Sep 09 07:12:35.813521 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:35.813523    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-ea0f1c/auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd"
Sep 09 07:12:35.813783 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:35.813526    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-ea0f1c/auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd" event={"ID":"4461d5e5-dcc2-4456-90c7-10ff2f23ee8b","Type":"ContainerDied","Data":"81a6f932696c6e46600474a78b098afaa9ac72771c611134ab3f2740873f2370"}
Sep 09 07:12:35.813783 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:35.813580    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-ea0f1c/auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd" event={"ID":"4461d5e5-dcc2-4456-90c7-10ff2f23ee8b","Type":"ContainerDied","Data":"c8e13bdbb5af388f66c5bb72c29ff796aa8e34a7702b03367a9bb32267b9b8ec"}
Sep 09 07:12:35.813783 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:35.813605    2575 scope.go:117] "RemoveContainer" containerID="81a6f932696c6e46600474a78b098afaa9ac72771c611134ab3f2740873f2370"
Sep 09 07:12:35.821181 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:35.821158    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swqn6\" (UniqueName: \"kubernetes.io/projected/4461d5e5-dcc2-4456-90c7-10ff2f23ee8b-kube-api-access-swqn6\") pod \"4461d5e5-dcc2-4456-90c7-10ff2f23ee8b\" (UID: \"4461d5e5-dcc2-4456-90c7-10ff2f23ee8b\") "
Sep 09 07:12:35.821292 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:35.821205    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4461d5e5-dcc2-4456-90c7-10ff2f23ee8b-dshm\") pod \"4461d5e5-dcc2-4456-90c7-10ff2f23ee8b\" (UID: \"4461d5e5-dcc2-4456-90c7-10ff2f23ee8b\") "
Sep 09 07:12:35.821292 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:35.821229    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4461d5e5-dcc2-4456-90c7-10ff2f23ee8b-home\") pod \"4461d5e5-dcc2-4456-90c7-10ff2f23ee8b\" (UID: \"4461d5e5-dcc2-4456-90c7-10ff2f23ee8b\") "
Sep 09 07:12:35.821437 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:35.821352    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4461d5e5-dcc2-4456-90c7-10ff2f23ee8b-tls-certs\") pod \"4461d5e5-dcc2-4456-90c7-10ff2f23ee8b\" (UID: \"4461d5e5-dcc2-4456-90c7-10ff2f23ee8b\") "
Sep 09 07:12:35.821437 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:35.821421    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4461d5e5-dcc2-4456-90c7-10ff2f23ee8b-model-cache\") pod \"4461d5e5-dcc2-4456-90c7-10ff2f23ee8b\" (UID: \"4461d5e5-dcc2-4456-90c7-10ff2f23ee8b\") "
Sep 09 07:12:35.821544 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:35.821455    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4461d5e5-dcc2-4456-90c7-10ff2f23ee8b-tmp-dir\") pod \"4461d5e5-dcc2-4456-90c7-10ff2f23ee8b\" (UID: \"4461d5e5-dcc2-4456-90c7-10ff2f23ee8b\") "
Sep 09 07:12:35.821614 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:35.821585    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4461d5e5-dcc2-4456-90c7-10ff2f23ee8b-home" (OuterVolumeSpecName: "home") pod "4461d5e5-dcc2-4456-90c7-10ff2f23ee8b" (UID: "4461d5e5-dcc2-4456-90c7-10ff2f23ee8b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 07:12:35.821851 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:35.821808    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4461d5e5-dcc2-4456-90c7-10ff2f23ee8b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4461d5e5-dcc2-4456-90c7-10ff2f23ee8b" (UID: "4461d5e5-dcc2-4456-90c7-10ff2f23ee8b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 07:12:35.822000 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:35.821825    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4461d5e5-dcc2-4456-90c7-10ff2f23ee8b-model-cache" (OuterVolumeSpecName: "model-cache") pod "4461d5e5-dcc2-4456-90c7-10ff2f23ee8b" (UID: "4461d5e5-dcc2-4456-90c7-10ff2f23ee8b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 07:12:35.822091 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:35.821849    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4461d5e5-dcc2-4456-90c7-10ff2f23ee8b-home\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:12:35.822994 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:35.822971    2575 scope.go:117] "RemoveContainer" containerID="81a6f932696c6e46600474a78b098afaa9ac72771c611134ab3f2740873f2370"
Sep 09 07:12:35.823346 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:12:35.823321    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81a6f932696c6e46600474a78b098afaa9ac72771c611134ab3f2740873f2370\": container with ID starting with 81a6f932696c6e46600474a78b098afaa9ac72771c611134ab3f2740873f2370 not found: ID does not exist" containerID="81a6f932696c6e46600474a78b098afaa9ac72771c611134ab3f2740873f2370"
Sep 09 07:12:35.823431 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:35.823357    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81a6f932696c6e46600474a78b098afaa9ac72771c611134ab3f2740873f2370"} err="failed to get container status \"81a6f932696c6e46600474a78b098afaa9ac72771c611134ab3f2740873f2370\": rpc error: code = NotFound desc = could not find container \"81a6f932696c6e46600474a78b098afaa9ac72771c611134ab3f2740873f2370\": container with ID starting with 81a6f932696c6e46600474a78b098afaa9ac72771c611134ab3f2740873f2370 not found: ID does not exist"
Sep 09 07:12:35.823802 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:35.823776    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4461d5e5-dcc2-4456-90c7-10ff2f23ee8b-kube-api-access-swqn6" (OuterVolumeSpecName: "kube-api-access-swqn6") pod "4461d5e5-dcc2-4456-90c7-10ff2f23ee8b" (UID: "4461d5e5-dcc2-4456-90c7-10ff2f23ee8b"). InnerVolumeSpecName "kube-api-access-swqn6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 07:12:35.823908 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:35.823889    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4461d5e5-dcc2-4456-90c7-10ff2f23ee8b-dshm" (OuterVolumeSpecName: "dshm") pod "4461d5e5-dcc2-4456-90c7-10ff2f23ee8b" (UID: "4461d5e5-dcc2-4456-90c7-10ff2f23ee8b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 07:12:35.824035 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:35.824012    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4461d5e5-dcc2-4456-90c7-10ff2f23ee8b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4461d5e5-dcc2-4456-90c7-10ff2f23ee8b" (UID: "4461d5e5-dcc2-4456-90c7-10ff2f23ee8b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 07:12:35.922983 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:35.922932    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4461d5e5-dcc2-4456-90c7-10ff2f23ee8b-model-cache\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:12:35.922983 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:35.922951    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4461d5e5-dcc2-4456-90c7-10ff2f23ee8b-tmp-dir\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:12:35.922983 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:35.922961    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swqn6\" (UniqueName: \"kubernetes.io/projected/4461d5e5-dcc2-4456-90c7-10ff2f23ee8b-kube-api-access-swqn6\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:12:35.922983 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:35.922970    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4461d5e5-dcc2-4456-90c7-10ff2f23ee8b-dshm\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:12:35.922983 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:35.922978    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4461d5e5-dcc2-4456-90c7-10ff2f23ee8b-tls-certs\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:12:36.135933 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:36.135904    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-ea0f1c/auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd"]
Sep 09 07:12:36.140640 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:36.140614    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-ea0f1c/auth-test-model-ea0f1c-kserve-6fc89bbcf5-z5lsd"]
Sep 09 07:12:37.712391 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:12:37.712358    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4461d5e5-dcc2-4456-90c7-10ff2f23ee8b" path="/var/lib/kubelet/pods/4461d5e5-dcc2-4456-90c7-10ff2f23ee8b/volumes"
Sep 09 07:13:31.542303 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:31.542219    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7946-dbcc6a"]
Sep 09 07:13:31.542694 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:31.542606    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4461d5e5-dcc2-4456-90c7-10ff2f23ee8b" containerName="main"
Sep 09 07:13:31.542694 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:31.542618    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4461d5e5-dcc2-4456-90c7-10ff2f23ee8b" containerName="main"
Sep 09 07:13:31.542694 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:31.542638    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="655b2c88-2680-4160-9e14-e17cb13b5a6d" containerName="mt-curl-7946-859200"
Sep 09 07:13:31.542694 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:31.542643    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="655b2c88-2680-4160-9e14-e17cb13b5a6d" containerName="mt-curl-7946-859200"
Sep 09 07:13:31.542876 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:31.542705    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="655b2c88-2680-4160-9e14-e17cb13b5a6d" containerName="mt-curl-7946-859200"
Sep 09 07:13:31.542876 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:31.542716    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4461d5e5-dcc2-4456-90c7-10ff2f23ee8b" containerName="main"
Sep 09 07:13:31.545499 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:31.545483    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7946-dbcc6a"
Sep 09 07:13:31.548229 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:31.548207    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-dw24h\""
Sep 09 07:13:31.550406 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:31.550381    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7946-dbcc6a"]
Sep 09 07:13:31.598437 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:31.598415    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5lt6\" (UniqueName: \"kubernetes.io/projected/7ca38c19-7729-49fc-ac98-32df0474fcc0-kube-api-access-m5lt6\") pod \"mt-curl-7946-dbcc6a\" (UID: \"7ca38c19-7729-49fc-ac98-32df0474fcc0\") " pod="opendatahub/mt-curl-7946-dbcc6a"
Sep 09 07:13:31.699263 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:31.699241    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5lt6\" (UniqueName: \"kubernetes.io/projected/7ca38c19-7729-49fc-ac98-32df0474fcc0-kube-api-access-m5lt6\") pod \"mt-curl-7946-dbcc6a\" (UID: \"7ca38c19-7729-49fc-ac98-32df0474fcc0\") " pod="opendatahub/mt-curl-7946-dbcc6a"
Sep 09 07:13:31.709899 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:31.709878    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5lt6\" (UniqueName: \"kubernetes.io/projected/7ca38c19-7729-49fc-ac98-32df0474fcc0-kube-api-access-m5lt6\") pod \"mt-curl-7946-dbcc6a\" (UID: \"7ca38c19-7729-49fc-ac98-32df0474fcc0\") " pod="opendatahub/mt-curl-7946-dbcc6a"
Sep 09 07:13:31.856343 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:31.856283    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7946-dbcc6a"
Sep 09 07:13:32.131868 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:32.131845    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7946-dbcc6a"]
Sep 09 07:13:32.134714 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:13:32.134688    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7ca38c19_7729_49fc_ac98_32df0474fcc0.slice/crio-3064ab7505f258939f16253be1b82937bd90884ab420f61ce471ae73b403fb4e WatchSource:0}: Error finding container 3064ab7505f258939f16253be1b82937bd90884ab420f61ce471ae73b403fb4e: Status 404 returned error can't find the container with id 3064ab7505f258939f16253be1b82937bd90884ab420f61ce471ae73b403fb4e
Sep 09 07:13:32.136146 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:32.136127    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 07:13:33.111581 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:33.111497    2575 generic.go:356] "Generic (PLEG): container finished" podID="7ca38c19-7729-49fc-ac98-32df0474fcc0" containerID="d810087c9e445a2ef286f83c599cc7cc3f138e931cfcd87a0b5a245287507dd2" exitCode=0
Sep 09 07:13:33.112008 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:33.111580    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7946-dbcc6a" event={"ID":"7ca38c19-7729-49fc-ac98-32df0474fcc0","Type":"ContainerDied","Data":"d810087c9e445a2ef286f83c599cc7cc3f138e931cfcd87a0b5a245287507dd2"}
Sep 09 07:13:33.112008 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:33.111619    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7946-dbcc6a" event={"ID":"7ca38c19-7729-49fc-ac98-32df0474fcc0","Type":"ContainerStarted","Data":"3064ab7505f258939f16253be1b82937bd90884ab420f61ce471ae73b403fb4e"}
Sep 09 07:13:34.254144 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:34.254124    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7946-dbcc6a"
Sep 09 07:13:34.276014 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:34.275992    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7946-dbcc6a_7ca38c19-7729-49fc-ac98-32df0474fcc0/mt-curl-7946-dbcc6a/0.log"
Sep 09 07:13:34.298490 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:34.298423    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7946-dbcc6a"]
Sep 09 07:13:34.301556 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:34.301534    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7946-dbcc6a"]
Sep 09 07:13:34.322875 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:34.322856    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5lt6\" (UniqueName: \"kubernetes.io/projected/7ca38c19-7729-49fc-ac98-32df0474fcc0-kube-api-access-m5lt6\") pod \"7ca38c19-7729-49fc-ac98-32df0474fcc0\" (UID: \"7ca38c19-7729-49fc-ac98-32df0474fcc0\") "
Sep 09 07:13:34.324983 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:34.324954    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ca38c19-7729-49fc-ac98-32df0474fcc0-kube-api-access-m5lt6" (OuterVolumeSpecName: "kube-api-access-m5lt6") pod "7ca38c19-7729-49fc-ac98-32df0474fcc0" (UID: "7ca38c19-7729-49fc-ac98-32df0474fcc0"). InnerVolumeSpecName "kube-api-access-m5lt6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 07:13:34.423836 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:34.423812    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5lt6\" (UniqueName: \"kubernetes.io/projected/7ca38c19-7729-49fc-ac98-32df0474fcc0-kube-api-access-m5lt6\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:13:34.433061 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:34.433041    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7946-a2bd40"]
Sep 09 07:13:34.433473 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:34.433461    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ca38c19-7729-49fc-ac98-32df0474fcc0" containerName="mt-curl-7946-dbcc6a"
Sep 09 07:13:34.433522 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:34.433476    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ca38c19-7729-49fc-ac98-32df0474fcc0" containerName="mt-curl-7946-dbcc6a"
Sep 09 07:13:34.433554 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:34.433543    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ca38c19-7729-49fc-ac98-32df0474fcc0" containerName="mt-curl-7946-dbcc6a"
Sep 09 07:13:34.435485 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:34.435472    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7946-a2bd40"
Sep 09 07:13:34.444001 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:34.443980    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7946-a2bd40"]
Sep 09 07:13:34.524363 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:34.524333    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwk58\" (UniqueName: \"kubernetes.io/projected/949d65c3-faaf-4dcb-9873-c48b2958ad53-kube-api-access-xwk58\") pod \"mt-curl-7946-a2bd40\" (UID: \"949d65c3-faaf-4dcb-9873-c48b2958ad53\") " pod="opendatahub/mt-curl-7946-a2bd40"
Sep 09 07:13:34.625257 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:34.625226    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwk58\" (UniqueName: \"kubernetes.io/projected/949d65c3-faaf-4dcb-9873-c48b2958ad53-kube-api-access-xwk58\") pod \"mt-curl-7946-a2bd40\" (UID: \"949d65c3-faaf-4dcb-9873-c48b2958ad53\") " pod="opendatahub/mt-curl-7946-a2bd40"
Sep 09 07:13:34.634641 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:34.634611    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwk58\" (UniqueName: \"kubernetes.io/projected/949d65c3-faaf-4dcb-9873-c48b2958ad53-kube-api-access-xwk58\") pod \"mt-curl-7946-a2bd40\" (UID: \"949d65c3-faaf-4dcb-9873-c48b2958ad53\") " pod="opendatahub/mt-curl-7946-a2bd40"
Sep 09 07:13:34.744562 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:34.744495    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7946-a2bd40"
Sep 09 07:13:35.013373 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:35.013295    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7946-a2bd40"]
Sep 09 07:13:35.016714 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:13:35.016690    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod949d65c3_faaf_4dcb_9873_c48b2958ad53.slice/crio-dd56dffcc9025515dd0ed05a3976bd6aa3167d8d535d9328f9238337ac352b06 WatchSource:0}: Error finding container dd56dffcc9025515dd0ed05a3976bd6aa3167d8d535d9328f9238337ac352b06: Status 404 returned error can't find the container with id dd56dffcc9025515dd0ed05a3976bd6aa3167d8d535d9328f9238337ac352b06
Sep 09 07:13:35.123355 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:35.123335    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7946-dbcc6a"
Sep 09 07:13:35.123460 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:35.123336    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3064ab7505f258939f16253be1b82937bd90884ab420f61ce471ae73b403fb4e"
Sep 09 07:13:35.124537 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:35.124514    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7946-a2bd40" event={"ID":"949d65c3-faaf-4dcb-9873-c48b2958ad53","Type":"ContainerStarted","Data":"dd56dffcc9025515dd0ed05a3976bd6aa3167d8d535d9328f9238337ac352b06"}
Sep 09 07:13:35.134267 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:13:35.134244    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"mt-curl-7946-dbcc6a\" is forbidden: User \"system:node:ip-10-0-132-176.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-176.ec2.internal' and this object" podUID="7ca38c19-7729-49fc-ac98-32df0474fcc0" pod="opendatahub/mt-curl-7946-dbcc6a"
Sep 09 07:13:35.711919 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:13:35.711880    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"mt-curl-7946-dbcc6a\" is forbidden: User \"system:node:ip-10-0-132-176.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-176.ec2.internal' and this object" podUID="7ca38c19-7729-49fc-ac98-32df0474fcc0" pod="opendatahub/mt-curl-7946-dbcc6a"
Sep 09 07:13:35.713296 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:35.713270    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ca38c19-7729-49fc-ac98-32df0474fcc0" path="/var/lib/kubelet/pods/7ca38c19-7729-49fc-ac98-32df0474fcc0/volumes"
Sep 09 07:13:36.130961 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:36.130929    2575 generic.go:356] "Generic (PLEG): container finished" podID="949d65c3-faaf-4dcb-9873-c48b2958ad53" containerID="a02014b9dcab4854958495855664558aacf5292a74613e29b668d436d7b85b61" exitCode=0
Sep 09 07:13:36.131151 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:36.131016    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7946-a2bd40" event={"ID":"949d65c3-faaf-4dcb-9873-c48b2958ad53","Type":"ContainerDied","Data":"a02014b9dcab4854958495855664558aacf5292a74613e29b668d436d7b85b61"}
Sep 09 07:13:37.270550 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:37.270528    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7946-a2bd40"
Sep 09 07:13:37.295406 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:37.295381    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7946-a2bd40_949d65c3-faaf-4dcb-9873-c48b2958ad53/mt-curl-7946-a2bd40/0.log"
Sep 09 07:13:37.318931 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:37.318905    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7946-a2bd40"]
Sep 09 07:13:37.325269 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:37.325244    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7946-a2bd40"]
Sep 09 07:13:37.347548 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:37.347525    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwk58\" (UniqueName: \"kubernetes.io/projected/949d65c3-faaf-4dcb-9873-c48b2958ad53-kube-api-access-xwk58\") pod \"949d65c3-faaf-4dcb-9873-c48b2958ad53\" (UID: \"949d65c3-faaf-4dcb-9873-c48b2958ad53\") "
Sep 09 07:13:37.349686 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:37.349660    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/949d65c3-faaf-4dcb-9873-c48b2958ad53-kube-api-access-xwk58" (OuterVolumeSpecName: "kube-api-access-xwk58") pod "949d65c3-faaf-4dcb-9873-c48b2958ad53" (UID: "949d65c3-faaf-4dcb-9873-c48b2958ad53"). InnerVolumeSpecName "kube-api-access-xwk58". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 07:13:37.448689 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:37.448627    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwk58\" (UniqueName: \"kubernetes.io/projected/949d65c3-faaf-4dcb-9873-c48b2958ad53-kube-api-access-xwk58\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:13:37.713694 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:37.713612    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="949d65c3-faaf-4dcb-9873-c48b2958ad53" path="/var/lib/kubelet/pods/949d65c3-faaf-4dcb-9873-c48b2958ad53/volumes"
Sep 09 07:13:38.143216 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:38.143186    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7946-a2bd40"
Sep 09 07:13:38.143409 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:13:38.143223    2575 scope.go:117] "RemoveContainer" containerID="a02014b9dcab4854958495855664558aacf5292a74613e29b668d436d7b85b61"
Sep 09 07:14:09.633672 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:09.633636    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-043f83-5c7dd78f98-n5znf"]
Sep 09 07:14:09.634123 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:09.634106    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="949d65c3-faaf-4dcb-9873-c48b2958ad53" containerName="mt-curl-7946-a2bd40"
Sep 09 07:14:09.634123 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:09.634119    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="949d65c3-faaf-4dcb-9873-c48b2958ad53" containerName="mt-curl-7946-a2bd40"
Sep 09 07:14:09.634204 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:09.634193    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="949d65c3-faaf-4dcb-9873-c48b2958ad53" containerName="mt-curl-7946-a2bd40"
Sep 09 07:14:09.638418 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:09.638400    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-043f83-5c7dd78f98-n5znf"
Sep 09 07:14:09.641701 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:09.641682    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-043f83-dockercfg-9nrc5\""
Sep 09 07:14:09.641814 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:09.641682    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-043f83\""
Sep 09 07:14:09.656326 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:09.656303    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-043f83-5c7dd78f98-n5znf"]
Sep 09 07:14:09.740713 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:09.740681    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cfd9\" (UniqueName: \"kubernetes.io/projected/e3d77d61-531b-4c16-aa8c-c017f8b5ea0e-kube-api-access-5cfd9\") pod \"payload-pre-processing-e2e-api-a-043f83-5c7dd78f98-n5znf\" (UID: \"e3d77d61-531b-4c16-aa8c-c017f8b5ea0e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-043f83-5c7dd78f98-n5znf"
Sep 09 07:14:09.740886 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:09.740775    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3d77d61-531b-4c16-aa8c-c017f8b5ea0e-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-043f83-5c7dd78f98-n5znf\" (UID: \"e3d77d61-531b-4c16-aa8c-c017f8b5ea0e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-043f83-5c7dd78f98-n5znf"
Sep 09 07:14:09.842211 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:09.842181    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cfd9\" (UniqueName: \"kubernetes.io/projected/e3d77d61-531b-4c16-aa8c-c017f8b5ea0e-kube-api-access-5cfd9\") pod \"payload-pre-processing-e2e-api-a-043f83-5c7dd78f98-n5znf\" (UID: \"e3d77d61-531b-4c16-aa8c-c017f8b5ea0e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-043f83-5c7dd78f98-n5znf"
Sep 09 07:14:09.842364 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:09.842229    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3d77d61-531b-4c16-aa8c-c017f8b5ea0e-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-043f83-5c7dd78f98-n5znf\" (UID: \"e3d77d61-531b-4c16-aa8c-c017f8b5ea0e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-043f83-5c7dd78f98-n5znf"
Sep 09 07:14:09.842932 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:09.842914    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3d77d61-531b-4c16-aa8c-c017f8b5ea0e-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-043f83-5c7dd78f98-n5znf\" (UID: \"e3d77d61-531b-4c16-aa8c-c017f8b5ea0e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-043f83-5c7dd78f98-n5znf"
Sep 09 07:14:09.852267 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:09.852241    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cfd9\" (UniqueName: \"kubernetes.io/projected/e3d77d61-531b-4c16-aa8c-c017f8b5ea0e-kube-api-access-5cfd9\") pod \"payload-pre-processing-e2e-api-a-043f83-5c7dd78f98-n5znf\" (UID: \"e3d77d61-531b-4c16-aa8c-c017f8b5ea0e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-043f83-5c7dd78f98-n5znf"
Sep 09 07:14:09.947852 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:09.947792    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-043f83-5c7dd78f98-n5znf"
Sep 09 07:14:10.219956 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:10.219877    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-043f83-5c7dd78f98-n5znf"]
Sep 09 07:14:10.222844 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:14:10.222817    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3d77d61_531b_4c16_aa8c_c017f8b5ea0e.slice/crio-de462ad218a46d7fe3715ea8ab0752d4d867a73261e53aa3c7539a16d11cc983 WatchSource:0}: Error finding container de462ad218a46d7fe3715ea8ab0752d4d867a73261e53aa3c7539a16d11cc983: Status 404 returned error can't find the container with id de462ad218a46d7fe3715ea8ab0752d4d867a73261e53aa3c7539a16d11cc983
Sep 09 07:14:10.308132 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:10.308100    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-043f83-5c7dd78f98-n5znf" event={"ID":"e3d77d61-531b-4c16-aa8c-c017f8b5ea0e","Type":"ContainerStarted","Data":"ae367c085af3d8ad64d486e48a3a60a50c0b699e7ae5f2db20b420c16e981b90"}
Sep 09 07:14:10.308262 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:10.308163    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-043f83-5c7dd78f98-n5znf" event={"ID":"e3d77d61-531b-4c16-aa8c-c017f8b5ea0e","Type":"ContainerStarted","Data":"de462ad218a46d7fe3715ea8ab0752d4d867a73261e53aa3c7539a16d11cc983"}
Sep 09 07:14:10.308346 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:10.308330    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-043f83-5c7dd78f98-n5znf"
Sep 09 07:14:10.327225 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:10.327175    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-043f83-5c7dd78f98-n5znf" podStartSLOduration=1.327157928 podStartE2EDuration="1.327157928s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 07:14:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 07:14:10.325982224 +0000 UTC m=+1385.117791564" watchObservedRunningTime="2026-09-09 07:14:10.327157928 +0000 UTC m=+1385.118967267"
Sep 09 07:14:17.430387 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:17.430357    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-988b24/rate-test-model-988b24-kserve-577dcbd587-shdrc"]
Sep 09 07:14:17.434090 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:17.434070    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-988b24/rate-test-model-988b24-kserve-577dcbd587-shdrc"
Sep 09 07:14:17.437784 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:17.437738    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-988b24\"/\"openshift-service-ca.crt\""
Sep 09 07:14:17.438272 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:17.438250    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-988b24\"/\"default-dockercfg-7bjfk\""
Sep 09 07:14:17.438374 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:17.438310    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-988b24\"/\"kube-root-ca.crt\""
Sep 09 07:14:17.438515 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:17.438495    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-988b24\"/\"rate-test-model-988b24-kserve-self-signed-certs\""
Sep 09 07:14:17.448680 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:17.448658    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-988b24/rate-test-model-988b24-kserve-577dcbd587-shdrc"]
Sep 09 07:14:17.504421 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:17.504387    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1c8e839-2a29-4ec9-aba2-5124ae29ee58-dshm\") pod \"rate-test-model-988b24-kserve-577dcbd587-shdrc\" (UID: \"c1c8e839-2a29-4ec9-aba2-5124ae29ee58\") " pod="ai-tenant-e2e-shared-b-w3-988b24/rate-test-model-988b24-kserve-577dcbd587-shdrc"
Sep 09 07:14:17.504582 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:17.504430    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1c8e839-2a29-4ec9-aba2-5124ae29ee58-model-cache\") pod \"rate-test-model-988b24-kserve-577dcbd587-shdrc\" (UID: \"c1c8e839-2a29-4ec9-aba2-5124ae29ee58\") " pod="ai-tenant-e2e-shared-b-w3-988b24/rate-test-model-988b24-kserve-577dcbd587-shdrc"
Sep 09 07:14:17.504582 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:17.504470    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1c8e839-2a29-4ec9-aba2-5124ae29ee58-tmp-dir\") pod \"rate-test-model-988b24-kserve-577dcbd587-shdrc\" (UID: \"c1c8e839-2a29-4ec9-aba2-5124ae29ee58\") " pod="ai-tenant-e2e-shared-b-w3-988b24/rate-test-model-988b24-kserve-577dcbd587-shdrc"
Sep 09 07:14:17.504582 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:17.504514    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1c8e839-2a29-4ec9-aba2-5124ae29ee58-tls-certs\") pod \"rate-test-model-988b24-kserve-577dcbd587-shdrc\" (UID: \"c1c8e839-2a29-4ec9-aba2-5124ae29ee58\") " pod="ai-tenant-e2e-shared-b-w3-988b24/rate-test-model-988b24-kserve-577dcbd587-shdrc"
Sep 09 07:14:17.504793 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:17.504676    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6knj\" (UniqueName: \"kubernetes.io/projected/c1c8e839-2a29-4ec9-aba2-5124ae29ee58-kube-api-access-t6knj\") pod \"rate-test-model-988b24-kserve-577dcbd587-shdrc\" (UID: \"c1c8e839-2a29-4ec9-aba2-5124ae29ee58\") " pod="ai-tenant-e2e-shared-b-w3-988b24/rate-test-model-988b24-kserve-577dcbd587-shdrc"
Sep 09 07:14:17.504793 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:17.504723    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1c8e839-2a29-4ec9-aba2-5124ae29ee58-home\") pod \"rate-test-model-988b24-kserve-577dcbd587-shdrc\" (UID: \"c1c8e839-2a29-4ec9-aba2-5124ae29ee58\") " pod="ai-tenant-e2e-shared-b-w3-988b24/rate-test-model-988b24-kserve-577dcbd587-shdrc"
Sep 09 07:14:17.605617 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:17.605581    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6knj\" (UniqueName: \"kubernetes.io/projected/c1c8e839-2a29-4ec9-aba2-5124ae29ee58-kube-api-access-t6knj\") pod \"rate-test-model-988b24-kserve-577dcbd587-shdrc\" (UID: \"c1c8e839-2a29-4ec9-aba2-5124ae29ee58\") " pod="ai-tenant-e2e-shared-b-w3-988b24/rate-test-model-988b24-kserve-577dcbd587-shdrc"
Sep 09 07:14:17.605617 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:17.605620    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1c8e839-2a29-4ec9-aba2-5124ae29ee58-home\") pod \"rate-test-model-988b24-kserve-577dcbd587-shdrc\" (UID: \"c1c8e839-2a29-4ec9-aba2-5124ae29ee58\") " pod="ai-tenant-e2e-shared-b-w3-988b24/rate-test-model-988b24-kserve-577dcbd587-shdrc"
Sep 09 07:14:17.605912 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:17.605636    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1c8e839-2a29-4ec9-aba2-5124ae29ee58-dshm\") pod \"rate-test-model-988b24-kserve-577dcbd587-shdrc\" (UID: \"c1c8e839-2a29-4ec9-aba2-5124ae29ee58\") " pod="ai-tenant-e2e-shared-b-w3-988b24/rate-test-model-988b24-kserve-577dcbd587-shdrc"
Sep 09 07:14:17.605912 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:17.605651    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1c8e839-2a29-4ec9-aba2-5124ae29ee58-model-cache\") pod \"rate-test-model-988b24-kserve-577dcbd587-shdrc\" (UID: \"c1c8e839-2a29-4ec9-aba2-5124ae29ee58\") " pod="ai-tenant-e2e-shared-b-w3-988b24/rate-test-model-988b24-kserve-577dcbd587-shdrc"
Sep 09 07:14:17.605912 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:17.605691    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1c8e839-2a29-4ec9-aba2-5124ae29ee58-tmp-dir\") pod \"rate-test-model-988b24-kserve-577dcbd587-shdrc\" (UID: \"c1c8e839-2a29-4ec9-aba2-5124ae29ee58\") " pod="ai-tenant-e2e-shared-b-w3-988b24/rate-test-model-988b24-kserve-577dcbd587-shdrc"
Sep 09 07:14:17.606075 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:17.606015    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1c8e839-2a29-4ec9-aba2-5124ae29ee58-tls-certs\") pod \"rate-test-model-988b24-kserve-577dcbd587-shdrc\" (UID: \"c1c8e839-2a29-4ec9-aba2-5124ae29ee58\") " pod="ai-tenant-e2e-shared-b-w3-988b24/rate-test-model-988b24-kserve-577dcbd587-shdrc"
Sep 09 07:14:17.606126 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:17.606083    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1c8e839-2a29-4ec9-aba2-5124ae29ee58-home\") pod \"rate-test-model-988b24-kserve-577dcbd587-shdrc\" (UID: \"c1c8e839-2a29-4ec9-aba2-5124ae29ee58\") " pod="ai-tenant-e2e-shared-b-w3-988b24/rate-test-model-988b24-kserve-577dcbd587-shdrc"
Sep 09 07:14:17.606175 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:17.606156    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1c8e839-2a29-4ec9-aba2-5124ae29ee58-model-cache\") pod \"rate-test-model-988b24-kserve-577dcbd587-shdrc\" (UID: \"c1c8e839-2a29-4ec9-aba2-5124ae29ee58\") " pod="ai-tenant-e2e-shared-b-w3-988b24/rate-test-model-988b24-kserve-577dcbd587-shdrc"
Sep 09 07:14:17.606245 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:17.606214    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1c8e839-2a29-4ec9-aba2-5124ae29ee58-tmp-dir\") pod \"rate-test-model-988b24-kserve-577dcbd587-shdrc\" (UID: \"c1c8e839-2a29-4ec9-aba2-5124ae29ee58\") " pod="ai-tenant-e2e-shared-b-w3-988b24/rate-test-model-988b24-kserve-577dcbd587-shdrc"
Sep 09 07:14:17.608148 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:17.608128    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1c8e839-2a29-4ec9-aba2-5124ae29ee58-dshm\") pod \"rate-test-model-988b24-kserve-577dcbd587-shdrc\" (UID: \"c1c8e839-2a29-4ec9-aba2-5124ae29ee58\") " pod="ai-tenant-e2e-shared-b-w3-988b24/rate-test-model-988b24-kserve-577dcbd587-shdrc"
Sep 09 07:14:17.608614 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:17.608598    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1c8e839-2a29-4ec9-aba2-5124ae29ee58-tls-certs\") pod \"rate-test-model-988b24-kserve-577dcbd587-shdrc\" (UID: \"c1c8e839-2a29-4ec9-aba2-5124ae29ee58\") " pod="ai-tenant-e2e-shared-b-w3-988b24/rate-test-model-988b24-kserve-577dcbd587-shdrc"
Sep 09 07:14:17.616794 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:17.616773    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6knj\" (UniqueName: \"kubernetes.io/projected/c1c8e839-2a29-4ec9-aba2-5124ae29ee58-kube-api-access-t6knj\") pod \"rate-test-model-988b24-kserve-577dcbd587-shdrc\" (UID: \"c1c8e839-2a29-4ec9-aba2-5124ae29ee58\") " pod="ai-tenant-e2e-shared-b-w3-988b24/rate-test-model-988b24-kserve-577dcbd587-shdrc"
Sep 09 07:14:17.745317 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:17.745226    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-988b24/rate-test-model-988b24-kserve-577dcbd587-shdrc"
Sep 09 07:14:18.020510 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:18.020485    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-988b24/rate-test-model-988b24-kserve-577dcbd587-shdrc"]
Sep 09 07:14:18.022348 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:14:18.022319    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc1c8e839_2a29_4ec9_aba2_5124ae29ee58.slice/crio-c3d388baa1719bfa17b175b4905865c0ccdae85baca859742d0e83711cd8f012 WatchSource:0}: Error finding container c3d388baa1719bfa17b175b4905865c0ccdae85baca859742d0e83711cd8f012: Status 404 returned error can't find the container with id c3d388baa1719bfa17b175b4905865c0ccdae85baca859742d0e83711cd8f012
Sep 09 07:14:18.364261 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:18.364165    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-988b24/rate-test-model-988b24-kserve-577dcbd587-shdrc" event={"ID":"c1c8e839-2a29-4ec9-aba2-5124ae29ee58","Type":"ContainerStarted","Data":"392f94958616028956fc90c7927b74de996c00b0b90d14c2233d73e957032e3f"}
Sep 09 07:14:18.364261 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:18.364212    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-988b24/rate-test-model-988b24-kserve-577dcbd587-shdrc" event={"ID":"c1c8e839-2a29-4ec9-aba2-5124ae29ee58","Type":"ContainerStarted","Data":"c3d388baa1719bfa17b175b4905865c0ccdae85baca859742d0e83711cd8f012"}
Sep 09 07:14:21.315464 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:21.315416    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-043f83-5c7dd78f98-n5znf"
Sep 09 07:14:21.337314 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:21.337258    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-988b24/rate-test-model-988b24-kserve-577dcbd587-shdrc" podStartSLOduration=4.337238406 podStartE2EDuration="4.337238406s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 07:14:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 07:14:18.382324539 +0000 UTC m=+1393.174133877" watchObservedRunningTime="2026-09-09 07:14:21.337238406 +0000 UTC m=+1396.129047745"
Sep 09 07:14:27.745368 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:27.745339    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-988b24/rate-test-model-988b24-kserve-577dcbd587-shdrc"
Sep 09 07:14:27.745770 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:27.745401    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-988b24/rate-test-model-988b24-kserve-577dcbd587-shdrc"
Sep 09 07:14:27.758106 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:27.758086    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-988b24/rate-test-model-988b24-kserve-577dcbd587-shdrc"
Sep 09 07:14:28.427357 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:28.427330    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-988b24/rate-test-model-988b24-kserve-577dcbd587-shdrc"
Sep 09 07:14:38.713148 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:38.713116    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-d8398c-7bb4654f5c-nvg5r"]
Sep 09 07:14:38.716947 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:38.716925    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d8398c-7bb4654f5c-nvg5r"
Sep 09 07:14:38.719583 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:38.719559    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-lbttc\""
Sep 09 07:14:38.720623 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:38.720602    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 09 07:14:38.720623 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:38.720618    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-d8398c-serving-cert\""
Sep 09 07:14:38.720839 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:38.720643    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 09 07:14:38.720928 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:38.720912    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 07:14:38.729896 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:38.729841    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-d8398c-7bb4654f5c-nvg5r"]
Sep 09 07:14:38.792505 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:38.792477    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f1dbc01-cdbc-481b-8c31-5952f83f37ff-maas-api-tls\") pod \"maas-api-e2e-api-b-d8398c-7bb4654f5c-nvg5r\" (UID: \"8f1dbc01-cdbc-481b-8c31-5952f83f37ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d8398c-7bb4654f5c-nvg5r"
Sep 09 07:14:38.792650 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:38.792554    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f1dbc01-cdbc-481b-8c31-5952f83f37ff-metrics-certs\") pod \"maas-api-e2e-api-b-d8398c-7bb4654f5c-nvg5r\" (UID: \"8f1dbc01-cdbc-481b-8c31-5952f83f37ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d8398c-7bb4654f5c-nvg5r"
Sep 09 07:14:38.792650 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:38.792633    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f1dbc01-cdbc-481b-8c31-5952f83f37ff-openshift-service-ca\") pod \"maas-api-e2e-api-b-d8398c-7bb4654f5c-nvg5r\" (UID: \"8f1dbc01-cdbc-481b-8c31-5952f83f37ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d8398c-7bb4654f5c-nvg5r"
Sep 09 07:14:38.792730 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:38.792698    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvbw2\" (UniqueName: \"kubernetes.io/projected/8f1dbc01-cdbc-481b-8c31-5952f83f37ff-kube-api-access-mvbw2\") pod \"maas-api-e2e-api-b-d8398c-7bb4654f5c-nvg5r\" (UID: \"8f1dbc01-cdbc-481b-8c31-5952f83f37ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d8398c-7bb4654f5c-nvg5r"
Sep 09 07:14:38.894058 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:38.894028    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f1dbc01-cdbc-481b-8c31-5952f83f37ff-maas-api-tls\") pod \"maas-api-e2e-api-b-d8398c-7bb4654f5c-nvg5r\" (UID: \"8f1dbc01-cdbc-481b-8c31-5952f83f37ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d8398c-7bb4654f5c-nvg5r"
Sep 09 07:14:38.894188 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:38.894078    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f1dbc01-cdbc-481b-8c31-5952f83f37ff-metrics-certs\") pod \"maas-api-e2e-api-b-d8398c-7bb4654f5c-nvg5r\" (UID: \"8f1dbc01-cdbc-481b-8c31-5952f83f37ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d8398c-7bb4654f5c-nvg5r"
Sep 09 07:14:38.894188 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:38.894106    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f1dbc01-cdbc-481b-8c31-5952f83f37ff-openshift-service-ca\") pod \"maas-api-e2e-api-b-d8398c-7bb4654f5c-nvg5r\" (UID: \"8f1dbc01-cdbc-481b-8c31-5952f83f37ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d8398c-7bb4654f5c-nvg5r"
Sep 09 07:14:38.894188 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:38.894135    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvbw2\" (UniqueName: \"kubernetes.io/projected/8f1dbc01-cdbc-481b-8c31-5952f83f37ff-kube-api-access-mvbw2\") pod \"maas-api-e2e-api-b-d8398c-7bb4654f5c-nvg5r\" (UID: \"8f1dbc01-cdbc-481b-8c31-5952f83f37ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d8398c-7bb4654f5c-nvg5r"
Sep 09 07:14:38.894188 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:14:38.894167    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-d8398c-serving-cert: secret "maas-api-e2e-api-b-d8398c-serving-cert" not found
Sep 09 07:14:38.894332 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:14:38.894236    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f1dbc01-cdbc-481b-8c31-5952f83f37ff-maas-api-tls podName:8f1dbc01-cdbc-481b-8c31-5952f83f37ff nodeName:}" failed. No retries permitted until 2026-09-09 07:14:39.394219067 +0000 UTC m=+1414.186028388 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8f1dbc01-cdbc-481b-8c31-5952f83f37ff-maas-api-tls") pod "maas-api-e2e-api-b-d8398c-7bb4654f5c-nvg5r" (UID: "8f1dbc01-cdbc-481b-8c31-5952f83f37ff") : secret "maas-api-e2e-api-b-d8398c-serving-cert" not found
Sep 09 07:14:38.894742 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:38.894723    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f1dbc01-cdbc-481b-8c31-5952f83f37ff-openshift-service-ca\") pod \"maas-api-e2e-api-b-d8398c-7bb4654f5c-nvg5r\" (UID: \"8f1dbc01-cdbc-481b-8c31-5952f83f37ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d8398c-7bb4654f5c-nvg5r"
Sep 09 07:14:38.896689 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:38.896667    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f1dbc01-cdbc-481b-8c31-5952f83f37ff-metrics-certs\") pod \"maas-api-e2e-api-b-d8398c-7bb4654f5c-nvg5r\" (UID: \"8f1dbc01-cdbc-481b-8c31-5952f83f37ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d8398c-7bb4654f5c-nvg5r"
Sep 09 07:14:38.902472 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:38.902448    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvbw2\" (UniqueName: \"kubernetes.io/projected/8f1dbc01-cdbc-481b-8c31-5952f83f37ff-kube-api-access-mvbw2\") pod \"maas-api-e2e-api-b-d8398c-7bb4654f5c-nvg5r\" (UID: \"8f1dbc01-cdbc-481b-8c31-5952f83f37ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d8398c-7bb4654f5c-nvg5r"
Sep 09 07:14:39.399168 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:39.399140    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f1dbc01-cdbc-481b-8c31-5952f83f37ff-maas-api-tls\") pod \"maas-api-e2e-api-b-d8398c-7bb4654f5c-nvg5r\" (UID: \"8f1dbc01-cdbc-481b-8c31-5952f83f37ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d8398c-7bb4654f5c-nvg5r"
Sep 09 07:14:39.399338 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:14:39.399265    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-d8398c-serving-cert: secret "maas-api-e2e-api-b-d8398c-serving-cert" not found
Sep 09 07:14:39.399338 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:14:39.399328    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f1dbc01-cdbc-481b-8c31-5952f83f37ff-maas-api-tls podName:8f1dbc01-cdbc-481b-8c31-5952f83f37ff nodeName:}" failed. No retries permitted until 2026-09-09 07:14:40.399313267 +0000 UTC m=+1415.191122583 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8f1dbc01-cdbc-481b-8c31-5952f83f37ff-maas-api-tls") pod "maas-api-e2e-api-b-d8398c-7bb4654f5c-nvg5r" (UID: "8f1dbc01-cdbc-481b-8c31-5952f83f37ff") : secret "maas-api-e2e-api-b-d8398c-serving-cert" not found
Sep 09 07:14:40.408004 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:40.407973    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f1dbc01-cdbc-481b-8c31-5952f83f37ff-maas-api-tls\") pod \"maas-api-e2e-api-b-d8398c-7bb4654f5c-nvg5r\" (UID: \"8f1dbc01-cdbc-481b-8c31-5952f83f37ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d8398c-7bb4654f5c-nvg5r"
Sep 09 07:14:40.410551 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:40.410526    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f1dbc01-cdbc-481b-8c31-5952f83f37ff-maas-api-tls\") pod \"maas-api-e2e-api-b-d8398c-7bb4654f5c-nvg5r\" (UID: \"8f1dbc01-cdbc-481b-8c31-5952f83f37ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d8398c-7bb4654f5c-nvg5r"
Sep 09 07:14:40.529871 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:40.529841    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d8398c-7bb4654f5c-nvg5r"
Sep 09 07:14:40.802076 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:40.802051    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-d8398c-7bb4654f5c-nvg5r"]
Sep 09 07:14:40.804322 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:14:40.804292    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f1dbc01_cdbc_481b_8c31_5952f83f37ff.slice/crio-05beffab6f1f50820babc21704f975bfc0621bd29300e99df0ffc116e333d3af WatchSource:0}: Error finding container 05beffab6f1f50820babc21704f975bfc0621bd29300e99df0ffc116e333d3af: Status 404 returned error can't find the container with id 05beffab6f1f50820babc21704f975bfc0621bd29300e99df0ffc116e333d3af
Sep 09 07:14:41.489693 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:41.489619    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d8398c-7bb4654f5c-nvg5r" event={"ID":"8f1dbc01-cdbc-481b-8c31-5952f83f37ff","Type":"ContainerStarted","Data":"219af378e8daf50ef62b30a43acec57f45daa8b4915f3315d319a9b6928aea98"}
Sep 09 07:14:41.489693 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:41.489667    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d8398c-7bb4654f5c-nvg5r" event={"ID":"8f1dbc01-cdbc-481b-8c31-5952f83f37ff","Type":"ContainerStarted","Data":"05beffab6f1f50820babc21704f975bfc0621bd29300e99df0ffc116e333d3af"}
Sep 09 07:14:41.490095 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:41.489784    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d8398c-7bb4654f5c-nvg5r"
Sep 09 07:14:41.511336 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:41.511288    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d8398c-7bb4654f5c-nvg5r" podStartSLOduration=3.098496635 podStartE2EDuration="3.511274514s" totalImagesPullingTime="412.777879ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 07:14:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 07:14:41.510025296 +0000 UTC m=+1416.301834634" watchObservedRunningTime="2026-09-09 07:14:41.511274514 +0000 UTC m=+1416.303083853"
Sep 09 07:14:47.503804 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:14:47.503769    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d8398c-7bb4654f5c-nvg5r"
Sep 09 07:15:00.182951 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:00.182869    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-1d8843-29815635-q7d29"]
Sep 09 07:15:00.186637 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:00.186621    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-1128ac-29815635-mdvn7"]
Sep 09 07:15:00.186766 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:00.186736    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-1d8843-29815635-q7d29"
Sep 09 07:15:00.190178 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:00.190152    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-1128ac-29815635-mdvn7"
Sep 09 07:15:00.190358 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:00.190339    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bbglc\""
Sep 09 07:15:00.200179 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:00.200156    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-1d8843-29815635-q7d29"
Sep 09 07:15:00.200559 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:00.200542    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-1128ac-29815635-mdvn7"]
Sep 09 07:15:00.206992 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:00.206971    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-1d8843-29815635-q7d29"]
Sep 09 07:15:00.209386 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:00.209028    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-1128ac-29815635-mdvn7"
Sep 09 07:15:00.216007 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:00.214991    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-d8398c-29815635-pt4vg"]
Sep 09 07:15:00.223831 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:00.223790    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-d8398c-29815635-pt4vg"
Sep 09 07:15:00.234391 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:00.234353    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-d8398c-29815635-pt4vg"]
Sep 09 07:15:00.257959 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:00.257937    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-d8398c-29815635-pt4vg"
Sep 09 07:15:00.492631 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:00.492608    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-1d8843-29815635-q7d29"]
Sep 09 07:15:00.495244 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:15:00.495219    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c4149de_7e16_4771_b695_bb2dfd024177.slice/crio-ea4e5c768bb820d0c13914bc305e7678e60c1e914477c4e9e88b984a0615cd4e WatchSource:0}: Error finding container ea4e5c768bb820d0c13914bc305e7678e60c1e914477c4e9e88b984a0615cd4e: Status 404 returned error can't find the container with id ea4e5c768bb820d0c13914bc305e7678e60c1e914477c4e9e88b984a0615cd4e
Sep 09 07:15:00.507968 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:00.507942    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-1128ac-29815635-mdvn7"]
Sep 09 07:15:00.509639 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:15:00.509613    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14ee9251_2938_4217_959c_8288b2c26c24.slice/crio-ec4b66ee17a12564a354730dfb183db4e261def2115f6eb1d60c4f9b107afc46 WatchSource:0}: Error finding container ec4b66ee17a12564a354730dfb183db4e261def2115f6eb1d60c4f9b107afc46: Status 404 returned error can't find the container with id ec4b66ee17a12564a354730dfb183db4e261def2115f6eb1d60c4f9b107afc46
Sep 09 07:15:00.546430 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:00.546391    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-d8398c-29815635-pt4vg"]
Sep 09 07:15:00.548470 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:15:00.548450    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod185a0743_1e18_48d1_8aed_d9aee3753bc3.slice/crio-557a53f481e8d4f5f64e3491d25a965db45d4a6425aa22a8f5cb1553a8729ac6 WatchSource:0}: Error finding container 557a53f481e8d4f5f64e3491d25a965db45d4a6425aa22a8f5cb1553a8729ac6: Status 404 returned error can't find the container with id 557a53f481e8d4f5f64e3491d25a965db45d4a6425aa22a8f5cb1553a8729ac6
Sep 09 07:15:00.596215 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:00.596188    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-1128ac-29815635-mdvn7" event={"ID":"14ee9251-2938-4217-959c-8288b2c26c24","Type":"ContainerStarted","Data":"ec4b66ee17a12564a354730dfb183db4e261def2115f6eb1d60c4f9b107afc46"}
Sep 09 07:15:00.597392 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:00.597368    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-1d8843-29815635-q7d29" event={"ID":"0c4149de-7e16-4771-b695-bb2dfd024177","Type":"ContainerStarted","Data":"ea4e5c768bb820d0c13914bc305e7678e60c1e914477c4e9e88b984a0615cd4e"}
Sep 09 07:15:00.598530 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:00.598505    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-d8398c-29815635-pt4vg" event={"ID":"185a0743-1e18-48d1-8aed-d9aee3753bc3","Type":"ContainerStarted","Data":"557a53f481e8d4f5f64e3491d25a965db45d4a6425aa22a8f5cb1553a8729ac6"}
Sep 09 07:15:01.605363 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:01.605333    2575 generic.go:356] "Generic (PLEG): container finished" podID="0c4149de-7e16-4771-b695-bb2dfd024177" containerID="14d36d6e241207705a4cbc571189fe7dcd7e648a536b2b9a086adf42692696c9" exitCode=0
Sep 09 07:15:01.605734 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:01.605416    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-1d8843-29815635-q7d29" event={"ID":"0c4149de-7e16-4771-b695-bb2dfd024177","Type":"ContainerDied","Data":"14d36d6e241207705a4cbc571189fe7dcd7e648a536b2b9a086adf42692696c9"}
Sep 09 07:15:01.607359 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:01.607336    2575 generic.go:356] "Generic (PLEG): container finished" podID="185a0743-1e18-48d1-8aed-d9aee3753bc3" containerID="3c7e03b17dae76ee7a28500cc74e5a6065bf261fed5da0361b06b59733e5a372" exitCode=0
Sep 09 07:15:01.607445 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:01.607414    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-d8398c-29815635-pt4vg" event={"ID":"185a0743-1e18-48d1-8aed-d9aee3753bc3","Type":"ContainerDied","Data":"3c7e03b17dae76ee7a28500cc74e5a6065bf261fed5da0361b06b59733e5a372"}
Sep 09 07:15:01.619354 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:01.619323    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-1128ac-29815635-mdvn7" event={"ID":"14ee9251-2938-4217-959c-8288b2c26c24","Type":"ContainerStarted","Data":"b4c49a537ad23664b0e857448300c1dc1118ffb1727149532192c933cd881ded"}
Sep 09 07:15:02.625470 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:02.625436    2575 generic.go:356] "Generic (PLEG): container finished" podID="14ee9251-2938-4217-959c-8288b2c26c24" containerID="b4c49a537ad23664b0e857448300c1dc1118ffb1727149532192c933cd881ded" exitCode=0
Sep 09 07:15:02.625902 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:02.625516    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-1128ac-29815635-mdvn7" event={"ID":"14ee9251-2938-4217-959c-8288b2c26c24","Type":"ContainerDied","Data":"b4c49a537ad23664b0e857448300c1dc1118ffb1727149532192c933cd881ded"}
Sep 09 07:15:02.784251 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:02.784225    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-d8398c-29815635-pt4vg"
Sep 09 07:15:02.815044 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:02.815022    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-1128ac-29815635-mdvn7"
Sep 09 07:15:02.819104 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:02.819088    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-1d8843-29815635-q7d29"
Sep 09 07:15:03.632408 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:03.632376    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-1d8843-29815635-q7d29"
Sep 09 07:15:03.632839 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:03.632415    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-1d8843-29815635-q7d29" event={"ID":"0c4149de-7e16-4771-b695-bb2dfd024177","Type":"ContainerDied","Data":"ea4e5c768bb820d0c13914bc305e7678e60c1e914477c4e9e88b984a0615cd4e"}
Sep 09 07:15:03.632839 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:03.632470    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ea4e5c768bb820d0c13914bc305e7678e60c1e914477c4e9e88b984a0615cd4e"
Sep 09 07:15:03.633717 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:03.633702    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-d8398c-29815635-pt4vg"
Sep 09 07:15:03.633852 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:03.633725    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-d8398c-29815635-pt4vg" event={"ID":"185a0743-1e18-48d1-8aed-d9aee3753bc3","Type":"ContainerDied","Data":"557a53f481e8d4f5f64e3491d25a965db45d4a6425aa22a8f5cb1553a8729ac6"}
Sep 09 07:15:03.633852 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:03.633784    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="557a53f481e8d4f5f64e3491d25a965db45d4a6425aa22a8f5cb1553a8729ac6"
Sep 09 07:15:03.635064 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:03.635041    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-1128ac-29815635-mdvn7" event={"ID":"14ee9251-2938-4217-959c-8288b2c26c24","Type":"ContainerDied","Data":"ec4b66ee17a12564a354730dfb183db4e261def2115f6eb1d60c4f9b107afc46"}
Sep 09 07:15:03.635174 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:03.635084    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ec4b66ee17a12564a354730dfb183db4e261def2115f6eb1d60c4f9b107afc46"
Sep 09 07:15:03.635174 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:03.635055    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-1128ac-29815635-mdvn7"
Sep 09 07:15:05.858554 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:05.858520    2575 scope.go:117] "RemoveContainer" containerID="1198db878b952b164216d0b4987e1e490905a2e004325799178dec3a5db5bc81"
Sep 09 07:15:09.718782 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:09.718735    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-988b24/rate-test-model-988b24-kserve-577dcbd587-shdrc"]
Sep 09 07:15:14.761501 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:14.761470    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-bea943-559d8d584b-tgnws"]
Sep 09 07:15:14.762004 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:14.761988    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14ee9251-2938-4217-959c-8288b2c26c24" containerName="cleanup"
Sep 09 07:15:14.762066 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:14.762009    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="14ee9251-2938-4217-959c-8288b2c26c24" containerName="cleanup"
Sep 09 07:15:14.762066 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:14.762025    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="185a0743-1e18-48d1-8aed-d9aee3753bc3" containerName="cleanup"
Sep 09 07:15:14.762066 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:14.762030    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="185a0743-1e18-48d1-8aed-d9aee3753bc3" containerName="cleanup"
Sep 09 07:15:14.762066 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:14.762045    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c4149de-7e16-4771-b695-bb2dfd024177" containerName="cleanup"
Sep 09 07:15:14.762066 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:14.762051    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c4149de-7e16-4771-b695-bb2dfd024177" containerName="cleanup"
Sep 09 07:15:14.762231 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:14.762123    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c4149de-7e16-4771-b695-bb2dfd024177" containerName="cleanup"
Sep 09 07:15:14.762231 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:14.762133    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="14ee9251-2938-4217-959c-8288b2c26c24" containerName="cleanup"
Sep 09 07:15:14.762231 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:14.762140    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="185a0743-1e18-48d1-8aed-d9aee3753bc3" containerName="cleanup"
Sep 09 07:15:14.766557 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:14.766539    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bea943-559d8d584b-tgnws"
Sep 09 07:15:14.769322 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:14.769298    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-bea943-serving-cert\""
Sep 09 07:15:14.777548 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:14.777526    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-bea943-559d8d584b-tgnws"]
Sep 09 07:15:14.813656 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:14.813628    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9knrz\" (UniqueName: \"kubernetes.io/projected/06914af0-be1b-4c31-bd1c-38b9275935fa-kube-api-access-9knrz\") pod \"maas-api-e2e-ipp-a-bea943-559d8d584b-tgnws\" (UID: \"06914af0-be1b-4c31-bd1c-38b9275935fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bea943-559d8d584b-tgnws"
Sep 09 07:15:14.813914 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:14.813876    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06914af0-be1b-4c31-bd1c-38b9275935fa-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-bea943-559d8d584b-tgnws\" (UID: \"06914af0-be1b-4c31-bd1c-38b9275935fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bea943-559d8d584b-tgnws"
Sep 09 07:15:14.814042 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:14.813961    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/06914af0-be1b-4c31-bd1c-38b9275935fa-metrics-certs\") pod \"maas-api-e2e-ipp-a-bea943-559d8d584b-tgnws\" (UID: \"06914af0-be1b-4c31-bd1c-38b9275935fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bea943-559d8d584b-tgnws"
Sep 09 07:15:14.814042 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:14.814015    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06914af0-be1b-4c31-bd1c-38b9275935fa-maas-api-tls\") pod \"maas-api-e2e-ipp-a-bea943-559d8d584b-tgnws\" (UID: \"06914af0-be1b-4c31-bd1c-38b9275935fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bea943-559d8d584b-tgnws"
Sep 09 07:15:14.915490 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:14.915457    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9knrz\" (UniqueName: \"kubernetes.io/projected/06914af0-be1b-4c31-bd1c-38b9275935fa-kube-api-access-9knrz\") pod \"maas-api-e2e-ipp-a-bea943-559d8d584b-tgnws\" (UID: \"06914af0-be1b-4c31-bd1c-38b9275935fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bea943-559d8d584b-tgnws"
Sep 09 07:15:14.915617 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:14.915530    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06914af0-be1b-4c31-bd1c-38b9275935fa-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-bea943-559d8d584b-tgnws\" (UID: \"06914af0-be1b-4c31-bd1c-38b9275935fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bea943-559d8d584b-tgnws"
Sep 09 07:15:14.915617 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:14.915566    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/06914af0-be1b-4c31-bd1c-38b9275935fa-metrics-certs\") pod \"maas-api-e2e-ipp-a-bea943-559d8d584b-tgnws\" (UID: \"06914af0-be1b-4c31-bd1c-38b9275935fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bea943-559d8d584b-tgnws"
Sep 09 07:15:14.915617 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:14.915596    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06914af0-be1b-4c31-bd1c-38b9275935fa-maas-api-tls\") pod \"maas-api-e2e-ipp-a-bea943-559d8d584b-tgnws\" (UID: \"06914af0-be1b-4c31-bd1c-38b9275935fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bea943-559d8d584b-tgnws"
Sep 09 07:15:14.915808 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:15:14.915728    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-bea943-serving-cert: secret "maas-api-e2e-ipp-a-bea943-serving-cert" not found
Sep 09 07:15:14.915853 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:15:14.915818    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06914af0-be1b-4c31-bd1c-38b9275935fa-maas-api-tls podName:06914af0-be1b-4c31-bd1c-38b9275935fa nodeName:}" failed. No retries permitted until 2026-09-09 07:15:15.415798033 +0000 UTC m=+1450.207607353 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/06914af0-be1b-4c31-bd1c-38b9275935fa-maas-api-tls") pod "maas-api-e2e-ipp-a-bea943-559d8d584b-tgnws" (UID: "06914af0-be1b-4c31-bd1c-38b9275935fa") : secret "maas-api-e2e-ipp-a-bea943-serving-cert" not found
Sep 09 07:15:14.916097 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:14.916077    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06914af0-be1b-4c31-bd1c-38b9275935fa-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-bea943-559d8d584b-tgnws\" (UID: \"06914af0-be1b-4c31-bd1c-38b9275935fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bea943-559d8d584b-tgnws"
Sep 09 07:15:14.917999 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:14.917976    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/06914af0-be1b-4c31-bd1c-38b9275935fa-metrics-certs\") pod \"maas-api-e2e-ipp-a-bea943-559d8d584b-tgnws\" (UID: \"06914af0-be1b-4c31-bd1c-38b9275935fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bea943-559d8d584b-tgnws"
Sep 09 07:15:14.923848 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:14.923826    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9knrz\" (UniqueName: \"kubernetes.io/projected/06914af0-be1b-4c31-bd1c-38b9275935fa-kube-api-access-9knrz\") pod \"maas-api-e2e-ipp-a-bea943-559d8d584b-tgnws\" (UID: \"06914af0-be1b-4c31-bd1c-38b9275935fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bea943-559d8d584b-tgnws"
Sep 09 07:15:15.420758 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:15.420713    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06914af0-be1b-4c31-bd1c-38b9275935fa-maas-api-tls\") pod \"maas-api-e2e-ipp-a-bea943-559d8d584b-tgnws\" (UID: \"06914af0-be1b-4c31-bd1c-38b9275935fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bea943-559d8d584b-tgnws"
Sep 09 07:15:15.423288 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:15.423255    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06914af0-be1b-4c31-bd1c-38b9275935fa-maas-api-tls\") pod \"maas-api-e2e-ipp-a-bea943-559d8d584b-tgnws\" (UID: \"06914af0-be1b-4c31-bd1c-38b9275935fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bea943-559d8d584b-tgnws"
Sep 09 07:15:15.435538 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:15.435514    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-bea943-5d46ff47df-r7xkx"]
Sep 09 07:15:15.439426 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:15.439409    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-bea943-5d46ff47df-r7xkx"
Sep 09 07:15:15.442196 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:15.442173    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-bea943\""
Sep 09 07:15:15.442307 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:15.442206    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-bea943-dockercfg-zx55t\""
Sep 09 07:15:15.450398 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:15.450377    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-bea943-5d46ff47df-r7xkx"]
Sep 09 07:15:15.522117 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:15.522082    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4254\" (UniqueName: \"kubernetes.io/projected/60de8180-e864-473a-8186-a00f671a109b-kube-api-access-z4254\") pod \"payload-processing-e2e-ipp-a-bea943-5d46ff47df-r7xkx\" (UID: \"60de8180-e864-473a-8186-a00f671a109b\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-bea943-5d46ff47df-r7xkx"
Sep 09 07:15:15.522268 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:15.522145    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/60de8180-e864-473a-8186-a00f671a109b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-bea943-5d46ff47df-r7xkx\" (UID: \"60de8180-e864-473a-8186-a00f671a109b\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-bea943-5d46ff47df-r7xkx"
Sep 09 07:15:15.623278 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:15.623245    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4254\" (UniqueName: \"kubernetes.io/projected/60de8180-e864-473a-8186-a00f671a109b-kube-api-access-z4254\") pod \"payload-processing-e2e-ipp-a-bea943-5d46ff47df-r7xkx\" (UID: \"60de8180-e864-473a-8186-a00f671a109b\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-bea943-5d46ff47df-r7xkx"
Sep 09 07:15:15.623429 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:15.623301    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/60de8180-e864-473a-8186-a00f671a109b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-bea943-5d46ff47df-r7xkx\" (UID: \"60de8180-e864-473a-8186-a00f671a109b\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-bea943-5d46ff47df-r7xkx"
Sep 09 07:15:15.623935 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:15.623915    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/60de8180-e864-473a-8186-a00f671a109b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-bea943-5d46ff47df-r7xkx\" (UID: \"60de8180-e864-473a-8186-a00f671a109b\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-bea943-5d46ff47df-r7xkx"
Sep 09 07:15:15.632893 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:15.632870    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4254\" (UniqueName: \"kubernetes.io/projected/60de8180-e864-473a-8186-a00f671a109b-kube-api-access-z4254\") pod \"payload-processing-e2e-ipp-a-bea943-5d46ff47df-r7xkx\" (UID: \"60de8180-e864-473a-8186-a00f671a109b\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-bea943-5d46ff47df-r7xkx"
Sep 09 07:15:15.680774 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:15.680693    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bea943-559d8d584b-tgnws"
Sep 09 07:15:15.751126 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:15.751089    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-bea943-5d46ff47df-r7xkx"
Sep 09 07:15:15.960479 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:15.960458    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-bea943-559d8d584b-tgnws"]
Sep 09 07:15:15.962386 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:15:15.962359    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06914af0_be1b_4c31_bd1c_38b9275935fa.slice/crio-d1a9fcfb1dddc651cf26fb1413d387fbcd864a174ace765d254a64b6138a6f86 WatchSource:0}: Error finding container d1a9fcfb1dddc651cf26fb1413d387fbcd864a174ace765d254a64b6138a6f86: Status 404 returned error can't find the container with id d1a9fcfb1dddc651cf26fb1413d387fbcd864a174ace765d254a64b6138a6f86
Sep 09 07:15:16.025804 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:16.025776    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-bea943-5d46ff47df-r7xkx"]
Sep 09 07:15:16.027344 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:15:16.027317    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60de8180_e864_473a_8186_a00f671a109b.slice/crio-a36d07f31426e75546658e127138593c76e629269110f8984079af48267254f2 WatchSource:0}: Error finding container a36d07f31426e75546658e127138593c76e629269110f8984079af48267254f2: Status 404 returned error can't find the container with id a36d07f31426e75546658e127138593c76e629269110f8984079af48267254f2
Sep 09 07:15:16.701908 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:16.701870    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bea943-559d8d584b-tgnws" event={"ID":"06914af0-be1b-4c31-bd1c-38b9275935fa","Type":"ContainerStarted","Data":"d1a9fcfb1dddc651cf26fb1413d387fbcd864a174ace765d254a64b6138a6f86"}
Sep 09 07:15:16.703436 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:16.703408    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-bea943-5d46ff47df-r7xkx" event={"ID":"60de8180-e864-473a-8186-a00f671a109b","Type":"ContainerStarted","Data":"c55919bf84012043093b51a46ffdcacaa3413950851bda7d96d90a7b9398b294"}
Sep 09 07:15:16.703564 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:16.703457    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-bea943-5d46ff47df-r7xkx" event={"ID":"60de8180-e864-473a-8186-a00f671a109b","Type":"ContainerStarted","Data":"a36d07f31426e75546658e127138593c76e629269110f8984079af48267254f2"}
Sep 09 07:15:16.703564 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:16.703510    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-bea943-5d46ff47df-r7xkx"
Sep 09 07:15:16.733452 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:16.733387    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-bea943-5d46ff47df-r7xkx" podStartSLOduration=1.733359721 podStartE2EDuration="1.733359721s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 07:15:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 07:15:16.729877402 +0000 UTC m=+1451.521686738" watchObservedRunningTime="2026-09-09 07:15:16.733359721 +0000 UTC m=+1451.525169061"
Sep 09 07:15:17.712350 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:17.712317    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bea943-559d8d584b-tgnws" event={"ID":"06914af0-be1b-4c31-bd1c-38b9275935fa","Type":"ContainerStarted","Data":"44b4f098607604445ec96948f3a8b624e8b8956166dcdbf31d41f00e13ac093d"}
Sep 09 07:15:17.728260 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:17.728212    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bea943-559d8d584b-tgnws" podStartSLOduration=2.626948706 podStartE2EDuration="3.728196472s" totalImagesPullingTime="1.101247766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 07:15:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 07:15:17.726529566 +0000 UTC m=+1452.518338906" watchObservedRunningTime="2026-09-09 07:15:17.728196472 +0000 UTC m=+1452.520005811"
Sep 09 07:15:18.716258 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:18.716223    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bea943-559d8d584b-tgnws"
Sep 09 07:15:22.774506 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:22.774465    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-043f83-5c7dd78f98-n5znf"]
Sep 09 07:15:22.775002 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:22.774719    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-043f83-5c7dd78f98-n5znf" podUID="e3d77d61-531b-4c16-aa8c-c017f8b5ea0e" containerName="payload-pre-processing" containerID="cri-o://ae367c085af3d8ad64d486e48a3a60a50c0b699e7ae5f2db20b420c16e981b90" gracePeriod=30
Sep 09 07:15:23.035295 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:23.035243    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-043f83-5c7dd78f98-n5znf"
Sep 09 07:15:23.093427 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:23.093401    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3d77d61-531b-4c16-aa8c-c017f8b5ea0e-plugins-config-volume\") pod \"e3d77d61-531b-4c16-aa8c-c017f8b5ea0e\" (UID: \"e3d77d61-531b-4c16-aa8c-c017f8b5ea0e\") "
Sep 09 07:15:23.093606 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:23.093502    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5cfd9\" (UniqueName: \"kubernetes.io/projected/e3d77d61-531b-4c16-aa8c-c017f8b5ea0e-kube-api-access-5cfd9\") pod \"e3d77d61-531b-4c16-aa8c-c017f8b5ea0e\" (UID: \"e3d77d61-531b-4c16-aa8c-c017f8b5ea0e\") "
Sep 09 07:15:23.093788 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:23.093766    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3d77d61-531b-4c16-aa8c-c017f8b5ea0e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e3d77d61-531b-4c16-aa8c-c017f8b5ea0e" (UID: "e3d77d61-531b-4c16-aa8c-c017f8b5ea0e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 07:15:23.093879 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:23.093867    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3d77d61-531b-4c16-aa8c-c017f8b5ea0e-plugins-config-volume\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:15:23.095621 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:23.095589    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3d77d61-531b-4c16-aa8c-c017f8b5ea0e-kube-api-access-5cfd9" (OuterVolumeSpecName: "kube-api-access-5cfd9") pod "e3d77d61-531b-4c16-aa8c-c017f8b5ea0e" (UID: "e3d77d61-531b-4c16-aa8c-c017f8b5ea0e"). InnerVolumeSpecName "kube-api-access-5cfd9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 07:15:23.194611 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:23.194579    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5cfd9\" (UniqueName: \"kubernetes.io/projected/e3d77d61-531b-4c16-aa8c-c017f8b5ea0e-kube-api-access-5cfd9\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:15:23.743307 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:23.743277    2575 generic.go:356] "Generic (PLEG): container finished" podID="e3d77d61-531b-4c16-aa8c-c017f8b5ea0e" containerID="ae367c085af3d8ad64d486e48a3a60a50c0b699e7ae5f2db20b420c16e981b90" exitCode=0
Sep 09 07:15:23.743457 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:23.743315    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-043f83-5c7dd78f98-n5znf" event={"ID":"e3d77d61-531b-4c16-aa8c-c017f8b5ea0e","Type":"ContainerDied","Data":"ae367c085af3d8ad64d486e48a3a60a50c0b699e7ae5f2db20b420c16e981b90"}
Sep 09 07:15:23.743457 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:23.743371    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-043f83-5c7dd78f98-n5znf" event={"ID":"e3d77d61-531b-4c16-aa8c-c017f8b5ea0e","Type":"ContainerDied","Data":"de462ad218a46d7fe3715ea8ab0752d4d867a73261e53aa3c7539a16d11cc983"}
Sep 09 07:15:23.743457 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:23.743326    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-043f83-5c7dd78f98-n5znf"
Sep 09 07:15:23.743625 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:23.743403    2575 scope.go:117] "RemoveContainer" containerID="ae367c085af3d8ad64d486e48a3a60a50c0b699e7ae5f2db20b420c16e981b90"
Sep 09 07:15:23.758382 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:23.758345    2575 scope.go:117] "RemoveContainer" containerID="ae367c085af3d8ad64d486e48a3a60a50c0b699e7ae5f2db20b420c16e981b90"
Sep 09 07:15:23.758826 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:15:23.758791    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae367c085af3d8ad64d486e48a3a60a50c0b699e7ae5f2db20b420c16e981b90\": container with ID starting with ae367c085af3d8ad64d486e48a3a60a50c0b699e7ae5f2db20b420c16e981b90 not found: ID does not exist" containerID="ae367c085af3d8ad64d486e48a3a60a50c0b699e7ae5f2db20b420c16e981b90"
Sep 09 07:15:23.758908 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:23.758842    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae367c085af3d8ad64d486e48a3a60a50c0b699e7ae5f2db20b420c16e981b90"} err="failed to get container status \"ae367c085af3d8ad64d486e48a3a60a50c0b699e7ae5f2db20b420c16e981b90\": rpc error: code = NotFound desc = could not find container \"ae367c085af3d8ad64d486e48a3a60a50c0b699e7ae5f2db20b420c16e981b90\": container with ID starting with ae367c085af3d8ad64d486e48a3a60a50c0b699e7ae5f2db20b420c16e981b90 not found: ID does not exist"
Sep 09 07:15:23.764222 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:23.764201    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-043f83-5c7dd78f98-n5znf"]
Sep 09 07:15:23.769519 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:23.769498    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-043f83-5c7dd78f98-n5znf"]
Sep 09 07:15:24.726706 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:24.726676    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bea943-559d8d584b-tgnws"
Sep 09 07:15:24.739242 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:24.739185    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-988b24/rate-test-model-988b24-kserve-577dcbd587-shdrc" podUID="c1c8e839-2a29-4ec9-aba2-5124ae29ee58" containerName="main" containerID="cri-o://392f94958616028956fc90c7927b74de996c00b0b90d14c2233d73e957032e3f" gracePeriod=45
Sep 09 07:15:24.992359 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:24.992299    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-988b24/rate-test-model-988b24-kserve-577dcbd587-shdrc"
Sep 09 07:15:25.119395 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:25.119364    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1c8e839-2a29-4ec9-aba2-5124ae29ee58-tls-certs\") pod \"c1c8e839-2a29-4ec9-aba2-5124ae29ee58\" (UID: \"c1c8e839-2a29-4ec9-aba2-5124ae29ee58\") "
Sep 09 07:15:25.119550 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:25.119421    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1c8e839-2a29-4ec9-aba2-5124ae29ee58-home\") pod \"c1c8e839-2a29-4ec9-aba2-5124ae29ee58\" (UID: \"c1c8e839-2a29-4ec9-aba2-5124ae29ee58\") "
Sep 09 07:15:25.119550 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:25.119453    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1c8e839-2a29-4ec9-aba2-5124ae29ee58-dshm\") pod \"c1c8e839-2a29-4ec9-aba2-5124ae29ee58\" (UID: \"c1c8e839-2a29-4ec9-aba2-5124ae29ee58\") "
Sep 09 07:15:25.119550 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:25.119501    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t6knj\" (UniqueName: \"kubernetes.io/projected/c1c8e839-2a29-4ec9-aba2-5124ae29ee58-kube-api-access-t6knj\") pod \"c1c8e839-2a29-4ec9-aba2-5124ae29ee58\" (UID: \"c1c8e839-2a29-4ec9-aba2-5124ae29ee58\") "
Sep 09 07:15:25.119710 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:25.119548    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1c8e839-2a29-4ec9-aba2-5124ae29ee58-model-cache\") pod \"c1c8e839-2a29-4ec9-aba2-5124ae29ee58\" (UID: \"c1c8e839-2a29-4ec9-aba2-5124ae29ee58\") "
Sep 09 07:15:25.119710 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:25.119586    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1c8e839-2a29-4ec9-aba2-5124ae29ee58-tmp-dir\") pod \"c1c8e839-2a29-4ec9-aba2-5124ae29ee58\" (UID: \"c1c8e839-2a29-4ec9-aba2-5124ae29ee58\") "
Sep 09 07:15:25.119710 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:25.119675    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1c8e839-2a29-4ec9-aba2-5124ae29ee58-home" (OuterVolumeSpecName: "home") pod "c1c8e839-2a29-4ec9-aba2-5124ae29ee58" (UID: "c1c8e839-2a29-4ec9-aba2-5124ae29ee58"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 07:15:25.119917 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:25.119848    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1c8e839-2a29-4ec9-aba2-5124ae29ee58-model-cache" (OuterVolumeSpecName: "model-cache") pod "c1c8e839-2a29-4ec9-aba2-5124ae29ee58" (UID: "c1c8e839-2a29-4ec9-aba2-5124ae29ee58"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 07:15:25.119917 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:25.119885    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1c8e839-2a29-4ec9-aba2-5124ae29ee58-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c1c8e839-2a29-4ec9-aba2-5124ae29ee58" (UID: "c1c8e839-2a29-4ec9-aba2-5124ae29ee58"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 07:15:25.120002 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:25.119985    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1c8e839-2a29-4ec9-aba2-5124ae29ee58-home\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:15:25.120002 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:25.119997    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1c8e839-2a29-4ec9-aba2-5124ae29ee58-model-cache\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:15:25.120083 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:25.120007    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1c8e839-2a29-4ec9-aba2-5124ae29ee58-tmp-dir\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:15:25.121829 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:25.121799    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1c8e839-2a29-4ec9-aba2-5124ae29ee58-dshm" (OuterVolumeSpecName: "dshm") pod "c1c8e839-2a29-4ec9-aba2-5124ae29ee58" (UID: "c1c8e839-2a29-4ec9-aba2-5124ae29ee58"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 07:15:25.122333 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:25.122311    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1c8e839-2a29-4ec9-aba2-5124ae29ee58-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c1c8e839-2a29-4ec9-aba2-5124ae29ee58" (UID: "c1c8e839-2a29-4ec9-aba2-5124ae29ee58"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 07:15:25.122427 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:25.122326    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1c8e839-2a29-4ec9-aba2-5124ae29ee58-kube-api-access-t6knj" (OuterVolumeSpecName: "kube-api-access-t6knj") pod "c1c8e839-2a29-4ec9-aba2-5124ae29ee58" (UID: "c1c8e839-2a29-4ec9-aba2-5124ae29ee58"). InnerVolumeSpecName "kube-api-access-t6knj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 07:15:25.220519 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:25.220494    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1c8e839-2a29-4ec9-aba2-5124ae29ee58-dshm\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:15:25.220622 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:25.220520    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6knj\" (UniqueName: \"kubernetes.io/projected/c1c8e839-2a29-4ec9-aba2-5124ae29ee58-kube-api-access-t6knj\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:15:25.220622 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:25.220535    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1c8e839-2a29-4ec9-aba2-5124ae29ee58-tls-certs\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:15:25.713662 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:25.713626    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3d77d61-531b-4c16-aa8c-c017f8b5ea0e" path="/var/lib/kubelet/pods/e3d77d61-531b-4c16-aa8c-c017f8b5ea0e/volumes"
Sep 09 07:15:25.757256 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:25.757227    2575 generic.go:356] "Generic (PLEG): container finished" podID="c1c8e839-2a29-4ec9-aba2-5124ae29ee58" containerID="392f94958616028956fc90c7927b74de996c00b0b90d14c2233d73e957032e3f" exitCode=0
Sep 09 07:15:25.757634 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:25.757278    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-988b24/rate-test-model-988b24-kserve-577dcbd587-shdrc"
Sep 09 07:15:25.757634 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:25.757306    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-988b24/rate-test-model-988b24-kserve-577dcbd587-shdrc" event={"ID":"c1c8e839-2a29-4ec9-aba2-5124ae29ee58","Type":"ContainerDied","Data":"392f94958616028956fc90c7927b74de996c00b0b90d14c2233d73e957032e3f"}
Sep 09 07:15:25.757634 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:25.757344    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-988b24/rate-test-model-988b24-kserve-577dcbd587-shdrc" event={"ID":"c1c8e839-2a29-4ec9-aba2-5124ae29ee58","Type":"ContainerDied","Data":"c3d388baa1719bfa17b175b4905865c0ccdae85baca859742d0e83711cd8f012"}
Sep 09 07:15:25.757634 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:25.757361    2575 scope.go:117] "RemoveContainer" containerID="392f94958616028956fc90c7927b74de996c00b0b90d14c2233d73e957032e3f"
Sep 09 07:15:25.766858 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:25.766839    2575 scope.go:117] "RemoveContainer" containerID="392f94958616028956fc90c7927b74de996c00b0b90d14c2233d73e957032e3f"
Sep 09 07:15:25.767128 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:15:25.767108    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"392f94958616028956fc90c7927b74de996c00b0b90d14c2233d73e957032e3f\": container with ID starting with 392f94958616028956fc90c7927b74de996c00b0b90d14c2233d73e957032e3f not found: ID does not exist" containerID="392f94958616028956fc90c7927b74de996c00b0b90d14c2233d73e957032e3f"
Sep 09 07:15:25.767211 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:25.767152    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"392f94958616028956fc90c7927b74de996c00b0b90d14c2233d73e957032e3f"} err="failed to get container status \"392f94958616028956fc90c7927b74de996c00b0b90d14c2233d73e957032e3f\": rpc error: code = NotFound desc = could not find container \"392f94958616028956fc90c7927b74de996c00b0b90d14c2233d73e957032e3f\": container with ID starting with 392f94958616028956fc90c7927b74de996c00b0b90d14c2233d73e957032e3f not found: ID does not exist"
Sep 09 07:15:25.774987 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:25.774964    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-988b24/rate-test-model-988b24-kserve-577dcbd587-shdrc"]
Sep 09 07:15:25.778919 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:25.778899    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-988b24/rate-test-model-988b24-kserve-577dcbd587-shdrc"]
Sep 09 07:15:27.712571 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:27.712540    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1c8e839-2a29-4ec9-aba2-5124ae29ee58" path="/var/lib/kubelet/pods/c1c8e839-2a29-4ec9-aba2-5124ae29ee58/volumes"
Sep 09 07:15:27.713075 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:27.713059    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-bea943-5d46ff47df-r7xkx"
Sep 09 07:15:46.319499 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:46.319463    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-d8398c-7bb4654f5c-nvg5r"]
Sep 09 07:15:46.320021 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:46.319690    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d8398c-7bb4654f5c-nvg5r" podUID="8f1dbc01-cdbc-481b-8c31-5952f83f37ff" containerName="maas-api" containerID="cri-o://219af378e8daf50ef62b30a43acec57f45daa8b4915f3315d319a9b6928aea98" gracePeriod=30
Sep 09 07:15:46.354609 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:46.354565    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-d8398c-29815635-pt4vg"]
Sep 09 07:15:46.356784 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:46.356740    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-d8398c-29815635-pt4vg"]
Sep 09 07:15:46.570253 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:46.570197    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d8398c-7bb4654f5c-nvg5r"
Sep 09 07:15:46.606382 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:46.606353    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mvbw2\" (UniqueName: \"kubernetes.io/projected/8f1dbc01-cdbc-481b-8c31-5952f83f37ff-kube-api-access-mvbw2\") pod \"8f1dbc01-cdbc-481b-8c31-5952f83f37ff\" (UID: \"8f1dbc01-cdbc-481b-8c31-5952f83f37ff\") "
Sep 09 07:15:46.606561 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:46.606461    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f1dbc01-cdbc-481b-8c31-5952f83f37ff-metrics-certs\") pod \"8f1dbc01-cdbc-481b-8c31-5952f83f37ff\" (UID: \"8f1dbc01-cdbc-481b-8c31-5952f83f37ff\") "
Sep 09 07:15:46.606561 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:46.606497    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f1dbc01-cdbc-481b-8c31-5952f83f37ff-maas-api-tls\") pod \"8f1dbc01-cdbc-481b-8c31-5952f83f37ff\" (UID: \"8f1dbc01-cdbc-481b-8c31-5952f83f37ff\") "
Sep 09 07:15:46.606669 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:46.606606    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f1dbc01-cdbc-481b-8c31-5952f83f37ff-openshift-service-ca\") pod \"8f1dbc01-cdbc-481b-8c31-5952f83f37ff\" (UID: \"8f1dbc01-cdbc-481b-8c31-5952f83f37ff\") "
Sep 09 07:15:46.607125 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:46.607090    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f1dbc01-cdbc-481b-8c31-5952f83f37ff-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8f1dbc01-cdbc-481b-8c31-5952f83f37ff" (UID: "8f1dbc01-cdbc-481b-8c31-5952f83f37ff"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 07:15:46.609367 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:46.609325    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f1dbc01-cdbc-481b-8c31-5952f83f37ff-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8f1dbc01-cdbc-481b-8c31-5952f83f37ff" (UID: "8f1dbc01-cdbc-481b-8c31-5952f83f37ff"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 07:15:46.609599 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:46.609573    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f1dbc01-cdbc-481b-8c31-5952f83f37ff-kube-api-access-mvbw2" (OuterVolumeSpecName: "kube-api-access-mvbw2") pod "8f1dbc01-cdbc-481b-8c31-5952f83f37ff" (UID: "8f1dbc01-cdbc-481b-8c31-5952f83f37ff"). InnerVolumeSpecName "kube-api-access-mvbw2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 07:15:46.609599 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:46.609593    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f1dbc01-cdbc-481b-8c31-5952f83f37ff-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8f1dbc01-cdbc-481b-8c31-5952f83f37ff" (UID: "8f1dbc01-cdbc-481b-8c31-5952f83f37ff"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 07:15:46.708347 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:46.708314    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mvbw2\" (UniqueName: \"kubernetes.io/projected/8f1dbc01-cdbc-481b-8c31-5952f83f37ff-kube-api-access-mvbw2\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:15:46.708347 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:46.708343    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f1dbc01-cdbc-481b-8c31-5952f83f37ff-metrics-certs\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:15:46.708347 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:46.708352    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f1dbc01-cdbc-481b-8c31-5952f83f37ff-maas-api-tls\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:15:46.708565 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:46.708360    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f1dbc01-cdbc-481b-8c31-5952f83f37ff-openshift-service-ca\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:15:46.869321 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:46.869235    2575 generic.go:356] "Generic (PLEG): container finished" podID="8f1dbc01-cdbc-481b-8c31-5952f83f37ff" containerID="219af378e8daf50ef62b30a43acec57f45daa8b4915f3315d319a9b6928aea98" exitCode=0
Sep 09 07:15:46.869321 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:46.869275    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d8398c-7bb4654f5c-nvg5r" event={"ID":"8f1dbc01-cdbc-481b-8c31-5952f83f37ff","Type":"ContainerDied","Data":"219af378e8daf50ef62b30a43acec57f45daa8b4915f3315d319a9b6928aea98"}
Sep 09 07:15:46.869321 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:46.869282    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d8398c-7bb4654f5c-nvg5r"
Sep 09 07:15:46.869321 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:46.869318    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d8398c-7bb4654f5c-nvg5r" event={"ID":"8f1dbc01-cdbc-481b-8c31-5952f83f37ff","Type":"ContainerDied","Data":"05beffab6f1f50820babc21704f975bfc0621bd29300e99df0ffc116e333d3af"}
Sep 09 07:15:46.869592 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:46.869339    2575 scope.go:117] "RemoveContainer" containerID="219af378e8daf50ef62b30a43acec57f45daa8b4915f3315d319a9b6928aea98"
Sep 09 07:15:46.878543 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:46.878514    2575 scope.go:117] "RemoveContainer" containerID="219af378e8daf50ef62b30a43acec57f45daa8b4915f3315d319a9b6928aea98"
Sep 09 07:15:46.878830 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:15:46.878812    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"219af378e8daf50ef62b30a43acec57f45daa8b4915f3315d319a9b6928aea98\": container with ID starting with 219af378e8daf50ef62b30a43acec57f45daa8b4915f3315d319a9b6928aea98 not found: ID does not exist" containerID="219af378e8daf50ef62b30a43acec57f45daa8b4915f3315d319a9b6928aea98"
Sep 09 07:15:46.878909 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:46.878839    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"219af378e8daf50ef62b30a43acec57f45daa8b4915f3315d319a9b6928aea98"} err="failed to get container status \"219af378e8daf50ef62b30a43acec57f45daa8b4915f3315d319a9b6928aea98\": rpc error: code = NotFound desc = could not find container \"219af378e8daf50ef62b30a43acec57f45daa8b4915f3315d319a9b6928aea98\": container with ID starting with 219af378e8daf50ef62b30a43acec57f45daa8b4915f3315d319a9b6928aea98 not found: ID does not exist"
Sep 09 07:15:46.891811 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:46.891785    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-d8398c-7bb4654f5c-nvg5r"]
Sep 09 07:15:46.895584 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:46.895565    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-d8398c-7bb4654f5c-nvg5r"]
Sep 09 07:15:47.712572 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:47.712540    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="185a0743-1e18-48d1-8aed-d9aee3753bc3" path="/var/lib/kubelet/pods/185a0743-1e18-48d1-8aed-d9aee3753bc3/volumes"
Sep 09 07:15:47.712971 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:15:47.712955    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f1dbc01-cdbc-481b-8c31-5952f83f37ff" path="/var/lib/kubelet/pods/8f1dbc01-cdbc-481b-8c31-5952f83f37ff/volumes"
Sep 09 07:16:04.559266 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:04.559229    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-1128ac-29815635-mdvn7"]
Sep 09 07:16:04.561236 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:04.561206    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-1128ac-29815635-mdvn7"]
Sep 09 07:16:04.587735 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:04.587706    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-1128ac-75f8dd598f-s7zgg"]
Sep 09 07:16:04.588014 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:04.587969    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-1128ac-75f8dd598f-s7zgg" podUID="64a12175-3c1c-4013-9a66-07757d81c3f0" containerName="payload-processing" containerID="cri-o://3fe790230656c1f3da1a44307f3a525668a6ea64b3c2735b23fe80d480b6f2a0" gracePeriod=30
Sep 09 07:16:04.593463 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:04.593437    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1128ac-cd99d78f4-hj2fg"]
Sep 09 07:16:04.593831 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:04.593804    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1128ac-cd99d78f4-hj2fg" podUID="f5ded2f4-2cf7-46f0-8e6a-58c5dceaae8c" containerName="payload-pre-processing" containerID="cri-o://27ee54a7302d35950698c93a98f42c8e07de9fbab140e0748ba8fac4d46093d6" gracePeriod=30
Sep 09 07:16:04.855680 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:04.855649    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-1128ac-75f8dd598f-s7zgg"
Sep 09 07:16:04.883851 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:04.883818    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1128ac-cd99d78f4-hj2fg"
Sep 09 07:16:04.965143 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:04.965111    2575 generic.go:356] "Generic (PLEG): container finished" podID="f5ded2f4-2cf7-46f0-8e6a-58c5dceaae8c" containerID="27ee54a7302d35950698c93a98f42c8e07de9fbab140e0748ba8fac4d46093d6" exitCode=0
Sep 09 07:16:04.965296 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:04.965148    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1128ac-cd99d78f4-hj2fg"
Sep 09 07:16:04.965296 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:04.965196    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1128ac-cd99d78f4-hj2fg" event={"ID":"f5ded2f4-2cf7-46f0-8e6a-58c5dceaae8c","Type":"ContainerDied","Data":"27ee54a7302d35950698c93a98f42c8e07de9fbab140e0748ba8fac4d46093d6"}
Sep 09 07:16:04.965296 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:04.965242    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1128ac-cd99d78f4-hj2fg" event={"ID":"f5ded2f4-2cf7-46f0-8e6a-58c5dceaae8c","Type":"ContainerDied","Data":"04422fd2b798928fffec827f8997f846b6e9a5aafe384a456f661d2b2234e7d1"}
Sep 09 07:16:04.965296 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:04.965263    2575 scope.go:117] "RemoveContainer" containerID="27ee54a7302d35950698c93a98f42c8e07de9fbab140e0748ba8fac4d46093d6"
Sep 09 07:16:04.966501 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:04.966480    2575 generic.go:356] "Generic (PLEG): container finished" podID="64a12175-3c1c-4013-9a66-07757d81c3f0" containerID="3fe790230656c1f3da1a44307f3a525668a6ea64b3c2735b23fe80d480b6f2a0" exitCode=0
Sep 09 07:16:04.966586 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:04.966517    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-1128ac-75f8dd598f-s7zgg"
Sep 09 07:16:04.966586 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:04.966563    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-1128ac-75f8dd598f-s7zgg" event={"ID":"64a12175-3c1c-4013-9a66-07757d81c3f0","Type":"ContainerDied","Data":"3fe790230656c1f3da1a44307f3a525668a6ea64b3c2735b23fe80d480b6f2a0"}
Sep 09 07:16:04.966668 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:04.966618    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-1128ac-75f8dd598f-s7zgg" event={"ID":"64a12175-3c1c-4013-9a66-07757d81c3f0","Type":"ContainerDied","Data":"a2740b34936635745df3a20fa58251eecc14e375ec2443545eedc839433bccf0"}
Sep 09 07:16:04.971877 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:04.971857    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mw846\" (UniqueName: \"kubernetes.io/projected/f5ded2f4-2cf7-46f0-8e6a-58c5dceaae8c-kube-api-access-mw846\") pod \"f5ded2f4-2cf7-46f0-8e6a-58c5dceaae8c\" (UID: \"f5ded2f4-2cf7-46f0-8e6a-58c5dceaae8c\") "
Sep 09 07:16:04.971994 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:04.971899    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64a12175-3c1c-4013-9a66-07757d81c3f0-plugins-config-volume\") pod \"64a12175-3c1c-4013-9a66-07757d81c3f0\" (UID: \"64a12175-3c1c-4013-9a66-07757d81c3f0\") "
Sep 09 07:16:04.971994 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:04.971924    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5ded2f4-2cf7-46f0-8e6a-58c5dceaae8c-plugins-config-volume\") pod \"f5ded2f4-2cf7-46f0-8e6a-58c5dceaae8c\" (UID: \"f5ded2f4-2cf7-46f0-8e6a-58c5dceaae8c\") "
Sep 09 07:16:04.971994 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:04.971954    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2btj9\" (UniqueName: \"kubernetes.io/projected/64a12175-3c1c-4013-9a66-07757d81c3f0-kube-api-access-2btj9\") pod \"64a12175-3c1c-4013-9a66-07757d81c3f0\" (UID: \"64a12175-3c1c-4013-9a66-07757d81c3f0\") "
Sep 09 07:16:04.972313 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:04.972285    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64a12175-3c1c-4013-9a66-07757d81c3f0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "64a12175-3c1c-4013-9a66-07757d81c3f0" (UID: "64a12175-3c1c-4013-9a66-07757d81c3f0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 07:16:04.972409 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:04.972285    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5ded2f4-2cf7-46f0-8e6a-58c5dceaae8c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f5ded2f4-2cf7-46f0-8e6a-58c5dceaae8c" (UID: "f5ded2f4-2cf7-46f0-8e6a-58c5dceaae8c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 07:16:04.974076 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:04.974054    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64a12175-3c1c-4013-9a66-07757d81c3f0-kube-api-access-2btj9" (OuterVolumeSpecName: "kube-api-access-2btj9") pod "64a12175-3c1c-4013-9a66-07757d81c3f0" (UID: "64a12175-3c1c-4013-9a66-07757d81c3f0"). InnerVolumeSpecName "kube-api-access-2btj9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 07:16:04.974553 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:04.974535    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5ded2f4-2cf7-46f0-8e6a-58c5dceaae8c-kube-api-access-mw846" (OuterVolumeSpecName: "kube-api-access-mw846") pod "f5ded2f4-2cf7-46f0-8e6a-58c5dceaae8c" (UID: "f5ded2f4-2cf7-46f0-8e6a-58c5dceaae8c"). InnerVolumeSpecName "kube-api-access-mw846". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 07:16:04.975103 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:04.975081    2575 scope.go:117] "RemoveContainer" containerID="27ee54a7302d35950698c93a98f42c8e07de9fbab140e0748ba8fac4d46093d6"
Sep 09 07:16:04.975385 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:16:04.975367    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27ee54a7302d35950698c93a98f42c8e07de9fbab140e0748ba8fac4d46093d6\": container with ID starting with 27ee54a7302d35950698c93a98f42c8e07de9fbab140e0748ba8fac4d46093d6 not found: ID does not exist" containerID="27ee54a7302d35950698c93a98f42c8e07de9fbab140e0748ba8fac4d46093d6"
Sep 09 07:16:04.975437 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:04.975398    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27ee54a7302d35950698c93a98f42c8e07de9fbab140e0748ba8fac4d46093d6"} err="failed to get container status \"27ee54a7302d35950698c93a98f42c8e07de9fbab140e0748ba8fac4d46093d6\": rpc error: code = NotFound desc = could not find container \"27ee54a7302d35950698c93a98f42c8e07de9fbab140e0748ba8fac4d46093d6\": container with ID starting with 27ee54a7302d35950698c93a98f42c8e07de9fbab140e0748ba8fac4d46093d6 not found: ID does not exist"
Sep 09 07:16:04.975437 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:04.975415    2575 scope.go:117] "RemoveContainer" containerID="3fe790230656c1f3da1a44307f3a525668a6ea64b3c2735b23fe80d480b6f2a0"
Sep 09 07:16:04.982936 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:04.982922    2575 scope.go:117] "RemoveContainer" containerID="3fe790230656c1f3da1a44307f3a525668a6ea64b3c2735b23fe80d480b6f2a0"
Sep 09 07:16:04.983188 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:16:04.983171    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fe790230656c1f3da1a44307f3a525668a6ea64b3c2735b23fe80d480b6f2a0\": container with ID starting with 3fe790230656c1f3da1a44307f3a525668a6ea64b3c2735b23fe80d480b6f2a0 not found: ID does not exist" containerID="3fe790230656c1f3da1a44307f3a525668a6ea64b3c2735b23fe80d480b6f2a0"
Sep 09 07:16:04.983246 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:04.983194    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fe790230656c1f3da1a44307f3a525668a6ea64b3c2735b23fe80d480b6f2a0"} err="failed to get container status \"3fe790230656c1f3da1a44307f3a525668a6ea64b3c2735b23fe80d480b6f2a0\": rpc error: code = NotFound desc = could not find container \"3fe790230656c1f3da1a44307f3a525668a6ea64b3c2735b23fe80d480b6f2a0\": container with ID starting with 3fe790230656c1f3da1a44307f3a525668a6ea64b3c2735b23fe80d480b6f2a0 not found: ID does not exist"
Sep 09 07:16:05.073267 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:05.073240    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64a12175-3c1c-4013-9a66-07757d81c3f0-plugins-config-volume\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:16:05.073267 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:05.073264    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5ded2f4-2cf7-46f0-8e6a-58c5dceaae8c-plugins-config-volume\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:16:05.073397 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:05.073274    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2btj9\" (UniqueName: \"kubernetes.io/projected/64a12175-3c1c-4013-9a66-07757d81c3f0-kube-api-access-2btj9\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:16:05.073397 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:05.073283    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mw846\" (UniqueName: \"kubernetes.io/projected/f5ded2f4-2cf7-46f0-8e6a-58c5dceaae8c-kube-api-access-mw846\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:16:05.295755 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:05.295712    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-1128ac-75f8dd598f-s7zgg"]
Sep 09 07:16:05.299213 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:05.299189    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-1128ac-75f8dd598f-s7zgg"]
Sep 09 07:16:05.309529 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:05.309502    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1128ac-cd99d78f4-hj2fg"]
Sep 09 07:16:05.313786 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:05.313691    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1128ac-cd99d78f4-hj2fg"]
Sep 09 07:16:05.712166 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:05.712135    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14ee9251-2938-4217-959c-8288b2c26c24" path="/var/lib/kubelet/pods/14ee9251-2938-4217-959c-8288b2c26c24/volumes"
Sep 09 07:16:05.712597 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:05.712580    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64a12175-3c1c-4013-9a66-07757d81c3f0" path="/var/lib/kubelet/pods/64a12175-3c1c-4013-9a66-07757d81c3f0/volumes"
Sep 09 07:16:05.713040 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:05.713021    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5ded2f4-2cf7-46f0-8e6a-58c5dceaae8c" path="/var/lib/kubelet/pods/f5ded2f4-2cf7-46f0-8e6a-58c5dceaae8c/volumes"
Sep 09 07:16:13.990778 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:13.990703    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-nwl5f_8f6df0b4-4f64-41b6-9c1b-bad76413aae3/payload-processing/0.log"
Sep 09 07:16:22.571957 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:22.571920    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-1d8843-29815635-q7d29"]
Sep 09 07:16:22.574261 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:22.574238    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-1d8843-29815635-q7d29"]
Sep 09 07:16:22.602520 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:22.602486    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-1d8843-754d4f4595-7qt5p"]
Sep 09 07:16:22.602831 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:22.602785    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-1d8843-754d4f4595-7qt5p" podUID="7088b1dc-cdb0-4bb8-afc0-11162e65217a" containerName="payload-processing" containerID="cri-o://58c7deb2f627cf99c04b372625d2f2f3706c4aa97660c509c1759dd6a93b0d28" gracePeriod=30
Sep 09 07:16:22.859415 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:22.859391    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-1d8843-754d4f4595-7qt5p"
Sep 09 07:16:22.942678 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:22.942644    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7088b1dc-cdb0-4bb8-afc0-11162e65217a-plugins-config-volume\") pod \"7088b1dc-cdb0-4bb8-afc0-11162e65217a\" (UID: \"7088b1dc-cdb0-4bb8-afc0-11162e65217a\") "
Sep 09 07:16:22.942678 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:22.942681    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bkgv6\" (UniqueName: \"kubernetes.io/projected/7088b1dc-cdb0-4bb8-afc0-11162e65217a-kube-api-access-bkgv6\") pod \"7088b1dc-cdb0-4bb8-afc0-11162e65217a\" (UID: \"7088b1dc-cdb0-4bb8-afc0-11162e65217a\") "
Sep 09 07:16:22.943110 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:22.943080    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7088b1dc-cdb0-4bb8-afc0-11162e65217a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7088b1dc-cdb0-4bb8-afc0-11162e65217a" (UID: "7088b1dc-cdb0-4bb8-afc0-11162e65217a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 07:16:22.944884 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:22.944861    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7088b1dc-cdb0-4bb8-afc0-11162e65217a-kube-api-access-bkgv6" (OuterVolumeSpecName: "kube-api-access-bkgv6") pod "7088b1dc-cdb0-4bb8-afc0-11162e65217a" (UID: "7088b1dc-cdb0-4bb8-afc0-11162e65217a"). InnerVolumeSpecName "kube-api-access-bkgv6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 07:16:23.043519 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:23.043480    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7088b1dc-cdb0-4bb8-afc0-11162e65217a-plugins-config-volume\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:16:23.043519 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:23.043514    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bkgv6\" (UniqueName: \"kubernetes.io/projected/7088b1dc-cdb0-4bb8-afc0-11162e65217a-kube-api-access-bkgv6\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:16:23.065882 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:23.065844    2575 generic.go:356] "Generic (PLEG): container finished" podID="7088b1dc-cdb0-4bb8-afc0-11162e65217a" containerID="58c7deb2f627cf99c04b372625d2f2f3706c4aa97660c509c1759dd6a93b0d28" exitCode=0
Sep 09 07:16:23.066039 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:23.065889    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-1d8843-754d4f4595-7qt5p"
Sep 09 07:16:23.066039 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:23.065930    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-1d8843-754d4f4595-7qt5p" event={"ID":"7088b1dc-cdb0-4bb8-afc0-11162e65217a","Type":"ContainerDied","Data":"58c7deb2f627cf99c04b372625d2f2f3706c4aa97660c509c1759dd6a93b0d28"}
Sep 09 07:16:23.066039 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:23.065980    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-1d8843-754d4f4595-7qt5p" event={"ID":"7088b1dc-cdb0-4bb8-afc0-11162e65217a","Type":"ContainerDied","Data":"9996915383b8e53fa491ba2113d7a1362a03f39ec0e73596aca0c13c9a622885"}
Sep 09 07:16:23.066039 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:23.066001    2575 scope.go:117] "RemoveContainer" containerID="58c7deb2f627cf99c04b372625d2f2f3706c4aa97660c509c1759dd6a93b0d28"
Sep 09 07:16:23.075384 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:23.075367    2575 scope.go:117] "RemoveContainer" containerID="58c7deb2f627cf99c04b372625d2f2f3706c4aa97660c509c1759dd6a93b0d28"
Sep 09 07:16:23.075665 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:16:23.075649    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58c7deb2f627cf99c04b372625d2f2f3706c4aa97660c509c1759dd6a93b0d28\": container with ID starting with 58c7deb2f627cf99c04b372625d2f2f3706c4aa97660c509c1759dd6a93b0d28 not found: ID does not exist" containerID="58c7deb2f627cf99c04b372625d2f2f3706c4aa97660c509c1759dd6a93b0d28"
Sep 09 07:16:23.075710 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:23.075672    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58c7deb2f627cf99c04b372625d2f2f3706c4aa97660c509c1759dd6a93b0d28"} err="failed to get container status \"58c7deb2f627cf99c04b372625d2f2f3706c4aa97660c509c1759dd6a93b0d28\": rpc error: code = NotFound desc = could not find container \"58c7deb2f627cf99c04b372625d2f2f3706c4aa97660c509c1759dd6a93b0d28\": container with ID starting with 58c7deb2f627cf99c04b372625d2f2f3706c4aa97660c509c1759dd6a93b0d28 not found: ID does not exist"
Sep 09 07:16:23.087524 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:23.087499    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-1d8843-754d4f4595-7qt5p"]
Sep 09 07:16:23.091895 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:23.091845    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-1d8843-754d4f4595-7qt5p"]
Sep 09 07:16:23.714115 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:23.714078    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c4149de-7e16-4771-b695-bb2dfd024177" path="/var/lib/kubelet/pods/0c4149de-7e16-4771-b695-bb2dfd024177/volumes"
Sep 09 07:16:23.714563 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:23.714545    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7088b1dc-cdb0-4bb8-afc0-11162e65217a" path="/var/lib/kubelet/pods/7088b1dc-cdb0-4bb8-afc0-11162e65217a/volumes"
Sep 09 07:16:25.828576 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:25.828545    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-bea943/ipp-route-bea943-kserve-54d4949d75-qn4jb"]
Sep 09 07:16:25.829151 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:25.829130    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f1dbc01-cdbc-481b-8c31-5952f83f37ff" containerName="maas-api"
Sep 09 07:16:25.829235 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:25.829154    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f1dbc01-cdbc-481b-8c31-5952f83f37ff" containerName="maas-api"
Sep 09 07:16:25.829235 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:25.829169    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3d77d61-531b-4c16-aa8c-c017f8b5ea0e" containerName="payload-pre-processing"
Sep 09 07:16:25.829235 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:25.829181    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3d77d61-531b-4c16-aa8c-c017f8b5ea0e" containerName="payload-pre-processing"
Sep 09 07:16:25.829235 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:25.829194    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64a12175-3c1c-4013-9a66-07757d81c3f0" containerName="payload-processing"
Sep 09 07:16:25.829235 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:25.829202    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="64a12175-3c1c-4013-9a66-07757d81c3f0" containerName="payload-processing"
Sep 09 07:16:25.829235 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:25.829228    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7088b1dc-cdb0-4bb8-afc0-11162e65217a" containerName="payload-processing"
Sep 09 07:16:25.829235 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:25.829236    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7088b1dc-cdb0-4bb8-afc0-11162e65217a" containerName="payload-processing"
Sep 09 07:16:25.829592 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:25.829245    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1c8e839-2a29-4ec9-aba2-5124ae29ee58" containerName="main"
Sep 09 07:16:25.829592 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:25.829253    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1c8e839-2a29-4ec9-aba2-5124ae29ee58" containerName="main"
Sep 09 07:16:25.829592 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:25.829263    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5ded2f4-2cf7-46f0-8e6a-58c5dceaae8c" containerName="payload-pre-processing"
Sep 09 07:16:25.829592 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:25.829271    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5ded2f4-2cf7-46f0-8e6a-58c5dceaae8c" containerName="payload-pre-processing"
Sep 09 07:16:25.829592 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:25.829371    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7088b1dc-cdb0-4bb8-afc0-11162e65217a" containerName="payload-processing"
Sep 09 07:16:25.829592 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:25.829386    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f1dbc01-cdbc-481b-8c31-5952f83f37ff" containerName="maas-api"
Sep 09 07:16:25.829592 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:25.829398    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5ded2f4-2cf7-46f0-8e6a-58c5dceaae8c" containerName="payload-pre-processing"
Sep 09 07:16:25.829592 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:25.829409    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3d77d61-531b-4c16-aa8c-c017f8b5ea0e" containerName="payload-pre-processing"
Sep 09 07:16:25.829592 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:25.829417    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1c8e839-2a29-4ec9-aba2-5124ae29ee58" containerName="main"
Sep 09 07:16:25.829592 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:25.829426    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="64a12175-3c1c-4013-9a66-07757d81c3f0" containerName="payload-processing"
Sep 09 07:16:25.833971 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:25.833951    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-bea943/ipp-route-bea943-kserve-54d4949d75-qn4jb"
Sep 09 07:16:25.838545 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:25.838516    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-bea943\"/\"default-dockercfg-q5nhg\""
Sep 09 07:16:25.839032 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:25.839004    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-bea943\"/\"ipp-route-bea943-kserve-self-signed-certs\""
Sep 09 07:16:25.839146 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:25.838544    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-bea943\"/\"openshift-service-ca.crt\""
Sep 09 07:16:25.843086 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:25.840314    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-bea943\"/\"kube-root-ca.crt\""
Sep 09 07:16:25.850798 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:25.850776    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-bea943/ipp-route-bea943-kserve-54d4949d75-qn4jb"]
Sep 09 07:16:25.863630 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:25.863606    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbthk\" (UniqueName: \"kubernetes.io/projected/5b41c80a-f5cd-42c1-beca-ea55f9acc7b1-kube-api-access-hbthk\") pod \"ipp-route-bea943-kserve-54d4949d75-qn4jb\" (UID: \"5b41c80a-f5cd-42c1-beca-ea55f9acc7b1\") " pod="ai-tenant-e2e-ipp-a-bea943/ipp-route-bea943-kserve-54d4949d75-qn4jb"
Sep 09 07:16:25.863720 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:25.863644    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b41c80a-f5cd-42c1-beca-ea55f9acc7b1-model-cache\") pod \"ipp-route-bea943-kserve-54d4949d75-qn4jb\" (UID: \"5b41c80a-f5cd-42c1-beca-ea55f9acc7b1\") " pod="ai-tenant-e2e-ipp-a-bea943/ipp-route-bea943-kserve-54d4949d75-qn4jb"
Sep 09 07:16:25.863792 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:25.863723    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b41c80a-f5cd-42c1-beca-ea55f9acc7b1-home\") pod \"ipp-route-bea943-kserve-54d4949d75-qn4jb\" (UID: \"5b41c80a-f5cd-42c1-beca-ea55f9acc7b1\") " pod="ai-tenant-e2e-ipp-a-bea943/ipp-route-bea943-kserve-54d4949d75-qn4jb"
Sep 09 07:16:25.863839 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:25.863796    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b41c80a-f5cd-42c1-beca-ea55f9acc7b1-tmp-dir\") pod \"ipp-route-bea943-kserve-54d4949d75-qn4jb\" (UID: \"5b41c80a-f5cd-42c1-beca-ea55f9acc7b1\") " pod="ai-tenant-e2e-ipp-a-bea943/ipp-route-bea943-kserve-54d4949d75-qn4jb"
Sep 09 07:16:25.863839 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:25.863823    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b41c80a-f5cd-42c1-beca-ea55f9acc7b1-tls-certs\") pod \"ipp-route-bea943-kserve-54d4949d75-qn4jb\" (UID: \"5b41c80a-f5cd-42c1-beca-ea55f9acc7b1\") " pod="ai-tenant-e2e-ipp-a-bea943/ipp-route-bea943-kserve-54d4949d75-qn4jb"
Sep 09 07:16:25.863919 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:25.863847    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b41c80a-f5cd-42c1-beca-ea55f9acc7b1-dshm\") pod \"ipp-route-bea943-kserve-54d4949d75-qn4jb\" (UID: \"5b41c80a-f5cd-42c1-beca-ea55f9acc7b1\") " pod="ai-tenant-e2e-ipp-a-bea943/ipp-route-bea943-kserve-54d4949d75-qn4jb"
Sep 09 07:16:25.964224 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:25.964188    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b41c80a-f5cd-42c1-beca-ea55f9acc7b1-home\") pod \"ipp-route-bea943-kserve-54d4949d75-qn4jb\" (UID: \"5b41c80a-f5cd-42c1-beca-ea55f9acc7b1\") " pod="ai-tenant-e2e-ipp-a-bea943/ipp-route-bea943-kserve-54d4949d75-qn4jb"
Sep 09 07:16:25.964224 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:25.964230    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b41c80a-f5cd-42c1-beca-ea55f9acc7b1-tmp-dir\") pod \"ipp-route-bea943-kserve-54d4949d75-qn4jb\" (UID: \"5b41c80a-f5cd-42c1-beca-ea55f9acc7b1\") " pod="ai-tenant-e2e-ipp-a-bea943/ipp-route-bea943-kserve-54d4949d75-qn4jb"
Sep 09 07:16:25.964502 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:25.964247    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b41c80a-f5cd-42c1-beca-ea55f9acc7b1-tls-certs\") pod \"ipp-route-bea943-kserve-54d4949d75-qn4jb\" (UID: \"5b41c80a-f5cd-42c1-beca-ea55f9acc7b1\") " pod="ai-tenant-e2e-ipp-a-bea943/ipp-route-bea943-kserve-54d4949d75-qn4jb"
Sep 09 07:16:25.964502 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:25.964277    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b41c80a-f5cd-42c1-beca-ea55f9acc7b1-dshm\") pod \"ipp-route-bea943-kserve-54d4949d75-qn4jb\" (UID: \"5b41c80a-f5cd-42c1-beca-ea55f9acc7b1\") " pod="ai-tenant-e2e-ipp-a-bea943/ipp-route-bea943-kserve-54d4949d75-qn4jb"
Sep 09 07:16:25.964502 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:25.964352    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbthk\" (UniqueName: \"kubernetes.io/projected/5b41c80a-f5cd-42c1-beca-ea55f9acc7b1-kube-api-access-hbthk\") pod \"ipp-route-bea943-kserve-54d4949d75-qn4jb\" (UID: \"5b41c80a-f5cd-42c1-beca-ea55f9acc7b1\") " pod="ai-tenant-e2e-ipp-a-bea943/ipp-route-bea943-kserve-54d4949d75-qn4jb"
Sep 09 07:16:25.964502 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:25.964482    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b41c80a-f5cd-42c1-beca-ea55f9acc7b1-model-cache\") pod \"ipp-route-bea943-kserve-54d4949d75-qn4jb\" (UID: \"5b41c80a-f5cd-42c1-beca-ea55f9acc7b1\") " pod="ai-tenant-e2e-ipp-a-bea943/ipp-route-bea943-kserve-54d4949d75-qn4jb"
Sep 09 07:16:25.964709 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:25.964667    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b41c80a-f5cd-42c1-beca-ea55f9acc7b1-home\") pod \"ipp-route-bea943-kserve-54d4949d75-qn4jb\" (UID: \"5b41c80a-f5cd-42c1-beca-ea55f9acc7b1\") " pod="ai-tenant-e2e-ipp-a-bea943/ipp-route-bea943-kserve-54d4949d75-qn4jb"
Sep 09 07:16:25.964709 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:25.964693    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b41c80a-f5cd-42c1-beca-ea55f9acc7b1-tmp-dir\") pod \"ipp-route-bea943-kserve-54d4949d75-qn4jb\" (UID: \"5b41c80a-f5cd-42c1-beca-ea55f9acc7b1\") " pod="ai-tenant-e2e-ipp-a-bea943/ipp-route-bea943-kserve-54d4949d75-qn4jb"
Sep 09 07:16:25.964835 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:25.964819    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b41c80a-f5cd-42c1-beca-ea55f9acc7b1-model-cache\") pod \"ipp-route-bea943-kserve-54d4949d75-qn4jb\" (UID: \"5b41c80a-f5cd-42c1-beca-ea55f9acc7b1\") " pod="ai-tenant-e2e-ipp-a-bea943/ipp-route-bea943-kserve-54d4949d75-qn4jb"
Sep 09 07:16:25.966868 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:25.966846    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b41c80a-f5cd-42c1-beca-ea55f9acc7b1-dshm\") pod \"ipp-route-bea943-kserve-54d4949d75-qn4jb\" (UID: \"5b41c80a-f5cd-42c1-beca-ea55f9acc7b1\") " pod="ai-tenant-e2e-ipp-a-bea943/ipp-route-bea943-kserve-54d4949d75-qn4jb"
Sep 09 07:16:25.966983 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:25.966933    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b41c80a-f5cd-42c1-beca-ea55f9acc7b1-tls-certs\") pod \"ipp-route-bea943-kserve-54d4949d75-qn4jb\" (UID: \"5b41c80a-f5cd-42c1-beca-ea55f9acc7b1\") " pod="ai-tenant-e2e-ipp-a-bea943/ipp-route-bea943-kserve-54d4949d75-qn4jb"
Sep 09 07:16:25.973613 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:25.973590    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbthk\" (UniqueName: \"kubernetes.io/projected/5b41c80a-f5cd-42c1-beca-ea55f9acc7b1-kube-api-access-hbthk\") pod \"ipp-route-bea943-kserve-54d4949d75-qn4jb\" (UID: \"5b41c80a-f5cd-42c1-beca-ea55f9acc7b1\") " pod="ai-tenant-e2e-ipp-a-bea943/ipp-route-bea943-kserve-54d4949d75-qn4jb"
Sep 09 07:16:26.148771 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:26.148711    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-bea943/ipp-route-bea943-kserve-54d4949d75-qn4jb"
Sep 09 07:16:26.422233 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:26.422199    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-bea943/ipp-route-bea943-kserve-54d4949d75-qn4jb"]
Sep 09 07:16:26.423943 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:16:26.423913    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5b41c80a_f5cd_42c1_beca_ea55f9acc7b1.slice/crio-c0662c9565aa5306302c86098d51e2d6192c7d61fae7e38334c74479b5777a58 WatchSource:0}: Error finding container c0662c9565aa5306302c86098d51e2d6192c7d61fae7e38334c74479b5777a58: Status 404 returned error can't find the container with id c0662c9565aa5306302c86098d51e2d6192c7d61fae7e38334c74479b5777a58
Sep 09 07:16:27.087833 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:27.087723    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-bea943/ipp-route-bea943-kserve-54d4949d75-qn4jb" event={"ID":"5b41c80a-f5cd-42c1-beca-ea55f9acc7b1","Type":"ContainerStarted","Data":"78256475c896447b64a4382866dc0a215209cf5053c50008a5952e906e1d1b49"}
Sep 09 07:16:27.087833 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:27.087780    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-bea943/ipp-route-bea943-kserve-54d4949d75-qn4jb" event={"ID":"5b41c80a-f5cd-42c1-beca-ea55f9acc7b1","Type":"ContainerStarted","Data":"c0662c9565aa5306302c86098d51e2d6192c7d61fae7e38334c74479b5777a58"}
Sep 09 07:16:27.106767 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:27.106693    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-bea943/ipp-route-bea943-kserve-54d4949d75-qn4jb" podStartSLOduration=2.106670783 podStartE2EDuration="2.106670783s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 07:16:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 07:16:27.104092716 +0000 UTC m=+1521.895902056" watchObservedRunningTime="2026-09-09 07:16:27.106670783 +0000 UTC m=+1521.898480124"
Sep 09 07:16:36.149875 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:36.149841    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-bea943/ipp-route-bea943-kserve-54d4949d75-qn4jb"
Sep 09 07:16:36.150444 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:36.149887    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-bea943/ipp-route-bea943-kserve-54d4949d75-qn4jb"
Sep 09 07:16:36.162636 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:36.162615    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-bea943/ipp-route-bea943-kserve-54d4949d75-qn4jb"
Sep 09 07:16:37.150808 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:37.150775    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-bea943/ipp-route-bea943-kserve-54d4949d75-qn4jb"
Sep 09 07:16:57.617645 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:57.617615    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-bea943-5d46ff47df-r7xkx_60de8180-e864-473a-8186-a00f671a109b/payload-processing/0.log"
Sep 09 07:16:57.755277 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:16:57.755244    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-nwl5f_8f6df0b4-4f64-41b6-9c1b-bad76413aae3/payload-processing/0.log"
Sep 09 07:17:03.356653 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:03.356623    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-36a83e-6667dd995-sx6sp"]
Sep 09 07:17:03.360223 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:03.360203    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-36a83e-6667dd995-sx6sp"
Sep 09 07:17:03.363369 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:03.363350    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-36a83e-serving-cert\""
Sep 09 07:17:03.372370 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:03.372349    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-36a83e-6667dd995-sx6sp"]
Sep 09 07:17:03.512268 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:03.512235    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5af5aff-491c-41c4-be79-d5c3e44e75f8-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-36a83e-6667dd995-sx6sp\" (UID: \"a5af5aff-491c-41c4-be79-d5c3e44e75f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-36a83e-6667dd995-sx6sp"
Sep 09 07:17:03.512436 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:03.512283    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5af5aff-491c-41c4-be79-d5c3e44e75f8-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-36a83e-6667dd995-sx6sp\" (UID: \"a5af5aff-491c-41c4-be79-d5c3e44e75f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-36a83e-6667dd995-sx6sp"
Sep 09 07:17:03.512436 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:03.512377    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5af5aff-491c-41c4-be79-d5c3e44e75f8-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-36a83e-6667dd995-sx6sp\" (UID: \"a5af5aff-491c-41c4-be79-d5c3e44e75f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-36a83e-6667dd995-sx6sp"
Sep 09 07:17:03.512436 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:03.512432    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw7zw\" (UniqueName: \"kubernetes.io/projected/a5af5aff-491c-41c4-be79-d5c3e44e75f8-kube-api-access-rw7zw\") pod \"maas-api-e2e-ipp-cleanup-36a83e-6667dd995-sx6sp\" (UID: \"a5af5aff-491c-41c4-be79-d5c3e44e75f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-36a83e-6667dd995-sx6sp"
Sep 09 07:17:03.612996 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:03.612915    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5af5aff-491c-41c4-be79-d5c3e44e75f8-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-36a83e-6667dd995-sx6sp\" (UID: \"a5af5aff-491c-41c4-be79-d5c3e44e75f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-36a83e-6667dd995-sx6sp"
Sep 09 07:17:03.612996 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:03.612964    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5af5aff-491c-41c4-be79-d5c3e44e75f8-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-36a83e-6667dd995-sx6sp\" (UID: \"a5af5aff-491c-41c4-be79-d5c3e44e75f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-36a83e-6667dd995-sx6sp"
Sep 09 07:17:03.613208 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:03.613033    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5af5aff-491c-41c4-be79-d5c3e44e75f8-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-36a83e-6667dd995-sx6sp\" (UID: \"a5af5aff-491c-41c4-be79-d5c3e44e75f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-36a83e-6667dd995-sx6sp"
Sep 09 07:17:03.613208 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:03.613097    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw7zw\" (UniqueName: \"kubernetes.io/projected/a5af5aff-491c-41c4-be79-d5c3e44e75f8-kube-api-access-rw7zw\") pod \"maas-api-e2e-ipp-cleanup-36a83e-6667dd995-sx6sp\" (UID: \"a5af5aff-491c-41c4-be79-d5c3e44e75f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-36a83e-6667dd995-sx6sp"
Sep 09 07:17:03.613208 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:17:03.613188    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-36a83e-serving-cert: secret "maas-api-e2e-ipp-cleanup-36a83e-serving-cert" not found
Sep 09 07:17:03.613364 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:17:03.613263    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5af5aff-491c-41c4-be79-d5c3e44e75f8-maas-api-tls podName:a5af5aff-491c-41c4-be79-d5c3e44e75f8 nodeName:}" failed. No retries permitted until 2026-09-09 07:17:04.113242736 +0000 UTC m=+1558.905052068 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a5af5aff-491c-41c4-be79-d5c3e44e75f8-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-36a83e-6667dd995-sx6sp" (UID: "a5af5aff-491c-41c4-be79-d5c3e44e75f8") : secret "maas-api-e2e-ipp-cleanup-36a83e-serving-cert" not found
Sep 09 07:17:03.613681 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:03.613663    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5af5aff-491c-41c4-be79-d5c3e44e75f8-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-36a83e-6667dd995-sx6sp\" (UID: \"a5af5aff-491c-41c4-be79-d5c3e44e75f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-36a83e-6667dd995-sx6sp"
Sep 09 07:17:03.615730 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:03.615707    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5af5aff-491c-41c4-be79-d5c3e44e75f8-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-36a83e-6667dd995-sx6sp\" (UID: \"a5af5aff-491c-41c4-be79-d5c3e44e75f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-36a83e-6667dd995-sx6sp"
Sep 09 07:17:03.621772 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:03.621725    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw7zw\" (UniqueName: \"kubernetes.io/projected/a5af5aff-491c-41c4-be79-d5c3e44e75f8-kube-api-access-rw7zw\") pod \"maas-api-e2e-ipp-cleanup-36a83e-6667dd995-sx6sp\" (UID: \"a5af5aff-491c-41c4-be79-d5c3e44e75f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-36a83e-6667dd995-sx6sp"
Sep 09 07:17:04.119075 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:04.119045    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5af5aff-491c-41c4-be79-d5c3e44e75f8-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-36a83e-6667dd995-sx6sp\" (UID: \"a5af5aff-491c-41c4-be79-d5c3e44e75f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-36a83e-6667dd995-sx6sp"
Sep 09 07:17:04.121710 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:04.121686    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5af5aff-491c-41c4-be79-d5c3e44e75f8-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-36a83e-6667dd995-sx6sp\" (UID: \"a5af5aff-491c-41c4-be79-d5c3e44e75f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-36a83e-6667dd995-sx6sp"
Sep 09 07:17:04.270876 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:04.270835    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-36a83e-6667dd995-sx6sp"
Sep 09 07:17:04.547640 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:04.547609    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-36a83e-6667dd995-sx6sp"]
Sep 09 07:17:04.549537 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:17:04.549508    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5af5aff_491c_41c4_be79_d5c3e44e75f8.slice/crio-dc879b020ccb838e3c0a35e7d4f924503a20861757f3fba2f722e0684f20049f WatchSource:0}: Error finding container dc879b020ccb838e3c0a35e7d4f924503a20861757f3fba2f722e0684f20049f: Status 404 returned error can't find the container with id dc879b020ccb838e3c0a35e7d4f924503a20861757f3fba2f722e0684f20049f
Sep 09 07:17:05.288301 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:05.288262    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-36a83e-6667dd995-sx6sp" event={"ID":"a5af5aff-491c-41c4-be79-d5c3e44e75f8","Type":"ContainerStarted","Data":"eca6074e8dfeaf1d077e869a296f9a6af2abfec5723513ed619c5d22534d4d9d"}
Sep 09 07:17:05.288460 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:05.288319    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-36a83e-6667dd995-sx6sp" event={"ID":"a5af5aff-491c-41c4-be79-d5c3e44e75f8","Type":"ContainerStarted","Data":"dc879b020ccb838e3c0a35e7d4f924503a20861757f3fba2f722e0684f20049f"}
Sep 09 07:17:05.288460 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:05.288376    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-36a83e-6667dd995-sx6sp"
Sep 09 07:17:05.307492 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:05.307438    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-36a83e-6667dd995-sx6sp" podStartSLOduration=1.772248753 podStartE2EDuration="2.307422072s" totalImagesPullingTime="535.173319ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 07:17:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 07:17:05.306123372 +0000 UTC m=+1560.097932736" watchObservedRunningTime="2026-09-09 07:17:05.307422072 +0000 UTC m=+1560.099231411"
Sep 09 07:17:11.299310 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:11.299278    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-36a83e-6667dd995-sx6sp"
Sep 09 07:17:33.936706 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:33.936670    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-36a83e-6667dd995-sx6sp"]
Sep 09 07:17:33.937401 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:33.936959    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-36a83e-6667dd995-sx6sp" podUID="a5af5aff-491c-41c4-be79-d5c3e44e75f8" containerName="maas-api" containerID="cri-o://eca6074e8dfeaf1d077e869a296f9a6af2abfec5723513ed619c5d22534d4d9d" gracePeriod=30
Sep 09 07:17:34.194623 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:34.194568    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-36a83e-6667dd995-sx6sp"
Sep 09 07:17:34.298665 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:34.298635    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5af5aff-491c-41c4-be79-d5c3e44e75f8-metrics-certs\") pod \"a5af5aff-491c-41c4-be79-d5c3e44e75f8\" (UID: \"a5af5aff-491c-41c4-be79-d5c3e44e75f8\") "
Sep 09 07:17:34.298665 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:34.298669    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5af5aff-491c-41c4-be79-d5c3e44e75f8-maas-api-tls\") pod \"a5af5aff-491c-41c4-be79-d5c3e44e75f8\" (UID: \"a5af5aff-491c-41c4-be79-d5c3e44e75f8\") "
Sep 09 07:17:34.298877 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:34.298848    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5af5aff-491c-41c4-be79-d5c3e44e75f8-openshift-service-ca\") pod \"a5af5aff-491c-41c4-be79-d5c3e44e75f8\" (UID: \"a5af5aff-491c-41c4-be79-d5c3e44e75f8\") "
Sep 09 07:17:34.298921 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:34.298902    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rw7zw\" (UniqueName: \"kubernetes.io/projected/a5af5aff-491c-41c4-be79-d5c3e44e75f8-kube-api-access-rw7zw\") pod \"a5af5aff-491c-41c4-be79-d5c3e44e75f8\" (UID: \"a5af5aff-491c-41c4-be79-d5c3e44e75f8\") "
Sep 09 07:17:34.299239 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:34.299212    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5af5aff-491c-41c4-be79-d5c3e44e75f8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a5af5aff-491c-41c4-be79-d5c3e44e75f8" (UID: "a5af5aff-491c-41c4-be79-d5c3e44e75f8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 07:17:34.301161 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:34.301126    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5af5aff-491c-41c4-be79-d5c3e44e75f8-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a5af5aff-491c-41c4-be79-d5c3e44e75f8" (UID: "a5af5aff-491c-41c4-be79-d5c3e44e75f8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 07:17:34.301161 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:34.301149    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5af5aff-491c-41c4-be79-d5c3e44e75f8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a5af5aff-491c-41c4-be79-d5c3e44e75f8" (UID: "a5af5aff-491c-41c4-be79-d5c3e44e75f8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 07:17:34.301330 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:34.301201    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5af5aff-491c-41c4-be79-d5c3e44e75f8-kube-api-access-rw7zw" (OuterVolumeSpecName: "kube-api-access-rw7zw") pod "a5af5aff-491c-41c4-be79-d5c3e44e75f8" (UID: "a5af5aff-491c-41c4-be79-d5c3e44e75f8"). InnerVolumeSpecName "kube-api-access-rw7zw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 07:17:34.400179 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:34.400150    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5af5aff-491c-41c4-be79-d5c3e44e75f8-openshift-service-ca\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:17:34.400179 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:34.400173    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rw7zw\" (UniqueName: \"kubernetes.io/projected/a5af5aff-491c-41c4-be79-d5c3e44e75f8-kube-api-access-rw7zw\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:17:34.400179 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:34.400183    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5af5aff-491c-41c4-be79-d5c3e44e75f8-metrics-certs\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:17:34.400391 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:34.400191    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5af5aff-491c-41c4-be79-d5c3e44e75f8-maas-api-tls\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:17:34.434358 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:34.434332    2575 generic.go:356] "Generic (PLEG): container finished" podID="a5af5aff-491c-41c4-be79-d5c3e44e75f8" containerID="eca6074e8dfeaf1d077e869a296f9a6af2abfec5723513ed619c5d22534d4d9d" exitCode=0
Sep 09 07:17:34.434501 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:34.434372    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-36a83e-6667dd995-sx6sp"
Sep 09 07:17:34.434501 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:34.434373    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-36a83e-6667dd995-sx6sp" event={"ID":"a5af5aff-491c-41c4-be79-d5c3e44e75f8","Type":"ContainerDied","Data":"eca6074e8dfeaf1d077e869a296f9a6af2abfec5723513ed619c5d22534d4d9d"}
Sep 09 07:17:34.434610 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:34.434534    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-36a83e-6667dd995-sx6sp" event={"ID":"a5af5aff-491c-41c4-be79-d5c3e44e75f8","Type":"ContainerDied","Data":"dc879b020ccb838e3c0a35e7d4f924503a20861757f3fba2f722e0684f20049f"}
Sep 09 07:17:34.434610 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:34.434566    2575 scope.go:117] "RemoveContainer" containerID="eca6074e8dfeaf1d077e869a296f9a6af2abfec5723513ed619c5d22534d4d9d"
Sep 09 07:17:34.444891 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:34.444875    2575 scope.go:117] "RemoveContainer" containerID="eca6074e8dfeaf1d077e869a296f9a6af2abfec5723513ed619c5d22534d4d9d"
Sep 09 07:17:34.445176 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:17:34.445156    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eca6074e8dfeaf1d077e869a296f9a6af2abfec5723513ed619c5d22534d4d9d\": container with ID starting with eca6074e8dfeaf1d077e869a296f9a6af2abfec5723513ed619c5d22534d4d9d not found: ID does not exist" containerID="eca6074e8dfeaf1d077e869a296f9a6af2abfec5723513ed619c5d22534d4d9d"
Sep 09 07:17:34.445248 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:34.445185    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eca6074e8dfeaf1d077e869a296f9a6af2abfec5723513ed619c5d22534d4d9d"} err="failed to get container status \"eca6074e8dfeaf1d077e869a296f9a6af2abfec5723513ed619c5d22534d4d9d\": rpc error: code = NotFound desc = could not find container \"eca6074e8dfeaf1d077e869a296f9a6af2abfec5723513ed619c5d22534d4d9d\": container with ID starting with eca6074e8dfeaf1d077e869a296f9a6af2abfec5723513ed619c5d22534d4d9d not found: ID does not exist"
Sep 09 07:17:34.456645 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:34.456616    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-36a83e-6667dd995-sx6sp"]
Sep 09 07:17:34.461007 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:34.460989    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-36a83e-6667dd995-sx6sp"]
Sep 09 07:17:35.713201 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:35.713169    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5af5aff-491c-41c4-be79-d5c3e44e75f8" path="/var/lib/kubelet/pods/a5af5aff-491c-41c4-be79-d5c3e44e75f8/volumes"
Sep 09 07:17:59.599046 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:59.598958    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-bea943-559d8d584b-tgnws"]
Sep 09 07:17:59.599527 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:59.599266    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bea943-559d8d584b-tgnws" podUID="06914af0-be1b-4c31-bd1c-38b9275935fa" containerName="maas-api" containerID="cri-o://44b4f098607604445ec96948f3a8b624e8b8956166dcdbf31d41f00e13ac093d" gracePeriod=30
Sep 09 07:17:59.655813 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:59.655780    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-bea943-5d46ff47df-r7xkx"]
Sep 09 07:17:59.656043 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:59.656009    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-bea943-5d46ff47df-r7xkx" podUID="60de8180-e864-473a-8186-a00f671a109b" containerName="payload-processing" containerID="cri-o://c55919bf84012043093b51a46ffdcacaa3413950851bda7d96d90a7b9398b294" gracePeriod=30
Sep 09 07:17:59.722427 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:59.722389    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bea943-559d8d584b-tgnws" podUID="06914af0-be1b-4c31-bd1c-38b9275935fa" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.78:8443/health\": dial tcp 10.132.0.78:8443: connect: connection refused"
Sep 09 07:17:59.906173 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:59.906151    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bea943-559d8d584b-tgnws"
Sep 09 07:17:59.914386 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:59.914352    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/06914af0-be1b-4c31-bd1c-38b9275935fa-metrics-certs\") pod \"06914af0-be1b-4c31-bd1c-38b9275935fa\" (UID: \"06914af0-be1b-4c31-bd1c-38b9275935fa\") "
Sep 09 07:17:59.914522 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:59.914419    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06914af0-be1b-4c31-bd1c-38b9275935fa-openshift-service-ca\") pod \"06914af0-be1b-4c31-bd1c-38b9275935fa\" (UID: \"06914af0-be1b-4c31-bd1c-38b9275935fa\") "
Sep 09 07:17:59.914522 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:59.914454    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9knrz\" (UniqueName: \"kubernetes.io/projected/06914af0-be1b-4c31-bd1c-38b9275935fa-kube-api-access-9knrz\") pod \"06914af0-be1b-4c31-bd1c-38b9275935fa\" (UID: \"06914af0-be1b-4c31-bd1c-38b9275935fa\") "
Sep 09 07:17:59.914522 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:59.914516    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06914af0-be1b-4c31-bd1c-38b9275935fa-maas-api-tls\") pod \"06914af0-be1b-4c31-bd1c-38b9275935fa\" (UID: \"06914af0-be1b-4c31-bd1c-38b9275935fa\") "
Sep 09 07:17:59.914898 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:59.914867    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06914af0-be1b-4c31-bd1c-38b9275935fa-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "06914af0-be1b-4c31-bd1c-38b9275935fa" (UID: "06914af0-be1b-4c31-bd1c-38b9275935fa"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 07:17:59.916832 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:59.916795    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06914af0-be1b-4c31-bd1c-38b9275935fa-kube-api-access-9knrz" (OuterVolumeSpecName: "kube-api-access-9knrz") pod "06914af0-be1b-4c31-bd1c-38b9275935fa" (UID: "06914af0-be1b-4c31-bd1c-38b9275935fa"). InnerVolumeSpecName "kube-api-access-9knrz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 07:17:59.916992 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:59.916971    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06914af0-be1b-4c31-bd1c-38b9275935fa-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "06914af0-be1b-4c31-bd1c-38b9275935fa" (UID: "06914af0-be1b-4c31-bd1c-38b9275935fa"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 07:17:59.917048 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:59.916990    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06914af0-be1b-4c31-bd1c-38b9275935fa-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "06914af0-be1b-4c31-bd1c-38b9275935fa" (UID: "06914af0-be1b-4c31-bd1c-38b9275935fa"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 07:17:59.933512 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:17:59.933492    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-bea943-5d46ff47df-r7xkx"
Sep 09 07:18:00.015003 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:00.014977    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4254\" (UniqueName: \"kubernetes.io/projected/60de8180-e864-473a-8186-a00f671a109b-kube-api-access-z4254\") pod \"60de8180-e864-473a-8186-a00f671a109b\" (UID: \"60de8180-e864-473a-8186-a00f671a109b\") "
Sep 09 07:18:00.015167 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:00.015028    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/60de8180-e864-473a-8186-a00f671a109b-plugins-config-volume\") pod \"60de8180-e864-473a-8186-a00f671a109b\" (UID: \"60de8180-e864-473a-8186-a00f671a109b\") "
Sep 09 07:18:00.015317 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:00.015303    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/06914af0-be1b-4c31-bd1c-38b9275935fa-metrics-certs\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:18:00.015356 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:00.015321    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06914af0-be1b-4c31-bd1c-38b9275935fa-openshift-service-ca\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:18:00.015356 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:00.015331    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9knrz\" (UniqueName: \"kubernetes.io/projected/06914af0-be1b-4c31-bd1c-38b9275935fa-kube-api-access-9knrz\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:18:00.015356 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:00.015342    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06914af0-be1b-4c31-bd1c-38b9275935fa-maas-api-tls\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:18:00.015468 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:00.015410    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60de8180-e864-473a-8186-a00f671a109b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "60de8180-e864-473a-8186-a00f671a109b" (UID: "60de8180-e864-473a-8186-a00f671a109b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 07:18:00.017253 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:00.017234    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60de8180-e864-473a-8186-a00f671a109b-kube-api-access-z4254" (OuterVolumeSpecName: "kube-api-access-z4254") pod "60de8180-e864-473a-8186-a00f671a109b" (UID: "60de8180-e864-473a-8186-a00f671a109b"). InnerVolumeSpecName "kube-api-access-z4254". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 07:18:00.116211 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:00.116141    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4254\" (UniqueName: \"kubernetes.io/projected/60de8180-e864-473a-8186-a00f671a109b-kube-api-access-z4254\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:18:00.116211 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:00.116164    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/60de8180-e864-473a-8186-a00f671a109b-plugins-config-volume\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:18:00.572036 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:00.572003    2575 generic.go:356] "Generic (PLEG): container finished" podID="06914af0-be1b-4c31-bd1c-38b9275935fa" containerID="44b4f098607604445ec96948f3a8b624e8b8956166dcdbf31d41f00e13ac093d" exitCode=0
Sep 09 07:18:00.572201 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:00.572051    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bea943-559d8d584b-tgnws"
Sep 09 07:18:00.572201 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:00.572085    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bea943-559d8d584b-tgnws" event={"ID":"06914af0-be1b-4c31-bd1c-38b9275935fa","Type":"ContainerDied","Data":"44b4f098607604445ec96948f3a8b624e8b8956166dcdbf31d41f00e13ac093d"}
Sep 09 07:18:00.572201 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:00.572136    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bea943-559d8d584b-tgnws" event={"ID":"06914af0-be1b-4c31-bd1c-38b9275935fa","Type":"ContainerDied","Data":"d1a9fcfb1dddc651cf26fb1413d387fbcd864a174ace765d254a64b6138a6f86"}
Sep 09 07:18:00.572201 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:00.572165    2575 scope.go:117] "RemoveContainer" containerID="44b4f098607604445ec96948f3a8b624e8b8956166dcdbf31d41f00e13ac093d"
Sep 09 07:18:00.573446 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:00.573428    2575 generic.go:356] "Generic (PLEG): container finished" podID="60de8180-e864-473a-8186-a00f671a109b" containerID="c55919bf84012043093b51a46ffdcacaa3413950851bda7d96d90a7b9398b294" exitCode=0
Sep 09 07:18:00.573532 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:00.573479    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-bea943-5d46ff47df-r7xkx"
Sep 09 07:18:00.573595 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:00.573523    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-bea943-5d46ff47df-r7xkx" event={"ID":"60de8180-e864-473a-8186-a00f671a109b","Type":"ContainerDied","Data":"c55919bf84012043093b51a46ffdcacaa3413950851bda7d96d90a7b9398b294"}
Sep 09 07:18:00.573595 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:00.573580    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-bea943-5d46ff47df-r7xkx" event={"ID":"60de8180-e864-473a-8186-a00f671a109b","Type":"ContainerDied","Data":"a36d07f31426e75546658e127138593c76e629269110f8984079af48267254f2"}
Sep 09 07:18:00.581493 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:00.581479    2575 scope.go:117] "RemoveContainer" containerID="44b4f098607604445ec96948f3a8b624e8b8956166dcdbf31d41f00e13ac093d"
Sep 09 07:18:00.584834 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:18:00.584804    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44b4f098607604445ec96948f3a8b624e8b8956166dcdbf31d41f00e13ac093d\": container with ID starting with 44b4f098607604445ec96948f3a8b624e8b8956166dcdbf31d41f00e13ac093d not found: ID does not exist" containerID="44b4f098607604445ec96948f3a8b624e8b8956166dcdbf31d41f00e13ac093d"
Sep 09 07:18:00.584943 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:00.584843    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44b4f098607604445ec96948f3a8b624e8b8956166dcdbf31d41f00e13ac093d"} err="failed to get container status \"44b4f098607604445ec96948f3a8b624e8b8956166dcdbf31d41f00e13ac093d\": rpc error: code = NotFound desc = could not find container \"44b4f098607604445ec96948f3a8b624e8b8956166dcdbf31d41f00e13ac093d\": container with ID starting with 44b4f098607604445ec96948f3a8b624e8b8956166dcdbf31d41f00e13ac093d not found: ID does not exist"
Sep 09 07:18:00.584943 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:00.584866    2575 scope.go:117] "RemoveContainer" containerID="c55919bf84012043093b51a46ffdcacaa3413950851bda7d96d90a7b9398b294"
Sep 09 07:18:00.592984 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:00.592969    2575 scope.go:117] "RemoveContainer" containerID="c55919bf84012043093b51a46ffdcacaa3413950851bda7d96d90a7b9398b294"
Sep 09 07:18:00.593222 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:18:00.593207    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c55919bf84012043093b51a46ffdcacaa3413950851bda7d96d90a7b9398b294\": container with ID starting with c55919bf84012043093b51a46ffdcacaa3413950851bda7d96d90a7b9398b294 not found: ID does not exist" containerID="c55919bf84012043093b51a46ffdcacaa3413950851bda7d96d90a7b9398b294"
Sep 09 07:18:00.593272 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:00.593227    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c55919bf84012043093b51a46ffdcacaa3413950851bda7d96d90a7b9398b294"} err="failed to get container status \"c55919bf84012043093b51a46ffdcacaa3413950851bda7d96d90a7b9398b294\": rpc error: code = NotFound desc = could not find container \"c55919bf84012043093b51a46ffdcacaa3413950851bda7d96d90a7b9398b294\": container with ID starting with c55919bf84012043093b51a46ffdcacaa3413950851bda7d96d90a7b9398b294 not found: ID does not exist"
Sep 09 07:18:00.602654 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:00.602633    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-bea943-559d8d584b-tgnws"]
Sep 09 07:18:00.615327 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:00.615304    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-bea943-559d8d584b-tgnws"]
Sep 09 07:18:00.635951 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:00.635932    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-bea943-5d46ff47df-r7xkx"]
Sep 09 07:18:00.653327 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:00.653308    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-bea943-5d46ff47df-r7xkx"]
Sep 09 07:18:01.711713 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:01.711681    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06914af0-be1b-4c31-bd1c-38b9275935fa" path="/var/lib/kubelet/pods/06914af0-be1b-4c31-bd1c-38b9275935fa/volumes"
Sep 09 07:18:01.712079 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:01.712049    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60de8180-e864-473a-8186-a00f671a109b" path="/var/lib/kubelet/pods/60de8180-e864-473a-8186-a00f671a109b/volumes"
Sep 09 07:18:05.244319 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:05.244284    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-bea943/ipp-route-bea943-kserve-54d4949d75-qn4jb"]
Sep 09 07:18:05.925901 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:05.925872    2575 scope.go:117] "RemoveContainer" containerID="ca9b4faba5e36093d87ba74a395444a5ac3417acc3019616eb86a67d56d88355"
Sep 09 07:18:20.264783 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:20.264719    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-bea943/ipp-route-bea943-kserve-54d4949d75-qn4jb" podUID="5b41c80a-f5cd-42c1-beca-ea55f9acc7b1" containerName="main" containerID="cri-o://78256475c896447b64a4382866dc0a215209cf5053c50008a5952e906e1d1b49" gracePeriod=45
Sep 09 07:18:20.503154 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:20.503122    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-bea943/ipp-route-bea943-kserve-54d4949d75-qn4jb"
Sep 09 07:18:20.601573 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:20.601497    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b41c80a-f5cd-42c1-beca-ea55f9acc7b1-tmp-dir\") pod \"5b41c80a-f5cd-42c1-beca-ea55f9acc7b1\" (UID: \"5b41c80a-f5cd-42c1-beca-ea55f9acc7b1\") "
Sep 09 07:18:20.601573 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:20.601535    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b41c80a-f5cd-42c1-beca-ea55f9acc7b1-home\") pod \"5b41c80a-f5cd-42c1-beca-ea55f9acc7b1\" (UID: \"5b41c80a-f5cd-42c1-beca-ea55f9acc7b1\") "
Sep 09 07:18:20.601573 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:20.601566    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbthk\" (UniqueName: \"kubernetes.io/projected/5b41c80a-f5cd-42c1-beca-ea55f9acc7b1-kube-api-access-hbthk\") pod \"5b41c80a-f5cd-42c1-beca-ea55f9acc7b1\" (UID: \"5b41c80a-f5cd-42c1-beca-ea55f9acc7b1\") "
Sep 09 07:18:20.601808 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:20.601593    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b41c80a-f5cd-42c1-beca-ea55f9acc7b1-model-cache\") pod \"5b41c80a-f5cd-42c1-beca-ea55f9acc7b1\" (UID: \"5b41c80a-f5cd-42c1-beca-ea55f9acc7b1\") "
Sep 09 07:18:20.601808 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:20.601698    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b41c80a-f5cd-42c1-beca-ea55f9acc7b1-tls-certs\") pod \"5b41c80a-f5cd-42c1-beca-ea55f9acc7b1\" (UID: \"5b41c80a-f5cd-42c1-beca-ea55f9acc7b1\") "
Sep 09 07:18:20.601808 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:20.601783    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b41c80a-f5cd-42c1-beca-ea55f9acc7b1-dshm\") pod \"5b41c80a-f5cd-42c1-beca-ea55f9acc7b1\" (UID: \"5b41c80a-f5cd-42c1-beca-ea55f9acc7b1\") "
Sep 09 07:18:20.601924 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:20.601779    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b41c80a-f5cd-42c1-beca-ea55f9acc7b1-home" (OuterVolumeSpecName: "home") pod "5b41c80a-f5cd-42c1-beca-ea55f9acc7b1" (UID: "5b41c80a-f5cd-42c1-beca-ea55f9acc7b1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 07:18:20.601924 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:20.601802    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b41c80a-f5cd-42c1-beca-ea55f9acc7b1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5b41c80a-f5cd-42c1-beca-ea55f9acc7b1" (UID: "5b41c80a-f5cd-42c1-beca-ea55f9acc7b1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 07:18:20.602017 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:20.601976    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b41c80a-f5cd-42c1-beca-ea55f9acc7b1-model-cache" (OuterVolumeSpecName: "model-cache") pod "5b41c80a-f5cd-42c1-beca-ea55f9acc7b1" (UID: "5b41c80a-f5cd-42c1-beca-ea55f9acc7b1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 07:18:20.602126 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:20.602109    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b41c80a-f5cd-42c1-beca-ea55f9acc7b1-tmp-dir\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:18:20.602189 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:20.602128    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b41c80a-f5cd-42c1-beca-ea55f9acc7b1-home\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:18:20.602189 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:20.602136    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b41c80a-f5cd-42c1-beca-ea55f9acc7b1-model-cache\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:18:20.604007 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:20.603983    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b41c80a-f5cd-42c1-beca-ea55f9acc7b1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5b41c80a-f5cd-42c1-beca-ea55f9acc7b1" (UID: "5b41c80a-f5cd-42c1-beca-ea55f9acc7b1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 07:18:20.604111 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:20.604032    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b41c80a-f5cd-42c1-beca-ea55f9acc7b1-kube-api-access-hbthk" (OuterVolumeSpecName: "kube-api-access-hbthk") pod "5b41c80a-f5cd-42c1-beca-ea55f9acc7b1" (UID: "5b41c80a-f5cd-42c1-beca-ea55f9acc7b1"). InnerVolumeSpecName "kube-api-access-hbthk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 07:18:20.604111 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:20.604050    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b41c80a-f5cd-42c1-beca-ea55f9acc7b1-dshm" (OuterVolumeSpecName: "dshm") pod "5b41c80a-f5cd-42c1-beca-ea55f9acc7b1" (UID: "5b41c80a-f5cd-42c1-beca-ea55f9acc7b1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 07:18:20.675985 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:20.675951    2575 generic.go:356] "Generic (PLEG): container finished" podID="5b41c80a-f5cd-42c1-beca-ea55f9acc7b1" containerID="78256475c896447b64a4382866dc0a215209cf5053c50008a5952e906e1d1b49" exitCode=0
Sep 09 07:18:20.676098 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:20.676000    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-bea943/ipp-route-bea943-kserve-54d4949d75-qn4jb"
Sep 09 07:18:20.676098 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:20.676006    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-bea943/ipp-route-bea943-kserve-54d4949d75-qn4jb" event={"ID":"5b41c80a-f5cd-42c1-beca-ea55f9acc7b1","Type":"ContainerDied","Data":"78256475c896447b64a4382866dc0a215209cf5053c50008a5952e906e1d1b49"}
Sep 09 07:18:20.676098 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:20.676045    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-bea943/ipp-route-bea943-kserve-54d4949d75-qn4jb" event={"ID":"5b41c80a-f5cd-42c1-beca-ea55f9acc7b1","Type":"ContainerDied","Data":"c0662c9565aa5306302c86098d51e2d6192c7d61fae7e38334c74479b5777a58"}
Sep 09 07:18:20.676098 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:20.676066    2575 scope.go:117] "RemoveContainer" containerID="78256475c896447b64a4382866dc0a215209cf5053c50008a5952e906e1d1b49"
Sep 09 07:18:20.684682 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:20.684666    2575 scope.go:117] "RemoveContainer" containerID="78256475c896447b64a4382866dc0a215209cf5053c50008a5952e906e1d1b49"
Sep 09 07:18:20.684967 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:18:20.684949    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78256475c896447b64a4382866dc0a215209cf5053c50008a5952e906e1d1b49\": container with ID starting with 78256475c896447b64a4382866dc0a215209cf5053c50008a5952e906e1d1b49 not found: ID does not exist" containerID="78256475c896447b64a4382866dc0a215209cf5053c50008a5952e906e1d1b49"
Sep 09 07:18:20.685022 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:20.684974    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78256475c896447b64a4382866dc0a215209cf5053c50008a5952e906e1d1b49"} err="failed to get container status \"78256475c896447b64a4382866dc0a215209cf5053c50008a5952e906e1d1b49\": rpc error: code = NotFound desc = could not find container \"78256475c896447b64a4382866dc0a215209cf5053c50008a5952e906e1d1b49\": container with ID starting with 78256475c896447b64a4382866dc0a215209cf5053c50008a5952e906e1d1b49 not found: ID does not exist"
Sep 09 07:18:20.697143 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:20.697119    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-bea943/ipp-route-bea943-kserve-54d4949d75-qn4jb"]
Sep 09 07:18:20.701672 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:20.701650    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-bea943/ipp-route-bea943-kserve-54d4949d75-qn4jb"]
Sep 09 07:18:20.703088 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:20.703073    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b41c80a-f5cd-42c1-beca-ea55f9acc7b1-dshm\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:18:20.703149 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:20.703092    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbthk\" (UniqueName: \"kubernetes.io/projected/5b41c80a-f5cd-42c1-beca-ea55f9acc7b1-kube-api-access-hbthk\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:18:20.703149 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:20.703101    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b41c80a-f5cd-42c1-beca-ea55f9acc7b1-tls-certs\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:18:21.711095 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:21.711056    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b41c80a-f5cd-42c1-beca-ea55f9acc7b1" path="/var/lib/kubelet/pods/5b41c80a-f5cd-42c1-beca-ea55f9acc7b1/volumes"
Sep 09 07:18:48.478635 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:48.478601    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-083e4a-wkjls"]
Sep 09 07:18:48.479032 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:48.478994    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06914af0-be1b-4c31-bd1c-38b9275935fa" containerName="maas-api"
Sep 09 07:18:48.479032 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:48.479006    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="06914af0-be1b-4c31-bd1c-38b9275935fa" containerName="maas-api"
Sep 09 07:18:48.479032 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:48.479015    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5af5aff-491c-41c4-be79-d5c3e44e75f8" containerName="maas-api"
Sep 09 07:18:48.479032 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:48.479020    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5af5aff-491c-41c4-be79-d5c3e44e75f8" containerName="maas-api"
Sep 09 07:18:48.479032 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:48.479028    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60de8180-e864-473a-8186-a00f671a109b" containerName="payload-processing"
Sep 09 07:18:48.479032 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:48.479034    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="60de8180-e864-473a-8186-a00f671a109b" containerName="payload-processing"
Sep 09 07:18:48.479228 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:48.479041    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b41c80a-f5cd-42c1-beca-ea55f9acc7b1" containerName="main"
Sep 09 07:18:48.479228 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:48.479046    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b41c80a-f5cd-42c1-beca-ea55f9acc7b1" containerName="main"
Sep 09 07:18:48.479228 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:48.479119    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b41c80a-f5cd-42c1-beca-ea55f9acc7b1" containerName="main"
Sep 09 07:18:48.479228 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:48.479130    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5af5aff-491c-41c4-be79-d5c3e44e75f8" containerName="maas-api"
Sep 09 07:18:48.479228 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:48.479136    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="60de8180-e864-473a-8186-a00f671a109b" containerName="payload-processing"
Sep 09 07:18:48.479228 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:48.479143    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="06914af0-be1b-4c31-bd1c-38b9275935fa" containerName="maas-api"
Sep 09 07:18:48.482147 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:48.482131    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-083e4a-wkjls"
Sep 09 07:18:48.485103 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:48.485081    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 07:18:48.485221 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:48.485176    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bbglc\""
Sep 09 07:18:48.490135 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:48.490115    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-083e4a-wkjls"]
Sep 09 07:18:48.527820 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:48.527794    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f93cef1-c60e-47c3-8b8e-1d39ad81d7c6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-083e4a-wkjls\" (UID: \"2f93cef1-c60e-47c3-8b8e-1d39ad81d7c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-083e4a-wkjls"
Sep 09 07:18:48.629021 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:48.628991    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f93cef1-c60e-47c3-8b8e-1d39ad81d7c6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-083e4a-wkjls\" (UID: \"2f93cef1-c60e-47c3-8b8e-1d39ad81d7c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-083e4a-wkjls"
Sep 09 07:18:48.629601 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:48.629581    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f93cef1-c60e-47c3-8b8e-1d39ad81d7c6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-083e4a-wkjls\" (UID: \"2f93cef1-c60e-47c3-8b8e-1d39ad81d7c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-083e4a-wkjls"
Sep 09 07:18:48.793200 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:48.793125    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-083e4a-wkjls"
Sep 09 07:18:49.066471 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:49.066443    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-083e4a-wkjls"]
Sep 09 07:18:49.068629 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:18:49.068601    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f93cef1_c60e_47c3_8b8e_1d39ad81d7c6.slice/crio-bbef3c3071557cfb265f73ba2ad146084c99c6e64cdff4d338e20e6080af4e28 WatchSource:0}: Error finding container bbef3c3071557cfb265f73ba2ad146084c99c6e64cdff4d338e20e6080af4e28: Status 404 returned error can't find the container with id bbef3c3071557cfb265f73ba2ad146084c99c6e64cdff4d338e20e6080af4e28
Sep 09 07:18:49.822417 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:49.822393    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-083e4a-wkjls" event={"ID":"2f93cef1-c60e-47c3-8b8e-1d39ad81d7c6","Type":"ContainerStarted","Data":"b8a17d76499e515c062125a4fe7ed4a9dd1a90baafcfb5a685518d2ffc7df4ff"}
Sep 09 07:18:49.822702 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:49.822449    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-083e4a-wkjls" event={"ID":"2f93cef1-c60e-47c3-8b8e-1d39ad81d7c6","Type":"ContainerStarted","Data":"bbef3c3071557cfb265f73ba2ad146084c99c6e64cdff4d338e20e6080af4e28"}
Sep 09 07:18:50.829063 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:50.829023    2575 generic.go:356] "Generic (PLEG): container finished" podID="2f93cef1-c60e-47c3-8b8e-1d39ad81d7c6" containerID="b8a17d76499e515c062125a4fe7ed4a9dd1a90baafcfb5a685518d2ffc7df4ff" exitCode=0
Sep 09 07:18:50.829464 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:50.829084    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-083e4a-wkjls" event={"ID":"2f93cef1-c60e-47c3-8b8e-1d39ad81d7c6","Type":"ContainerDied","Data":"b8a17d76499e515c062125a4fe7ed4a9dd1a90baafcfb5a685518d2ffc7df4ff"}
Sep 09 07:18:50.964297 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:50.964275    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-083e4a-wkjls"
Sep 09 07:18:51.049848 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:51.049816    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f93cef1-c60e-47c3-8b8e-1d39ad81d7c6-maas-api-service-ca\") pod \"2f93cef1-c60e-47c3-8b8e-1d39ad81d7c6\" (UID: \"2f93cef1-c60e-47c3-8b8e-1d39ad81d7c6\") "
Sep 09 07:18:51.050212 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:51.050187    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f93cef1-c60e-47c3-8b8e-1d39ad81d7c6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2f93cef1-c60e-47c3-8b8e-1d39ad81d7c6" (UID: "2f93cef1-c60e-47c3-8b8e-1d39ad81d7c6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 07:18:51.151165 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:51.151136    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f93cef1-c60e-47c3-8b8e-1d39ad81d7c6-maas-api-service-ca\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:18:51.836401 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:51.836375    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-083e4a-wkjls"
Sep 09 07:18:51.836824 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:51.836368    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-083e4a-wkjls" event={"ID":"2f93cef1-c60e-47c3-8b8e-1d39ad81d7c6","Type":"ContainerDied","Data":"bbef3c3071557cfb265f73ba2ad146084c99c6e64cdff4d338e20e6080af4e28"}
Sep 09 07:18:51.836824 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:51.836520    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bbef3c3071557cfb265f73ba2ad146084c99c6e64cdff4d338e20e6080af4e28"
Sep 09 07:18:59.153902 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:59.153869    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-083e4a-wkjls"]
Sep 09 07:18:59.157672 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:59.157648    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-083e4a-wkjls"]
Sep 09 07:18:59.713465 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:18:59.713425    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f93cef1-c60e-47c3-8b8e-1d39ad81d7c6" path="/var/lib/kubelet/pods/2f93cef1-c60e-47c3-8b8e-1d39ad81d7c6/volumes"
Sep 09 07:19:16.502921 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:16.502881    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-ea0f1c-bd755c56c-9qpt4"]
Sep 09 07:19:16.503380 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:16.503158    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ea0f1c-bd755c56c-9qpt4" podUID="9c5e60db-c474-4691-9d05-214734d67834" containerName="payload-processing" containerID="cri-o://36fea2e78c39a4699d20a2bceb0a10de5afec62a53f374f1be846c484c4870b0" gracePeriod=30
Sep 09 07:19:16.513592 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:16.513567    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ea0f1c-6d4fdfff5d-jtzpq"]
Sep 09 07:19:16.514043 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:16.513997    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ea0f1c-6d4fdfff5d-jtzpq" podUID="f2b88f27-ae58-407d-9ca3-230e5bde6740" containerName="payload-pre-processing" containerID="cri-o://3e60a7c75c83fac21338a175fc5b8f0f098d7fbf06c5b8323a0595522be2e4c7" gracePeriod=30
Sep 09 07:19:16.792469 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:16.792443    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ea0f1c-bd755c56c-9qpt4"
Sep 09 07:19:16.795131 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:16.795116    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ea0f1c-6d4fdfff5d-jtzpq"
Sep 09 07:19:16.864789 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:16.864760    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2b88f27-ae58-407d-9ca3-230e5bde6740-plugins-config-volume\") pod \"f2b88f27-ae58-407d-9ca3-230e5bde6740\" (UID: \"f2b88f27-ae58-407d-9ca3-230e5bde6740\") "
Sep 09 07:19:16.864943 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:16.864804    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nx2x8\" (UniqueName: \"kubernetes.io/projected/f2b88f27-ae58-407d-9ca3-230e5bde6740-kube-api-access-nx2x8\") pod \"f2b88f27-ae58-407d-9ca3-230e5bde6740\" (UID: \"f2b88f27-ae58-407d-9ca3-230e5bde6740\") "
Sep 09 07:19:16.864943 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:16.864835    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h8n9l\" (UniqueName: \"kubernetes.io/projected/9c5e60db-c474-4691-9d05-214734d67834-kube-api-access-h8n9l\") pod \"9c5e60db-c474-4691-9d05-214734d67834\" (UID: \"9c5e60db-c474-4691-9d05-214734d67834\") "
Sep 09 07:19:16.864943 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:16.864916    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c5e60db-c474-4691-9d05-214734d67834-plugins-config-volume\") pod \"9c5e60db-c474-4691-9d05-214734d67834\" (UID: \"9c5e60db-c474-4691-9d05-214734d67834\") "
Sep 09 07:19:16.865291 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:16.865134    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2b88f27-ae58-407d-9ca3-230e5bde6740-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f2b88f27-ae58-407d-9ca3-230e5bde6740" (UID: "f2b88f27-ae58-407d-9ca3-230e5bde6740"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 07:19:16.865390 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:16.865295    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c5e60db-c474-4691-9d05-214734d67834-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9c5e60db-c474-4691-9d05-214734d67834" (UID: "9c5e60db-c474-4691-9d05-214734d67834"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 07:19:16.867107 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:16.867075    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2b88f27-ae58-407d-9ca3-230e5bde6740-kube-api-access-nx2x8" (OuterVolumeSpecName: "kube-api-access-nx2x8") pod "f2b88f27-ae58-407d-9ca3-230e5bde6740" (UID: "f2b88f27-ae58-407d-9ca3-230e5bde6740"). InnerVolumeSpecName "kube-api-access-nx2x8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 07:19:16.867107 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:16.867084    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c5e60db-c474-4691-9d05-214734d67834-kube-api-access-h8n9l" (OuterVolumeSpecName: "kube-api-access-h8n9l") pod "9c5e60db-c474-4691-9d05-214734d67834" (UID: "9c5e60db-c474-4691-9d05-214734d67834"). InnerVolumeSpecName "kube-api-access-h8n9l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 07:19:16.957921 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:16.957893    2575 generic.go:356] "Generic (PLEG): container finished" podID="9c5e60db-c474-4691-9d05-214734d67834" containerID="36fea2e78c39a4699d20a2bceb0a10de5afec62a53f374f1be846c484c4870b0" exitCode=0
Sep 09 07:19:16.958078 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:16.957938    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ea0f1c-bd755c56c-9qpt4"
Sep 09 07:19:16.958078 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:16.957982    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ea0f1c-bd755c56c-9qpt4" event={"ID":"9c5e60db-c474-4691-9d05-214734d67834","Type":"ContainerDied","Data":"36fea2e78c39a4699d20a2bceb0a10de5afec62a53f374f1be846c484c4870b0"}
Sep 09 07:19:16.958078 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:16.958042    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ea0f1c-bd755c56c-9qpt4" event={"ID":"9c5e60db-c474-4691-9d05-214734d67834","Type":"ContainerDied","Data":"464ab00d716989be80a1a952e41a220d306549c5b08de786284452effc8e2453"}
Sep 09 07:19:16.958078 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:16.958071    2575 scope.go:117] "RemoveContainer" containerID="36fea2e78c39a4699d20a2bceb0a10de5afec62a53f374f1be846c484c4870b0"
Sep 09 07:19:16.965931 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:16.965900    2575 generic.go:356] "Generic (PLEG): container finished" podID="f2b88f27-ae58-407d-9ca3-230e5bde6740" containerID="3e60a7c75c83fac21338a175fc5b8f0f098d7fbf06c5b8323a0595522be2e4c7" exitCode=0
Sep 09 07:19:16.966056 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:16.966038    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ea0f1c-6d4fdfff5d-jtzpq" event={"ID":"f2b88f27-ae58-407d-9ca3-230e5bde6740","Type":"ContainerDied","Data":"3e60a7c75c83fac21338a175fc5b8f0f098d7fbf06c5b8323a0595522be2e4c7"}
Sep 09 07:19:16.966203 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:16.966181    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ea0f1c-6d4fdfff5d-jtzpq"
Sep 09 07:19:16.966203 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:16.966194    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ea0f1c-6d4fdfff5d-jtzpq" event={"ID":"f2b88f27-ae58-407d-9ca3-230e5bde6740","Type":"ContainerDied","Data":"e4d885c629abc591acacd500ed6a406697d2dee3469e91750ac71c0553fce7ca"}
Sep 09 07:19:16.967056 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:16.967034    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2b88f27-ae58-407d-9ca3-230e5bde6740-plugins-config-volume\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:19:16.967056 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:16.967061    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nx2x8\" (UniqueName: \"kubernetes.io/projected/f2b88f27-ae58-407d-9ca3-230e5bde6740-kube-api-access-nx2x8\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:19:16.967231 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:16.967084    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8n9l\" (UniqueName: \"kubernetes.io/projected/9c5e60db-c474-4691-9d05-214734d67834-kube-api-access-h8n9l\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:19:16.967231 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:16.967106    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c5e60db-c474-4691-9d05-214734d67834-plugins-config-volume\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:19:16.976503 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:16.976487    2575 scope.go:117] "RemoveContainer" containerID="36fea2e78c39a4699d20a2bceb0a10de5afec62a53f374f1be846c484c4870b0"
Sep 09 07:19:16.976803 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:19:16.976783    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36fea2e78c39a4699d20a2bceb0a10de5afec62a53f374f1be846c484c4870b0\": container with ID starting with 36fea2e78c39a4699d20a2bceb0a10de5afec62a53f374f1be846c484c4870b0 not found: ID does not exist" containerID="36fea2e78c39a4699d20a2bceb0a10de5afec62a53f374f1be846c484c4870b0"
Sep 09 07:19:16.976861 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:16.976812    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36fea2e78c39a4699d20a2bceb0a10de5afec62a53f374f1be846c484c4870b0"} err="failed to get container status \"36fea2e78c39a4699d20a2bceb0a10de5afec62a53f374f1be846c484c4870b0\": rpc error: code = NotFound desc = could not find container \"36fea2e78c39a4699d20a2bceb0a10de5afec62a53f374f1be846c484c4870b0\": container with ID starting with 36fea2e78c39a4699d20a2bceb0a10de5afec62a53f374f1be846c484c4870b0 not found: ID does not exist"
Sep 09 07:19:16.976861 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:16.976828    2575 scope.go:117] "RemoveContainer" containerID="3e60a7c75c83fac21338a175fc5b8f0f098d7fbf06c5b8323a0595522be2e4c7"
Sep 09 07:19:16.984791 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:16.984773    2575 scope.go:117] "RemoveContainer" containerID="3e60a7c75c83fac21338a175fc5b8f0f098d7fbf06c5b8323a0595522be2e4c7"
Sep 09 07:19:16.985043 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:19:16.985026    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e60a7c75c83fac21338a175fc5b8f0f098d7fbf06c5b8323a0595522be2e4c7\": container with ID starting with 3e60a7c75c83fac21338a175fc5b8f0f098d7fbf06c5b8323a0595522be2e4c7 not found: ID does not exist" containerID="3e60a7c75c83fac21338a175fc5b8f0f098d7fbf06c5b8323a0595522be2e4c7"
Sep 09 07:19:16.985089 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:16.985051    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e60a7c75c83fac21338a175fc5b8f0f098d7fbf06c5b8323a0595522be2e4c7"} err="failed to get container status \"3e60a7c75c83fac21338a175fc5b8f0f098d7fbf06c5b8323a0595522be2e4c7\": rpc error: code = NotFound desc = could not find container \"3e60a7c75c83fac21338a175fc5b8f0f098d7fbf06c5b8323a0595522be2e4c7\": container with ID starting with 3e60a7c75c83fac21338a175fc5b8f0f098d7fbf06c5b8323a0595522be2e4c7 not found: ID does not exist"
Sep 09 07:19:16.998278 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:16.998257    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-ea0f1c-bd755c56c-9qpt4"]
Sep 09 07:19:17.004342 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:17.004323    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-ea0f1c-bd755c56c-9qpt4"]
Sep 09 07:19:17.015789 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:17.015741    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ea0f1c-6d4fdfff5d-jtzpq"]
Sep 09 07:19:17.021084 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:17.021027    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ea0f1c-6d4fdfff5d-jtzpq"]
Sep 09 07:19:17.711795 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:17.711765    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c5e60db-c474-4691-9d05-214734d67834" path="/var/lib/kubelet/pods/9c5e60db-c474-4691-9d05-214734d67834/volumes"
Sep 09 07:19:17.712166 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:17.712130    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2b88f27-ae58-407d-9ca3-230e5bde6740" path="/var/lib/kubelet/pods/f2b88f27-ae58-407d-9ca3-230e5bde6740/volumes"
Sep 09 07:19:34.692639 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:34.692554    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-988b24-6d44b9dcc5-s577j"]
Sep 09 07:19:34.693469 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:34.693409    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-988b24-6d44b9dcc5-s577j" podUID="b0009a37-110e-4422-af75-b5ea06ff64da" containerName="payload-processing" containerID="cri-o://20903f7b3a3f302ef0e585c65a2d6e2da487c24a9302cdf718b5618e198079e9" gracePeriod=30
Sep 09 07:19:34.699098 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:34.699073    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-988b24-7cbcc787c8-kqzth"]
Sep 09 07:19:34.699309 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:34.699264    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-988b24-7cbcc787c8-kqzth" podUID="ccbfc2e6-2cea-4eb3-a0e0-e2c4af53bf9e" containerName="payload-pre-processing" containerID="cri-o://e7248408f72f4a8571d81a20f22e260a77afcf00273c0abbfde31cc3fec30c3a" gracePeriod=30
Sep 09 07:19:34.979178 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:34.979157    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-988b24-6d44b9dcc5-s577j"
Sep 09 07:19:34.982186 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:34.982169    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-988b24-7cbcc787c8-kqzth"
Sep 09 07:19:35.058563 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:35.058532    2575 generic.go:356] "Generic (PLEG): container finished" podID="ccbfc2e6-2cea-4eb3-a0e0-e2c4af53bf9e" containerID="e7248408f72f4a8571d81a20f22e260a77afcf00273c0abbfde31cc3fec30c3a" exitCode=0
Sep 09 07:19:35.058730 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:35.058575    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-988b24-7cbcc787c8-kqzth"
Sep 09 07:19:35.058730 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:35.058616    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-988b24-7cbcc787c8-kqzth" event={"ID":"ccbfc2e6-2cea-4eb3-a0e0-e2c4af53bf9e","Type":"ContainerDied","Data":"e7248408f72f4a8571d81a20f22e260a77afcf00273c0abbfde31cc3fec30c3a"}
Sep 09 07:19:35.058730 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:35.058673    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-988b24-7cbcc787c8-kqzth" event={"ID":"ccbfc2e6-2cea-4eb3-a0e0-e2c4af53bf9e","Type":"ContainerDied","Data":"f4ecd987ac021dd27e6480417ed2b8140521da0e6ae1533873e662349b4e7962"}
Sep 09 07:19:35.058730 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:35.058702    2575 scope.go:117] "RemoveContainer" containerID="e7248408f72f4a8571d81a20f22e260a77afcf00273c0abbfde31cc3fec30c3a"
Sep 09 07:19:35.059850 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:35.059827    2575 generic.go:356] "Generic (PLEG): container finished" podID="b0009a37-110e-4422-af75-b5ea06ff64da" containerID="20903f7b3a3f302ef0e585c65a2d6e2da487c24a9302cdf718b5618e198079e9" exitCode=0
Sep 09 07:19:35.059945 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:35.059868    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-988b24-6d44b9dcc5-s577j"
Sep 09 07:19:35.059945 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:35.059899    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-988b24-6d44b9dcc5-s577j" event={"ID":"b0009a37-110e-4422-af75-b5ea06ff64da","Type":"ContainerDied","Data":"20903f7b3a3f302ef0e585c65a2d6e2da487c24a9302cdf718b5618e198079e9"}
Sep 09 07:19:35.059945 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:35.059935    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-988b24-6d44b9dcc5-s577j" event={"ID":"b0009a37-110e-4422-af75-b5ea06ff64da","Type":"ContainerDied","Data":"26ae9d1073c633b23accce31e5f67c626f6c48a1f84f690a631c6b53a58a3aae"}
Sep 09 07:19:35.067612 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:35.067536    2575 scope.go:117] "RemoveContainer" containerID="e7248408f72f4a8571d81a20f22e260a77afcf00273c0abbfde31cc3fec30c3a"
Sep 09 07:19:35.068078 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:19:35.067963    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7248408f72f4a8571d81a20f22e260a77afcf00273c0abbfde31cc3fec30c3a\": container with ID starting with e7248408f72f4a8571d81a20f22e260a77afcf00273c0abbfde31cc3fec30c3a not found: ID does not exist" containerID="e7248408f72f4a8571d81a20f22e260a77afcf00273c0abbfde31cc3fec30c3a"
Sep 09 07:19:35.068078 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:35.067995    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7248408f72f4a8571d81a20f22e260a77afcf00273c0abbfde31cc3fec30c3a"} err="failed to get container status \"e7248408f72f4a8571d81a20f22e260a77afcf00273c0abbfde31cc3fec30c3a\": rpc error: code = NotFound desc = could not find container \"e7248408f72f4a8571d81a20f22e260a77afcf00273c0abbfde31cc3fec30c3a\": container with ID starting with e7248408f72f4a8571d81a20f22e260a77afcf00273c0abbfde31cc3fec30c3a not found: ID does not exist"
Sep 09 07:19:35.068078 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:35.068015    2575 scope.go:117] "RemoveContainer" containerID="20903f7b3a3f302ef0e585c65a2d6e2da487c24a9302cdf718b5618e198079e9"
Sep 09 07:19:35.081830 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:35.081814    2575 scope.go:117] "RemoveContainer" containerID="20903f7b3a3f302ef0e585c65a2d6e2da487c24a9302cdf718b5618e198079e9"
Sep 09 07:19:35.082086 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:19:35.082068    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20903f7b3a3f302ef0e585c65a2d6e2da487c24a9302cdf718b5618e198079e9\": container with ID starting with 20903f7b3a3f302ef0e585c65a2d6e2da487c24a9302cdf718b5618e198079e9 not found: ID does not exist" containerID="20903f7b3a3f302ef0e585c65a2d6e2da487c24a9302cdf718b5618e198079e9"
Sep 09 07:19:35.082140 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:35.082092    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20903f7b3a3f302ef0e585c65a2d6e2da487c24a9302cdf718b5618e198079e9"} err="failed to get container status \"20903f7b3a3f302ef0e585c65a2d6e2da487c24a9302cdf718b5618e198079e9\": rpc error: code = NotFound desc = could not find container \"20903f7b3a3f302ef0e585c65a2d6e2da487c24a9302cdf718b5618e198079e9\": container with ID starting with 20903f7b3a3f302ef0e585c65a2d6e2da487c24a9302cdf718b5618e198079e9 not found: ID does not exist"
Sep 09 07:19:35.135186 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:35.135166    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ccbfc2e6-2cea-4eb3-a0e0-e2c4af53bf9e-plugins-config-volume\") pod \"ccbfc2e6-2cea-4eb3-a0e0-e2c4af53bf9e\" (UID: \"ccbfc2e6-2cea-4eb3-a0e0-e2c4af53bf9e\") "
Sep 09 07:19:35.135277 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:35.135193    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b0009a37-110e-4422-af75-b5ea06ff64da-plugins-config-volume\") pod \"b0009a37-110e-4422-af75-b5ea06ff64da\" (UID: \"b0009a37-110e-4422-af75-b5ea06ff64da\") "
Sep 09 07:19:35.135277 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:35.135259    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sktf7\" (UniqueName: \"kubernetes.io/projected/ccbfc2e6-2cea-4eb3-a0e0-e2c4af53bf9e-kube-api-access-sktf7\") pod \"ccbfc2e6-2cea-4eb3-a0e0-e2c4af53bf9e\" (UID: \"ccbfc2e6-2cea-4eb3-a0e0-e2c4af53bf9e\") "
Sep 09 07:19:35.135381 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:35.135292    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4vmk\" (UniqueName: \"kubernetes.io/projected/b0009a37-110e-4422-af75-b5ea06ff64da-kube-api-access-q4vmk\") pod \"b0009a37-110e-4422-af75-b5ea06ff64da\" (UID: \"b0009a37-110e-4422-af75-b5ea06ff64da\") "
Sep 09 07:19:35.135541 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:35.135517    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ccbfc2e6-2cea-4eb3-a0e0-e2c4af53bf9e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ccbfc2e6-2cea-4eb3-a0e0-e2c4af53bf9e" (UID: "ccbfc2e6-2cea-4eb3-a0e0-e2c4af53bf9e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 07:19:35.135620 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:35.135579    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0009a37-110e-4422-af75-b5ea06ff64da-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b0009a37-110e-4422-af75-b5ea06ff64da" (UID: "b0009a37-110e-4422-af75-b5ea06ff64da"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 07:19:35.137475 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:35.137456    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0009a37-110e-4422-af75-b5ea06ff64da-kube-api-access-q4vmk" (OuterVolumeSpecName: "kube-api-access-q4vmk") pod "b0009a37-110e-4422-af75-b5ea06ff64da" (UID: "b0009a37-110e-4422-af75-b5ea06ff64da"). InnerVolumeSpecName "kube-api-access-q4vmk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 07:19:35.137567 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:35.137529    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccbfc2e6-2cea-4eb3-a0e0-e2c4af53bf9e-kube-api-access-sktf7" (OuterVolumeSpecName: "kube-api-access-sktf7") pod "ccbfc2e6-2cea-4eb3-a0e0-e2c4af53bf9e" (UID: "ccbfc2e6-2cea-4eb3-a0e0-e2c4af53bf9e"). InnerVolumeSpecName "kube-api-access-sktf7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 07:19:35.236764 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:35.236671    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sktf7\" (UniqueName: \"kubernetes.io/projected/ccbfc2e6-2cea-4eb3-a0e0-e2c4af53bf9e-kube-api-access-sktf7\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:19:35.236764 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:35.236697    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4vmk\" (UniqueName: \"kubernetes.io/projected/b0009a37-110e-4422-af75-b5ea06ff64da-kube-api-access-q4vmk\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:19:35.236764 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:35.236710    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ccbfc2e6-2cea-4eb3-a0e0-e2c4af53bf9e-plugins-config-volume\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:19:35.236764 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:35.236722    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b0009a37-110e-4422-af75-b5ea06ff64da-plugins-config-volume\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:19:35.383325 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:35.383299    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-988b24-6d44b9dcc5-s577j"]
Sep 09 07:19:35.387702 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:35.387674    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-988b24-6d44b9dcc5-s577j"]
Sep 09 07:19:35.398230 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:35.398208    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-988b24-7cbcc787c8-kqzth"]
Sep 09 07:19:35.402450 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:35.402431    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-988b24-7cbcc787c8-kqzth"]
Sep 09 07:19:35.712419 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:35.712390    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0009a37-110e-4422-af75-b5ea06ff64da" path="/var/lib/kubelet/pods/b0009a37-110e-4422-af75-b5ea06ff64da/volumes"
Sep 09 07:19:35.712762 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:19:35.712734    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ccbfc2e6-2cea-4eb3-a0e0-e2c4af53bf9e" path="/var/lib/kubelet/pods/ccbfc2e6-2cea-4eb3-a0e0-e2c4af53bf9e/volumes"
Sep 09 07:20:05.967380 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:20:05.967348    2575 scope.go:117] "RemoveContainer" containerID="d810087c9e445a2ef286f83c599cc7cc3f138e931cfcd87a0b5a245287507dd2"
Sep 09 07:21:05.998060 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:21:05.998035    2575 scope.go:117] "RemoveContainer" containerID="3c7e03b17dae76ee7a28500cc74e5a6065bf261fed5da0361b06b59733e5a372"
Sep 09 07:21:06.005533 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:21:06.005518    2575 scope.go:117] "RemoveContainer" containerID="b4c49a537ad23664b0e857448300c1dc1118ffb1727149532192c933cd881ded"
Sep 09 07:21:06.012528 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:21:06.012511    2575 scope.go:117] "RemoveContainer" containerID="14d36d6e241207705a4cbc571189fe7dcd7e648a536b2b9a086adf42692696c9"
Sep 09 07:22:31.569558 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:22:31.569475    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5k2lr"]
Sep 09 07:22:31.572102 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:22:31.569692    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5k2lr" podUID="e09f7636-8d96-43de-9632-9433bf590c77" containerName="manager" containerID="cri-o://4e5fc00c1b6041422167cd8d8548b50f2d0e84cba6f55716cade1ab641bec98b" gracePeriod=10
Sep 09 07:22:31.813665 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:22:31.813644    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5k2lr"
Sep 09 07:22:31.888308 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:22:31.888275    2575 generic.go:356] "Generic (PLEG): container finished" podID="e09f7636-8d96-43de-9632-9433bf590c77" containerID="4e5fc00c1b6041422167cd8d8548b50f2d0e84cba6f55716cade1ab641bec98b" exitCode=0
Sep 09 07:22:31.888495 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:22:31.888318    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5k2lr"
Sep 09 07:22:31.888495 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:22:31.888360    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5k2lr" event={"ID":"e09f7636-8d96-43de-9632-9433bf590c77","Type":"ContainerDied","Data":"4e5fc00c1b6041422167cd8d8548b50f2d0e84cba6f55716cade1ab641bec98b"}
Sep 09 07:22:31.888495 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:22:31.888431    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5k2lr" event={"ID":"e09f7636-8d96-43de-9632-9433bf590c77","Type":"ContainerDied","Data":"8faa0fdfb0bc0b418f16d3386b60696324493096d5912d9abdcb17bd3928caac"}
Sep 09 07:22:31.888495 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:22:31.888461    2575 scope.go:117] "RemoveContainer" containerID="4e5fc00c1b6041422167cd8d8548b50f2d0e84cba6f55716cade1ab641bec98b"
Sep 09 07:22:31.898163 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:22:31.898146    2575 scope.go:117] "RemoveContainer" containerID="4e5fc00c1b6041422167cd8d8548b50f2d0e84cba6f55716cade1ab641bec98b"
Sep 09 07:22:31.898439 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:22:31.898422    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e5fc00c1b6041422167cd8d8548b50f2d0e84cba6f55716cade1ab641bec98b\": container with ID starting with 4e5fc00c1b6041422167cd8d8548b50f2d0e84cba6f55716cade1ab641bec98b not found: ID does not exist" containerID="4e5fc00c1b6041422167cd8d8548b50f2d0e84cba6f55716cade1ab641bec98b"
Sep 09 07:22:31.898540 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:22:31.898449    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e5fc00c1b6041422167cd8d8548b50f2d0e84cba6f55716cade1ab641bec98b"} err="failed to get container status \"4e5fc00c1b6041422167cd8d8548b50f2d0e84cba6f55716cade1ab641bec98b\": rpc error: code = NotFound desc = could not find container \"4e5fc00c1b6041422167cd8d8548b50f2d0e84cba6f55716cade1ab641bec98b\": container with ID starting with 4e5fc00c1b6041422167cd8d8548b50f2d0e84cba6f55716cade1ab641bec98b not found: ID does not exist"
Sep 09 07:22:31.991475 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:22:31.991451    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x72lx\" (UniqueName: \"kubernetes.io/projected/e09f7636-8d96-43de-9632-9433bf590c77-kube-api-access-x72lx\") pod \"e09f7636-8d96-43de-9632-9433bf590c77\" (UID: \"e09f7636-8d96-43de-9632-9433bf590c77\") "
Sep 09 07:22:31.991587 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:22:31.991481    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e09f7636-8d96-43de-9632-9433bf590c77-extensions-socket-volume\") pod \"e09f7636-8d96-43de-9632-9433bf590c77\" (UID: \"e09f7636-8d96-43de-9632-9433bf590c77\") "
Sep 09 07:22:31.991927 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:22:31.991909    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e09f7636-8d96-43de-9632-9433bf590c77-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e09f7636-8d96-43de-9632-9433bf590c77" (UID: "e09f7636-8d96-43de-9632-9433bf590c77"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 07:22:31.993525 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:22:31.993507    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e09f7636-8d96-43de-9632-9433bf590c77-kube-api-access-x72lx" (OuterVolumeSpecName: "kube-api-access-x72lx") pod "e09f7636-8d96-43de-9632-9433bf590c77" (UID: "e09f7636-8d96-43de-9632-9433bf590c77"). InnerVolumeSpecName "kube-api-access-x72lx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 07:22:32.092360 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:22:32.092336    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x72lx\" (UniqueName: \"kubernetes.io/projected/e09f7636-8d96-43de-9632-9433bf590c77-kube-api-access-x72lx\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:22:32.092360 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:22:32.092357    2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e09f7636-8d96-43de-9632-9433bf590c77-extensions-socket-volume\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:22:32.214858 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:22:32.214829    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5k2lr"]
Sep 09 07:22:32.219562 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:22:32.219538    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5k2lr"]
Sep 09 07:22:33.711141 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:22:33.711099    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e09f7636-8d96-43de-9632-9433bf590c77" path="/var/lib/kubelet/pods/e09f7636-8d96-43de-9632-9433bf590c77/volumes"
Sep 09 07:23:32.271619 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:23:32.271582    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kvzq9"]
Sep 09 07:23:32.272096 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:23:32.271939    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f93cef1-c60e-47c3-8b8e-1d39ad81d7c6" containerName="revoke-keys"
Sep 09 07:23:32.272096 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:23:32.271952    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f93cef1-c60e-47c3-8b8e-1d39ad81d7c6" containerName="revoke-keys"
Sep 09 07:23:32.272096 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:23:32.271959    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c5e60db-c474-4691-9d05-214734d67834" containerName="payload-processing"
Sep 09 07:23:32.272096 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:23:32.271965    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c5e60db-c474-4691-9d05-214734d67834" containerName="payload-processing"
Sep 09 07:23:32.272096 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:23:32.271974    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e09f7636-8d96-43de-9632-9433bf590c77" containerName="manager"
Sep 09 07:23:32.272096 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:23:32.271979    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e09f7636-8d96-43de-9632-9433bf590c77" containerName="manager"
Sep 09 07:23:32.272096 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:23:32.271991    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccbfc2e6-2cea-4eb3-a0e0-e2c4af53bf9e" containerName="payload-pre-processing"
Sep 09 07:23:32.272096 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:23:32.271996    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccbfc2e6-2cea-4eb3-a0e0-e2c4af53bf9e" containerName="payload-pre-processing"
Sep 09 07:23:32.272096 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:23:32.272001    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0009a37-110e-4422-af75-b5ea06ff64da" containerName="payload-processing"
Sep 09 07:23:32.272096 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:23:32.272006    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0009a37-110e-4422-af75-b5ea06ff64da" containerName="payload-processing"
Sep 09 07:23:32.272096 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:23:32.272014    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2b88f27-ae58-407d-9ca3-230e5bde6740" containerName="payload-pre-processing"
Sep 09 07:23:32.272096 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:23:32.272019    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2b88f27-ae58-407d-9ca3-230e5bde6740" containerName="payload-pre-processing"
Sep 09 07:23:32.272096 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:23:32.272071    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e09f7636-8d96-43de-9632-9433bf590c77" containerName="manager"
Sep 09 07:23:32.272096 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:23:32.272078    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c5e60db-c474-4691-9d05-214734d67834" containerName="payload-processing"
Sep 09 07:23:32.272096 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:23:32.272083    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccbfc2e6-2cea-4eb3-a0e0-e2c4af53bf9e" containerName="payload-pre-processing"
Sep 09 07:23:32.272096 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:23:32.272089    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2b88f27-ae58-407d-9ca3-230e5bde6740" containerName="payload-pre-processing"
Sep 09 07:23:32.272096 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:23:32.272094    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0009a37-110e-4422-af75-b5ea06ff64da" containerName="payload-processing"
Sep 09 07:23:32.272096 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:23:32.272101    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f93cef1-c60e-47c3-8b8e-1d39ad81d7c6" containerName="revoke-keys"
Sep 09 07:23:32.275114 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:23:32.275099    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kvzq9"
Sep 09 07:23:32.277979 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:23:32.277959    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-gfwrd\""
Sep 09 07:23:32.287616 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:23:32.287590    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kvzq9"]
Sep 09 07:23:32.305672 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:23:32.305645    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b57f22a1-2317-4f63-9362-53a5be5f9f80-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-kvzq9\" (UID: \"b57f22a1-2317-4f63-9362-53a5be5f9f80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kvzq9"
Sep 09 07:23:32.305794 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:23:32.305688    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krxg7\" (UniqueName: \"kubernetes.io/projected/b57f22a1-2317-4f63-9362-53a5be5f9f80-kube-api-access-krxg7\") pod \"kuadrant-operator-controller-manager-5769f99d9f-kvzq9\" (UID: \"b57f22a1-2317-4f63-9362-53a5be5f9f80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kvzq9"
Sep 09 07:23:32.407094 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:23:32.407069    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krxg7\" (UniqueName: \"kubernetes.io/projected/b57f22a1-2317-4f63-9362-53a5be5f9f80-kube-api-access-krxg7\") pod \"kuadrant-operator-controller-manager-5769f99d9f-kvzq9\" (UID: \"b57f22a1-2317-4f63-9362-53a5be5f9f80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kvzq9"
Sep 09 07:23:32.407200 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:23:32.407184    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b57f22a1-2317-4f63-9362-53a5be5f9f80-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-kvzq9\" (UID: \"b57f22a1-2317-4f63-9362-53a5be5f9f80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kvzq9"
Sep 09 07:23:32.407523 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:23:32.407507    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b57f22a1-2317-4f63-9362-53a5be5f9f80-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-kvzq9\" (UID: \"b57f22a1-2317-4f63-9362-53a5be5f9f80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kvzq9"
Sep 09 07:23:32.415893 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:23:32.415865    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krxg7\" (UniqueName: \"kubernetes.io/projected/b57f22a1-2317-4f63-9362-53a5be5f9f80-kube-api-access-krxg7\") pod \"kuadrant-operator-controller-manager-5769f99d9f-kvzq9\" (UID: \"b57f22a1-2317-4f63-9362-53a5be5f9f80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kvzq9"
Sep 09 07:23:32.585325 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:23:32.585255    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kvzq9"
Sep 09 07:23:32.864456 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:23:32.864425    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kvzq9"]
Sep 09 07:23:32.865858 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:23:32.865825    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb57f22a1_2317_4f63_9362_53a5be5f9f80.slice/crio-2ae112ac147b87ccbaa148c25ef9a56d1bdf029e1c18a6d67aca0bf8e6d7ce5a WatchSource:0}: Error finding container 2ae112ac147b87ccbaa148c25ef9a56d1bdf029e1c18a6d67aca0bf8e6d7ce5a: Status 404 returned error can't find the container with id 2ae112ac147b87ccbaa148c25ef9a56d1bdf029e1c18a6d67aca0bf8e6d7ce5a
Sep 09 07:23:33.167187 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:23:33.167152    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kvzq9" event={"ID":"b57f22a1-2317-4f63-9362-53a5be5f9f80","Type":"ContainerStarted","Data":"5b6042cd91608786a4572f76fead83f85fa3dcec64af978040d4fe707328a976"}
Sep 09 07:23:33.167367 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:23:33.167203    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kvzq9" event={"ID":"b57f22a1-2317-4f63-9362-53a5be5f9f80","Type":"ContainerStarted","Data":"2ae112ac147b87ccbaa148c25ef9a56d1bdf029e1c18a6d67aca0bf8e6d7ce5a"}
Sep 09 07:23:33.167367 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:23:33.167273    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kvzq9"
Sep 09 07:23:33.189235 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:23:33.189182    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kvzq9" podStartSLOduration=1.189166666 podStartE2EDuration="1.189166666s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 07:23:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 07:23:33.188873194 +0000 UTC m=+1947.980682533" watchObservedRunningTime="2026-09-09 07:23:33.189166666 +0000 UTC m=+1947.980976005"
Sep 09 07:23:44.173874 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:23:44.173846    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kvzq9"
Sep 09 07:24:13.231264 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:13.231187    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh"]
Sep 09 07:24:13.234182 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:13.234163    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh"
Sep 09 07:24:13.236651 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:13.236630    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-ebbdbe84-kserve-self-signed-certs\""
Sep 09 07:24:13.245546 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:13.245526    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh"]
Sep 09 07:24:13.352877 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:13.352848    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28fa62de-3531-485a-ae63-d08e23507c91-tmp-dir\") pod \"e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh\" (UID: \"28fa62de-3531-485a-ae63-d08e23507c91\") " pod="llm/e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh"
Sep 09 07:24:13.353029 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:13.352904    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28fa62de-3531-485a-ae63-d08e23507c91-tls-certs\") pod \"e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh\" (UID: \"28fa62de-3531-485a-ae63-d08e23507c91\") " pod="llm/e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh"
Sep 09 07:24:13.353029 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:13.352930    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28fa62de-3531-485a-ae63-d08e23507c91-dshm\") pod \"e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh\" (UID: \"28fa62de-3531-485a-ae63-d08e23507c91\") " pod="llm/e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh"
Sep 09 07:24:13.353029 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:13.352957    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28fa62de-3531-485a-ae63-d08e23507c91-home\") pod \"e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh\" (UID: \"28fa62de-3531-485a-ae63-d08e23507c91\") " pod="llm/e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh"
Sep 09 07:24:13.353029 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:13.353008    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28fa62de-3531-485a-ae63-d08e23507c91-model-cache\") pod \"e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh\" (UID: \"28fa62de-3531-485a-ae63-d08e23507c91\") " pod="llm/e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh"
Sep 09 07:24:13.353214 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:13.353041    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z4nx\" (UniqueName: \"kubernetes.io/projected/28fa62de-3531-485a-ae63-d08e23507c91-kube-api-access-8z4nx\") pod \"e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh\" (UID: \"28fa62de-3531-485a-ae63-d08e23507c91\") " pod="llm/e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh"
Sep 09 07:24:13.453899 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:13.453869    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28fa62de-3531-485a-ae63-d08e23507c91-model-cache\") pod \"e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh\" (UID: \"28fa62de-3531-485a-ae63-d08e23507c91\") " pod="llm/e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh"
Sep 09 07:24:13.454023 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:13.453903    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z4nx\" (UniqueName: \"kubernetes.io/projected/28fa62de-3531-485a-ae63-d08e23507c91-kube-api-access-8z4nx\") pod \"e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh\" (UID: \"28fa62de-3531-485a-ae63-d08e23507c91\") " pod="llm/e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh"
Sep 09 07:24:13.454023 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:13.453959    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28fa62de-3531-485a-ae63-d08e23507c91-tmp-dir\") pod \"e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh\" (UID: \"28fa62de-3531-485a-ae63-d08e23507c91\") " pod="llm/e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh"
Sep 09 07:24:13.454023 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:13.453988    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28fa62de-3531-485a-ae63-d08e23507c91-tls-certs\") pod \"e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh\" (UID: \"28fa62de-3531-485a-ae63-d08e23507c91\") " pod="llm/e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh"
Sep 09 07:24:13.454023 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:13.454007    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28fa62de-3531-485a-ae63-d08e23507c91-dshm\") pod \"e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh\" (UID: \"28fa62de-3531-485a-ae63-d08e23507c91\") " pod="llm/e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh"
Sep 09 07:24:13.454238 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:13.454039    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28fa62de-3531-485a-ae63-d08e23507c91-home\") pod \"e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh\" (UID: \"28fa62de-3531-485a-ae63-d08e23507c91\") " pod="llm/e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh"
Sep 09 07:24:13.454306 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:13.454258    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28fa62de-3531-485a-ae63-d08e23507c91-model-cache\") pod \"e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh\" (UID: \"28fa62de-3531-485a-ae63-d08e23507c91\") " pod="llm/e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh"
Sep 09 07:24:13.454370 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:13.454328    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28fa62de-3531-485a-ae63-d08e23507c91-tmp-dir\") pod \"e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh\" (UID: \"28fa62de-3531-485a-ae63-d08e23507c91\") " pod="llm/e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh"
Sep 09 07:24:13.454370 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:13.454360    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28fa62de-3531-485a-ae63-d08e23507c91-home\") pod \"e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh\" (UID: \"28fa62de-3531-485a-ae63-d08e23507c91\") " pod="llm/e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh"
Sep 09 07:24:13.456448 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:13.456427    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28fa62de-3531-485a-ae63-d08e23507c91-dshm\") pod \"e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh\" (UID: \"28fa62de-3531-485a-ae63-d08e23507c91\") " pod="llm/e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh"
Sep 09 07:24:13.456809 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:13.456789    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28fa62de-3531-485a-ae63-d08e23507c91-tls-certs\") pod \"e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh\" (UID: \"28fa62de-3531-485a-ae63-d08e23507c91\") " pod="llm/e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh"
Sep 09 07:24:13.463471 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:13.463442    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z4nx\" (UniqueName: \"kubernetes.io/projected/28fa62de-3531-485a-ae63-d08e23507c91-kube-api-access-8z4nx\") pod \"e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh\" (UID: \"28fa62de-3531-485a-ae63-d08e23507c91\") " pod="llm/e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh"
Sep 09 07:24:13.543318 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:13.543261    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh"
Sep 09 07:24:13.813969 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:13.813943    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh"]
Sep 09 07:24:13.816706 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:24:13.816676    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod28fa62de_3531_485a_ae63_d08e23507c91.slice/crio-7a2be2c003bf9a82067d9e85b51ce4dcec7e5b2a1139d0c4c5f03d51da9cf7c6 WatchSource:0}: Error finding container 7a2be2c003bf9a82067d9e85b51ce4dcec7e5b2a1139d0c4c5f03d51da9cf7c6: Status 404 returned error can't find the container with id 7a2be2c003bf9a82067d9e85b51ce4dcec7e5b2a1139d0c4c5f03d51da9cf7c6
Sep 09 07:24:14.353116 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:14.353086    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh" event={"ID":"28fa62de-3531-485a-ae63-d08e23507c91","Type":"ContainerStarted","Data":"0083185b42135d605c7c610e296c547ee3f871701d68b570d6d421f7530d5f7d"}
Sep 09 07:24:14.353508 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:14.353128    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh" event={"ID":"28fa62de-3531-485a-ae63-d08e23507c91","Type":"ContainerStarted","Data":"7a2be2c003bf9a82067d9e85b51ce4dcec7e5b2a1139d0c4c5f03d51da9cf7c6"}
Sep 09 07:24:14.372120 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:14.372076    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh" podStartSLOduration=1.372060994 podStartE2EDuration="1.372060994s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 07:24:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 07:24:14.369433977 +0000 UTC m=+1989.161243315" watchObservedRunningTime="2026-09-09 07:24:14.372060994 +0000 UTC m=+1989.163870390"
Sep 09 07:24:23.544065 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:23.544023    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh"
Sep 09 07:24:23.544065 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:23.544071    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh"
Sep 09 07:24:23.556654 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:23.556625    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh"
Sep 09 07:24:24.416585 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:24.416557    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh"
Sep 09 07:24:44.305621 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:44.305589    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh"]
Sep 09 07:24:59.325327 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:59.325283    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh" podUID="28fa62de-3531-485a-ae63-d08e23507c91" containerName="main" containerID="cri-o://0083185b42135d605c7c610e296c547ee3f871701d68b570d6d421f7530d5f7d" gracePeriod=45
Sep 09 07:24:59.567992 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:59.567970    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh"
Sep 09 07:24:59.572938 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:59.572908    2575 generic.go:356] "Generic (PLEG): container finished" podID="28fa62de-3531-485a-ae63-d08e23507c91" containerID="0083185b42135d605c7c610e296c547ee3f871701d68b570d6d421f7530d5f7d" exitCode=0
Sep 09 07:24:59.573046 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:59.572943    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh"
Sep 09 07:24:59.573046 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:59.572955    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh" event={"ID":"28fa62de-3531-485a-ae63-d08e23507c91","Type":"ContainerDied","Data":"0083185b42135d605c7c610e296c547ee3f871701d68b570d6d421f7530d5f7d"}
Sep 09 07:24:59.573046 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:59.573001    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh" event={"ID":"28fa62de-3531-485a-ae63-d08e23507c91","Type":"ContainerDied","Data":"7a2be2c003bf9a82067d9e85b51ce4dcec7e5b2a1139d0c4c5f03d51da9cf7c6"}
Sep 09 07:24:59.573046 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:59.573020    2575 scope.go:117] "RemoveContainer" containerID="0083185b42135d605c7c610e296c547ee3f871701d68b570d6d421f7530d5f7d"
Sep 09 07:24:59.581471 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:59.581451    2575 scope.go:117] "RemoveContainer" containerID="0083185b42135d605c7c610e296c547ee3f871701d68b570d6d421f7530d5f7d"
Sep 09 07:24:59.581731 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:24:59.581711    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0083185b42135d605c7c610e296c547ee3f871701d68b570d6d421f7530d5f7d\": container with ID starting with 0083185b42135d605c7c610e296c547ee3f871701d68b570d6d421f7530d5f7d not found: ID does not exist" containerID="0083185b42135d605c7c610e296c547ee3f871701d68b570d6d421f7530d5f7d"
Sep 09 07:24:59.581793 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:59.581763    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0083185b42135d605c7c610e296c547ee3f871701d68b570d6d421f7530d5f7d"} err="failed to get container status \"0083185b42135d605c7c610e296c547ee3f871701d68b570d6d421f7530d5f7d\": rpc error: code = NotFound desc = could not find container \"0083185b42135d605c7c610e296c547ee3f871701d68b570d6d421f7530d5f7d\": container with ID starting with 0083185b42135d605c7c610e296c547ee3f871701d68b570d6d421f7530d5f7d not found: ID does not exist"
Sep 09 07:24:59.756564 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:59.756531    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28fa62de-3531-485a-ae63-d08e23507c91-tls-certs\") pod \"28fa62de-3531-485a-ae63-d08e23507c91\" (UID: \"28fa62de-3531-485a-ae63-d08e23507c91\") "
Sep 09 07:24:59.756776 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:59.756574    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28fa62de-3531-485a-ae63-d08e23507c91-tmp-dir\") pod \"28fa62de-3531-485a-ae63-d08e23507c91\" (UID: \"28fa62de-3531-485a-ae63-d08e23507c91\") "
Sep 09 07:24:59.756776 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:59.756668    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8z4nx\" (UniqueName: \"kubernetes.io/projected/28fa62de-3531-485a-ae63-d08e23507c91-kube-api-access-8z4nx\") pod \"28fa62de-3531-485a-ae63-d08e23507c91\" (UID: \"28fa62de-3531-485a-ae63-d08e23507c91\") "
Sep 09 07:24:59.756776 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:59.756698    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28fa62de-3531-485a-ae63-d08e23507c91-model-cache\") pod \"28fa62de-3531-485a-ae63-d08e23507c91\" (UID: \"28fa62de-3531-485a-ae63-d08e23507c91\") "
Sep 09 07:24:59.756776 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:59.756729    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28fa62de-3531-485a-ae63-d08e23507c91-dshm\") pod \"28fa62de-3531-485a-ae63-d08e23507c91\" (UID: \"28fa62de-3531-485a-ae63-d08e23507c91\") "
Sep 09 07:24:59.756994 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:59.756782    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28fa62de-3531-485a-ae63-d08e23507c91-home\") pod \"28fa62de-3531-485a-ae63-d08e23507c91\" (UID: \"28fa62de-3531-485a-ae63-d08e23507c91\") "
Sep 09 07:24:59.756994 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:59.756878    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28fa62de-3531-485a-ae63-d08e23507c91-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "28fa62de-3531-485a-ae63-d08e23507c91" (UID: "28fa62de-3531-485a-ae63-d08e23507c91"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 07:24:59.757105 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:59.757016    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28fa62de-3531-485a-ae63-d08e23507c91-model-cache" (OuterVolumeSpecName: "model-cache") pod "28fa62de-3531-485a-ae63-d08e23507c91" (UID: "28fa62de-3531-485a-ae63-d08e23507c91"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 07:24:59.757105 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:59.757052    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28fa62de-3531-485a-ae63-d08e23507c91-home" (OuterVolumeSpecName: "home") pod "28fa62de-3531-485a-ae63-d08e23507c91" (UID: "28fa62de-3531-485a-ae63-d08e23507c91"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 07:24:59.757207 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:59.757131    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28fa62de-3531-485a-ae63-d08e23507c91-model-cache\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:24:59.757207 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:59.757145    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28fa62de-3531-485a-ae63-d08e23507c91-home\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:24:59.757207 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:59.757153    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28fa62de-3531-485a-ae63-d08e23507c91-tmp-dir\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:24:59.759042 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:59.759020    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28fa62de-3531-485a-ae63-d08e23507c91-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "28fa62de-3531-485a-ae63-d08e23507c91" (UID: "28fa62de-3531-485a-ae63-d08e23507c91"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 07:24:59.759042 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:59.759031    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28fa62de-3531-485a-ae63-d08e23507c91-kube-api-access-8z4nx" (OuterVolumeSpecName: "kube-api-access-8z4nx") pod "28fa62de-3531-485a-ae63-d08e23507c91" (UID: "28fa62de-3531-485a-ae63-d08e23507c91"). InnerVolumeSpecName "kube-api-access-8z4nx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 07:24:59.759205 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:59.759071    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28fa62de-3531-485a-ae63-d08e23507c91-dshm" (OuterVolumeSpecName: "dshm") pod "28fa62de-3531-485a-ae63-d08e23507c91" (UID: "28fa62de-3531-485a-ae63-d08e23507c91"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 07:24:59.858277 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:59.858189    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28fa62de-3531-485a-ae63-d08e23507c91-tls-certs\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:24:59.858465 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:59.858311    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8z4nx\" (UniqueName: \"kubernetes.io/projected/28fa62de-3531-485a-ae63-d08e23507c91-kube-api-access-8z4nx\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:24:59.858465 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:59.858330    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28fa62de-3531-485a-ae63-d08e23507c91-dshm\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:24:59.895237 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:59.895213    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh"]
Sep 09 07:24:59.899421 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:24:59.899397    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-ebbdbe84-kserve-584ff85987-4n9gh"]
Sep 09 07:25:01.712135 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:01.712104    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28fa62de-3531-485a-ae63-d08e23507c91" path="/var/lib/kubelet/pods/28fa62de-3531-485a-ae63-d08e23507c91/volumes"
Sep 09 07:25:02.020646 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:02.020561    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7998845878-sgq7s"]
Sep 09 07:25:02.021058 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:02.021039    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28fa62de-3531-485a-ae63-d08e23507c91" containerName="main"
Sep 09 07:25:02.021130 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:02.021064    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="28fa62de-3531-485a-ae63-d08e23507c91" containerName="main"
Sep 09 07:25:02.021184 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:02.021169    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="28fa62de-3531-485a-ae63-d08e23507c91" containerName="main"
Sep 09 07:25:02.026944 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:02.026925    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7998845878-sgq7s"
Sep 09 07:25:02.030445 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:02.030376    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 09 07:25:02.030445 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:02.030407    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 07:25:02.030664 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:02.030459    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-lbttc\""
Sep 09 07:25:02.030664 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:02.030486    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 09 07:25:02.031158 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:02.031139    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 09 07:25:02.032918 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:02.032898    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7998845878-sgq7s"]
Sep 09 07:25:02.075845 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:02.075817    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a027ad33-a305-4474-9f05-f85b3279ad30-maas-api-tls\") pod \"maas-api-7998845878-sgq7s\" (UID: \"a027ad33-a305-4474-9f05-f85b3279ad30\") " pod="odh-ai-gateway-infra/maas-api-7998845878-sgq7s"
Sep 09 07:25:02.075967 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:02.075878    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a027ad33-a305-4474-9f05-f85b3279ad30-metrics-certs\") pod \"maas-api-7998845878-sgq7s\" (UID: \"a027ad33-a305-4474-9f05-f85b3279ad30\") " pod="odh-ai-gateway-infra/maas-api-7998845878-sgq7s"
Sep 09 07:25:02.075967 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:02.075910    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a027ad33-a305-4474-9f05-f85b3279ad30-openshift-service-ca\") pod \"maas-api-7998845878-sgq7s\" (UID: \"a027ad33-a305-4474-9f05-f85b3279ad30\") " pod="odh-ai-gateway-infra/maas-api-7998845878-sgq7s"
Sep 09 07:25:02.075967 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:02.075937    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7k9s\" (UniqueName: \"kubernetes.io/projected/a027ad33-a305-4474-9f05-f85b3279ad30-kube-api-access-z7k9s\") pod \"maas-api-7998845878-sgq7s\" (UID: \"a027ad33-a305-4474-9f05-f85b3279ad30\") " pod="odh-ai-gateway-infra/maas-api-7998845878-sgq7s"
Sep 09 07:25:02.176476 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:02.176447    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a027ad33-a305-4474-9f05-f85b3279ad30-maas-api-tls\") pod \"maas-api-7998845878-sgq7s\" (UID: \"a027ad33-a305-4474-9f05-f85b3279ad30\") " pod="odh-ai-gateway-infra/maas-api-7998845878-sgq7s"
Sep 09 07:25:02.176625 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:02.176494    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a027ad33-a305-4474-9f05-f85b3279ad30-metrics-certs\") pod \"maas-api-7998845878-sgq7s\" (UID: \"a027ad33-a305-4474-9f05-f85b3279ad30\") " pod="odh-ai-gateway-infra/maas-api-7998845878-sgq7s"
Sep 09 07:25:02.176625 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:02.176531    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a027ad33-a305-4474-9f05-f85b3279ad30-openshift-service-ca\") pod \"maas-api-7998845878-sgq7s\" (UID: \"a027ad33-a305-4474-9f05-f85b3279ad30\") " pod="odh-ai-gateway-infra/maas-api-7998845878-sgq7s"
Sep 09 07:25:02.176625 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:02.176567    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7k9s\" (UniqueName: \"kubernetes.io/projected/a027ad33-a305-4474-9f05-f85b3279ad30-kube-api-access-z7k9s\") pod \"maas-api-7998845878-sgq7s\" (UID: \"a027ad33-a305-4474-9f05-f85b3279ad30\") " pod="odh-ai-gateway-infra/maas-api-7998845878-sgq7s"
Sep 09 07:25:02.177390 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:02.177317    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a027ad33-a305-4474-9f05-f85b3279ad30-openshift-service-ca\") pod \"maas-api-7998845878-sgq7s\" (UID: \"a027ad33-a305-4474-9f05-f85b3279ad30\") " pod="odh-ai-gateway-infra/maas-api-7998845878-sgq7s"
Sep 09 07:25:02.179161 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:02.179133    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a027ad33-a305-4474-9f05-f85b3279ad30-maas-api-tls\") pod \"maas-api-7998845878-sgq7s\" (UID: \"a027ad33-a305-4474-9f05-f85b3279ad30\") " pod="odh-ai-gateway-infra/maas-api-7998845878-sgq7s"
Sep 09 07:25:02.179241 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:02.179175    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a027ad33-a305-4474-9f05-f85b3279ad30-metrics-certs\") pod \"maas-api-7998845878-sgq7s\" (UID: \"a027ad33-a305-4474-9f05-f85b3279ad30\") " pod="odh-ai-gateway-infra/maas-api-7998845878-sgq7s"
Sep 09 07:25:02.183975 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:02.183952    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7k9s\" (UniqueName: \"kubernetes.io/projected/a027ad33-a305-4474-9f05-f85b3279ad30-kube-api-access-z7k9s\") pod \"maas-api-7998845878-sgq7s\" (UID: \"a027ad33-a305-4474-9f05-f85b3279ad30\") " pod="odh-ai-gateway-infra/maas-api-7998845878-sgq7s"
Sep 09 07:25:02.339324 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:02.339224    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7998845878-sgq7s"
Sep 09 07:25:02.611064 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:02.611035    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7998845878-sgq7s"]
Sep 09 07:25:02.612058 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:25:02.612034    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda027ad33_a305_4474_9f05_f85b3279ad30.slice/crio-546944614d8a7a207421d1649ecad0066dbf2687541ff398600849c50cbfc99c WatchSource:0}: Error finding container 546944614d8a7a207421d1649ecad0066dbf2687541ff398600849c50cbfc99c: Status 404 returned error can't find the container with id 546944614d8a7a207421d1649ecad0066dbf2687541ff398600849c50cbfc99c
Sep 09 07:25:02.613272 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:02.613248    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 07:25:03.592877 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:03.592842    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7998845878-sgq7s" event={"ID":"a027ad33-a305-4474-9f05-f85b3279ad30","Type":"ContainerStarted","Data":"a1b352fa02b6130142e266d7b8d0a70f45bd669617e1c7c0b3d050d394e59e7d"}
Sep 09 07:25:03.593269 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:03.592926    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7998845878-sgq7s" event={"ID":"a027ad33-a305-4474-9f05-f85b3279ad30","Type":"ContainerStarted","Data":"546944614d8a7a207421d1649ecad0066dbf2687541ff398600849c50cbfc99c"}
Sep 09 07:25:03.593269 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:03.593054    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7998845878-sgq7s"
Sep 09 07:25:03.609131 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:03.609064    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7998845878-sgq7s" podStartSLOduration=1.166643721 podStartE2EDuration="1.60904565s" totalImagesPullingTime="442.401929ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 07:25:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 07:25:03.608771822 +0000 UTC m=+2038.400581152" watchObservedRunningTime="2026-09-09 07:25:03.60904565 +0000 UTC m=+2038.400854992"
Sep 09 07:25:06.058609 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:06.058581    2575 scope.go:117] "RemoveContainer" containerID="b8a17d76499e515c062125a4fe7ed4a9dd1a90baafcfb5a685518d2ffc7df4ff"
Sep 09 07:25:09.603050 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:09.603023    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7998845878-sgq7s"
Sep 09 07:25:09.778280 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:09.778246    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-ff785c76b-w6slx"]
Sep 09 07:25:09.781458 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:09.781439    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-ff785c76b-w6slx"
Sep 09 07:25:09.790593 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:09.790563    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-ff785c76b-w6slx"]
Sep 09 07:25:09.840316 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:09.840279    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f0ea011-52be-405f-bac0-2ab8def668bc-openshift-service-ca\") pod \"maas-api-ff785c76b-w6slx\" (UID: \"1f0ea011-52be-405f-bac0-2ab8def668bc\") " pod="odh-ai-gateway-infra/maas-api-ff785c76b-w6slx"
Sep 09 07:25:09.840316 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:09.840320    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f0ea011-52be-405f-bac0-2ab8def668bc-metrics-certs\") pod \"maas-api-ff785c76b-w6slx\" (UID: \"1f0ea011-52be-405f-bac0-2ab8def668bc\") " pod="odh-ai-gateway-infra/maas-api-ff785c76b-w6slx"
Sep 09 07:25:09.840540 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:09.840338    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgf2b\" (UniqueName: \"kubernetes.io/projected/1f0ea011-52be-405f-bac0-2ab8def668bc-kube-api-access-xgf2b\") pod \"maas-api-ff785c76b-w6slx\" (UID: \"1f0ea011-52be-405f-bac0-2ab8def668bc\") " pod="odh-ai-gateway-infra/maas-api-ff785c76b-w6slx"
Sep 09 07:25:09.840540 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:09.840452    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f0ea011-52be-405f-bac0-2ab8def668bc-maas-api-tls\") pod \"maas-api-ff785c76b-w6slx\" (UID: \"1f0ea011-52be-405f-bac0-2ab8def668bc\") " pod="odh-ai-gateway-infra/maas-api-ff785c76b-w6slx"
Sep 09 07:25:09.941874 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:09.941842    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f0ea011-52be-405f-bac0-2ab8def668bc-maas-api-tls\") pod \"maas-api-ff785c76b-w6slx\" (UID: \"1f0ea011-52be-405f-bac0-2ab8def668bc\") " pod="odh-ai-gateway-infra/maas-api-ff785c76b-w6slx"
Sep 09 07:25:09.942079 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:09.941909    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f0ea011-52be-405f-bac0-2ab8def668bc-openshift-service-ca\") pod \"maas-api-ff785c76b-w6slx\" (UID: \"1f0ea011-52be-405f-bac0-2ab8def668bc\") " pod="odh-ai-gateway-infra/maas-api-ff785c76b-w6slx"
Sep 09 07:25:09.942079 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:09.941945    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f0ea011-52be-405f-bac0-2ab8def668bc-metrics-certs\") pod \"maas-api-ff785c76b-w6slx\" (UID: \"1f0ea011-52be-405f-bac0-2ab8def668bc\") " pod="odh-ai-gateway-infra/maas-api-ff785c76b-w6slx"
Sep 09 07:25:09.942079 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:09.941966    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgf2b\" (UniqueName: \"kubernetes.io/projected/1f0ea011-52be-405f-bac0-2ab8def668bc-kube-api-access-xgf2b\") pod \"maas-api-ff785c76b-w6slx\" (UID: \"1f0ea011-52be-405f-bac0-2ab8def668bc\") " pod="odh-ai-gateway-infra/maas-api-ff785c76b-w6slx"
Sep 09 07:25:09.942601 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:09.942531    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f0ea011-52be-405f-bac0-2ab8def668bc-openshift-service-ca\") pod \"maas-api-ff785c76b-w6slx\" (UID: \"1f0ea011-52be-405f-bac0-2ab8def668bc\") " pod="odh-ai-gateway-infra/maas-api-ff785c76b-w6slx"
Sep 09 07:25:09.944368 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:09.944348    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f0ea011-52be-405f-bac0-2ab8def668bc-maas-api-tls\") pod \"maas-api-ff785c76b-w6slx\" (UID: \"1f0ea011-52be-405f-bac0-2ab8def668bc\") " pod="odh-ai-gateway-infra/maas-api-ff785c76b-w6slx"
Sep 09 07:25:09.944480 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:09.944461    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f0ea011-52be-405f-bac0-2ab8def668bc-metrics-certs\") pod \"maas-api-ff785c76b-w6slx\" (UID: \"1f0ea011-52be-405f-bac0-2ab8def668bc\") " pod="odh-ai-gateway-infra/maas-api-ff785c76b-w6slx"
Sep 09 07:25:09.950320 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:09.950297    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgf2b\" (UniqueName: \"kubernetes.io/projected/1f0ea011-52be-405f-bac0-2ab8def668bc-kube-api-access-xgf2b\") pod \"maas-api-ff785c76b-w6slx\" (UID: \"1f0ea011-52be-405f-bac0-2ab8def668bc\") " pod="odh-ai-gateway-infra/maas-api-ff785c76b-w6slx"
Sep 09 07:25:10.092999 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:10.092965    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-ff785c76b-w6slx"
Sep 09 07:25:10.366353 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:10.366324    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-ff785c76b-w6slx"]
Sep 09 07:25:10.367947 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:25:10.367918    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f0ea011_52be_405f_bac0_2ab8def668bc.slice/crio-774acdb1f879b2658cd12e63f0708fc70fe8e768c8832018db4db804b52f8df9 WatchSource:0}: Error finding container 774acdb1f879b2658cd12e63f0708fc70fe8e768c8832018db4db804b52f8df9: Status 404 returned error can't find the container with id 774acdb1f879b2658cd12e63f0708fc70fe8e768c8832018db4db804b52f8df9
Sep 09 07:25:10.631209 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:10.631172    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-ff785c76b-w6slx" event={"ID":"1f0ea011-52be-405f-bac0-2ab8def668bc","Type":"ContainerStarted","Data":"774acdb1f879b2658cd12e63f0708fc70fe8e768c8832018db4db804b52f8df9"}
Sep 09 07:25:11.637080 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:11.637047    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-ff785c76b-w6slx" event={"ID":"1f0ea011-52be-405f-bac0-2ab8def668bc","Type":"ContainerStarted","Data":"813544a3ac7af7eaf7ae330b58c23f150ee7c8a089e8153ef4158fbe8c14292e"}
Sep 09 07:25:11.637453 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:11.637103    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-ff785c76b-w6slx"
Sep 09 07:25:11.654306 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:11.654257    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-ff785c76b-w6slx" podStartSLOduration=2.332505773 podStartE2EDuration="2.654240571s" totalImagesPullingTime="321.734798ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 07:25:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 07:25:11.653008692 +0000 UTC m=+2046.444818056" watchObservedRunningTime="2026-09-09 07:25:11.654240571 +0000 UTC m=+2046.446049909"
Sep 09 07:25:17.647469 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:17.647435    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-ff785c76b-w6slx"
Sep 09 07:25:17.692824 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:17.692793    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7998845878-sgq7s"]
Sep 09 07:25:17.693010 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:17.692977    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-7998845878-sgq7s" podUID="a027ad33-a305-4474-9f05-f85b3279ad30" containerName="maas-api" containerID="cri-o://a1b352fa02b6130142e266d7b8d0a70f45bd669617e1c7c0b3d050d394e59e7d" gracePeriod=30
Sep 09 07:25:18.933092 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:18.933071    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7998845878-sgq7s"
Sep 09 07:25:19.023973 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:19.023907    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a027ad33-a305-4474-9f05-f85b3279ad30-metrics-certs\") pod \"a027ad33-a305-4474-9f05-f85b3279ad30\" (UID: \"a027ad33-a305-4474-9f05-f85b3279ad30\") "
Sep 09 07:25:19.024123 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:19.023977    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7k9s\" (UniqueName: \"kubernetes.io/projected/a027ad33-a305-4474-9f05-f85b3279ad30-kube-api-access-z7k9s\") pod \"a027ad33-a305-4474-9f05-f85b3279ad30\" (UID: \"a027ad33-a305-4474-9f05-f85b3279ad30\") "
Sep 09 07:25:19.024123 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:19.024040    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a027ad33-a305-4474-9f05-f85b3279ad30-maas-api-tls\") pod \"a027ad33-a305-4474-9f05-f85b3279ad30\" (UID: \"a027ad33-a305-4474-9f05-f85b3279ad30\") "
Sep 09 07:25:19.024123 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:19.024081    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a027ad33-a305-4474-9f05-f85b3279ad30-openshift-service-ca\") pod \"a027ad33-a305-4474-9f05-f85b3279ad30\" (UID: \"a027ad33-a305-4474-9f05-f85b3279ad30\") "
Sep 09 07:25:19.024556 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:19.024526    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a027ad33-a305-4474-9f05-f85b3279ad30-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a027ad33-a305-4474-9f05-f85b3279ad30" (UID: "a027ad33-a305-4474-9f05-f85b3279ad30"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 07:25:19.026445 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:19.026420    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a027ad33-a305-4474-9f05-f85b3279ad30-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a027ad33-a305-4474-9f05-f85b3279ad30" (UID: "a027ad33-a305-4474-9f05-f85b3279ad30"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 07:25:19.026734 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:19.026714    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a027ad33-a305-4474-9f05-f85b3279ad30-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a027ad33-a305-4474-9f05-f85b3279ad30" (UID: "a027ad33-a305-4474-9f05-f85b3279ad30"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 07:25:19.026826 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:19.026730    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a027ad33-a305-4474-9f05-f85b3279ad30-kube-api-access-z7k9s" (OuterVolumeSpecName: "kube-api-access-z7k9s") pod "a027ad33-a305-4474-9f05-f85b3279ad30" (UID: "a027ad33-a305-4474-9f05-f85b3279ad30"). InnerVolumeSpecName "kube-api-access-z7k9s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 07:25:19.124653 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:19.124634    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7k9s\" (UniqueName: \"kubernetes.io/projected/a027ad33-a305-4474-9f05-f85b3279ad30-kube-api-access-z7k9s\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:25:19.124653 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:19.124653    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a027ad33-a305-4474-9f05-f85b3279ad30-maas-api-tls\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:25:19.124794 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:19.124662    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a027ad33-a305-4474-9f05-f85b3279ad30-openshift-service-ca\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:25:19.124794 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:19.124670    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a027ad33-a305-4474-9f05-f85b3279ad30-metrics-certs\") on node \"ip-10-0-132-176.ec2.internal\" DevicePath \"\""
Sep 09 07:25:19.674920 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:19.674884    2575 generic.go:356] "Generic (PLEG): container finished" podID="a027ad33-a305-4474-9f05-f85b3279ad30" containerID="a1b352fa02b6130142e266d7b8d0a70f45bd669617e1c7c0b3d050d394e59e7d" exitCode=0
Sep 09 07:25:19.675092 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:19.674925    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7998845878-sgq7s"
Sep 09 07:25:19.675092 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:19.674956    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7998845878-sgq7s" event={"ID":"a027ad33-a305-4474-9f05-f85b3279ad30","Type":"ContainerDied","Data":"a1b352fa02b6130142e266d7b8d0a70f45bd669617e1c7c0b3d050d394e59e7d"}
Sep 09 07:25:19.675092 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:19.675000    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7998845878-sgq7s" event={"ID":"a027ad33-a305-4474-9f05-f85b3279ad30","Type":"ContainerDied","Data":"546944614d8a7a207421d1649ecad0066dbf2687541ff398600849c50cbfc99c"}
Sep 09 07:25:19.675092 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:19.675023    2575 scope.go:117] "RemoveContainer" containerID="a1b352fa02b6130142e266d7b8d0a70f45bd669617e1c7c0b3d050d394e59e7d"
Sep 09 07:25:19.685965 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:19.685934    2575 scope.go:117] "RemoveContainer" containerID="a1b352fa02b6130142e266d7b8d0a70f45bd669617e1c7c0b3d050d394e59e7d"
Sep 09 07:25:19.686511 ip-10-0-132-176 kubenswrapper[2575]: E0909 07:25:19.686488    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1b352fa02b6130142e266d7b8d0a70f45bd669617e1c7c0b3d050d394e59e7d\": container with ID starting with a1b352fa02b6130142e266d7b8d0a70f45bd669617e1c7c0b3d050d394e59e7d not found: ID does not exist" containerID="a1b352fa02b6130142e266d7b8d0a70f45bd669617e1c7c0b3d050d394e59e7d"
Sep 09 07:25:19.686611 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:19.686522    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1b352fa02b6130142e266d7b8d0a70f45bd669617e1c7c0b3d050d394e59e7d"} err="failed to get container status \"a1b352fa02b6130142e266d7b8d0a70f45bd669617e1c7c0b3d050d394e59e7d\": rpc error: code = NotFound desc = could not find container \"a1b352fa02b6130142e266d7b8d0a70f45bd669617e1c7c0b3d050d394e59e7d\": container with ID starting with a1b352fa02b6130142e266d7b8d0a70f45bd669617e1c7c0b3d050d394e59e7d not found: ID does not exist"
Sep 09 07:25:19.696073 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:19.696052    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7998845878-sgq7s"]
Sep 09 07:25:19.700326 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:19.700304    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-7998845878-sgq7s"]
Sep 09 07:25:19.711488 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:19.711467    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a027ad33-a305-4474-9f05-f85b3279ad30" path="/var/lib/kubelet/pods/a027ad33-a305-4474-9f05-f85b3279ad30/volumes"
Sep 09 07:25:32.107055 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:32.106967    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7d897ccb4c-v7km4_bf200635-f995-4cf6-aeec-ddbd9913a601/authorino/0.log"
Sep 09 07:25:38.335575 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:38.335542    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c69cbcb-wgjw9_ea06747b-bccf-4a47-9ef3-b6e646f2594c/copy-manifests/0.log"
Sep 09 07:25:38.342578 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:38.342559    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c69cbcb-wgjw9_ea06747b-bccf-4a47-9ef3-b6e646f2594c/manager/0.log"
Sep 09 07:25:38.915095 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:38.915065    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-ff785c76b-w6slx_1f0ea011-52be-405f-bac0-2ab8def668bc/maas-api/0.log"
Sep 09 07:25:39.956314 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:39.956286    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7d897ccb4c-v7km4_bf200635-f995-4cf6-aeec-ddbd9913a601/authorino/0.log"
Sep 09 07:25:40.419836 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:40.419813    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-kvzq9_b57f22a1-2317-4f63-9362-53a5be5f9f80/manager/0.log"
Sep 09 07:25:41.240788 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:41.240756    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-56d6c696f5-plgx8_340258b9-c06a-45e3-9ce6-216fb2128b8e/kube-auth-proxy/0.log"
Sep 09 07:25:41.716339 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:41.716308    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-nwl5f_8f6df0b4-4f64-41b6-9c1b-bad76413aae3/payload-processing/0.log"
Sep 09 07:25:42.431056 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:42.431026    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-ckzkb_eda93acd-78d2-4a33-8b77-6e032be1f12d/main/0.log"
Sep 09 07:25:42.548913 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:42.548887    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-rpllj_fe771cca-d5bd-46ac-abea-7df58d3eb669/main/0.log"
Sep 09 07:25:52.107441 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:52.107416    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tlg4m_fa0cd37d-c6ff-4f45-9954-b2abc2645a4c/global-pull-secret-syncer/0.log"
Sep 09 07:25:52.227255 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:52.227232    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xv8b9_25fed217-b55a-417b-87be-cae14b802dc3/konnectivity-agent/0.log"
Sep 09 07:25:52.270909 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:52.270886    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-176.ec2.internal_10ede7a8d76e64113edb635ab66c3e5e/haproxy/0.log"
Sep 09 07:25:56.571280 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:56.571253    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7d897ccb4c-v7km4_bf200635-f995-4cf6-aeec-ddbd9913a601/authorino/0.log"
Sep 09 07:25:56.708077 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:56.708055    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-kvzq9_b57f22a1-2317-4f63-9362-53a5be5f9f80/manager/0.log"
Sep 09 07:25:58.493348 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:58.493307    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-mq6bf_e983cf46-9062-43cc-a0da-3c6827751b97/cluster-monitoring-operator/0.log"
Sep 09 07:25:58.519124 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:58.519095    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-5sphz_b4379c3c-fcea-44ae-9629-12fbb0c1581d/kube-state-metrics/0.log"
Sep 09 07:25:58.540356 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:58.540322    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-5sphz_b4379c3c-fcea-44ae-9629-12fbb0c1581d/kube-rbac-proxy-main/0.log"
Sep 09 07:25:58.564256 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:58.564239    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-5sphz_b4379c3c-fcea-44ae-9629-12fbb0c1581d/kube-rbac-proxy-self/0.log"
Sep 09 07:25:58.591623 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:58.591594    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7b575d98bf-fhppb_e5966dfb-9cb2-4925-92fb-44bf3a79728c/metrics-server/0.log"
Sep 09 07:25:58.737830 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:58.737800    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mtfrc_d1a74301-792f-4a92-a2e8-aa54ad25cadb/node-exporter/0.log"
Sep 09 07:25:58.759713 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:58.759655    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mtfrc_d1a74301-792f-4a92-a2e8-aa54ad25cadb/kube-rbac-proxy/0.log"
Sep 09 07:25:58.782621 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:58.782602    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mtfrc_d1a74301-792f-4a92-a2e8-aa54ad25cadb/init-textfile/0.log"
Sep 09 07:25:58.890617 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:58.890595    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-82qcv_e666d12c-e536-4e5e-85b9-74b773cfed35/kube-rbac-proxy-main/0.log"
Sep 09 07:25:58.911998 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:58.911980    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-82qcv_e666d12c-e536-4e5e-85b9-74b773cfed35/kube-rbac-proxy-self/0.log"
Sep 09 07:25:58.935157 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:58.935133    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-82qcv_e666d12c-e536-4e5e-85b9-74b773cfed35/openshift-state-metrics/0.log"
Sep 09 07:25:58.973641 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:58.973619    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_059680a7-5b9b-41c3-b46a-3194020b2dab/prometheus/0.log"
Sep 09 07:25:58.996030 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:58.996011    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_059680a7-5b9b-41c3-b46a-3194020b2dab/config-reloader/0.log"
Sep 09 07:25:59.017341 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:59.017284    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_059680a7-5b9b-41c3-b46a-3194020b2dab/thanos-sidecar/0.log"
Sep 09 07:25:59.039482 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:59.039464    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_059680a7-5b9b-41c3-b46a-3194020b2dab/kube-rbac-proxy-web/0.log"
Sep 09 07:25:59.063702 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:59.063679    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_059680a7-5b9b-41c3-b46a-3194020b2dab/kube-rbac-proxy/0.log"
Sep 09 07:25:59.088473 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:59.088453    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_059680a7-5b9b-41c3-b46a-3194020b2dab/kube-rbac-proxy-thanos/0.log"
Sep 09 07:25:59.114151 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:59.114133    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_059680a7-5b9b-41c3-b46a-3194020b2dab/init-config-reloader/0.log"
Sep 09 07:25:59.155989 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:59.155970    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-8bsmg_344a71e8-d7ae-4278-8cf4-8a72a4d7adac/prometheus-operator/0.log"
Sep 09 07:25:59.176386 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:59.176370    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-8bsmg_344a71e8-d7ae-4278-8cf4-8a72a4d7adac/kube-rbac-proxy/0.log"
Sep 09 07:25:59.204093 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:25:59.204075    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-rhdzw_01d5c542-d3b9-4dfb-b368-81af9955d94d/prometheus-operator-admission-webhook/0.log"
Sep 09 07:26:00.968373 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:00.968346    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-gk2bj_fba513b1-0c6e-49c0-b171-29ef7cb39608/networking-console-plugin/0.log"
Sep 09 07:26:02.638650 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:02.638617    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pv7q6/perf-node-gather-daemonset-ht9rm"]
Sep 09 07:26:02.639032 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:02.638966    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a027ad33-a305-4474-9f05-f85b3279ad30" containerName="maas-api"
Sep 09 07:26:02.639032 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:02.638978    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a027ad33-a305-4474-9f05-f85b3279ad30" containerName="maas-api"
Sep 09 07:26:02.639109 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:02.639040    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a027ad33-a305-4474-9f05-f85b3279ad30" containerName="maas-api"
Sep 09 07:26:02.642018 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:02.642003    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pv7q6/perf-node-gather-daemonset-ht9rm"
Sep 09 07:26:02.644842 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:02.644819    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pv7q6\"/\"openshift-service-ca.crt\""
Sep 09 07:26:02.644985 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:02.644856    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pv7q6\"/\"default-dockercfg-zmvt5\""
Sep 09 07:26:02.645547 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:02.645525    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pv7q6\"/\"kube-root-ca.crt\""
Sep 09 07:26:02.653180 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:02.653157    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pv7q6/perf-node-gather-daemonset-ht9rm"]
Sep 09 07:26:02.692188 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:02.692164    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b71c3ebf-a8d8-42d1-9821-05c7c0b6dceb-proc\") pod \"perf-node-gather-daemonset-ht9rm\" (UID: \"b71c3ebf-a8d8-42d1-9821-05c7c0b6dceb\") " pod="openshift-must-gather-pv7q6/perf-node-gather-daemonset-ht9rm"
Sep 09 07:26:02.692288 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:02.692194    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgt64\" (UniqueName: \"kubernetes.io/projected/b71c3ebf-a8d8-42d1-9821-05c7c0b6dceb-kube-api-access-dgt64\") pod \"perf-node-gather-daemonset-ht9rm\" (UID: \"b71c3ebf-a8d8-42d1-9821-05c7c0b6dceb\") " pod="openshift-must-gather-pv7q6/perf-node-gather-daemonset-ht9rm"
Sep 09 07:26:02.692288 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:02.692216    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b71c3ebf-a8d8-42d1-9821-05c7c0b6dceb-podres\") pod \"perf-node-gather-daemonset-ht9rm\" (UID: \"b71c3ebf-a8d8-42d1-9821-05c7c0b6dceb\") " pod="openshift-must-gather-pv7q6/perf-node-gather-daemonset-ht9rm"
Sep 09 07:26:02.692288 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:02.692279    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b71c3ebf-a8d8-42d1-9821-05c7c0b6dceb-lib-modules\") pod \"perf-node-gather-daemonset-ht9rm\" (UID: \"b71c3ebf-a8d8-42d1-9821-05c7c0b6dceb\") " pod="openshift-must-gather-pv7q6/perf-node-gather-daemonset-ht9rm"
Sep 09 07:26:02.692436 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:02.692314    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b71c3ebf-a8d8-42d1-9821-05c7c0b6dceb-sys\") pod \"perf-node-gather-daemonset-ht9rm\" (UID: \"b71c3ebf-a8d8-42d1-9821-05c7c0b6dceb\") " pod="openshift-must-gather-pv7q6/perf-node-gather-daemonset-ht9rm"
Sep 09 07:26:02.792933 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:02.792908    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b71c3ebf-a8d8-42d1-9821-05c7c0b6dceb-podres\") pod \"perf-node-gather-daemonset-ht9rm\" (UID: \"b71c3ebf-a8d8-42d1-9821-05c7c0b6dceb\") " pod="openshift-must-gather-pv7q6/perf-node-gather-daemonset-ht9rm"
Sep 09 07:26:02.793095 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:02.792966    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b71c3ebf-a8d8-42d1-9821-05c7c0b6dceb-lib-modules\") pod \"perf-node-gather-daemonset-ht9rm\" (UID: \"b71c3ebf-a8d8-42d1-9821-05c7c0b6dceb\") " pod="openshift-must-gather-pv7q6/perf-node-gather-daemonset-ht9rm"
Sep 09 07:26:02.793095 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:02.793075    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b71c3ebf-a8d8-42d1-9821-05c7c0b6dceb-lib-modules\") pod \"perf-node-gather-daemonset-ht9rm\" (UID: \"b71c3ebf-a8d8-42d1-9821-05c7c0b6dceb\") " pod="openshift-must-gather-pv7q6/perf-node-gather-daemonset-ht9rm"
Sep 09 07:26:02.793227 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:02.793089    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b71c3ebf-a8d8-42d1-9821-05c7c0b6dceb-podres\") pod \"perf-node-gather-daemonset-ht9rm\" (UID: \"b71c3ebf-a8d8-42d1-9821-05c7c0b6dceb\") " pod="openshift-must-gather-pv7q6/perf-node-gather-daemonset-ht9rm"
Sep 09 07:26:02.793227 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:02.793107    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b71c3ebf-a8d8-42d1-9821-05c7c0b6dceb-sys\") pod \"perf-node-gather-daemonset-ht9rm\" (UID: \"b71c3ebf-a8d8-42d1-9821-05c7c0b6dceb\") " pod="openshift-must-gather-pv7q6/perf-node-gather-daemonset-ht9rm"
Sep 09 07:26:02.793227 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:02.793134    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b71c3ebf-a8d8-42d1-9821-05c7c0b6dceb-sys\") pod \"perf-node-gather-daemonset-ht9rm\" (UID: \"b71c3ebf-a8d8-42d1-9821-05c7c0b6dceb\") " pod="openshift-must-gather-pv7q6/perf-node-gather-daemonset-ht9rm"
Sep 09 07:26:02.793227 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:02.793152    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b71c3ebf-a8d8-42d1-9821-05c7c0b6dceb-proc\") pod \"perf-node-gather-daemonset-ht9rm\" (UID: \"b71c3ebf-a8d8-42d1-9821-05c7c0b6dceb\") " pod="openshift-must-gather-pv7q6/perf-node-gather-daemonset-ht9rm"
Sep 09 07:26:02.793227 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:02.793190    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgt64\" (UniqueName: \"kubernetes.io/projected/b71c3ebf-a8d8-42d1-9821-05c7c0b6dceb-kube-api-access-dgt64\") pod \"perf-node-gather-daemonset-ht9rm\" (UID: \"b71c3ebf-a8d8-42d1-9821-05c7c0b6dceb\") " pod="openshift-must-gather-pv7q6/perf-node-gather-daemonset-ht9rm"
Sep 09 07:26:02.793465 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:02.793232    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b71c3ebf-a8d8-42d1-9821-05c7c0b6dceb-proc\") pod \"perf-node-gather-daemonset-ht9rm\" (UID: \"b71c3ebf-a8d8-42d1-9821-05c7c0b6dceb\") " pod="openshift-must-gather-pv7q6/perf-node-gather-daemonset-ht9rm"
Sep 09 07:26:02.801615 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:02.801595    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgt64\" (UniqueName: \"kubernetes.io/projected/b71c3ebf-a8d8-42d1-9821-05c7c0b6dceb-kube-api-access-dgt64\") pod \"perf-node-gather-daemonset-ht9rm\" (UID: \"b71c3ebf-a8d8-42d1-9821-05c7c0b6dceb\") " pod="openshift-must-gather-pv7q6/perf-node-gather-daemonset-ht9rm"
Sep 09 07:26:02.951632 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:02.951558    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pv7q6/perf-node-gather-daemonset-ht9rm"
Sep 09 07:26:03.224901 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:03.224878    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pv7q6/perf-node-gather-daemonset-ht9rm"]
Sep 09 07:26:03.227360 ip-10-0-132-176 kubenswrapper[2575]: W0909 07:26:03.227335    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb71c3ebf_a8d8_42d1_9821_05c7c0b6dceb.slice/crio-4d16d4e54ca67f0317c6819e1aa1163e8a5ead38718b9ed1e8120b49f229d48b WatchSource:0}: Error finding container 4d16d4e54ca67f0317c6819e1aa1163e8a5ead38718b9ed1e8120b49f229d48b: Status 404 returned error can't find the container with id 4d16d4e54ca67f0317c6819e1aa1163e8a5ead38718b9ed1e8120b49f229d48b
Sep 09 07:26:03.875938 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:03.875911    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pv7q6/perf-node-gather-daemonset-ht9rm" event={"ID":"b71c3ebf-a8d8-42d1-9821-05c7c0b6dceb","Type":"ContainerStarted","Data":"e2114ea3b2944a3f0d1250e20f4eae1aa2d5ec3aa382636ef54b6a81907d39fa"}
Sep 09 07:26:03.876314 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:03.875955    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pv7q6/perf-node-gather-daemonset-ht9rm" event={"ID":"b71c3ebf-a8d8-42d1-9821-05c7c0b6dceb","Type":"ContainerStarted","Data":"4d16d4e54ca67f0317c6819e1aa1163e8a5ead38718b9ed1e8120b49f229d48b"}
Sep 09 07:26:03.876314 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:03.876016    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pv7q6/perf-node-gather-daemonset-ht9rm"
Sep 09 07:26:03.893103 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:03.893058    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pv7q6/perf-node-gather-daemonset-ht9rm" podStartSLOduration=1.89304425 podStartE2EDuration="1.89304425s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 07:26:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 07:26:03.891650442 +0000 UTC m=+2098.683459786" watchObservedRunningTime="2026-09-09 07:26:03.89304425 +0000 UTC m=+2098.684853588"
Sep 09 07:26:04.177151 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:04.177074    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hq6f8_18e9c162-f015-4a2f-bc71-d4403466dcf6/dns/0.log"
Sep 09 07:26:04.197648 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:04.197626    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hq6f8_18e9c162-f015-4a2f-bc71-d4403466dcf6/kube-rbac-proxy/0.log"
Sep 09 07:26:04.245126 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:04.245108    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cr4hg_48a06719-7aab-46cf-a45e-76754185735a/dns-node-resolver/0.log"
Sep 09 07:26:04.840503 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:04.840481    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rljvj_761f8c97-f2c7-4769-9c0b-924a4877cd38/node-ca/0.log"
Sep 09 07:26:06.250895 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:06.250868    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-56d6c696f5-plgx8_340258b9-c06a-45e3-9ce6-216fb2128b8e/kube-auth-proxy/0.log"
Sep 09 07:26:06.393760 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:06.393725    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-nwl5f_8f6df0b4-4f64-41b6-9c1b-bad76413aae3/payload-processing/0.log"
Sep 09 07:26:07.297566 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:07.297535    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wbd57_450d68be-a858-4505-abdf-9a43aca25ad9/serve-healthcheck-canary/0.log"
Sep 09 07:26:07.828820 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:07.828790    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6t86r_c097e9a1-524c-4ac3-bc56-c3947efed719/kube-rbac-proxy/0.log"
Sep 09 07:26:07.853891 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:07.853868    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6t86r_c097e9a1-524c-4ac3-bc56-c3947efed719/exporter/0.log"
Sep 09 07:26:07.878727 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:07.878708    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6t86r_c097e9a1-524c-4ac3-bc56-c3947efed719/extractor/0.log"
Sep 09 07:26:09.891388 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:09.891364    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pv7q6/perf-node-gather-daemonset-ht9rm"
Sep 09 07:26:10.636456 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:10.636430    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c69cbcb-wgjw9_ea06747b-bccf-4a47-9ef3-b6e646f2594c/manager/0.log"
Sep 09 07:26:10.657649 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:10.657627    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c69cbcb-wgjw9_ea06747b-bccf-4a47-9ef3-b6e646f2594c/copy-manifests/0.log"
Sep 09 07:26:12.145572 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:12.145544    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-789c5bdf9c-dtdcs_e095b85b-84bc-4e88-90f8-31eae9c1a5f6/manager/0.log"
Sep 09 07:26:12.216287 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:12.216253    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-cmcrb_aefc7797-44b9-4ef5-b45d-0be18623f2b3/openshift-lws-operator/0.log"
Sep 09 07:26:13.164464 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:13.164437    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-56d6c696f5-plgx8_340258b9-c06a-45e3-9ce6-216fb2128b8e/kube-auth-proxy/0.log"
Sep 09 07:26:13.266361 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:13.266337    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-nwl5f_8f6df0b4-4f64-41b6-9c1b-bad76413aae3/payload-processing/0.log"
Sep 09 07:26:15.319662 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:15.319632    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-56d6c696f5-plgx8_340258b9-c06a-45e3-9ce6-216fb2128b8e/kube-auth-proxy/0.log"
Sep 09 07:26:15.440448 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:15.440422    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-nwl5f_8f6df0b4-4f64-41b6-9c1b-bad76413aae3/payload-processing/0.log"
Sep 09 07:26:18.779242 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:18.779219    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2p2z8_00e0c40f-e508-4900-9f82-94f5ef3c04a8/kube-multus-additional-cni-plugins/0.log"
Sep 09 07:26:18.799821 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:18.799797    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2p2z8_00e0c40f-e508-4900-9f82-94f5ef3c04a8/egress-router-binary-copy/0.log"
Sep 09 07:26:18.819860 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:18.819841    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2p2z8_00e0c40f-e508-4900-9f82-94f5ef3c04a8/cni-plugins/0.log"
Sep 09 07:26:18.840423 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:18.840406    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2p2z8_00e0c40f-e508-4900-9f82-94f5ef3c04a8/bond-cni-plugin/0.log"
Sep 09 07:26:18.861688 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:18.861671    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2p2z8_00e0c40f-e508-4900-9f82-94f5ef3c04a8/routeoverride-cni/0.log"
Sep 09 07:26:18.884176 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:18.884159    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2p2z8_00e0c40f-e508-4900-9f82-94f5ef3c04a8/whereabouts-cni-bincopy/0.log"
Sep 09 07:26:18.904627 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:18.904606    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2p2z8_00e0c40f-e508-4900-9f82-94f5ef3c04a8/whereabouts-cni/0.log"
Sep 09 07:26:19.257084 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:19.257058    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-blbwl_919417d2-9658-4035-87e5-a82416654da8/kube-multus/0.log"
Sep 09 07:26:19.420206 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:19.420176    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-pj9sz_96676d24-b303-4849-bdc0-e5b99b9b8602/network-metrics-daemon/0.log"
Sep 09 07:26:19.442198 ip-10-0-132-176 kubenswrapper[2575]: I0909 07:26:19.442174    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-pj9sz_96676d24-b303-4849-bdc0-e5b99b9b8602/kube-rbac-proxy/0.log"